An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

npmjs.org : url-scraper

Url scraper which takes the text input and finds the links/urls, scraps them using cheerio and will returns an object with original text, parsed text (using npm-text-parser) and array of objects where each object contains scraped webpage's information.

Registry - Source - Homepage - JSON
purl: pkg:npm/url-scraper
Keywords: url , scraper , urlscrap , webscraper , webcrawler , scrapping , webcrawling , bots , urlscrapping , scanner , urlparser , parse , web , scrap , url-scrapper , web-bot , scrapper , cheerio , text-parser , url-scraper
License: MIT
Latest release: almost 9 years ago
First release: almost 9 years ago
Dependent repositories: 1
Downloads: 13 last month
Stars: 6 on GitHub
Forks: 1 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 29 days ago

    Loading...
    Readme
    Loading...