Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

npmjs.org "web-crawler" keyword

Top 1.4% on npmjs.org
crawlee 3.9.2
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
1,015 versions - Latest release: about 1 month ago - 35 dependent packages - 38 dependent repositories - 69.8 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
Top 1.8% on npmjs.org
@crawlee/puppeteer 3.10.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
1,019 versions - Latest release: 4 days ago - 5 dependent packages - 34 dependent repositories - 72.7 thousand downloads last month - 10,899 stars on GitHub - 10 maintainers
Top 1.6% on npmjs.org
@crawlee/playwright 3.10.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
1,017 versions - Latest release: 4 days ago - 6 dependent packages - 34 dependent repositories - 71 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
Top 1.7% on npmjs.org
@crawlee/http 3.10.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
823 versions - Latest release: 4 days ago - 6 dependent packages - 33 dependent repositories - 76.2 thousand downloads last month - 11,973 stars on GitHub - 10 maintainers
Top 1.8% on npmjs.org
@crawlee/cheerio 3.10.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
1,019 versions - Latest release: 4 days ago - 4 dependent packages - 35 dependent repositories - 74.6 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
Top 1.5% on npmjs.org
@crawlee/browser-pool 3.10.0
Rotate multiple browsers using popular automation libraries such as Playwright or Puppeteer.
1,015 versions - Latest release: 4 days ago - 11 dependent packages - 35 dependent repositories - 77.6 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
Top 1.7% on npmjs.org
@crawlee/browser 3.10.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
1,019 versions - Latest release: 4 days ago - 5 dependent packages - 35 dependent repositories - 75.6 thousand downloads last month - 11,973 stars on GitHub - 10 maintainers
@crawlee/linkedom 3.10.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
520 versions - Latest release: 4 days ago - 1 dependent package - 8 dependent repositories - 63.8 thousand downloads last month - 10,928 stars on GitHub - 2 maintainers
Top 1.7% on npmjs.org
@crawlee/basic 3.10.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
1,019 versions - Latest release: 4 days ago - 5 dependent packages - 36 dependent repositories - 83.6 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
Top 1.2% on npmjs.org
@crawlee/utils 3.10.0
A set of shared utilities that can be used by crawlers
1,018 versions - Latest release: 4 days ago - 14 dependent packages - 88 dependent repositories - 106 thousand downloads last month - 10,899 stars on GitHub - 10 maintainers
Top 1.1% on npmjs.org
@crawlee/types 3.10.0
Shared types for the crawlee projects
984 versions - Latest release: 4 days ago - 21 dependent packages - 163 dependent repositories - 180 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
Top 2.5% on npmjs.org
@crawlee/templates 3.10.0
Templates for the crawlee projects
897 versions - Latest release: 4 days ago - 2 dependent packages - 32 dependent repositories - 68.5 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
Top 2.5% on npmjs.org
@crawlee/cli 3.10.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
911 versions - Latest release: 4 days ago - 2 dependent packages - 32 dependent repositories - 68.3 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
Top 1.2% on npmjs.org
@crawlee/core 3.10.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
1,019 versions - Latest release: 4 days ago - 16 dependent packages - 88 dependent repositories - 95.7 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
Top 2.6% on npmjs.org
@crawlee/jsdom 3.10.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
814 versions - Latest release: 4 days ago - 2 dependent packages - 27 dependent repositories - 68.3 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
Top 1.9% on npmjs.org
@crawlee/memory-storage 3.10.0
A simple in-memory storage implementation of the Apify API
984 versions - Latest release: 4 days ago - 3 dependent packages - 88 dependent repositories - 98.7 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
@mendable/firecrawl-js 0.0.21
JavaScript SDK for Firecrawl API
27 versions - Latest release: 7 days ago - 6.92 thousand downloads last month - 3,347 stars on GitHub - 3 maintainers
Top 9.0% on npmjs.org
puppeteer-service 0.4.8
Run headless Chrome (aka Puppeteer) as a service, for web crawling, remote controlling and so on.
23 versions - Latest release: about 6 years ago - 2 dependent packages - 1 dependent repositories - 126 downloads last month - 44 stars on GitHub - 1 maintainer
scan-link
Scan given website recursively and report 404 links
4 versions - 0 stars on GitHub - 1 maintainer
Top 6.9% on npmjs.org
@a11ywatch/crawler 0.9.6
gRPC tokio based web crawler
133 versions - Latest release: about 1 month ago - 3 dependent packages - 1 dependent repositories - 686 downloads last month - 39 stars on GitHub - 1 maintainer
Top 7.4% on npmjs.org
apifier 0.0.53
Legacy Apifier runtime for JavaScript
52 versions - Latest release: almost 7 years ago - 3 dependent packages - 1 dependent repositories - 63 downloads last month - 11,973 stars on GitHub - 10 maintainers
algolia-webcrawler 3.2.3
Simple node worker that crawls sitemaps in order to keep an algolia index up-to-date.
28 versions - Latest release: over 4 years ago - 2 dependent packages - 2 dependent repositories - 141 downloads last month - 46 stars on GitHub - 2 maintainers
@adncorp/apify 2.7.6
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
25 versions - Latest release: over 3 years ago - 3 dependent packages - 31 downloads last month - 11,973 stars on GitHub - 1 maintainer
Top 8.5% on npmjs.org
google-news-scraper 1.2.3 💰
Lightweight async scraper for Google News
20 versions - Latest release: 7 days ago - 1 dependent package - 7 dependent repositories - 445 downloads last month - 181 stars on GitHub - 1 maintainer
Top 6.7% on npmjs.org
@vladfrangu-dev/crawlee-browser-pool 3.3.0
Rotate multiple browsers using popular automation libraries such as Playwright or Puppeteer.
4 versions - Latest release: over 1 year ago - 4 dependent packages - 1 dependent repositories - 2 downloads last month - 11,973 stars on GitHub - 1 maintainer
@cassidyai/crawlee-root 3.7.3
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
1 version - Latest release: 4 months ago - 14 downloads last month - 11,761 stars on GitHub - 2 maintainers
snazzy-crawler 1.2.8
A snazzy light Node.js image crawler laced with TypeScript goodness! 🕵️🦾
10 versions - Latest release: 11 months ago - 21 downloads last month - 1 maintainer
Top 7.0% on npmjs.org
@vladfrangu-dev/crawlee-basic 3.3.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
4 versions - Latest release: over 1 year ago - 4 dependent packages - 1 dependent repositories - 2 downloads last month - 11,973 stars on GitHub - 1 maintainer
Top 6.6% on npmjs.org
@vladfrangu-dev/crawlee-utils 3.3.0
A set of shared utilities that can be used by crawlers
4 versions - Latest release: over 1 year ago - 8 dependent packages - 1 dependent repositories - 2 downloads last month - 11,973 stars on GitHub - 1 maintainer
@crawlee/dom 3.0.3-beta.21
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
7 versions - Latest release: almost 2 years ago - 2 dependent packages - 11 downloads last month - 11,973 stars on GitHub - 2 maintainers
@vladfrangu-dev/crawlee 3.3.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
4 versions - Latest release: over 1 year ago - 1 dependent package - 1 dependent repositories - 2 downloads last month - 11,973 stars on GitHub - 1 maintainer
Top 7.8% on npmjs.org
@vladfrangu-dev/crawlee-memory-storage 3.3.0
A simple in-memory storage implementation of the Apify API
4 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 2 downloads last month - 11,973 stars on GitHub - 1 maintainer
Top 6.7% on npmjs.org
@vladfrangu-dev/crawlee-http 3.3.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
4 versions - Latest release: over 1 year ago - 4 dependent packages - 1 dependent repositories - 2 downloads last month - 11,973 stars on GitHub - 1 maintainer
Top 7.7% on npmjs.org
@vladfrangu-dev/crawlee-playwright 3.3.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
4 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 2 downloads last month - 11,973 stars on GitHub - 1 maintainer
Top 7.0% on npmjs.org
@vladfrangu-dev/crawlee-browser 3.3.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
4 versions - Latest release: over 1 year ago - 4 dependent packages - 1 dependent repositories - 2 downloads last month - 11,973 stars on GitHub - 1 maintainer
Top 8.2% on npmjs.org
@vladfrangu-dev/crawlee-cli 3.2.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
3 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 3 downloads last month - 11,973 stars on GitHub - 1 maintainer
Top 7.8% on npmjs.org
@vladfrangu-dev/crawlee-puppeteer 3.3.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
4 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 2 downloads last month - 11,973 stars on GitHub - 1 maintainer
Top 6.4% on npmjs.org
@vladfrangu-dev/crawlee-types 3.3.0
Shared types for the crawlee projects
4 versions - Latest release: over 1 year ago - 12 dependent packages - 1 dependent repositories - 2 downloads last month - 11,973 stars on GitHub - 1 maintainer
Top 8.1% on npmjs.org
@vladfrangu-dev/crawlee-templates 3.2.0
Templates for the crawlee projects
3 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 3 downloads last month - 11,973 stars on GitHub - 1 maintainer
Top 7.6% on npmjs.org
@vladfrangu-dev/crawlee-jsdom 3.3.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
4 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 2 downloads last month - 11,973 stars on GitHub - 1 maintainer
Top 7.2% on npmjs.org
@vladfrangu-dev/crawlee-core 3.3.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
4 versions - Latest release: over 1 year ago - 3 dependent packages - 1 dependent repositories - 2 downloads last month - 11,973 stars on GitHub - 1 maintainer
Top 7.8% on npmjs.org
@vladfrangu-dev/crawlee-cheerio 3.3.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
4 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 2 downloads last month - 11,144 stars on GitHub - 1 maintainer
socials_regex 1.0.3
🪡 Social account detection and extraction in js, e.g. for crawling/scraping.
4 versions - Latest release: 5 months ago - 121 downloads last month - 1 stars on GitHub - 1 maintainer
siteshooter 1.14.0
Automate full website screenshots and PDF generation with multiple viewports
73 versions - Latest release: about 5 years ago - 1 dependent repositories - 80 downloads last month - 67 stars on GitHub - 1 maintainer
node-crawling-framework 0.0.1-alpha.2
NodeJs crawling & scraping framework heavily inspired by Scrapy (Pyhton)
2 versions - Latest release: almost 6 years ago - 1 dependent package - 1 dependent repositories - 8 downloads last month - 4 stars on GitHub - 1 maintainer
Top 3.0% on npmjs.org
js-crawler 0.3.21
Web crawler for Node.js
23 versions - Latest release: almost 6 years ago - 13 dependent packages - 81 dependent repositories - 1.06 thousand downloads last month - 249 stars on GitHub - 1 maintainer
@botmation/reddit 1.0.0
Auxiliary package of functions for the TypeScript framework Botmation focused on Reddit
2 versions - Latest release: about 3 years ago - 1 dependent package - 7 downloads last month - 18 stars on GitHub - 1 maintainer
url-to-docs 0.0.0
A simple web crawler with a cli suitable for downloading online html documentation.
1 version - Latest release: over 1 year ago - 3 downloads last month - 0 stars on GitHub - 1 maintainer
flysh 1.1.5
DOM Document Object Artifact Collector
12 versions - Latest release: 7 months ago - 1 dependent package - 32 downloads last month - 2 stars on GitHub - 1 maintainer
schabbi-webscraper 1.2.1
Lightweight and easy to use crawling solution for websites.
28 versions - Latest release: over 1 year ago - 57 downloads last month - 0 stars on GitHub - 1 maintainer
nodejs-web-scraper-samdak 5.1.0
A web scraper for NodeJs
1 version - Latest release: about 3 years ago - 1 dependent package - 5 downloads last month - 80 stars on GitHub - 1 maintainer
Top 4.2% on npmjs.org
nodejs-web-scraper 6.1.3
A web scraper for NodeJs
81 versions - Latest release: over 1 year ago - 5 dependent packages - 22 dependent repositories - 1.29 thousand downloads last month - 80 stars on GitHub - 1 maintainer
@scrapingant/amazon-proxy-scraper 2.1.2
Amazon products scraper by keyword with using ScrapingAnt API
13 versions - Latest release: almost 2 years ago - 2 dependent packages - 1 dependent repositories - 26 downloads last month - 75 stars on GitHub - 2 maintainers
botmation 3.0.0
A simple TypeScript framework for building composable web bots declaratively with Puppeteer
9 versions - Latest release: over 3 years ago - 1 dependent package - 1 dependent repositories - 11 downloads last month - 18 stars on GitHub - 1 maintainer
@botmation/facebook 1.0.0
Auxiliary package of functions for the TypeScript framework Botmation focused on Facebook
2 versions - Latest release: about 3 years ago - 1 dependent package - 6 downloads last month - 18 stars on GitHub - 1 maintainer
@botmation/core 1.4.0
Main package of functions for the TypeScript framework Botmation
10 versions - Latest release: about 3 years ago - 1 dependent package - 18 downloads last month - 18 stars on GitHub - 1 maintainer
@botmation/twitter 1.0.2
Auxiliary package of functions for the TypeScript framework Botmation
3 versions - Latest release: about 3 years ago - 1 dependent package - 8 downloads last month - 18 stars on GitHub - 1 maintainer
@botmation/instagram 1.1.0
Auxiliary package of functions for the TypeScript framework Botmation
7 versions - Latest release: about 3 years ago - 1 dependent package - 12 downloads last month - 18 stars on GitHub - 1 maintainer
@botmation/linkedin 1.0.2
Auxiliary package of functions for the TypeScript framework Botmation
5 versions - Latest release: about 3 years ago - 1 dependent package - 9 downloads last month - 18 stars on GitHub - 1 maintainer
@mnmkng/apify-debug 0.12.5
The scalable web crawling and scraping library for JavaScript. Enables development of data extrac...
4 versions - Latest release: about 5 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 11,973 stars on GitHub - 1 maintainer
json-web-crawler 0.8.3
Crawl website by json
20 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 37 downloads last month - 17 stars on GitHub - 1 maintainer
@ljw1412/web-crawler 0.0.25
基于Node.js的网络爬虫
20 versions - Latest release: almost 4 years ago - 2 dependent packages - 1 dependent repositories - 21 downloads last month - 4 stars on GitHub - 1 maintainer
kz-crawler 1.2.3
kz webcrawler - install by running npm install kz-crawler
6 versions - Latest release: over 6 years ago - 2 dependent packages - 29 downloads last month - 0 stars on GitHub - 1 maintainer
commodidolores 1.1.1
Web crawler for Node.js
5 versions - Latest release: about 2 months ago - 143 downloads last month - 0 stars on GitHub - 1 maintainer
get-image-urls 1.0.5
Scrape image urls from HTML website including CSS background images.
3 versions - Latest release: over 6 years ago - 1 dependent package - 12 dependent repositories - 32 downloads last month - 16 stars on GitHub - 1 maintainer
image-crawler 1.0.1
Scrape image urls from HTML website including CSS background images.
1 version - Latest release: over 9 years ago - 1 dependent package - 2 dependent repositories - 4 downloads last month - 16 stars on GitHub - 1 maintainer
scrapyteer 1.4.0
Web scraping/crawling framework built on top of headless Chrome
8 versions - Latest release: 12 months ago - 25 downloads last month - 15 stars on GitHub - 1 maintainer
image-url-data 1.0.5
Scrape image urls from HTML website including CSS background images.
1 version - Latest release: over 3 years ago - 1 dependent package - 9 downloads last month - 0 stars on GitHub - 1 maintainer
cool-crawler 0.0.1
A web crawler
1 version - Latest release: 12 months ago - 3 downloads last month - 0 stars on GitHub - 1 maintainer
crawlerr 1.5.0 💰
A simple and fully customizable web crawler/spider for Node.js with server-side DOM. Comes with e...
10 versions - Latest release: over 5 years ago - 1 dependent package - 1 dependent repositories - 18 downloads last month - 25 stars on GitHub - 1 maintainer
web-tree-crawler 3.1.0 💰
A web crawler that builds a tree of URLs
7 versions - Latest release: over 4 years ago - 1 dependent repositories - 21 downloads last month - 0 stars on GitHub - 2 maintainers
readme-crawler 1.0.5 deprecated
Download README files from GitHub repository links
6 versions - Latest release: almost 3 years ago - 1 dependent package - 14 downloads last month - 4 stars on GitHub - 1 maintainer
quaepariatur 1.0.2
Web crawler for Node.js
3 versions - Latest release: about 2 months ago - 43 downloads last month - 0 stars on GitHub - 1 maintainer
@ljw1412/web-crawler-lite 0.1.3
基于Node.js的网络爬虫(轻量版)，该版本不支持动态页面爬取。
4 versions - Latest release: about 2 months ago - 1 dependent package - 76 downloads last month - 4 stars on GitHub - 1 maintainer
capek 0.0.1
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
1 version - Latest release: over 2 years ago - 1 dependent package - 1 dependent repositories - 5 downloads last month - 11,843 stars on GitHub - 1 maintainer
eslite-com-api-long-intro 1.1.8
Unofficial eslite-com API (Plus Long Introduction)
12 versions - Latest release: almost 4 years ago - 1 dependent package - 15 downloads last month - 2 stars on GitHub - 1 maintainer
eslite-com-crawler 1.1.1
eslite-com crawler
2 versions - Latest release: over 3 years ago - 1 dependent package - 7 downloads last month - 2 stars on GitHub - 1 maintainer
phantomjs-sitemap-generator 0.1.6
PhantomJS sitemap generator
2 versions - Latest release: almost 8 years ago - 1 dependent package - 1 dependent repositories - 13 downloads last month - 1 maintainer
Crawler 1.1.3
Search for anything on web.
4 versions - Latest release: almost 8 years ago - 1 dependent package - 2 dependent repositories - 14 downloads last month - 2 stars on GitHub - 1 maintainer
@sanv/apify 1.1.4
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
2 versions - Latest release: about 3 years ago - 1 dependent package - 4 downloads last month - 11,973 stars on GitHub - 1 maintainer
github-crawler-lib 0.1.2
A JavaScript Library for web crawling github.com
14 versions - Latest release: over 6 years ago - 2 dependent packages - 1 dependent repositories - 34 downloads last month - 1 stars on GitHub - 1 maintainer
@waynechang65/ptt-crawler 2.6.0
A web crawler module designed to scarp data from Ptt.
17 versions - Latest release: 4 months ago - 1 dependent package - 3 dependent repositories - 25 downloads last month - 20 stars on GitHub - 1 maintainer
books-com-tw-crawler 1.2.2
books.com.tw crawler
5 versions - Latest release: 5 months ago - 2 dependent packages - 1 dependent repositories - 17 downloads last month - 12 stars on GitHub - 1 maintainer
Top 7.0% on npmjs.org
supercrawler 2.0.0
A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse conten...
45 versions - Latest release: over 4 years ago - 2 dependent packages - 7 dependent repositories - 36 downloads last month - 369 stars on GitHub - 1 maintainer
tvgh-library-collection-crawler 1.1.2
Taipei Veterans General Hospital Medical Library Collection crawler
2 versions - Latest release: over 2 years ago - 3 downloads last month - 0 stars on GitHub - 1 maintainer
gumo 1.0.7
A web-crawler and scraper that extracts data from a family of nested dynamic webpages with added ...
7 versions - Latest release: almost 2 years ago - 1 dependent package - 16 downloads last month - 21 stars on GitHub - 2 maintainers
easycrawler 1.0.1
Simple and Easy Crawler library for Node.js
8 versions - Latest release: over 7 years ago - 2 dependent packages - 1 dependent repositories - 24 downloads last month - 3 stars on GitHub - 1 maintainer
@sapkotamadan/cache-server 2.0.8
CacheServer is an efficient web page extractor that uses Puppeteer to launch a headless browser a...
28 versions - Latest release: 5 months ago - 1 dependent package - 1 dependent repositories - 31 downloads last month - 3 stars on GitHub - 1 maintainer
nbinet-collection-crawler 1.2.1
Unofficial National Bibliographic Information Network collection crawler
2 versions - Latest release: over 2 years ago - 1 dependent package - 7 downloads last month - 2 stars on GitHub - 1 maintainer
@bpw1621/imgscrape 0.0.3
Puppeteer-based image search engine scraper.
4 versions - Latest release: almost 3 years ago - 1 dependent package - 7 downloads last month - 0 stars on GitHub - 1 maintainer
@mnmkng/apify 0.13.14
The scalable web crawling and scraping library for JavaScript. Enables development of data extrac...
7 versions - Latest release: about 5 years ago - 1 dependent package - 1 dependent repositories - 1 downloads last month - 11,973 stars on GitHub - 1 maintainer
spiderboi 1.1.0 💰
A web crawler written in TypeScript.
3 versions - Latest release: about 5 years ago - 1 dependent repositories - 3 downloads last month - 5 stars on GitHub - 1 maintainer
octopus-web-crawler 1.1.0
Another web crawler.
3 versions - Latest release: over 2 years ago - 1 dependent package - 16 downloads last month - 0 stars on GitHub - 1 maintainer
suck 0.0.7
Simple crawler tree of patterns.
4 versions - Latest release: over 10 years ago - 1 dependent repositories - 14 downloads last month - 0 stars on GitHub - 1 maintainer
bettong 0.2.1
Web crawler in JavaScript
5 versions - Latest release: over 4 years ago - 1 dependent package - 3 downloads last month - 0 stars on GitHub - 1 maintainer
redis-web-crawler 1.0.0 deprecated
Web Crawler to create directed graph of links among connected sites. Runs with Node.js and stores...
1 version - Latest release: almost 3 years ago - 5 downloads last month - 1 stars on GitHub - 1 maintainer
url-clean 1.0.2 deprecated
Normalize a URL
3 versions - Latest release: over 6 years ago - 2 dependent packages - 1 dependent repositories - 3.71 thousand downloads last month - 0 stars on GitLab.com - 1 maintainer
@flowereatfish/eslite-com-api 1.0.5 deprecated
Unofficial eslite-com API
4 versions - Latest release: about 4 years ago - 1 dependent package - 1 dependent repositories - 4 downloads last month - 2 stars on GitHub - 1 maintainer
@flowereatfish/books-com-tw-api 1.0.5 deprecated
Unofficial books.com.tw API
5 versions - Latest release: almost 5 years ago - 1 dependent package - 1 dependent repositories - 1 downloads last month - 12 stars on GitHub - 1 maintainer
ptt-crawler.js 2.0.0 deprecated
A web crawler module designed to scarp data from Ptt.
1 version - Latest release: almost 5 years ago - 1 dependent package - 1 dependent repositories - 2 downloads last month - 20 stars on GitHub - 1 maintainer
Related Keywords
crawler 81 scraper 59 nodejs 58 puppeteer 55 scraping 54 typescript 52 crawling 50 automation 49 javascript 49 web-crawling 47 web-scraping 43 headless-chrome 42 headless 41 npm 40 playwright 39 apify 39 chrome 29 spider 15 web 11 api 10 social 8 declarative 7 functional 7 async-functionality 7 bots 7 composable-architecture 7 curry 7 higher-order-functions 7 npm-package 7 bot 7 crawl 7 login 7 browser 7 webcrawler 7 crawling-framework 6 html 5 node 5 url 5 deprecated-repo 5 node-crawler 4 images 4 jquery 4 web-scraper 4 es6-generators 4 jsdom 3 web crawler 3 data 3 search 3 proxy 3 website-crawler 3 js-crawler 3 data-mining 3 sitemap 3 scrape 3 elasticsearch 2 scraping-framework 2 scrapy 2 mining 2 screenshot 2 phantomjs 2 web-bot 2 puppeteer-service 2 dom 2 screenshots 2 javascript-library 2 supercrawler 2 web scraper 2 memory 2 ptt 2 datamining 2 links 2 web-search 2 website 2 js 2 utilities 2 github 2 utils 2 scraping-websites 2 selenium 2 types 2 crawlers 2 cli 2 google 2 node-web-crawler 1 canonical 1 trim 1 strip 1 made-with-love 1 simplify 1 unicode 1 querystring 1 query 1 distributed-crawler 1 robot 1 normalisation 1 normalization 1 neo4j 1 string 1 knowledge mining 1 API 1