Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
npmjs.org "crawler" keyword
Top 7.4% on npmjs.org
52 versions - Latest release: almost 7 years ago - 3 dependent packages - 1 dependent repositories - 61 downloads last month - 11,973 stars on GitHub - 10 maintainers
apifier 0.0.53
Legacy Apifier runtime for JavaScript52 versions - Latest release: almost 7 years ago - 3 dependent packages - 1 dependent repositories - 61 downloads last month - 11,973 stars on GitHub - 10 maintainers
@zigtech/scrapper 0.0.7
Headless scrapper developed to run in serverfull and serverless infra.7 versions - Latest release: almost 4 years ago - 1 dependent package - 4 downloads last month - 1 stars on GitHub - 1 maintainer
mangadownload 1.0.9
Crawler to download manga from submanga.com and other sites in the future10 versions - Latest release: over 8 years ago - 2 dependent packages - 1 dependent repositories - 5 downloads last month - 0 stars on GitHub - 1 maintainer
grunt-cookielist 0.1.0
A grunt crawler to list all cookies on urls using phantomjs1 version - Latest release: over 9 years ago - 2 dependent packages - 1 dependent repositories - 4 downloads last month - 0 stars on GitHub - 1 maintainer
scrape-them-all 2.0.0
🚀 An easy-to-handle Node.js scraper that allow you to scrape them all in a record time.4 versions - Latest release: over 3 years ago - 1 dependent repositories - 14 downloads last month - 10 stars on GitHub - 1 maintainer
js-website-crawler 1.0.6 💰
Website crawler written in JavaScript built with Node.js.4 versions - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
spider-stealth-core 1.3.4
A Node.js scraping framework built on puppeteer-extra (to use a headless Chrome/Chromium browser)...13 versions - Latest release: almost 2 years ago - 21 downloads last month - 1 maintainer
jquery-simpleticker 1.0.0
Simple news ticker based on Scott Alguire jQuery grouploop plugins1 version - Latest release: 8 months ago - 5 downloads last month - 0 stars on GitHub - 1 maintainer
simple-headless-chrome-asksuite 4.3.13
Headless Chrome abstraction to simplify the interaction with the browser. It may be used for craw...4 versions - Latest release: about 6 years ago - 1 dependent package - 1 dependent repositories - 21 downloads last month - 0 stars on GitHub - 2 maintainers
netlify-plugin-chatbees 0.5.7
Netlify Build plugin that adds a personalized AI assistant to your website8 versions - Latest release: 4 months ago - 50 downloads last month - 5 stars on GitHub - 1 maintainer
img-crawler 0.0.2
A module to download images from a given URL2 versions - Latest release: over 11 years ago - 1 dependent package - 4 dependent repositories - 5 downloads last month - 10 stars on GitHub - 1 maintainer
noscrape
obfuscate your content3 versions - 48 downloads last month - 0 stars on GitHub - 1 maintainer
noderogue-game 1.0.3
Roguelike dungeon crawler for terminals3 versions - Latest release: about 3 years ago - 1 dependent package - 5 downloads last month - 0 stars on GitHub - 1 maintainer
centipede 0.0.2
small crawler2 versions - Latest release: over 8 years ago - 1 dependent package - 1 dependent repositories - 5 downloads last month - 0 stars on GitHub - 2 maintainers
Top 8.8% on npmjs.org
78 versions - Latest release: about 4 years ago - 2 dependent packages - 1 dependent repositories - 13 downloads last month - 13 stars on GitHub - 1 maintainer
floodesh 0.8.19
Floodesh is a distributed web spider/crawler written with Nodejs.78 versions - Latest release: about 4 years ago - 2 dependent packages - 1 dependent repositories - 13 downloads last month - 13 stars on GitHub - 1 maintainer
@acq/bool 0.2.2
A util tool4 versions - Latest release: about 4 years ago - 3 dependent packages - 8 downloads last month - 0 stars on GitHub - 1 maintainer
@mendable/firecrawl-js 0.0.21
JavaScript SDK for Firecrawl API28 versions - Latest release: 24 days ago - 8.99 thousand downloads last month - 4,092 stars on GitHub - 3 maintainers
Top 2.1% on npmjs.org
16 versions - Latest release: about 5 years ago - 41 dependent packages - 125 dependent repositories - 87.6 thousand downloads last month - 230 stars on GitHub - 1 maintainer
npm-license-crawler 0.2.1
Analyzes license information for multiple node.js modules (package.json files) as part of your so...16 versions - Latest release: about 5 years ago - 41 dependent packages - 125 dependent repositories - 87.6 thousand downloads last month - 230 stars on GitHub - 1 maintainer
phantom-crawl 0.0.3
Web crawler for ajax applications2 versions - Latest release: almost 11 years ago - 1 dependent package - 1 dependent repositories - 10 downloads last month - 38 stars on GitHub - 1 maintainer
syphonx 1.2.66
SyphonX is a tool that extracts data from HTML data, transforming it into JSON of any shape or si...32 versions - Latest release: 3 months ago - 32 downloads last month - 1 stars on GitHub - 1 maintainer
@hlustikp/license-exporter 0.2.3
A simple license crawler for crediting open source work5 versions - Latest release: 9 months ago - 67 downloads last month - 0 stars on GitHub - 1 maintainer
@figma-api/community 0.0.7
Figma Community API8 versions - Latest release: 12 months ago - 1 dependent repositories - 8 downloads last month - 9 stars on GitHub - 1 maintainer
amibot 2.0.0 💰
Am I bot or not?2 versions - Latest release: over 3 years ago - 2 dependent packages - 1 dependent repositories - 101 downloads last month - 10 stars on GitHub - 2 maintainers
Top 8.8% on npmjs.org
28 versions - Latest release: about 8 years ago - 4 dependent packages - 1 dependent repositories - 59 downloads last month - 1 maintainer
crawler-ninja 0.2.7
A web crawler made for the SEO based on plugins. Please wait or contribute ... still in beta28 versions - Latest release: about 8 years ago - 4 dependent packages - 1 dependent repositories - 59 downloads last month - 1 maintainer
@beermonster/hltv 3.5.12
The unofficial HLTV Node.js API12 versions - Latest release: 4 months ago - 37 downloads last month - 0 stars on GitHub - 1 maintainer
alexandria 0.1.7
A storage interface to store crawled content in Elasticsearch8 versions - Latest release: almost 10 years ago - 2 dependent packages - 3 dependent repositories - 9 downloads last month - 2 maintainers
unsplash-crawl 0.0.2
Crawl all images from unsplash2 versions - Latest release: over 9 years ago - 2 dependent repositories - 6 downloads last month - 4 stars on GitHub - 1 maintainer
@binochoi/aliexpress-scraper 1.0.9
fork of https://github.com/sudheer-ranga/aliexpress-product-scraper4 versions - Latest release: about 1 year ago - 28 downloads last month - 1 maintainer
webster 1.9.0 💰
a reliable web crawling & scraping framework for Node.js.42 versions - Latest release: 7 months ago - 1 dependent repositories - 49 downloads last month - 505 stars on GitHub - 1 maintainer
dm-web-start 1.8.6 💰
a reliable web crawling & scraping framework for Node.js.1 version - Latest release: almost 2 years ago - 1 dependent package - 5 downloads last month - 505 stars on GitHub - 1 maintainer
scrape-linkedin 0.0.2
Scrape Linkedin profiles has never been so simple with nodejs :D !2 versions - Latest release: over 7 years ago - 4 dependent repositories - 32 downloads last month - 19 stars on GitHub - 1 maintainer
scrapyteer 1.4.0
Web scraping/crawling framework built on top of headless Chrome8 versions - Latest release: almost 1 year ago - 17 downloads last month - 18 stars on GitHub - 1 maintainer
Top 9.1% on npmjs.org
140 versions - Latest release: 27 days ago - 2 dependent packages - 1 dependent repositories - 2.07 thousand downloads last month - 2 stars on GitHub - 3 maintainers
fiftyone.devicedetection.cloud 4.4.118
Device detection cloud services for the 51Degrees Pipeline API140 versions - Latest release: 27 days ago - 2 dependent packages - 1 dependent repositories - 2.07 thousand downloads last month - 2 stars on GitHub - 3 maintainers
Top 9.0% on npmjs.org
140 versions - Latest release: 27 days ago - 2 dependent packages - 1 dependent repositories - 2.7 thousand downloads last month - 2 stars on GitHub - 3 maintainers
fiftyone.devicedetection.onpremise 4.4.118
Device detection on-premise services for the 51Degrees Pipeline API140 versions - Latest release: 27 days ago - 2 dependent packages - 1 dependent repositories - 2.7 thousand downloads last month - 2 stars on GitHub - 3 maintainers
fiftyone.devicedetection 4.4.118
Parse HTTP headers to detect the device type, model, operating system, browser, and crawler infor...147 versions - Latest release: 27 days ago - 1 dependent package - 1 dependent repositories - 1.39 thousand downloads last month - 2 stars on GitHub - 3 maintainers
Top 8.1% on npmjs.org
125 versions - Latest release: 27 days ago - 4 dependent packages - 1 dependent repositories - 2.82 thousand downloads last month - 2 stars on GitHub - 3 maintainers
fiftyone.devicedetection.shared 4.4.118
Shared functionality for implementing device detection engine for the 51Degrees Pipeline API125 versions - Latest release: 27 days ago - 4 dependent packages - 1 dependent repositories - 2.82 thousand downloads last month - 2 stars on GitHub - 3 maintainers
hotfetch 2.1.9
Scrape pages and extract data in ease11 versions - Latest release: about 2 years ago - 1 dependent package - 7 downloads last month - 1 stars on GitHub - 1 maintainer
grabby 0.2.2
Enhanced request library with some specific cases like win1251 encoding and encoding support.11 versions - Latest release: over 8 years ago - 1 dependent package - 1 dependent repositories - 30 downloads last month - 1 stars on GitHub - 1 maintainer
@acq/enum-ret 0.2.2
A util tool13 versions - Latest release: about 4 years ago - 3 dependent packages - 1 dependent repositories - 11 downloads last month - 0 stars on GitHub - 1 maintainer
Top 0.6% on npmjs.org
69 versions - Latest release: over 1 year ago - 500 dependent packages - 2,606 dependent repositories - 1.68 million downloads last month - 6,082 stars on GitHub - 1 maintainer
puppeteer-extra-plugin-stealth 2.11.2 💰
Stealth mode: Applies various techniques to make detection of headless puppeteer harder.69 versions - Latest release: over 1 year ago - 500 dependent packages - 2,606 dependent repositories - 1.68 million downloads last month - 6,082 stars on GitHub - 1 maintainer
path-crawler 0.1.0
An utility to crawl generic objects paths2 versions - Latest release: over 2 years ago - 2 dependent packages - 1 dependent repositories - 84 downloads last month - 7 stars on GitHub - 1 maintainer
facebook-keyword-crawler 1.0.5
Simple facebook posts crawler5 versions - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 17 downloads last month - 2 stars on GitHub - 2 maintainers
robots-txt-component 0.0.4
Lightweight robots.txt parsing component without any external dependencies for Node.js.3 versions - Latest release: over 1 year ago - 23 downloads last month - 0 stars on GitHub - 1 maintainer
gretel 0.0.7 💰
Follows and collects breadcrumbs accross the web8 versions - Latest release: about 8 years ago - 2 dependent packages - 2 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
spiderman-crawler 0.2.3
Spiderman makes it trivial work to write a crawler. Just define some components, use segues to co...10 versions - Latest release: almost 10 years ago - 1 dependent repositories - 15 downloads last month - 49 stars on GitHub - 1 maintainer
@toctive-com/hotfetch 2.1.9
Scrape pages and extract data in ease5 versions - Latest release: about 2 years ago - 2 dependent packages - 4 downloads last month - 1 stars on GitHub - 1 maintainer
salmonjs 0.5.0 💰
Web Crawler in Node.js to spider dynamically whole websites.5 versions - Latest release: about 10 years ago - 2 dependent repositories - 29 downloads last month - 35 stars on GitHub - 1 maintainer
mini-crawler 4.0.2
A really small crawler.7 versions - Latest release: almost 4 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
dom-reducer 1.0.9
DOM crawler, executing given reducer recursively beginning with provided node.9 versions - Latest release: almost 4 years ago - 1 dependent package - 1 dependent repositories - 24 downloads last month - 0 stars on GitHub - 1 maintainer
koa-detect-crawler 0.0.0
Handle http request from crawler (Something like Googlebot)1 version - Latest release: about 10 years ago - 1 dependent package - 1 dependent repositories - 7 downloads last month - 1 maintainer
@silva95gustavo/crawlee-core 3.9.2-silva95gustavo-6
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...6 versions - Latest release: about 1 month ago - 128 downloads last month - 0 stars on GitHub - 1 maintainer
wintr 1.2.0
Wintr (wintr.com) unofficial API wrapper3 versions - Latest release: over 2 years ago - 1 dependent package - 2 dependent repositories - 6 downloads last month - 0 stars on GitHub - 1 maintainer
@tradle/x-ray-crawler 2.1.0
x-ray's crawler1 version - Latest release: over 2 years ago - 2 dependent packages - 1 dependent repositories - 4 downloads last month - 44 stars on GitHub - 5 maintainers
crawlerr 1.5.0 💰
A simple and fully customizable web crawler/spider for Node.js with server-side DOM. Comes with e...10 versions - Latest release: over 5 years ago - 1 dependent package - 1 dependent repositories - 9 downloads last month - 25 stars on GitHub - 1 maintainer
xlspider 1.0.6
nodejs's web spider tools7 versions - Latest release: about 2 years ago - 7 downloads last month - 1 maintainer
commodidolores 1.1.1
Web crawler for Node.js5 versions - Latest release: 2 months ago - 7 downloads last month - 0 stars on GitHub - 1 maintainer
@hotbrainstech/crawler-extractor-sdk 0.0.1
Web data extraction can be effectively performed using CSS selectors.1 version - Latest release: about 1 month ago - 48 downloads last month - 0 stars on GitHub - 1 maintainer
kz-crawler 1.2.3
kz webcrawler - install by running npm install kz-crawler6 versions - Latest release: over 6 years ago - 2 dependent packages - 27 downloads last month - 0 stars on GitHub - 1 maintainer
extract-from-document 1.1.0
Simplify data extraction from document2 versions - Latest release: over 4 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 0 stars on GitHub - 1 maintainer
scawler 0.0.1
A scraping crawler1 version - Latest release: over 10 years ago - 1 dependent repositories - 9 downloads last month - 1 maintainer
microfrontier 1.0.2
A web crawler frontier implementation in TypeScript backed by Redis. MicroFrontier is a scalable ...3 versions - Latest release: over 2 years ago - 2 dependent packages - 5 downloads last month - 7 stars on GitHub - 1 maintainer
@0y0/scraper-extensions 1.0.0
A @0y0/scraper expansion pack.5 versions - Latest release: over 3 years ago - 2 dependent packages - 9 downloads last month - 1 stars on GitHub - 1 maintainer
site-to-rss 1.0.0
Site to Rss API module and examples1 version - Latest release: almost 2 years ago - 1 dependent repositories - 22 downloads last month - 3 stars on GitHub - 1 maintainer
Top 8.6% on npmjs.org
12 versions - Latest release: almost 5 years ago - 2 dependent packages - 1 dependent repositories - 803 downloads last month - 8 stars on GitHub - 1 maintainer
node-site-downloader 1.3.0
An easy to use CLI for downloading websites for offline usage12 versions - Latest release: almost 5 years ago - 2 dependent packages - 1 dependent repositories - 803 downloads last month - 8 stars on GitHub - 1 maintainer
insta-crawler 0.3.0
Crawl the content of any instagram public page with no token or login3 versions - Latest release: about 4 years ago - 2 dependent packages - 1 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
website2pdf 0.0.16
Tool to export a website in PDFs based on its sitemap15 versions - Latest release: 7 months ago - 1 dependent repositories - 87 downloads last month - 21 stars on GitHub - 1 maintainer
github_trending_node 0.0.1
nodejs modules used for fetching github trending data1 version - Latest release: over 8 years ago - 2 dependent packages - 3 downloads last month - 0 stars on GitHub - 1 maintainer
get-set-fetch-extension-admin 0.4.1
React based frontend communicating with the backend (extension background script) via chrome.runt...7 versions - Latest release: over 3 years ago - 2 dependent packages - 1 dependent repositories - 10 downloads last month - 60 stars on GitHub - 1 maintainer
get-set-fetch-scenario-scrape-static-content 0.4.1
extracts text and binary content from static html pages based on CSS selectors3 versions - Latest release: over 3 years ago - 2 dependent packages - 1 dependent repositories - 7 downloads last month - 60 stars on GitHub - 1 maintainer
get-set-fetch-scenario-extract-html-content 0.1.1
Extract Html Content scenario is used for extracting html nodes text based on dom selectors.3 versions - Latest release: almost 5 years ago - 2 dependent packages - 1 dependent repositories - 8 downloads last month - 60 stars on GitHub - 1 maintainer
get-set-fetch-extension-test-utils 0.4.1
web scraping extension5 versions - Latest release: over 3 years ago - 3 dependent packages - 3 dependent repositories - 9 downloads last month - 60 stars on GitHub - 1 maintainer
get-set-fetch-scenario-extract-resources 0.4.1
Extract Resources scenario is used for extracting various resources from the corresponding sites.7 versions - Latest release: over 3 years ago - 2 dependent packages - 1 dependent repositories - 9 downloads last month - 60 stars on GitHub - 1 maintainer
get-set-fetch-extension-background 0.4.1
Handles the crawling and scraping logic.7 versions - Latest release: over 3 years ago - 2 dependent packages - 1 dependent repositories - 13 downloads last month - 60 stars on GitHub - 1 maintainer
get-set-fetch-scenario-scrape-dynamic-content 0.4.1
extracts text and binary content from dynamic (javascript) pages based on CSS selectors3 versions - Latest release: over 3 years ago - 2 dependent packages - 1 dependent repositories - 6 downloads last month - 60 stars on GitHub - 1 maintainer
get-set-fetch-extension-popup 0.3.0
Responsible for handling toolbar integration. Opens the admin front-end into a new tab.6 versions - Latest release: almost 4 years ago - 2 dependent packages - 1 dependent repositories - 9 downloads last month - 58 stars on GitHub - 1 maintainer
reqscraper 0.1.2
Lightweight wrapper for Request and X-Ray JS.6 versions - Latest release: over 8 years ago - 3 dependent packages - 3 dependent repositories - 6 downloads last month - 4 stars on GitHub - 1 maintainer
get-set-fetch-extension-commons 0.4.1
Contains common typescript definitions and utilities used throughout the lerna monorepo.7 versions - Latest release: over 3 years ago - 12 dependent packages - 3 dependent repositories - 8 downloads last month - 60 stars on GitHub - 1 maintainer
congregator-sitescraper 1.0.1
Site scraper for Congregator2 versions - Latest release: almost 10 years ago - 1 dependent package - 2 dependent repositories - 16 downloads last month - 10 stars on GitHub - 1 maintainer
noscrape-node unpublished
## Installation1 version - 15 downloads last month - 0 stars on GitHub - 1 maintainer
drawlr 0.3.1
A high-performance automatic crawler library4 versions - Latest release: over 7 years ago - 1 dependent package - 1 dependent repositories - 5 downloads last month - 3 stars on GitHub - 1 maintainer
hltv-rh 1.0.8
The unofficial HLTV Node.js API9 versions - Latest release: about 6 years ago - 1 dependent package - 1 dependent repositories - 7 downloads last month - 0 stars on GitHub - 1 maintainer
slyrics 1.0.22
Scrape Lyrics without API Key14 versions - Latest release: about 1 year ago - 3 dependent repositories - 19 downloads last month - 5 stars on GitHub - 1 maintainer
aliexscrape 1.0.11
Get Aliexpress product details in JSON12 versions - Latest release: over 5 years ago - 2 dependent packages - 3 dependent repositories - 34 downloads last month - 98 stars on GitHub - 1 maintainer
@rsodre/crawler-data 0.0.7
Endless Crawler Cached Data6 versions - Latest release: 12 months ago - 10 downloads last month - 0 stars on GitHub - 1 maintainer
arcgismapserver2postgis 1.0.3
该库可将arcgis mapserver上发布的矢量服务,获取矢量数据存储到postgis库4 versions - Latest release: almost 3 years ago - 2 dependent packages - 7 downloads last month - 1 maintainer
zy-crawler 1.0.5
zy-crawler是一个基于Node.js的简单易用的爬虫工具6 versions - Latest release: about 1 year ago - 12 downloads last month - 1 maintainer
Top 1.7% on npmjs.org
205 versions - Latest release: over 1 year ago - 12 dependent packages - 55 dependent repositories - 10.7 thousand downloads last month - 1 maintainer
sqreen 2.0.2
Node.js agent for Sqreen, please see https://www.sqreen.io/205 versions - Latest release: over 1 year ago - 12 dependent packages - 55 dependent repositories - 10.7 thousand downloads last month - 1 maintainer
Top 1.3% on npmjs.org
35 versions - Latest release: 7 months ago - 116 dependent packages - 5,433 dependent repositories - 2.67 million downloads last month - 1,262 stars on GitHub - 1 maintainer
fdir 6.1.1 💰
The fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m f...35 versions - Latest release: 7 months ago - 116 dependent packages - 5,433 dependent repositories - 2.67 million downloads last month - 1,262 stars on GitHub - 1 maintainer
@acq/rand 0.2.2
A util tool10 versions - Latest release: about 4 years ago - 2 dependent packages - 8 downloads last month - 0 stars on GitHub - 1 maintainer
quick-scraper 1.7.0
An easy, lightweight scraper for humans with many inbuilt features..10 versions - Latest release: over 2 years ago - 2 dependent packages - 1 dependent repositories - 9 downloads last month - 3 stars on GitHub - 1 maintainer
Top 6.8% on npmjs.org
15 versions - Latest release: about 6 years ago - 1 dependent package - 17 dependent repositories - 18.8 thousand downloads last month - 153 stars on GitHub - 1 maintainer
ng-meta 1.0.3
Meta tags support for AngularJS single page applications (SPA)15 versions - Latest release: about 6 years ago - 1 dependent package - 17 dependent repositories - 18.8 thousand downloads last month - 153 stars on GitHub - 1 maintainer
Top 4.8% on npmjs.org
4 versions - Latest release: over 4 years ago - 13 dependent packages - 17 dependent repositories - 38.4 thousand downloads last month - 11 stars on GitHub - 1 maintainer
isbot-fast 1.2.0
JavaScript module detecting bots/crawlers/spiders via user-agent4 versions - Latest release: over 4 years ago - 13 dependent packages - 17 dependent repositories - 38.4 thousand downloads last month - 11 stars on GitHub - 1 maintainer
Top 5.1% on npmjs.org
17 versions - Latest release: almost 2 years ago - 4 dependent packages - 14 dependent repositories - 908 downloads last month - 25 stars on GitHub - 1 maintainer
get-site-urls 3.0.0
Crawl a URL to generate a sitemap and find 404 errors with one command17 versions - Latest release: almost 2 years ago - 4 dependent packages - 14 dependent repositories - 908 downloads last month - 25 stars on GitHub - 1 maintainer
crawlab-sdk 0.3.3
Node.js SDK for Crawlab20 versions - Latest release: almost 4 years ago - 1 dependent package - 1 dependent repositories - 191 downloads last month - 52 stars on GitHub - 1 maintainer
bauer-cli 0.2.5
Command-line interface for bauer-crawler.13 versions - Latest release: over 8 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
slinky 0.0.1
web crawler just for links1 version - Latest release: almost 10 years ago - 1 dependent package - 1 dependent repositories - 7 downloads last month - 11 stars on GitHub - 1 maintainer
epic-link-crawler 1.0.23
A simple in depth links crawler. You can easily collect all the links available on a website.23 versions - Latest release: almost 4 years ago - 2 dependent packages - 1 dependent repositories - 13 downloads last month - 0 stars on GitHub - 1 maintainer
crawlercore 1.5.51
crawler with nodejs34 versions - Latest release: over 6 years ago - 2 dependent packages - 1 dependent repositories - 10 downloads last month - 1 stars on GitHub - 1 maintainer
hcrawler 0.0.5
a hierachical web crawler with concurrency control and server-side jQuery support4 versions - Latest release: almost 11 years ago - 2 dependent packages - 1 dependent repositories - 8 downloads last month - 1 stars on GitHub - 1 maintainer
openwebspider 0.3.0
Open Source Web Crawler1 version - Latest release: about 7 years ago - 1 dependent package - 1 dependent repositories - 3 downloads last month - 50 stars on GitHub - 1 maintainer
Related Keywords
scraper
384
spider
298
nodejs
274
scraping
180
javascript
163
crawling
155
puppeteer
146
web
127
typescript
125
api
109
headless
94
crawl
87
parser
86
node
86
web-crawler
81
npm
73
chrome
72
automation
70
bot
63
headless-chrome
61
web-scraping
61
cheerio
61
html
52
scrape
52
apify
50
cli
50
web-crawling
49
dom
48
playwright
47
google
46
browser
42
jquery
37
download
31
data
31
seo
30
json
30
phantomjs
28
scrapper
27
scrapy
25
request
24
play
23
extract
23
fetch
23
website
22
sitemap
21
cluster
20
multi-process
20
user-agent
20
library
20
url
20
robot
20
chromium
20
multi-thread
20
multi-core
20
process
20
fork
20
web crawler
19
search
19
site
19
downloader
18
webcrawler
18
cache
18
promise
17
proxy
17
extractor
17
xml
16
news
16
youtube
16
http
15
middleware
15
stealth
15
twitter
15
core
15
simple
15
google-play
15
movies
14
framework
14
npm-package
14
checker
13
test
13
js
13
indexer
13
hltv
13
csgo
13
scrap
13
queue
13
puppeteer-extra
13
links
13
simplecrawler
12
image
12
movies-api
12
googlebot
12
apis
12
scraping-websites
12
declarative
12
instagram
12
SEO
12
express
12
page
12
generator
11