Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
npmjs.org "crawler" keyword
@deptagency/octopus 1.5.1
Recursive and multi-threaded broken link checker3 versions - Latest release: almost 5 years ago - 1 dependent package - 1 dependent repositories - 67 downloads last month - 31 stars on GitHub - 2 maintainers
interrobot-plugin 0.9.0
Used in the creation of plugins (aka reports) that present data or visualizations for a website i...4 versions - Latest release: 2 months ago - 8 downloads last month - 0 stars on GitHub - 1 maintainer
promise-parser 0.0.4
Web scraper4 versions - Latest release: over 9 years ago - 2 dependent packages - 1 dependent repositories - 8 downloads last month - 1 maintainer
@leoko/crawler 1.3.1
Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server ...2 versions - Latest release: almost 2 years ago - 1 dependent package - 6 downloads last month - 6,561 stars on GitHub - 1 maintainer
Top 0.8% on npmjs.org
36 versions - Latest release: 5 months ago - 151 dependent packages - 915 dependent repositories - 35.7 thousand downloads last month - 6,629 stars on GitHub - 4 maintainers
crawler 1.5.0
New TypeScript Crawler Test version36 versions - Latest release: 5 months ago - 151 dependent packages - 915 dependent repositories - 35.7 thousand downloads last month - 6,629 stars on GitHub - 4 maintainers
Top 1.8% on npmjs.org
61 versions - Latest release: over 3 years ago - 24 dependent packages - 211 dependent repositories - 38.9 thousand downloads last month - 396 stars on GitHub - 1 maintainer
sitemap-generator 8.5.1
Easily create XML sitemaps for your website.61 versions - Latest release: over 3 years ago - 24 dependent packages - 211 dependent repositories - 38.9 thousand downloads last month - 396 stars on GitHub - 1 maintainer
axe-crawler 0.5.5
A highly configurable website crawler for automatically testing a website for accessibility issue...18 versions - Latest release: over 6 years ago - 2 dependent packages - 1 dependent repositories - 27 downloads last month - 21 stars on GitHub - 1 maintainer
@sashke-er/hltv 2.15.14
The unofficial HLTV Node.js API15 versions - Latest release: over 3 years ago - 2 dependent packages - 233 downloads last month - 0 stars on GitHub - 1 maintainer
spider.io 5.0.10
极简网络蜘蛛爬虫，适用任何网站，只需设置一条规则，就可以把你想要网站上的内容整理出来，非常方便，简单！73 versions - Latest release: almost 5 years ago - 1 dependent repositories - 267 downloads last month - 42 stars on GitHub - 1 maintainer
ejoyx-osmosis 1.1.2
Web scraper for NodeJS1 version - Latest release: about 7 years ago - 1 dependent package - 1 dependent repositories - 2 downloads last month - 4,114 stars on GitHub - 1 maintainer
ejoy-osmosis 1.1.4
Web scraper for NodeJS1 version - Latest release: about 7 years ago - 1 dependent package - 1 dependent repositories - 3 downloads last month - 4,114 stars on GitHub - 1 maintainer
spider-engine 0.1.3
Web crawling and scraping engine.3 versions - Latest release: over 9 years ago - 1 dependent repositories - 9 downloads last month - 1 maintainer
spider-stealth 1.2.2
A Node.js scraping framework built on puppeteer-extra (to use a headless Chrome/Chromium browser)...7 versions - Latest release: about 2 years ago - 18 downloads last month - 1 maintainer
Top 1.9% on npmjs.org
27 versions - Latest release: about 5 years ago - 52 dependent packages - 205 dependent repositories - 775 downloads last month - 4,114 stars on GitHub - 1 maintainer
osmosis 1.1.10
Web scraper for NodeJS27 versions - Latest release: about 5 years ago - 52 dependent packages - 205 dependent repositories - 775 downloads last month - 4,114 stars on GitHub - 1 maintainer
social-link-extractor 1.0.1
Library to extractor all social (profile) links from a website2 versions - Latest release: about 6 years ago - 1 dependent repositories - 44 downloads last month - 1 stars on GitHub - 1 maintainer
@1-bi/scrapy 0.0.1
基于nodejs平台下使用的Scrapy模型框架组件1 version - Latest release: over 4 years ago - 2 dependent packages - 1 dependent repositories - 9 downloads last month - 0 stars on GitHub - 1 maintainer
subscrape 0.1.0
Subscrape is a very simple tool to download the latest images from a specific sub reddit.1 version - Latest release: over 4 years ago - 4 downloads last month - 1 maintainer
@warren-bank/node-request-cli 4.0.19
An extremely lightweight HTTP request client for the command-line. Supports: http, https, proxy, ...35 versions - Latest release: 12 months ago - 2 dependent packages - 1 dependent repositories - 95 downloads last month - 1 stars on GitHub - 1 maintainer
@deepcrawl/custom-metric-types 1.41.0
TypeScript types for defining custom metrics38 versions - Latest release: 20 days ago - 2 dependent packages - 409 downloads last month - 2 maintainers
spider.cli 1.2.10
Spider for Commandline and Programming API24 versions - Latest release: over 3 years ago - 28 downloads last month - 1 stars on GitHub - 1 maintainer
crawl_fetcher 1.0.0
A web crawler. Automatically crawls websites. Define custom handlers to parse content. Obeys robo...1 version - Latest release: almost 4 years ago - 1 dependent package - 11 downloads last month - 1 maintainer
fb-crawler-check 0.8.1
Check user agent to be a facebook crawler2 versions - Latest release: almost 8 years ago - 1 dependent package - 1 dependent repositories - 7 downloads last month - 1 maintainer
pauk 0.0.2
web crawler2 versions - Latest release: almost 10 years ago - 1 dependent package - 1 dependent repositories - 9 downloads last month - 1 maintainer
scrapping_engine 1.0.0
To scrap the content from the web site1 version - Latest release: almost 4 years ago - 3 downloads last month - 1 maintainer
gnews-scraper 1.2.3
GNewsScraper is a TypeScript package that scrapes article data from Google News based on a keywor...5 versions - Latest release: 11 months ago - 1 dependent repositories - 74 downloads last month - 5 stars on GitHub - 1 maintainer
Top 1.6% on npmjs.org
1,024 versions - Latest release: 7 days ago - 6 dependent packages - 34 dependent repositories - 74.6 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
@crawlee/playwright 3.10.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...1,024 versions - Latest release: 7 days ago - 6 dependent packages - 34 dependent repositories - 74.6 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
Top 2.6% on npmjs.org
821 versions - Latest release: 7 days ago - 2 dependent packages - 27 dependent repositories - 71.7 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
@crawlee/jsdom 3.10.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...821 versions - Latest release: 7 days ago - 2 dependent packages - 27 dependent repositories - 71.7 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
snapshooter 0.3.9
Simple crawler for Single Page Applications26 versions - Latest release: about 10 years ago - 1 dependent package - 8 dependent repositories - 62 downloads last month - 16 stars on GitHub - 2 maintainers
node-jquery-retriever 0.0.5
Get a webpage and select elements with jquery2 versions - Latest release: almost 8 years ago - 2 dependent packages - 1 dependent repositories - 11 downloads last month - 1 maintainer
simplecrawler-zic 1.2.6
Very straightforward, event driven web crawler. Features a flexible queue interface and a basic c...10 versions - Latest release: about 5 years ago - 1 dependent repositories - 24 downloads last month - 0 stars on GitHub - 1 maintainer
@mendable/firecrawl-js 0.0.21
JavaScript SDK for Firecrawl API27 versions - Latest release: 9 days ago - 7.85 thousand downloads last month - 4,092 stars on GitHub - 3 maintainers
ppspider 2.2.3
web spider, support puppeteer, cheerio and so on, include task-queue and dispatcher61 versions - Latest release: about 4 years ago - 1 dependent package - 1 dependent repositories - 73 downloads last month - 326 stars on GitHub - 1 maintainer
price-extract 0.0.5
Performant way to extract price amount and metadatas (currency, decimal & thousands separator) fr...3 versions - Latest release: over 2 years ago - 2 dependent packages - 178 downloads last month - 3 stars on GitHub - 1 maintainer
@rajathans/productscraper 1.0.4
Get product details as a json reponse including feedbacks, variants, description, images, etc.,5 versions - Latest release: over 4 years ago - 2 dependent packages - 7 downloads last month - 1 maintainer
Top 2.4% on npmjs.org
478 versions - Latest release: 3 months ago - 44 dependent packages - 510 dependent repositories - 114 thousand downloads last month - 60 stars on GitHub - 10 maintainers
apify-client 2.9.3
Apify API client for JavaScript478 versions - Latest release: 3 months ago - 44 dependent packages - 510 dependent repositories - 114 thousand downloads last month - 60 stars on GitHub - 10 maintainers
Top 6.4% on npmjs.org
17 versions - Latest release: about 2 years ago - 2 dependent packages - 9 dependent repositories - 2.09 thousand downloads last month - 11 stars on GitHub - 1 maintainer
robots-txt-parser 2.0.3
A lightweight robots.txt parser for Node.js with support for wildcards, caching and promises.17 versions - Latest release: about 2 years ago - 2 dependent packages - 9 dependent repositories - 2.09 thousand downloads last month - 11 stars on GitHub - 1 maintainer
dex8-cli 2.1.6
Dex8 CLI is a command line interface which helps developers to create and run dex8.com skripts (a...15 versions - Latest release: about 1 month ago - 619 downloads last month - 0 stars on GitHub - 1 maintainer
vws-js-lib 4.1.0
Node module for web-scraping on torrent video websites1 version - Latest release: almost 3 years ago - 27 downloads last month - 0 stars on GitHub - 1 maintainer
socialblade-api 1.0.0 💰
Unofficial APIs for Socialblade.com website.1 version - Latest release: over 3 years ago - 24 downloads last month - 10 stars on GitHub - 1 maintainer
beian-domain 1.0.1 💰
最新可备案域名查询爬虫2 versions - Latest release: about 6 years ago - 1 dependent package - 1 dependent repositories - 5 downloads last month - 10 stars on GitHub - 1 maintainer
knightcrawler 0.0.1
DDM web article crawler1 version - Latest release: almost 9 years ago - 1 dependent package - 1 dependent repositories - 4 downloads last month - 0 stars on GitHub - 1 maintainer
squirrelbot 1.0.0
CLI utility to crawl web servers, cache HTML documents, and query them with CSS selectors.1 version - Latest release: over 5 years ago - 1 dependent package - 1 dependent repositories - 3 downloads last month - 0 stars on GitHub - 1 maintainer
page-fetch 0.0.2
Fetches a page based on the configuration. Handles JSON and jQuery types of request.2 versions - Latest release: over 7 years ago - 2 dependent packages - 1 dependent repositories - 6 downloads last month - 1 maintainer
tiny-crawler 0.0.5
tiny-crawler is a web crawler.4 versions - Latest release: almost 5 years ago - 1 dependent package - 1 dependent repositories - 7 downloads last month - 1 stars on GitHub - 1 maintainer
Top 2.3% on npmjs.org
29 versions - Latest release: 16 days ago - 10 dependent packages - 11 dependent repositories - 23 thousand downloads last month - 1,418 stars on GitHub - 2 maintainers
@extractus/article-extractor 8.0.10
To extract main article from given URL29 versions - Latest release: 16 days ago - 10 dependent packages - 11 dependent repositories - 23 thousand downloads last month - 1,418 stars on GitHub - 2 maintainers
mcrozz-article-parser 8.0.10
To extract main article from given URL4 versions - Latest release: 11 days ago - 1 dependent package - 131 downloads last month - 1,418 stars on GitHub - 1 maintainer
@fast-horse/article-extractor 7.2.18
To extract main article from given URL2 versions - Latest release: 11 months ago - 73 downloads last month - 1,418 stars on GitHub - 1 maintainer
@arbitral/article-parser 6.0.48
To extract main article from given URL64 versions - Latest release: 3 months ago - 2 dependent packages - 1.7 thousand downloads last month - 1,414 stars on GitHub - 2 maintainers
simple-webloader 0.0.4
3 versions - Latest release: over 8 years ago - 1 dependent repositories - 8 downloads last month - 0 stars on GitHub - 2 maintainersnode-pick 1.0.1
## Dom selection tool based on cheerio.js2 versions - Latest release: over 5 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 1 maintainer
psi-report 2.2.1
Crawls a website, gets PageSpeed Insights data for each page, and exports an HTML report6 versions - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 11 downloads last month - 11 stars on GitHub - 1 maintainer
Top 2.5% on npmjs.org
899 versions - Latest release: 7 days ago - 2 dependent packages - 32 dependent repositories - 70.5 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
@crawlee/templates 3.10.0
Templates for the crawlee projects899 versions - Latest release: 7 days ago - 2 dependent packages - 32 dependent repositories - 70.5 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
Top 2.5% on npmjs.org
913 versions - Latest release: 7 days ago - 2 dependent packages - 32 dependent repositories - 70.3 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
@crawlee/cli 3.10.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...913 versions - Latest release: 7 days ago - 2 dependent packages - 32 dependent repositories - 70.3 thousand downloads last month - 10,928 stars on GitHub - 10 maintainers
@crawlee/linkedom 3.10.0
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...522 versions - Latest release: 7 days ago - 1 dependent package - 8 dependent repositories - 65.7 thousand downloads last month - 10,928 stars on GitHub - 2 maintainers
repo-crawler-for-gpt 1.0.12
Crawl a site to generate knowledge files to create your own custom GPT12 versions - Latest release: 5 months ago - 15 downloads last month - 4 stars on GitHub - 1 maintainer
Top 1.0% on npmjs.org
70 versions - Latest release: about 4 years ago - 71 dependent packages - 466 dependent repositories - 128 thousand downloads last month - 2,138 stars on GitHub - 3 maintainers
simplecrawler 1.1.9
Very straightforward, event driven web crawler. Features a flexible queue interface and a basic c...70 versions - Latest release: about 4 years ago - 71 dependent packages - 466 dependent repositories - 128 thousand downloads last month - 2,138 stars on GitHub - 3 maintainers
@blocklet/crawler 1.6.247
blocklet crawler lib340 versions - Latest release: 7 days ago - 2.06 thousand downloads last month - 2 maintainers
octopus-web-crawler 1.1.0
Another web crawler.3 versions - Latest release: over 2 years ago - 1 dependent package - 23 downloads last month - 0 stars on GitHub - 1 maintainer
subscrapetest 0.1.0
subscrape is a very simple tool to download the latest images from a specific sub reddit.1 version - Latest release: over 4 years ago - 4 downloads last month - 1 maintainer
yomuco 0.0.8
Yomuco – A simple web crawling library for Node.js2 versions - Latest release: 11 days ago - 451 downloads last month - 33 stars on GitHub - 1 maintainer
routers-news 1.0.4
A crawler for various popular tech news sources. Read technology news from the comfort of your CLI.13 versions - Latest release: about 11 years ago - 2 dependent repositories - 34 downloads last month - 1 maintainer
spidermap 1.0.0
sipder network with nodejs1 version - Latest release: about 7 years ago - 1 dependent repositories - 10 downloads last month - 42 stars on GitHub - 1 maintainer
plugin-comic-pro 1.0.10
```shell yarn add plugin-comic-pro ```11 versions - Latest release: about 1 month ago - 132 downloads last month - 1 stars on GitHub - 1 maintainer
puppeteer-spider 0.1.0
A web crawler powered by puppeteer2 versions - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 7 downloads last month - 22 stars on GitHub
plentiful-files 0.0.5
Abstract layer for managing big sets of files5 versions - Latest release: over 9 years ago - 1 dependent package - 2 dependent repositories - 8 downloads last month - 0 stars on GitHub - 1 maintainer
node-simple-crawler 0.1.6
Simple web-crawler for nodejs7 versions - Latest release: almost 9 years ago - 1 dependent package - 1 dependent repositories - 11 downloads last month - 1 stars on GitHub - 2 maintainers
wbdl 0.1.0
crawl and archive a website and all its pages as plain HTML files organized in directories to mat...16 versions - Latest release: 6 months ago - 26 downloads last month - 0 stars on GitHub - 1 maintainer
scrano 0.0.19
模仿scrapy的node爬虫框架16 versions - Latest release: almost 5 years ago - 1 dependent repositories - 18 downloads last month - 6 stars on GitHub - 1 maintainer
@figma-api/community 0.0.7
Figma Community API8 versions - Latest release: 11 months ago - 1 dependent repositories - 13 downloads last month - 9 stars on GitHub - 1 maintainer
Top 8.1% on npmjs.org
120 versions - Latest release: 11 days ago - 4 dependent packages - 1 dependent repositories - 2.7 thousand downloads last month - 2 stars on GitHub - 3 maintainers
fiftyone.devicedetection.shared 4.4.118
Shared functionality for implementing device detection engine for the 51Degrees Pipeline API120 versions - Latest release: 11 days ago - 4 dependent packages - 1 dependent repositories - 2.7 thousand downloads last month - 2 stars on GitHub - 3 maintainers
Top 9.0% on npmjs.org
135 versions - Latest release: 11 days ago - 2 dependent packages - 1 dependent repositories - 2.55 thousand downloads last month - 2 stars on GitHub - 3 maintainers
fiftyone.devicedetection.onpremise 4.4.118
Device detection on-premise services for the 51Degrees Pipeline API135 versions - Latest release: 11 days ago - 2 dependent packages - 1 dependent repositories - 2.55 thousand downloads last month - 2 stars on GitHub - 3 maintainers
Top 9.1% on npmjs.org
135 versions - Latest release: 11 days ago - 2 dependent packages - 1 dependent repositories - 2.06 thousand downloads last month - 2 stars on GitHub - 3 maintainers
fiftyone.devicedetection.cloud 4.4.118
Device detection cloud services for the 51Degrees Pipeline API135 versions - Latest release: 11 days ago - 2 dependent packages - 1 dependent repositories - 2.06 thousand downloads last month - 2 stars on GitHub - 3 maintainers
fiftyone.devicedetection 4.4.118
Parse HTTP headers to detect the device type, model, operating system, browser, and crawler infor...142 versions - Latest release: 11 days ago - 1 dependent package - 1 dependent repositories - 1.28 thousand downloads last month - 2 stars on GitHub - 3 maintainers
Top 3.2% on npmjs.org
101 versions - Latest release: 8 months ago - 5 dependent packages - 55 dependent repositories - 964 downloads last month - 376 stars on GitHub - 1 maintainer
hltv 3.5.0 💰
The unofficial HLTV Node.js API101 versions - Latest release: 8 months ago - 5 dependent packages - 55 dependent repositories - 964 downloads last month - 376 stars on GitHub - 1 maintainer
hltv-personal-custom 1.0.6 💰
The unofficial HLTV Node.js API7 versions - Latest release: about 2 years ago - 1 dependent package - 10 downloads last month - 375 stars on GitHub - 1 maintainer
hltv-proxy 1.0.13 unpublished
The unofficial HLTV Node.js API14 versions - Latest release: about 2 years ago - 310 stars on
nintendo-eshop-api 4.0.1 💰
Unofficial API lib for Nintendo Switch eShop game listing and pricing information.2 versions - Latest release: over 3 years ago - 1 dependent package - 7 downloads last month - 1 stars on GitHub - 1 maintainer
webrobber 0.2.0
A light weight nodejs library to helps you grab the specified content on any web page on internet.5 versions - Latest release: almost 9 years ago - 1 dependent package - 1 dependent repositories - 7 downloads last month - 2 stars on GitHub - 1 maintainer
@iyowei/fs-deep-walk 1.0.0
专注于深度扫描指定磁盘位置。1 version - Latest release: over 2 years ago - 1 dependent package - 3 downloads last month - 0 stars on GitHub - 1 maintainer
neocrawler 2.0.2
Nodejs Distribute Crawler3 versions - Latest release: about 9 years ago - 1 dependent package - 1 dependent repositories - 14 downloads last month - 1 maintainer
moo-youtube-crawler 0.4.0
Do some youtube magic4 versions - Latest release: over 2 years ago - 1 dependent package - 6 downloads last month - 0 stars on GitHub - 1 maintainer
webster 1.9.0 💰
a reliable web crawling & scraping framework for Node.js.42 versions - Latest release: 7 months ago - 1 dependent repositories - 49 downloads last month - 505 stars on GitHub - 1 maintainer
dm-web-start 1.8.6 💰
a reliable web crawling & scraping framework for Node.js.1 version - Latest release: almost 2 years ago - 1 dependent package - 3 downloads last month - 505 stars on GitHub - 1 maintainer
@youlingred/spider.io 5.0.10
极简网络蜘蛛爬虫，适用任何网站，只需设置一条规则，就可以把你想要网站上的内容整理出来，非常方便，简单！1 version - Latest release: over 3 years ago - 1 dependent package - 4 downloads last month - 42 stars on GitHub - 1 maintainer
turbocrawl 0.4.1
The simple and fast crawling framework. So you can focus on scraping.19 versions - Latest release: over 4 years ago - 1 dependent package - 1 dependent repositories - 110 downloads last month - 0 stars on GitHub - 1 maintainer
@vws-js-lib/crawler 4.4.5
Node module for web-scraping on torrent video websites14 versions - Latest release: over 2 years ago - 1 dependent package - 1 dependent repositories - 18 downloads last month - 0 stars on GitHub - 1 maintainer
Top 5.4% on npmjs.org
7 versions - Latest release: about 3 years ago - 11 dependent packages - 11 dependent repositories - 13.3 thousand downloads last month - 42 stars on GitHub - 2 maintainers
@folder/readdir 3.1.0 💰
Recursively read a directory, blazing fast.7 versions - Latest release: about 3 years ago - 11 dependent packages - 11 dependent repositories - 13.3 thousand downloads last month - 42 stars on GitHub - 2 maintainers
@albert-team/spiderman 2.1.0
Minimalistic web crawler for Node.js32 versions - Latest release: almost 4 years ago - 2 dependent packages - 1 dependent repositories - 44 downloads last month - 6 stars on GitHub - 1 maintainer
@unistudents/saffron 6.1.5
A fairly intuitive & powerful framework that enables you to collect & save articles and news from...20 versions - Latest release: about 1 month ago - 62 downloads last month - 10 stars on GitHub - 1 maintainer
bettong 0.2.1
Web crawler in JavaScript5 versions - Latest release: over 4 years ago - 1 dependent package - 7 downloads last month - 0 stars on GitHub - 1 maintainer
@xkairo/scrapy-puppeteer-plugin 0.1.0
Puppeteer integration to Scrapy library2 versions - Latest release: 10 months ago - 8 downloads last month - 1 maintainer
parkour 1.0.0
Parkour the web like a yamakazi1 version - Latest release: about 6 years ago - 1 dependent package - 1 dependent repositories - 4 downloads last month - 0 stars on GitHub - 1 maintainer
nspider 0.0.3
A Node.js Web Spider3 versions - Latest release: over 9 years ago - 1 dependent package - 1 dependent repositories - 8 downloads last month - 1 maintainer
@kulkul/asos-crawler 0.0.1
Easily use to crawl assos.com detail product by list of product url1 version - Latest release: over 3 years ago - 1 dependent package - 4 downloads last month - 5 stars on GitHub - 2 maintainers
hquery.php 3.0.3
An extremely fast web scraper that parses megabytes of HTML in a blink of an eye. No dependencies...23 versions - Latest release: almost 5 years ago - 1 dependent package - 1 dependent repositories - 105 downloads last month - 351 stars on GitHub - 1 maintainer
wikiextensions-flix 1.8.7
Nodejs library that provides an Api for obtaining the movies information from FlixHQ website.15 versions - Latest release: about 1 month ago - 112 downloads last month - 2 maintainers
itunes-feed 1.0.0 💰
Generate and retrieve iTunes feeds1 version - Latest release: about 5 years ago - 1 dependent package - 1 dependent repositories - 21 downloads last month - 4 stars on GitHub - 1 maintainer
@konker.dev/tiny-treecrawler-fp 0.0.17
A library for crawling a filesystem tree, based on Effect-ts16 versions - Latest release: 2 months ago - 31 downloads last month - 0 stars on GitHub - 2 maintainers
torrent-grabber 1.0.2
Simple torrent search engine3 versions - Latest release: about 5 years ago - 1 dependent package - 3 dependent repositories - 43 downloads last month - 1 maintainer
mreaper 0.0.31
A web crawler framework27 versions - Latest release: about 6 years ago - 1 dependent package - 1 dependent repositories - 31 downloads last month - 1 stars on GitHub - 1 maintainer
Related Keywords
scraper
383
spider
298
nodejs
274
scraping
177
javascript
163
crawling
155
puppeteer
145
web
127
typescript
125
api
109
headless
93
crawl
86
node
86
parser
86
web-crawler
81
npm
73
chrome
71
automation
70
bot
63
cheerio
61
web-scraping
61
headless-chrome
61
html
52
scrape
50
apify
50
cli
50
web-crawling
49
dom
48
playwright
47
google
46
browser
42
jquery
37
data
31
download
31
seo
30
json
30
phantomjs
28
scrapper
27
scrapy
25
play
23
fetch
23
request
23
extract
23
website
22
sitemap
21
robot
20
library
20
multi-thread
20
chromium
20
multi-core
20
process
20
fork
20
user-agent
20
multi-process
20
cluster
20
search
19
site
19
web crawler
19
url
19
webcrawler
18
downloader
18
cache
18
proxy
17
extractor
17
promise
17
news
16
youtube
16
xml
16
middleware
15
google-play
15
twitter
15
simple
15
core
15
framework
14
stealth
14
movies
14
npm-package
14
http
14
js
13
indexer
13
scrap
13
queue
13
checker
13
links
13
test
13
hltv
13
csgo
13
puppeteer-extra
12
instagram
12
page
12
googlebot
12
express
12
movies-api
12
scraping-websites
12
apis
12
image
12
declarative
12
SEO
12
simplecrawler
12
images
11