Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
npmjs.org "spider" keyword
pagemunch 1.0.0
A node.js wrapper for the PageMunch link unfurling API3 versions - Latest release: over 7 years ago - 2 dependent packages - 3 dependent repositories - 9 downloads last month - 2 stars on GitHub - 1 maintainer
dandy-crawl 1.2.2
A website crawler. Stays in the same website and return every internal linked URL with the associ...9 versions - Latest release: about 6 years ago - 2 dependent packages - 1 dependent repositories - 13 downloads last month - 1 stars on GitHub - 1 maintainer
Top 7.3% on npmjs.org
11 versions - Latest release: over 10 years ago - 7 dependent packages - 26 dependent repositories - 86 downloads last month - 21 stars on GitHub - 1 maintainer
flexible 0.1.20
Easily build flexible, scalable, and distributed, web crawlers.11 versions - Latest release: over 10 years ago - 7 dependent packages - 26 dependent repositories - 86 downloads last month - 21 stars on GitHub - 1 maintainer
aranea 0.0.1 💰
Web crawler toolkit1 version - Latest release: almost 7 years ago - 3 dependent packages - 1 dependent repositories - 3 downloads last month - 0 stars on GitHub - 1 maintainer
spankbang 0.0.9
spankbang.com api implementation7 versions - Latest release: about 1 month ago - 78 downloads last month - 1 maintainer
floodesh-cli 0.4.22
a cli tool for floodesh49 versions - Latest release: almost 4 years ago - 2 dependent packages - 1 dependent repositories - 56 downloads last month - 1 maintainer
norch-crawlers 0.0.3
A NodeJS crawler library to quick and easy build versatile crawlers.3 versions - Latest release: about 6 years ago - 2 dependent packages - 1 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
qscrape 0.1.0
Explore the Web1 version - Latest release: 3 months ago - 4 downloads last month - 0 stars on GitHub - 1 maintainer
tal-chart 1.0.1
A canvas spider / radar chart Component for React2 versions - Latest release: over 1 year ago - 1 dependent repositories - 3 downloads last month - 1 stars on GitHub - 1 maintainer
email-extractor 0.2.9
extract emails address from website by following links17 versions - Latest release: over 9 years ago - 1 dependent package - 4 dependent repositories - 41 downloads last month - 18 stars on GitHub - 1 maintainer
@yunyoujun/douban-spider 0.0.2 💰
豆瓣爬虫小工具 By Node.js.2 versions - Latest release: about 3 years ago - 2 dependent packages - 3 downloads last month - 5 stars on GitHub - 1 maintainer
baidu-image-spider 0.0.3 💰
百度图片爬虫小工具 By Node.js.3 versions - Latest release: over 3 years ago - 2 dependent packages - 9 downloads last month - 5 stars on GitHub - 1 maintainer
creepy-phantomjs-runner 1.0.2
creepy-phantomjs-runner3 versions - Latest release: about 8 years ago - 1 dependent package - 1 dependent repositories - 14 downloads last month - 0 stars on GitHub - 1 maintainer
flowesh 1.2.4
Flowesh is the non-cluster version of floodesh. It's a middleware based web spider which is light...17 versions - Latest release: over 7 years ago - 2 dependent packages - 1 dependent repositories - 10 downloads last month - 1 maintainer
spiderweb 0.0.14
Crawl multiple domains using one or more entry URLs.14 versions - Latest release: over 10 years ago - 1 dependent package - 2 dependent repositories - 15 downloads last month - 0 stars on GitHub - 1 maintainer
jspider 0.0.1
Web crawler framework for Node.js1 version - Latest release: over 7 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 1 maintainer
@glossa/ratio-fin-cn 0.2.8
A crawler23 versions - Latest release: about 3 years ago - 1 dependent package - 11 downloads last month - 0 stars on GitHub - 1 maintainer
xvideos-lib 1.1.21
xvideos.com api implementation and update.18 versions - Latest release: over 3 years ago - 1 dependent repositories - 30 downloads last month - 1 stars on GitHub - 1 maintainer
dature 1.1.2
新浪博客备份工具29 versions - Latest release: about 1 year ago - 1 dependent package - 1 dependent repositories - 41 downloads last month - 57 stars on GitHub - 1 maintainer
gumo 1.0.7
A web-crawler and scraper that extracts data from a family of nested dynamic webpages with added ...7 versions - Latest release: almost 2 years ago - 1 dependent package - 6 downloads last month - 21 stars on GitHub - 2 maintainers
curlas 4.5.0
nodejs web crawl tool70 versions - Latest release: over 5 years ago - 2 dependent packages - 1 dependent repositories - 12 downloads last month - 3 stars on GitHub - 1 maintainer
@waynechang65/ptt-crawler 2.6.0
A web crawler module designed to scarp data from Ptt.17 versions - Latest release: 4 months ago - 1 dependent package - 3 dependent repositories - 47 downloads last month - 20 stars on GitHub - 1 maintainer
@glossa/c12n-fin-sina 0.2.8
A crawler29 versions - Latest release: about 3 years ago - 2 dependent packages - 1 dependent repositories - 3 downloads last month - 0 stars on GitHub - 1 maintainer
egg-spider 0.0.2
Crawler/Spider for EggJS + server-side jQuery2 versions - Latest release: over 5 years ago - 2 dependent packages - 1 dependent repositories - 5 downloads last month - 0 stars on GitHub - 1 maintainer
@spider-rs/spider-rs-linux-x64-musl 0.0.70
This is the **x86_64-unknown-linux-musl** binary for `@spider-rs/spider-rs`30 versions - Latest release: 2 months ago - 1 dependent package - 48 downloads last month - 13 stars on GitHub - 1 maintainer
@spider-rs/spider-rs-win32-ia32-msvc 0.0.70
This is the **i686-pc-windows-msvc** binary for `@spider-rs/spider-rs`30 versions - Latest release: 2 months ago - 1 dependent package - 40 downloads last month - 13 stars on GitHub - 1 maintainer
@spider-rs/spider-rs-darwin-universal 0.0.70
This is the **universal-apple-darwin** binary for `@spider-rs/spider-rs`30 versions - Latest release: 2 months ago - 1 dependent package - 49 downloads last month - 13 stars on GitHub - 1 maintainer
@spider-rs/spider-rs-darwin-x64 0.0.70
This is the **x86_64-apple-darwin** binary for `@spider-rs/spider-rs`30 versions - Latest release: 2 months ago - 1 dependent package - 42 downloads last month - 13 stars on GitHub - 1 maintainer
@spider-rs/spider-rs-linux-x64-gnu 0.0.70
This is the **x86_64-unknown-linux-gnu** binary for `@spider-rs/spider-rs`30 versions - Latest release: 2 months ago - 1 dependent package - 54 downloads last month - 13 stars on GitHub - 1 maintainer
@spider-rs/spider-rs-win32-arm64-msvc 0.0.70
This is the **aarch64-pc-windows-msvc** binary for `@spider-rs/spider-rs`30 versions - Latest release: 2 months ago - 1 dependent package - 42 downloads last month - 13 stars on GitHub - 1 maintainer
@spider-rs/spider-rs 0.0.70
The [spider](https://github.com/spider-rs/spider) project ported to Node.js30 versions - Latest release: 2 months ago - 75 downloads last month - 13 stars on GitHub - 1 maintainer
@spider-rs/spider-rs-darwin-arm64 0.0.70
This is the **aarch64-apple-darwin** binary for `@spider-rs/spider-rs`30 versions - Latest release: 2 months ago - 1 dependent package - 46 downloads last month - 13 stars on GitHub - 1 maintainer
@spider-rs/spider-rs-win32-x64-msvc 0.0.70
This is the **x86_64-pc-windows-msvc** binary for `@spider-rs/spider-rs`30 versions - Latest release: 2 months ago - 1 dependent package - 44 downloads last month - 13 stars on GitHub - 1 maintainer
@spider-rs/spider-rs-freebsd-x64 0.0.26
This is the **x86_64-unknown-freebsd** binary for `@spider-rs/spider-rs`11 versions - Latest release: 6 months ago - 1 dependent package - 25 downloads last month - 13 stars on GitHub - 1 maintainer
goose-browser-environment 1.0.4
Environment for Goose parser which allows to run it in commmon Browser4 versions - Latest release: almost 6 years ago - 1 dependent package - 1 dependent repositories - 11 downloads last month - 0 stars on GitHub - 1 maintainer
biquge-spider 1.0.0
a usual spider actually for xym1 version - Latest release: almost 2 years ago - 1 dependent package - 2 downloads last month - 1 maintainer
jandan 0.0.2
煎蛋网爬虫。2 versions - Latest release: almost 5 years ago - 1 dependent package - 1 dependent repositories - 8 downloads last month - 1 maintainer
fb-spider 0.0.0
Facebook Spider CORE1 version - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 3 downloads last month - 1 maintainer
nocrawler 0.4.3
Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server ...2 versions - Latest release: over 7 years ago - 1 dependent package - 1 dependent repositories - 7 downloads last month - 1 stars on GitHub - 1 maintainer
kspider 0.1.7
Simple web page spider13 versions - Latest release: over 7 years ago - 3 dependent packages - 1 dependent repositories - 11 downloads last month - 1 maintainer
email-crawler 1.0.4
"a service for scraping emails from a webpage, given the number of levels to reach5 versions - Latest release: over 6 years ago - 1 dependent package - 5 dependent repositories - 13 downloads last month - 9 stars on GitHub - 1 maintainer
wget-parser 2.0.0
Parses the wget spider output into an object5 versions - Latest release: over 8 years ago - 1 dependent repositories - 1.67 thousand downloads last month - 2 stars on GitHub - 2 maintainers
kaiser-crawler 1.0.5
Node.js module for crawling the web6 versions - Latest release: over 7 years ago - 1 dependent package - 1 dependent repositories - 13 downloads last month - 3 stars on GitHub - 1 maintainer
onepiece 0.2.0
onepiece comic downloader11 versions - Latest release: over 8 years ago - 1 dependent package - 1 dependent repositories - 19 downloads last month - 4 stars on GitHub - 1 maintainer
rc-spider 0.0.8
spider ui component for react5 versions - Latest release: about 8 years ago - 2 dependent packages - 1 dependent repositories - 13 downloads last month - 46 stars on GitHub - 1 maintainer
rc-spider-intergalactico 0.0.8
spider ui component for react1 version - Latest release: about 3 years ago - 2 dependent packages - 1 dependent repositories - 13 downloads last month - 46 stars on GitHub - 1 maintainer
easycrawler 1.0.1
Simple and Easy Crawler library for Node.js8 versions - Latest release: over 7 years ago - 2 dependent packages - 1 dependent repositories - 18 downloads last month - 3 stars on GitHub - 1 maintainer
get-all-links 1.0.2
A node crawler that return all links/href from website3 versions - Latest release: over 4 years ago - 1 dependent package - 1 dependent repositories - 93 downloads last month - 3 stars on GitHub - 1 maintainer
iflytek-spider-api 1.0.3
科大讯飞爬虫API3 versions - Latest release: about 2 years ago - 1 dependent package - 3 downloads last month - 2 stars on GitHub - 1 maintainer
@adulttechinc/xvideos 1.2.0
xvideos.com api implementation.1 version - Latest release: almost 5 years ago - 3 dependent packages - 1 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
@acq/times 0.2.2
A util tool11 versions - Latest release: about 4 years ago - 2 dependent packages - 5 downloads last month - 0 stars on GitHub - 1 maintainer
@glossa/index-fin-sse 0.2.8
A crawler20 versions - Latest release: about 3 years ago - 1 dependent package - 3 downloads last month - 0 stars on GitHub - 1 maintainer
Top 7.0% on npmjs.org
45 versions - Latest release: over 4 years ago - 2 dependent packages - 7 dependent repositories - 93 downloads last month - 368 stars on GitHub - 1 maintainer
supercrawler 2.0.0
A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse conten...45 versions - Latest release: over 4 years ago - 2 dependent packages - 7 dependent repositories - 93 downloads last month - 368 stars on GitHub - 1 maintainer
express-spider-middleware 1.1.9
And ExpressJS middleware for detecting search engine crawlers/spiders and handling crawler-specif...10 versions - Latest release: about 4 years ago - 1 dependent package - 1 dependent repositories - 65 downloads last month - 0 stars on GitHub - 1 maintainer
tapazz 1.0.1
This is a spider for Tap.az written in Node.2 versions - Latest release: almost 6 years ago - 1 dependent repositories - 6 downloads last month - 0 stars on GitHub - 1 maintainer
webster 1.9.0 💰
a reliable web crawling & scraping framework for Node.js.42 versions - Latest release: 7 months ago - 1 dependent repositories - 58 downloads last month - 505 stars on GitHub - 1 maintainer
dm-web-start 1.8.6 💰
a reliable web crawling & scraping framework for Node.js.1 version - Latest release: almost 2 years ago - 1 dependent package - 4 downloads last month - 505 stars on GitHub - 1 maintainer
@znode/browser 0.0.11
Create Browser with Puppeteer for Crawl11 versions - Latest release: over 2 years ago - 2 dependent packages - 18 downloads last month - 1 maintainer
spidey 1.0.7
Robust web spider for Node.js15 versions - Latest release: about 1 year ago - 1 dependent package - 1 dependent repositories - 16 downloads last month - 15 stars on GitHub - 1 maintainer
boloto 2.0.1
node.js web crawler17 versions - Latest release: almost 5 years ago - 2 dependent packages - 1 dependent repositories - 4 downloads last month - 1 maintainer
connect-is-bot 1.0.1
adds `isBot` to the request, when requested from a bot, search engine, spider etc.2 versions - Latest release: over 8 years ago - 3 dependent packages - 1 dependent repositories - 6 downloads last month - 0 stars on GitHub - 1 maintainer
@inest/scraper 0.0.5
类似java中webmagic类似的爬虫框架5 versions - Latest release: 3 months ago - 6 downloads last month - 1 maintainer
spider-rosi 1.0.0
about image spider1 version - Latest release: almost 5 years ago - 1 dependent repositories - 5 downloads last month - 0 stars on GitHub - 1 maintainer
Top 1.0% on npmjs.org
70 versions - Latest release: about 4 years ago - 71 dependent packages - 466 dependent repositories - 129 thousand downloads last month - 2,138 stars on GitHub - 3 maintainers
simplecrawler 1.1.9
Very straightforward, event driven web crawler. Features a flexible queue interface and a basic c...70 versions - Latest release: about 4 years ago - 71 dependent packages - 466 dependent repositories - 129 thousand downloads last month - 2,138 stars on GitHub - 3 maintainers
@glossa/index-fin-hs300 0.2.8
A crawler29 versions - Latest release: about 3 years ago - 2 dependent packages - 1 dependent repositories - 5 downloads last month - 0 stars on GitHub - 1 maintainer
btspider 0.1.0
dht spider1 version - Latest release: over 7 years ago - 1 dependent package - 1 dependent repositories - 5 downloads last month - 1 maintainer
crawler-mod 0.0.1
based on node-crawler1 version - Latest release: over 10 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
extract-email 1.1.3
A simple email extractor for obfuscated emails.3 versions - Latest release: over 6 years ago - 2 dependent packages - 1 dependent repositories - 1.96 thousand downloads last month - 1 stars on GitLab.com - 1 maintainer
jsonld-extract 0.0.8
A damn simple tool to extract json-ld metadata from webpage using jquery like api (jQuery, Cheeri...1 version - Latest release: over 2 years ago - 3 dependent packages - 1 dependent repositories - 391 downloads last month - 5 stars on GitHub - 1 maintainer
Top 3.8% on npmjs.org
15 versions - Latest release: over 2 years ago - 3 dependent packages - 8 dependent repositories - 37.1 thousand downloads last month - 88 stars on GitHub - 1 maintainer
es6-crawler-detect 3.3.0 💰
This is an ES6 adaptation of the original PHP library CrawlerDetect, this library will help you d...15 versions - Latest release: over 2 years ago - 3 dependent packages - 8 dependent repositories - 37.1 thousand downloads last month - 88 stars on GitHub - 1 maintainer
doc-dl
doc downloader12 versions - 588 downloads last month - 1 maintainer
f2e-spider 0.1.0
spider1 version - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 4 downloads last month - 0 stars on GitHub - 1 maintainer
spider-channels 0.0.2
Channels Library for Spider3 versions - Latest release: over 9 years ago - 1 dependent repositories - 9 downloads last month - 8 stars on GitHub - 1 maintainer
@glossa/c12n-fin-tush 0.2.8
A crawler29 versions - Latest release: about 3 years ago - 2 dependent packages - 1 dependent repositories - 12 downloads last month - 0 stars on GitHub - 1 maintainer
dom-collector 1.0.8
A simple DOM crawler based on JSON scheme.9 versions - Latest release: over 7 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 0 stars on GitHub - 1 maintainer
@glossa/fin-insight 0.2.8
A crawler30 versions - Latest release: about 3 years ago - 1 dependent package - 32 downloads last month - 0 stars on GitHub - 1 maintainer
interrobot-plugin 0.9.0
Used in the creation of plugins (aka reports) that present data or visualizations for a website i...4 versions - Latest release: 2 months ago - 7 downloads last month - 0 stars on GitHub - 1 maintainer
@someok/comic-spider 1.10.0
Comic Spider17 versions - Latest release: about 3 years ago - 1 dependent package - 1 dependent repositories - 9 downloads last month - 1 stars on GitHub - 1 maintainer
black-spider 0.0.1
A crawler framework, just my experience.1 version - Latest release: over 5 years ago - 1 dependent package - 1 dependent repositories - 4 downloads last month - 0 stars on GitHub - 1 maintainer
easyspider 1.0.0
mini spider.6 versions - Latest release: almost 9 years ago - 1 dependent package - 2 dependent repositories - 13 downloads last month - 1 stars on GitHub - 1 maintainer
nspider22 1.0.11
a node spider framework12 versions - Latest release: over 5 years ago - 1 dependent package - 1 dependent repositories - 18 downloads last month - 5 stars on GitHub - 1 maintainer
qd-data 1.0.7
crawling data from website by nodejs8 versions - Latest release: about 7 years ago - 1 dependent package - 1 dependent repositories - 24 downloads last month - 0 stars on GitHub - 1 maintainer
@noscrape/noscrape 2.1.1 💰
protect your content from scraping23 versions - Latest release: 4 months ago - 1 dependent package - 1 dependent repositories - 157 downloads last month - 40 stars on GitHub - 1 maintainer
easy_web_crawler 1.0.6
Web crawler wrapper around puppeteer module to simply the crawling on ajax/java script enabled pa...7 versions - Latest release: over 5 years ago - 1 dependent package - 5 downloads last month - 3 stars on GitHub - 1 maintainer
@ladybug-tools/spider-core 1.0.0
A lightweight module containing the core data parsing and rendering functions of Spider2 versions - Latest release: about 5 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 2 maintainers
goods-spider 1.0.2
抓取电商网站的商品信息，暂时只支持淘宝、天猫3 versions - Latest release: about 8 years ago - 1 dependent package - 1 dependent repositories - 11 downloads last month - 1 maintainer
@ksky521/html-picker 1.0.0
html picker1 version - Latest release: over 3 years ago - 1 dependent package - 5 downloads last month - 1 maintainer
crawler2 0.0.2
Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server ...2 versions - Latest release: over 9 years ago - 1 dependent package - 1 dependent repositories - 9 downloads last month - 6,629 stars on GitHub - 1 maintainer
phantom-crawler 1.0.2
Lightweight crawler that works like a real browser3 versions - Latest release: over 8 years ago - 1 dependent package - 1 dependent repositories - 8 downloads last month - 2 stars on GitHub - 1 maintainer
node-web-crawler 0.0.6
Node Web Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on th...6 versions - Latest release: over 8 years ago - 2 dependent packages - 1 dependent repositories - 24 downloads last month - 1 maintainer
hatcher 0.2.1
Provides APIs by simple configuration.3 versions - Latest release: about 4 years ago - 2 dependent packages - 1 dependent repositories - 11 downloads last month - 0 stars on GitHub - 1 maintainer
goodspider 1.2.1
搜索工具10 versions - Latest release: over 5 years ago - 1 dependent package - 1 dependent repositories - 15 downloads last month - 1 maintainer
inka.js 1.0.0
Reactive, configurable web crawler1 version - Latest release: almost 9 years ago - 1 dependent package - 1 dependent repositories - 4 downloads last month - 2 stars on GitHub - 1 maintainer
github-trending-crawler 1.0.1
transform github-trending repos to json data2 versions - Latest release: over 6 years ago - 2 dependent packages - 1 dependent repositories - 7 downloads last month - 1 stars on GitHub - 1 maintainer
@spider-cloud/spider-client 0.0.21
A Javascript SDK for Spider Cloud services18 versions - Latest release: 19 days ago - 4.03 thousand downloads last month - 1 maintainer
puppeteer-spider-framework 1.0.1
基于puppeteer爬虫框架，增加本地缓存功能1 version - Latest release: over 3 years ago - 1 dependent package - 7 downloads last month - 1 stars on GitHub - 1 maintainer
declarative-scraper 0.1.1
Simple & Human-Friendly HTML Scraper with Json-ld support4 versions - Latest release: over 2 years ago - 1 dependent package - 11 downloads last month - 19 stars on GitHub - 1 maintainer
enispider 1.2.5
A Node.js scraping framework built on puppeteer (to use a headless Chrome/Chromium browser)12 versions - Latest release: over 1 year ago - 1 dependent package - 39 downloads last month - 1 maintainer
spider-event 0.0.2
A simple evented web scraping framework using node.js1 version - Latest release: about 10 years ago - 1 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
nodejs-scrapy 0.0.2
基于nodejs平台下使用的Scrapy模型框架组件2 versions - Latest release: over 4 years ago - 1 dependent package - 1 dependent repositories - 8 downloads last month - 0 stars on GitHub - 1 maintainer
Related Keywords
crawler
298
scraper
121
nodejs
81
scraping
66
crawling
64
web
57
javascript
57
crawl
51
puppeteer
33
node
31
dom
29
jquery
29
typescript
28
cheerio
28
scrape
28
parser
26
html
23
bot
21
api
19
cli
19
framework
16
web-crawler
15
phantomjs
15
headless-chrome
14
headless
14
request
14
robot
14
scrapy
14
queue
13
data
13
browser
13
url
13
json
13
fetch
12
indexer
12
web-scraping
12
extract
11
react
11
cache
11
simplecrawler
11
chrome
11
chromium
11
distributed-systems
10
website
10
simple
10
dropship
9
dropshipping
9
scrapper
9
aliexpress
9
page
9
middleware
9
web crawler
9
eventemitter
9
proxy
8
extractor
8
comic
7
search
7
serverless
7
extensions
7
npm
7
webcrawler
7
web spider
7
product-json
7
product-scraper
7
site
7
aliexpress-scraper
7
library
7
aliexpress-api
7
distributed
7
aliexpress-crawler
7
aliexpress-spider
7
爬虫
7
syntax
6
download
6
cdk
6
awscdk
6
aws-cdk
6
cloudformation
6
grab
6
cfn
6
constructs
6
cfn-resources
6
cloudformation-registry
6
l1
6
freyraim
6
web scraper
6
module
6
porn
6
http
6
parsing
6
aliexpress-product-scraper
5
links
5
aliexpress-product-json
5
captcha
5
react-component
5
data extraction
5
recaptcha
5
node-crawler
5
aliexpress-dropshipping
5
promise
5