Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

npmjs.org "crawler" keyword

Top 7.4% on npmjs.org
apifier 0.0.53
Legacy Apifier runtime for JavaScript
52 versions - Latest release: almost 7 years ago - 3 dependent packages - 1 dependent repositories - 61 downloads last month - 11,973 stars on GitHub - 10 maintainers
@zigtech/scrapper 0.0.7
Headless scrapper developed to run in serverfull and serverless infra.
7 versions - Latest release: almost 4 years ago - 1 dependent package - 4 downloads last month - 1 stars on GitHub - 1 maintainer
mangadownload 1.0.9
Crawler to download manga from submanga.com and other sites in the future
10 versions - Latest release: over 8 years ago - 2 dependent packages - 1 dependent repositories - 5 downloads last month - 0 stars on GitHub - 1 maintainer
grunt-cookielist 0.1.0
A grunt crawler to list all cookies on urls using phantomjs
1 version - Latest release: over 9 years ago - 2 dependent packages - 1 dependent repositories - 4 downloads last month - 0 stars on GitHub - 1 maintainer
scrape-them-all 2.0.0
🚀 An easy-to-handle Node.js scraper that allow you to scrape them all in a record time.
4 versions - Latest release: over 3 years ago - 1 dependent repositories - 14 downloads last month - 10 stars on GitHub - 1 maintainer
js-website-crawler 1.0.6 💰
Website crawler written in JavaScript built with Node.js.
4 versions - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
spider-stealth-core 1.3.4
A Node.js scraping framework built on puppeteer-extra (to use a headless Chrome/Chromium browser)...
13 versions - Latest release: almost 2 years ago - 21 downloads last month - 1 maintainer
jquery-simpleticker 1.0.0
Simple news ticker based on Scott Alguire jQuery grouploop plugins
1 version - Latest release: 8 months ago - 5 downloads last month - 0 stars on GitHub - 1 maintainer
simple-headless-chrome-asksuite 4.3.13
Headless Chrome abstraction to simplify the interaction with the browser. It may be used for craw...
4 versions - Latest release: about 6 years ago - 1 dependent package - 1 dependent repositories - 21 downloads last month - 0 stars on GitHub - 2 maintainers
netlify-plugin-chatbees 0.5.7
Netlify Build plugin that adds a personalized AI assistant to your website
8 versions - Latest release: 4 months ago - 50 downloads last month - 5 stars on GitHub - 1 maintainer
img-crawler 0.0.2
A module to download images from a given URL
2 versions - Latest release: over 11 years ago - 1 dependent package - 4 dependent repositories - 5 downloads last month - 10 stars on GitHub - 1 maintainer
noscrape
obfuscate your content
3 versions - 48 downloads last month - 0 stars on GitHub - 1 maintainer
noderogue-game 1.0.3
Roguelike dungeon crawler for terminals
3 versions - Latest release: about 3 years ago - 1 dependent package - 5 downloads last month - 0 stars on GitHub - 1 maintainer
centipede 0.0.2
small crawler
2 versions - Latest release: over 8 years ago - 1 dependent package - 1 dependent repositories - 5 downloads last month - 0 stars on GitHub - 2 maintainers
Top 8.8% on npmjs.org
floodesh 0.8.19
Floodesh is a distributed web spider/crawler written with Nodejs.
78 versions - Latest release: about 4 years ago - 2 dependent packages - 1 dependent repositories - 13 downloads last month - 13 stars on GitHub - 1 maintainer
@acq/bool 0.2.2
A util tool
4 versions - Latest release: about 4 years ago - 3 dependent packages - 8 downloads last month - 0 stars on GitHub - 1 maintainer
@mendable/firecrawl-js 0.0.21
JavaScript SDK for Firecrawl API
28 versions - Latest release: 24 days ago - 8.99 thousand downloads last month - 4,092 stars on GitHub - 3 maintainers
Top 2.1% on npmjs.org
npm-license-crawler 0.2.1
Analyzes license information for multiple node.js modules (package.json files) as part of your so...
16 versions - Latest release: about 5 years ago - 41 dependent packages - 125 dependent repositories - 87.6 thousand downloads last month - 230 stars on GitHub - 1 maintainer
phantom-crawl 0.0.3
Web crawler for ajax applications
2 versions - Latest release: almost 11 years ago - 1 dependent package - 1 dependent repositories - 10 downloads last month - 38 stars on GitHub - 1 maintainer
syphonx 1.2.66
SyphonX is a tool that extracts data from HTML data, transforming it into JSON of any shape or si...
32 versions - Latest release: 3 months ago - 32 downloads last month - 1 stars on GitHub - 1 maintainer
@hlustikp/license-exporter 0.2.3
A simple license crawler for crediting open source work
5 versions - Latest release: 9 months ago - 67 downloads last month - 0 stars on GitHub - 1 maintainer
@figma-api/community 0.0.7
Figma Community API
8 versions - Latest release: 12 months ago - 1 dependent repositories - 8 downloads last month - 9 stars on GitHub - 1 maintainer
amibot 2.0.0 💰
Am I bot or not?
2 versions - Latest release: over 3 years ago - 2 dependent packages - 1 dependent repositories - 101 downloads last month - 10 stars on GitHub - 2 maintainers
Top 8.8% on npmjs.org
crawler-ninja 0.2.7
A web crawler made for the SEO based on plugins. Please wait or contribute ... still in beta
28 versions - Latest release: about 8 years ago - 4 dependent packages - 1 dependent repositories - 59 downloads last month - 1 maintainer
@beermonster/hltv 3.5.12
The unofficial HLTV Node.js API
12 versions - Latest release: 4 months ago - 37 downloads last month - 0 stars on GitHub - 1 maintainer
alexandria 0.1.7
A storage interface to store crawled content in Elasticsearch
8 versions - Latest release: almost 10 years ago - 2 dependent packages - 3 dependent repositories - 9 downloads last month - 2 maintainers
unsplash-crawl 0.0.2
Crawl all images from unsplash
2 versions - Latest release: over 9 years ago - 2 dependent repositories - 6 downloads last month - 4 stars on GitHub - 1 maintainer
@binochoi/aliexpress-scraper 1.0.9
fork of https://github.com/sudheer-ranga/aliexpress-product-scraper
4 versions - Latest release: about 1 year ago - 28 downloads last month - 1 maintainer
webster 1.9.0 💰
a reliable web crawling & scraping framework for Node.js.
42 versions - Latest release: 7 months ago - 1 dependent repositories - 49 downloads last month - 505 stars on GitHub - 1 maintainer
dm-web-start 1.8.6 💰
a reliable web crawling & scraping framework for Node.js.
1 version - Latest release: almost 2 years ago - 1 dependent package - 5 downloads last month - 505 stars on GitHub - 1 maintainer
scrape-linkedin 0.0.2
Scrape Linkedin profiles has never been so simple with nodejs :D !
2 versions - Latest release: over 7 years ago - 4 dependent repositories - 32 downloads last month - 19 stars on GitHub - 1 maintainer
scrapyteer 1.4.0
Web scraping/crawling framework built on top of headless Chrome
8 versions - Latest release: almost 1 year ago - 17 downloads last month - 18 stars on GitHub - 1 maintainer
Top 9.1% on npmjs.org
fiftyone.devicedetection.cloud 4.4.118
Device detection cloud services for the 51Degrees Pipeline API
140 versions - Latest release: 27 days ago - 2 dependent packages - 1 dependent repositories - 2.07 thousand downloads last month - 2 stars on GitHub - 3 maintainers
Top 9.0% on npmjs.org
fiftyone.devicedetection.onpremise 4.4.118
Device detection on-premise services for the 51Degrees Pipeline API
140 versions - Latest release: 27 days ago - 2 dependent packages - 1 dependent repositories - 2.7 thousand downloads last month - 2 stars on GitHub - 3 maintainers
fiftyone.devicedetection 4.4.118
Parse HTTP headers to detect the device type, model, operating system, browser, and crawler infor...
147 versions - Latest release: 27 days ago - 1 dependent package - 1 dependent repositories - 1.39 thousand downloads last month - 2 stars on GitHub - 3 maintainers
Top 8.1% on npmjs.org
fiftyone.devicedetection.shared 4.4.118
Shared functionality for implementing device detection engine for the 51Degrees Pipeline API
125 versions - Latest release: 27 days ago - 4 dependent packages - 1 dependent repositories - 2.82 thousand downloads last month - 2 stars on GitHub - 3 maintainers
hotfetch 2.1.9
Scrape pages and extract data in ease
11 versions - Latest release: about 2 years ago - 1 dependent package - 7 downloads last month - 1 stars on GitHub - 1 maintainer
grabby 0.2.2
Enhanced request library with some specific cases like win1251 encoding and encoding support.
11 versions - Latest release: over 8 years ago - 1 dependent package - 1 dependent repositories - 30 downloads last month - 1 stars on GitHub - 1 maintainer
@acq/enum-ret 0.2.2
A util tool
13 versions - Latest release: about 4 years ago - 3 dependent packages - 1 dependent repositories - 11 downloads last month - 0 stars on GitHub - 1 maintainer
Top 0.6% on npmjs.org
puppeteer-extra-plugin-stealth 2.11.2 💰
Stealth mode: Applies various techniques to make detection of headless puppeteer harder.
69 versions - Latest release: over 1 year ago - 500 dependent packages - 2,606 dependent repositories - 1.68 million downloads last month - 6,082 stars on GitHub - 1 maintainer
path-crawler 0.1.0
An utility to crawl generic objects paths
2 versions - Latest release: over 2 years ago - 2 dependent packages - 1 dependent repositories - 84 downloads last month - 7 stars on GitHub - 1 maintainer
facebook-keyword-crawler 1.0.5
Simple facebook posts crawler
5 versions - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 17 downloads last month - 2 stars on GitHub - 2 maintainers
robots-txt-component 0.0.4
Lightweight robots.txt parsing component without any external dependencies for Node.js.
3 versions - Latest release: over 1 year ago - 23 downloads last month - 0 stars on GitHub - 1 maintainer
gretel 0.0.7 💰
Follows and collects breadcrumbs accross the web
8 versions - Latest release: about 8 years ago - 2 dependent packages - 2 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
spiderman-crawler 0.2.3
Spiderman makes it trivial work to write a crawler. Just define some components, use segues to co...
10 versions - Latest release: almost 10 years ago - 1 dependent repositories - 15 downloads last month - 49 stars on GitHub - 1 maintainer
@toctive-com/hotfetch 2.1.9
Scrape pages and extract data in ease
5 versions - Latest release: about 2 years ago - 2 dependent packages - 4 downloads last month - 1 stars on GitHub - 1 maintainer
salmonjs 0.5.0 💰
Web Crawler in Node.js to spider dynamically whole websites.
5 versions - Latest release: about 10 years ago - 2 dependent repositories - 29 downloads last month - 35 stars on GitHub - 1 maintainer
mini-crawler 4.0.2
A really small crawler.
7 versions - Latest release: almost 4 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
dom-reducer 1.0.9
DOM crawler, executing given reducer recursively beginning with provided node.
9 versions - Latest release: almost 4 years ago - 1 dependent package - 1 dependent repositories - 24 downloads last month - 0 stars on GitHub - 1 maintainer
koa-detect-crawler 0.0.0
Handle http request from crawler (Something like Googlebot)
1 version - Latest release: about 10 years ago - 1 dependent package - 1 dependent repositories - 7 downloads last month - 1 maintainer
@silva95gustavo/crawlee-core 3.9.2-silva95gustavo-6
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of dat...
6 versions - Latest release: about 1 month ago - 128 downloads last month - 0 stars on GitHub - 1 maintainer
wintr 1.2.0
Wintr (wintr.com) unofficial API wrapper
3 versions - Latest release: over 2 years ago - 1 dependent package - 2 dependent repositories - 6 downloads last month - 0 stars on GitHub - 1 maintainer
@tradle/x-ray-crawler 2.1.0
x-ray's crawler
1 version - Latest release: over 2 years ago - 2 dependent packages - 1 dependent repositories - 4 downloads last month - 44 stars on GitHub - 5 maintainers
crawlerr 1.5.0 💰
A simple and fully customizable web crawler/spider for Node.js with server-side DOM. Comes with e...
10 versions - Latest release: over 5 years ago - 1 dependent package - 1 dependent repositories - 9 downloads last month - 25 stars on GitHub - 1 maintainer
xlspider 1.0.6
nodejs's web spider tools
7 versions - Latest release: about 2 years ago - 7 downloads last month - 1 maintainer
commodidolores 1.1.1
Web crawler for Node.js
5 versions - Latest release: 2 months ago - 7 downloads last month - 0 stars on GitHub - 1 maintainer
@hotbrainstech/crawler-extractor-sdk 0.0.1
Web data extraction can be effectively performed using CSS selectors.
1 version - Latest release: about 1 month ago - 48 downloads last month - 0 stars on GitHub - 1 maintainer
kz-crawler 1.2.3
kz webcrawler - install by running npm install kz-crawler
6 versions - Latest release: over 6 years ago - 2 dependent packages - 27 downloads last month - 0 stars on GitHub - 1 maintainer
extract-from-document 1.1.0
Simplify data extraction from document
2 versions - Latest release: over 4 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 0 stars on GitHub - 1 maintainer
scawler 0.0.1
A scraping crawler
1 version - Latest release: over 10 years ago - 1 dependent repositories - 9 downloads last month - 1 maintainer
microfrontier 1.0.2
A web crawler frontier implementation in TypeScript backed by Redis. MicroFrontier is a scalable ...
3 versions - Latest release: over 2 years ago - 2 dependent packages - 5 downloads last month - 7 stars on GitHub - 1 maintainer
@0y0/scraper-extensions 1.0.0
A @0y0/scraper expansion pack.
5 versions - Latest release: over 3 years ago - 2 dependent packages - 9 downloads last month - 1 stars on GitHub - 1 maintainer
site-to-rss 1.0.0
Site to Rss API module and examples
1 version - Latest release: almost 2 years ago - 1 dependent repositories - 22 downloads last month - 3 stars on GitHub - 1 maintainer
Top 8.6% on npmjs.org
node-site-downloader 1.3.0
An easy to use CLI for downloading websites for offline usage
12 versions - Latest release: almost 5 years ago - 2 dependent packages - 1 dependent repositories - 803 downloads last month - 8 stars on GitHub - 1 maintainer
insta-crawler 0.3.0
Crawl the content of any instagram public page with no token or login
3 versions - Latest release: about 4 years ago - 2 dependent packages - 1 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
website2pdf 0.0.16
Tool to export a website in PDFs based on its sitemap
15 versions - Latest release: 7 months ago - 1 dependent repositories - 87 downloads last month - 21 stars on GitHub - 1 maintainer
github_trending_node 0.0.1
nodejs modules used for fetching github trending data
1 version - Latest release: over 8 years ago - 2 dependent packages - 3 downloads last month - 0 stars on GitHub - 1 maintainer
get-set-fetch-extension-admin 0.4.1
React based frontend communicating with the backend (extension background script) via chrome.runt...
7 versions - Latest release: over 3 years ago - 2 dependent packages - 1 dependent repositories - 10 downloads last month - 60 stars on GitHub - 1 maintainer
get-set-fetch-scenario-scrape-static-content 0.4.1
extracts text and binary content from static html pages based on CSS selectors
3 versions - Latest release: over 3 years ago - 2 dependent packages - 1 dependent repositories - 7 downloads last month - 60 stars on GitHub - 1 maintainer
get-set-fetch-scenario-extract-html-content 0.1.1
Extract Html Content scenario is used for extracting html nodes text based on dom selectors.
3 versions - Latest release: almost 5 years ago - 2 dependent packages - 1 dependent repositories - 8 downloads last month - 60 stars on GitHub - 1 maintainer
get-set-fetch-extension-test-utils 0.4.1
web scraping extension
5 versions - Latest release: over 3 years ago - 3 dependent packages - 3 dependent repositories - 9 downloads last month - 60 stars on GitHub - 1 maintainer
get-set-fetch-scenario-extract-resources 0.4.1
Extract Resources scenario is used for extracting various resources from the corresponding sites.
7 versions - Latest release: over 3 years ago - 2 dependent packages - 1 dependent repositories - 9 downloads last month - 60 stars on GitHub - 1 maintainer
get-set-fetch-extension-background 0.4.1
Handles the crawling and scraping logic.
7 versions - Latest release: over 3 years ago - 2 dependent packages - 1 dependent repositories - 13 downloads last month - 60 stars on GitHub - 1 maintainer
get-set-fetch-scenario-scrape-dynamic-content 0.4.1
extracts text and binary content from dynamic (javascript) pages based on CSS selectors
3 versions - Latest release: over 3 years ago - 2 dependent packages - 1 dependent repositories - 6 downloads last month - 60 stars on GitHub - 1 maintainer
get-set-fetch-extension-popup 0.3.0
Responsible for handling toolbar integration. Opens the admin front-end into a new tab.
6 versions - Latest release: almost 4 years ago - 2 dependent packages - 1 dependent repositories - 9 downloads last month - 58 stars on GitHub - 1 maintainer
reqscraper 0.1.2
Lightweight wrapper for Request and X-Ray JS.
6 versions - Latest release: over 8 years ago - 3 dependent packages - 3 dependent repositories - 6 downloads last month - 4 stars on GitHub - 1 maintainer
get-set-fetch-extension-commons 0.4.1
Contains common typescript definitions and utilities used throughout the lerna monorepo.
7 versions - Latest release: over 3 years ago - 12 dependent packages - 3 dependent repositories - 8 downloads last month - 60 stars on GitHub - 1 maintainer
congregator-sitescraper 1.0.1
Site scraper for Congregator
2 versions - Latest release: almost 10 years ago - 1 dependent package - 2 dependent repositories - 16 downloads last month - 10 stars on GitHub - 1 maintainer
noscrape-node unpublished
## Installation
1 version - 15 downloads last month - 0 stars on GitHub - 1 maintainer
drawlr 0.3.1
A high-performance automatic crawler library
4 versions - Latest release: over 7 years ago - 1 dependent package - 1 dependent repositories - 5 downloads last month - 3 stars on GitHub - 1 maintainer
hltv-rh 1.0.8
The unofficial HLTV Node.js API
9 versions - Latest release: about 6 years ago - 1 dependent package - 1 dependent repositories - 7 downloads last month - 0 stars on GitHub - 1 maintainer
slyrics 1.0.22
Scrape Lyrics without API Key
14 versions - Latest release: about 1 year ago - 3 dependent repositories - 19 downloads last month - 5 stars on GitHub - 1 maintainer
aliexscrape 1.0.11
Get Aliexpress product details in JSON
12 versions - Latest release: over 5 years ago - 2 dependent packages - 3 dependent repositories - 34 downloads last month - 98 stars on GitHub - 1 maintainer
@rsodre/crawler-data 0.0.7
Endless Crawler Cached Data
6 versions - Latest release: 12 months ago - 10 downloads last month - 0 stars on GitHub - 1 maintainer
arcgismapserver2postgis 1.0.3
该库可将arcgis mapserver上发布的矢量服务,获取矢量数据存储到postgis库
4 versions - Latest release: almost 3 years ago - 2 dependent packages - 7 downloads last month - 1 maintainer
zy-crawler 1.0.5
zy-crawler是一个基于Node.js的简单易用的爬虫工具
6 versions - Latest release: about 1 year ago - 12 downloads last month - 1 maintainer
Top 1.7% on npmjs.org
sqreen 2.0.2
Node.js agent for Sqreen, please see https://www.sqreen.io/
205 versions - Latest release: over 1 year ago - 12 dependent packages - 55 dependent repositories - 10.7 thousand downloads last month - 1 maintainer
Top 1.3% on npmjs.org
fdir 6.1.1 💰
The fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m f...
35 versions - Latest release: 7 months ago - 116 dependent packages - 5,433 dependent repositories - 2.67 million downloads last month - 1,262 stars on GitHub - 1 maintainer
@acq/rand 0.2.2
A util tool
10 versions - Latest release: about 4 years ago - 2 dependent packages - 8 downloads last month - 0 stars on GitHub - 1 maintainer
quick-scraper 1.7.0
An easy, lightweight scraper for humans with many inbuilt features..
10 versions - Latest release: over 2 years ago - 2 dependent packages - 1 dependent repositories - 9 downloads last month - 3 stars on GitHub - 1 maintainer
Top 6.8% on npmjs.org
ng-meta 1.0.3
Meta tags support for AngularJS single page applications (SPA)
15 versions - Latest release: about 6 years ago - 1 dependent package - 17 dependent repositories - 18.8 thousand downloads last month - 153 stars on GitHub - 1 maintainer
Top 4.8% on npmjs.org
isbot-fast 1.2.0
JavaScript module detecting bots/crawlers/spiders via user-agent
4 versions - Latest release: over 4 years ago - 13 dependent packages - 17 dependent repositories - 38.4 thousand downloads last month - 11 stars on GitHub - 1 maintainer
Top 5.1% on npmjs.org
get-site-urls 3.0.0
Crawl a URL to generate a sitemap and find 404 errors with one command
17 versions - Latest release: almost 2 years ago - 4 dependent packages - 14 dependent repositories - 908 downloads last month - 25 stars on GitHub - 1 maintainer
crawlab-sdk 0.3.3
Node.js SDK for Crawlab
20 versions - Latest release: almost 4 years ago - 1 dependent package - 1 dependent repositories - 191 downloads last month - 52 stars on GitHub - 1 maintainer
bauer-cli 0.2.5
Command-line interface for bauer-crawler.
13 versions - Latest release: over 8 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
slinky 0.0.1
web crawler just for links
1 version - Latest release: almost 10 years ago - 1 dependent package - 1 dependent repositories - 7 downloads last month - 11 stars on GitHub - 1 maintainer
epic-link-crawler 1.0.23
A simple in depth links crawler. You can easily collect all the links available on a website.
23 versions - Latest release: almost 4 years ago - 2 dependent packages - 1 dependent repositories - 13 downloads last month - 0 stars on GitHub - 1 maintainer
crawlercore 1.5.51
crawler with nodejs
34 versions - Latest release: over 6 years ago - 2 dependent packages - 1 dependent repositories - 10 downloads last month - 1 stars on GitHub - 1 maintainer
hcrawler 0.0.5
a hierachical web crawler with concurrency control and server-side jQuery support
4 versions - Latest release: almost 11 years ago - 2 dependent packages - 1 dependent repositories - 8 downloads last month - 1 stars on GitHub - 1 maintainer
openwebspider 0.3.0
Open Source Web Crawler
1 version - Latest release: about 7 years ago - 1 dependent package - 1 dependent repositories - 3 downloads last month - 50 stars on GitHub - 1 maintainer