Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
npmjs.org : spiderhunt
Very straightforward web crawler. Uses EventEmitter. Based on Simplecrawler but using a distributed queue system.
Registry
-
Source
- JSON
purl: pkg:npm/spiderhunt
Keywords: simple, crawler, spider, cache, queue, simplecrawler, eventemitter, spiderhunt, distributed, redis, rabbitmq, rabbit, scalable
License: BSD-2-Clause
Latest release: almost 8 years ago
First release: almost 8 years ago
Dependent repositories: 1
Downloads: 11 last month
Stars: 5 on GitHub
Forks: 1 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 21 days ago