Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
Top 4.4% downloads on rubygems.org
Top 4.0% dependent packages on rubygems.org
Top 6.6% dependent repos on rubygems.org
Top 4.0% forks on rubygems.org
rubygems.org : cobweb
Cobweb is a web crawler that can use resque to cluster crawls to quickly crawl extremely large sites which is much more performant than multi-threaded crawlers. It is also a standalone crawler that has a sophisticated statistics monitoring interface to monitor the progress of the crawls.
Registry
-
Source
- Homepage
- Documentation
- JSON
purl: pkg:gem/cobweb
License: MIT
Latest release: over 3 years ago
First release: over 13 years ago
Dependent packages: 3
Dependent repositories: 12
Downloads: 325,101 total
Stars: 228 on GitHub
Forks: 45 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 7 days ago