Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
rubygems.org : spidercrawl
With the help of Nokogiri, SpiderCrawl will parse each page and return you its title, links, css, words, and many many more! You can also customize what you want to do before & after each fetch request.
Registry
-
Source
- Homepage
- Documentation
- JSON
purl: pkg:gem/spidercrawl
Keywords: crawler, rubygems
License: MIT
Latest release: over 8 years ago
First release: over 8 years ago
Dependent packages: 1
Dependent repositories: 1
Downloads: 2,711 total
Stars: 0 on GitHub
Forks: 0 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 13 days ago