proxy.golang.org : github.com/postmodern/spidr
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Registry
-
Source
- Documentation
- JSON
- codemeta.json
purl: pkg:golang/github.com/postmodern/spidr
Keywords:
crawler
, ruby
, scraper
, spider
, spider-links
, web
, web-crawler
, web-scraper
, web-scraping
, web-spider
License: MIT
Latest release: 10 months ago
First release: over 15 years ago
Stars: 826 on GitHub
Forks: 109 on GitHub
Total Commits: 868
Committers: 16
Average commits per author: 54.25
Development Distribution Score (DDS): 0.039
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Funding links: https://github.com/sponsors/postmodern
Last synced: 8 days ago