Top 7.4% on proxy.golang.org
Top 6.1% forks on proxy.golang.org
Top 6.1% forks on proxy.golang.org
proxy.golang.org : github.com/phayes/crawlbot
Crawlbot is a simple, efficient, and flexible webcrawler / spider. Crawlbot is easy to use out-of-the-box, but also provides extensive flexibility for advanced users. CrawlBot provides extensive customizability for advances use cases. Please see documentation on Crawler and Response for more details.
Registry
-
Source
- Documentation
- JSON
purl: pkg:golang/github.com/phayes/crawlbot
License: BSD-3-Clause
Latest release: over 10 years ago
First release: over 10 years ago
Namespace: github.com/phayes
Stars: 3 on GitHub
Forks: 2 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 22 days ago
Loading...
Readme
Loading...