crates.io : website_crawler
gRPC tokio based web crawler built with spider
Registry
-
Source
- Documentation
- JSON
purl: pkg:cargo/website_crawler
Keywords:
crawler
, site-map-generator
, spider
, web-crawler
, web-indexer
, a11ywatch
, grpc
, scraper
License: MIT
Latest release: 11 months ago
First release: over 4 years ago
Downloads: 168,335 total
Stars: 53 on GitHub
Forks: 2 on GitHub
Total Commits: 242
Committers: 2
Average commits per author: 121.0
Development Distribution Score (DDS): 0.091
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Funding links: https://github.com/sponsors/a11ywatch
Last synced: 5 months ago