Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
crates.io "spider" keyword
dyer-cli 0.6.0
dyer-cli is a great tool created to guide you use dyer fast and at ease, helps you build a robust...9 versions - Latest release: almost 2 years ago - 119 thousand downloads total - 2 stars on GitHub - 1 maintainer
dyer 3.3.2
dyer is designed for reliable, flexible and fast Request-Response based service, including data ...19 versions - Latest release: almost 2 years ago - 1 dependent package - 1.3 million downloads total - 134 stars on GitHub - 1 maintainer
spider_cli 1.94.5
The fastest web crawler CLI written in Rust.586 versions - Latest release: about 9 hours ago - 159 thousand downloads total - 406 stars on GitHub - 1 maintainer
crusty-core 0.82.0
Library for creating blazing fast and configurable web crawlers87 versions - Latest release: over 2 years ago - 1 dependent package - 1 dependent repositories - 29.9 thousand downloads total - 14 stars on GitHub - 1 maintainer
spider 1.94.4
The fastest web crawler written in Rust.613 versions - Latest release: 3 days ago - 6 dependent packages - 1 dependent repositories - 192 thousand downloads total - 406 stars on GitHub - 2 maintainers
texting_robots 0.2.2
Texting Robots: A Rust native `robots.txt` parser with thorough unit testing.4 versions - Latest release: about 1 year ago - 6 dependent packages - 2 dependent repositories - 35.1 thousand downloads total - 22 stars on GitHub - 1 maintainer
browse 0.1.1
fast crawling framework2 versions - Latest release: 4 months ago - 382 downloads total - 0 stars on GitHub - 1 maintainer
maman 0.13.1
Rust Web Crawler16 versions - Latest release: over 5 years ago - 12.7 thousand downloads total - 43 stars on GitHub - 1 maintainer
recursive_scraper 0.6.2
Constant-frequency recursive CLI web scraper with frequency, filtering, file directory, and many ...9 versions - Latest release: about 1 year ago - 2.48 thousand downloads total - 4 stars on GitHub - 1 maintainer
bcdown 0.2.2
Bilibili漫画下载器，written in Rust，支持epub pdf zip格式11 versions - Latest release: almost 2 years ago - 3.48 thousand downloads total - 184 stars on GitHub - 1 maintainer
Top 6.8% on crates.io
10 versions - Latest release: about 3 years ago - 14 dependent packages - 23 dependent repositories - 296 thousand downloads total - 121 stars on GitHub - 1 maintainer
nipper 0.1.9
HTML manipulation with CSS seletors10 versions - Latest release: about 3 years ago - 14 dependent packages - 23 dependent repositories - 296 thousand downloads total - 121 stars on GitHub - 1 maintainer
spider_worker 1.93.14
The fastest web crawler as a worker or proxy.388 versions - Latest release: 13 days ago - 104 thousand downloads total - 406 stars on GitHub - 1 maintainer
async_job 0.1.4
Simple async cron job crate for Rust5 versions - Latest release: 5 months ago - 1 dependent package - 3.35 thousand downloads total - 0 stars on GitHub - 1 maintainer
yuki 0.1.3
multithreaded web archiver4 versions - Latest release: about 1 year ago - 966 downloads total - 1 stars on GitHub - 1 maintainer
robotparser-fork 0.11.0 💰
robots.txt parser for Rust7 versions - Latest release: about 2 years ago - 2 dependent packages - 2 dependent repositories - 3.87 thousand downloads total - 17 stars on GitHub - 1 maintainer
robotparser 0.11.0 💰
robots.txt parser for Rust19 versions - Latest release: about 2 years ago - 3 dependent packages - 2 dependent repositories - 19.4 thousand downloads total - 17 stars on GitHub - 1 maintainer
website_crawler 0.9.6
gRPC tokio based web crawler200 versions - Latest release: 28 days ago - 53.6 thousand downloads total - 39 stars on GitHub - 1 maintainer
dyer-macros 0.2.0
Dyer-macros is a collection of macros when compiling and building dyer.2 versions - Latest release: over 2 years ago - 1 dependent package - 1 dependent repositories - 131 thousand downloads total - 134 stars on GitHub - 1 maintainer
crawl 0.2.1 removed
Rust crawl6 versions - Latest release: 4 months ago - 110 downloads total - 0 stars on GitHub - 1 maintainer
Related Keywords
crawler
16
rust
10
web-crawler
5
scraper
5
http
4
scraping
4
web-framework
3
robots
3
robot
3
parser
3
headless-chrome
3
indexer
3
robots-parser
2
web
2
async
2
spider_cli
2
web-scraping
2
rust-programming-language
2
data-processing
2
web-crawling
2
request-response
2
css-selectors
1
html5ever
1
nipper
1
selectors
1
async-jobs
1
async-task
1
cronjob
1
site-map-generator
1
web-indexer
1
a11ywatch
1
grpc
1
dyer-cli
1
dyer
1
crawl
1
css
1
html
1
selector
1
rust-lang
1
pdf
1
epub
1
bilibili-download
1
comic
1
bilibili
1
downloader
1
bcdown
1
recursive
1
tokio
1
multi-threaded
1