crates.io "web-crawler" keyword
View the packages on the crates.io package registry that are tagged with the "web-crawler" keyword.
spider-client 0.1.69
Spider Cloud client64 versions - Latest release: 6 days ago - 29.4 thousand downloads total - 18 stars on GitHub - 1 maintainer
spider_utils 2.37.136
Utilities to use for Spider Web Crawler.834 versions - Latest release: 4 days ago - 644 thousand downloads total - 842 stars on GitHub - 1 maintainer
maman 0.13.1
Rust Web Crawler16 versions - Latest release: over 6 years ago - 25.7 thousand downloads total - 44 stars on GitHub - 1 maintainer
capp 0.4.3
Common things i use to build Rust CLI tools for web crawlers.9 versions - Latest release: 9 months ago - 9.31 thousand downloads total - 1 stars on GitHub - 1 maintainer
spider-cloud-cli 0.1.68
The Spider Cloud CLI for web crawling and scraping48 versions - Latest release: 7 days ago - 15.4 thousand downloads total - 1 maintainer
firecrawl 1.2.0
Rust SDK for Firecrawl API.4 versions - Latest release: about 2 months ago - 4.14 thousand downloads total - 43,082 stars on GitHub - 2 maintainers
firecrawl_rs 0.1.1
Rust SDK for Firecrawl API.2 versions - Latest release: about 1 year ago - 2.03 thousand downloads total - 43,082 stars on GitHub - 2 maintainers
waxy 0.2.0
web crawler for community driven search engine7 versions - Latest release: about 3 years ago - 7.41 thousand downloads total - 2 stars on GitHub - 1 maintainer
tarzi 0.0.15
Rust-native lite search for AI applications10 versions - Latest release: 14 days ago - 1.68 thousand downloads total - 2 stars on GitHub - 1 maintainer
dyer-macros 0.2.0
Dyer-macros is a collection of macros when compiling and building dyer.2 versions - Latest release: over 3 years ago - 1 dependent package - 1 dependent repositories - 144 thousand downloads total - 126 stars on GitHub - 1 maintainer
wrake 0.3.0
Collect links from the given URL4 versions - Latest release: over 3 years ago - 4.32 thousand downloads total - 0 stars on GitHub - 1 maintainer
dyer 3.3.2
dyer is designed for reliable, flexible and fast Request-Response based service, including data ...19 versions - Latest release: almost 3 years ago - 1 dependent package - 1.37 million downloads total - 126 stars on GitHub - 1 maintainer
frangipani 0.3.1 💰
Scraping framework for rust4 versions - Latest release: over 2 years ago - 4.48 thousand downloads total - 3 stars on GitHub - 1 maintainer
seaward 1.1.0
seaward is a grep-like tool for the web.5 versions - Latest release: about 2 months ago - 4.89 thousand downloads total - 3 stars on GitHub - 1 maintainer
siteprobe 0.5.2
Siteprobe is a Rust-based CLI tool that fetches all URLs from a given `sitemap.xml` url, checks t...7 versions - Latest release: about 2 months ago - 2.33 thousand downloads total - 0 stars on GitHub - 1 maintainer
crusty-core 0.82.0
Library for creating blazing fast and configurable web crawlers87 versions - Latest release: over 3 years ago - 1 dependent package - 1 dependent repositories - 94.6 thousand downloads total - 16 stars on GitHub - 1 maintainer
website_crawler 0.9.9 💰
gRPC tokio based web crawler built with spider203 versions - Latest release: 11 months ago - 168 thousand downloads total - 53 stars on GitHub - 1 maintainer
Related Keywords
crawler
13
spider
8
scraper
6
web-scraping
5
ai
4
ai-scraping
4
rust
4
scraping
4
html-to-markdown
3
web-indexer
3
rag
3
web-framework
2
rust-programming-language
2
webscraping
2
markdown
2
llm
2
data
2
async
2
web
2
web-scraper
2
grpc
1
a11ywatch
1
site-map-generator
1
tokio
1
multi-threaded
1
http-monitoring
1
url-checker
1
sitemap
1
performance
1
rustcrawler
1
cli
1
continuous-crawler
1
request-response
1
web-crawling
1
data-processing
1
ai-agents
1
dyer-cli
1
dyer
1
search
1
llm-webcrawler
1
supabase
1
headless-chrome
1
indexer
1
llm-crawler
1
executor
1
http
1