crates.io "scraping" keyword
firecrawl-local 0.1.0
Firecrawl Local: scrape, crawl and map on your own machine from one binary, with a hand-off to Fi...1 version - Latest release: 1 day ago - 0 downloads total - 198,844 stars on GitHub - 1 maintainer
firecrawl 2.21.8
Official Rust SDK for Firecrawl, the context API for AI agents: search, scrape, parse, crawl, map...41 versions - Latest release: 23 days ago - 19 thousand downloads total - 198,844 stars on GitHub - 2 maintainers
rama 0.4.0 💰
modular service framework25 versions - Latest release: 3 months ago - 145 thousand downloads total - 1,255 stars on GitHub - 1 maintainer
h2s 0.18.0
A declarative HTML parser, which works like a deserializer from HTML to struct9 versions - Latest release: over 3 years ago - 12.2 thousand downloads total - 6 stars on GitHub - 1 maintainer
website_crawler_sdk 1.0.0
The official Rust SDK for the Website Crawler API1 version - Latest release: 9 months ago - 24 downloads total - 75 stars on GitHub - 1 maintainer
piconbiere 0.3.1
Scrape and download media from Piccoma/ピッコマ9 versions - Latest release: almost 3 years ago - 10.9 thousand downloads total - 0 stars on GitHub - 1 maintainer
webscrapingapi 0.1.0
WebScrapingApi is an API that allows scraping websites while using rotating proxies to prevent ba...1 version - Latest release: over 4 years ago - 1.54 thousand downloads total - 0 stars on GitHub - 1 maintainer
fatsearch 0.2.4
Web pages and documents turned into small, clean, cached Markdown for AI agents9 versions - Latest release: 21 days ago - 109 downloads total - 51 stars on GitHub - 1 maintainer
get_user_agent 0.1.1
Get_User_Agent is an easy to use rust CLI program and library for extracting the latest user agen...2 versions - Latest release: over 4 years ago - 2.9 thousand downloads total - 5 stars on GitHub - 1 maintainer
mission 0.1.2
Robust HTML parser and CSS selector engine. Won't crash on bad HTML.3 versions - Latest release: over 4 years ago - 0 downloads total - 4 stars on GitHub - 1 maintainer
apify-client 0.17.0
Rust client for the Apify API (https://apify.com).14 versions - Latest release: 1 day ago - 1 dependent package - 1 dependent repositories - 5.54 thousand downloads total - 4 stars on GitHub - 2 maintainers
urls2disk 0.1.1
Http client to download urls to disk concurrently, optionally converting them to PDF2 versions - Latest release: over 8 years ago - 3.55 thousand downloads total - 25 stars on GitHub - 1 maintainer
torchbear 0.11.5
Lua programming environment in Rust28 versions - Latest release: almost 8 years ago - 39 thousand downloads total - 147 stars on GitHub - 1 maintainer
Top 2.6% on crates.io
38 versions - Latest release: 6 months ago - 441 dependent packages - 1,043 dependent repositories - 23.1 million downloads total - 2,431 stars on GitHub - 3 maintainers
scraper 0.27.0
HTML parsing and querying with CSS selectors38 versions - Latest release: 6 months ago - 441 dependent packages - 1,043 dependent repositories - 23.1 million downloads total - 2,431 stars on GitHub - 3 maintainers
scrapmf 1.5.13
Safe, interactive archiver for social media galleries10 versions - Latest release: 2 days ago - 48 downloads total - 0 stars on GitHub - 1 maintainer
nos 0.1.11
HTML manipulation with CSS seletors2 versions - Latest release: over 5 years ago - 3.2 thousand downloads total - 0 stars on GitHub - 1 maintainer
nipper-trunk 0.1.9 💰
HTML manipulation with CSS seletors1 version - Latest release: over 5 years ago - 1 dependent package - 1 dependent repositories - 7.16 thousand downloads total - 0 stars on GitHub - 1 maintainer
medina 0.0.1
An asynchronous web crawling engine12 versions - Latest release: over 6 years ago - 15.5 thousand downloads total - 1 maintainer
lookout 0.1.1
👀 Declarative, asynchronous scraper utility.2 versions - Latest release: over 5 years ago - 3.28 thousand downloads total - 1 stars on GitHub - 1 maintainer
fleece 0.4.0
Render-free live-document extraction into index and structured reader shapes.5 versions - Latest release: 3 months ago - 124 downloads total - 3 stars on GitHub - 1 maintainer
imdb 0.0.1
imdb is a library to retrieve information from IMDb1 version - Latest release: about 9 years ago - 1.94 thousand downloads total - 6 stars on GitHub - 1 maintainer
hyraigne 0.1.4
Web spiders to scrap various man{ga,hua;hwa}s websites5 versions - Latest release: over 5 years ago - 1 dependent package - 1 dependent repositories - 8.51 thousand downloads total - 2 stars on GitHub - 1 maintainer
html-extractor 1.0.0
A Rust crate for extracting data from HTML7 versions - Latest release: over 6 years ago - 4 dependent packages - 1 dependent repositories - 14.8 thousand downloads total - 6 stars on GitHub - 1 maintainer
git-spy 0.1.2
command-line tool to efficiently collect github repository3 versions - Latest release: over 6 years ago - 4.46 thousand downloads total - 3 stars on GitHub - 1 maintainer
gignore 0.2.2
A command line tool to generate gitignore template files4 versions - Latest release: about 5 years ago - 5.36 thousand downloads total - 3 stars on GitHub - 1 maintainer
easy-scraper 0.2.0
HTML scraping library focused on easy to use3 versions - Latest release: about 6 years ago - 5 dependent packages - 6 dependent repositories - 23.7 thousand downloads total - 203 stars on GitHub - 1 maintainer
aither-webfetch 0.26.0
Web content fetching and HTML-to-Markdown conversion30 versions - Latest release: 3 days ago - 1.24 thousand downloads total - 2 stars on GitHub - 1 maintainer
zendriver-mcp 0.16.43 💰
MCP server exposing zendriver-rs's stealth browser automation to MCP clients.95 versions - Latest release: 4 days ago - 2.05 thousand downloads total - 25 stars on GitHub - 1 maintainer
zendriver 0.5.31 💰
Async-first browser automation via the Chrome DevTools Protocol, with anti-detection controls on ...88 versions - Latest release: 4 days ago - 5.73 thousand downloads total - 25 stars on GitHub - 1 maintainer
zendriver-stealth 0.12.10 💰
Anti-detection patches and profiles for zendriver49 versions - Latest release: 4 days ago - 5.62 thousand downloads total - 25 stars on GitHub - 1 maintainer
zendriver-fingerprints 0.3.25 💰
Real-device persona sources (pool + generative) for zendriver-rs47 versions - Latest release: 4 days ago - 1.18 thousand downloads total - 25 stars on GitHub - 1 maintainer
vegapull 1.3.3 💰
Command line tool for scraping data for the One Piece Trading Card Game17 versions - Latest release: 4 days ago - 2.42 thousand downloads total - 42 stars on GitHub - 1 maintainer
cinema_feed 0.1.4
Scrape a cinema website and store the schedule into a DB, export it as RSS feed2 versions - Latest release: almost 8 years ago - 3.47 thousand downloads total - 3 stars on GitHub - 1 maintainer
trafilatura 0.6.0
Extract readable content, comments, and metadata from web pages8 versions - Latest release: 16 days ago - 65 thousand downloads total - 9 stars on GitHub - 1 maintainer
mov-cli-rs 1.0.1
A CLI tool for scraping and playing TV, movies and anime.2 versions - Latest release: over 2 years ago - 3.53 thousand downloads total - 13 stars on GitHub - 1 maintainer
bibe 0.1.4
CLI tool to download from various man{ga,hua;hwa}s websites5 versions - Latest release: over 5 years ago - 7.03 thousand downloads total - 2 stars on GitHub - 1 maintainer
proxy-llama 💰
a proxy framework using Tokio written purely in Rust1 version - Latest release: about 4 years ago - 1.26 thousand downloads total - 1,189 stars on GitHub - 1 maintainer
eggsearch-meta removed
Metasearch adapter with vendored search engines for eggsearch1 version - Latest release: 5 months ago - 0 downloads total - 1 maintainer
pf_lib removed
petit-filou core library25 versions - Latest release: almost 2 years ago - 16.4 thousand downloads total - 1 stars on GitHub - 1 maintainer
emon 0.2.0
PDFs and images to semantic HTML and a JSON model, for scraping and indexing: reading order, tabl...1 version - Latest release: 16 days ago - 10 downloads total - 0 stars on GitHub - 1 maintainer
telemaco-net 0.2.0
HTTP client, cookie jar, stealth transport and SSRF guard for the Telemaco headless browser.1 version - Latest release: 2 months ago - 132 downloads total - 4 stars on GitHub - 1 maintainer
telemaco-browser 0.2.0
Page navigation and JavaScript evaluation for the Telemaco headless browser.1 version - Latest release: 2 months ago - 99 downloads total - 4 stars on GitHub - 1 maintainer
telemaco-dom 0.2.0
DOM tree and CSS selector matching for the Telemaco headless browser engine.1 version - Latest release: 2 months ago - 156 downloads total - 4 stars on GitHub - 1 maintainer
telemaco 0.2.0
Embeddable Rust API for Telemaco, a headless browser engine with a real DOM, V8 and native layout.1 version - Latest release: 2 months ago - 14 downloads total - 4 stars on GitHub - 1 maintainer
telemaco-cli 0.2.0
Command line interface for Telemaco: fetch, CDP server, scraping and MCP.1 version - Latest release: 2 months ago - 12 downloads total - 4 stars on GitHub - 1 maintainer
scrapfly-sdk 0.6.0
Async Rust client for the Scrapfly web scraping, screenshot, extraction and crawler APIs8 versions - Latest release: 21 days ago - 171 downloads total - 2 stars on GitHub - 1 maintainer
docrawl 0.1.6 💰
Docs-focused crawler library and CLI: crawl documentation sites, extract main content, convert to...7 versions - Latest release: 8 months ago - 1.71 thousand downloads total - 50 stars on GitHub - 1 maintainer
zendriver-transport 0.3.1 💰
Internal: WebSocket + CDP routing actor for zendriver21 versions - Latest release: about 2 months ago - 5.53 thousand downloads total - 25 stars on GitHub - 1 maintainer
zendriver-imperva 0.3.6 💰
Imperva WAF / Incapsula bypass for zendriver26 versions - Latest release: about 2 months ago - 2.31 thousand downloads total - 25 stars on GitHub - 1 maintainer
zendriver-datadome 0.1.23 💰
DataDome anti-bot bypass for zendriver24 versions - Latest release: about 2 months ago - 2.31 thousand downloads total - 25 stars on GitHub - 1 maintainer
zendriver-cloudflare 0.2.17 💰
Cloudflare Turnstile bypass for zendriver23 versions - Latest release: about 2 months ago - 1.41 thousand downloads total - 25 stars on GitHub - 1 maintainer
zendriver-fetcher 0.2.1 💰
Chromium binary downloader for zendriver — Chrome for Testing, ungoogled-chromium and Chromium sn...18 versions - Latest release: 3 months ago - 2.29 thousand downloads total - 25 stars on GitHub - 1 maintainer
zendriver-interception 0.3.20 💰
Network interception (Fetch.* CDP domain) for zendriver26 versions - Latest release: about 2 months ago - 3.66 thousand downloads total - 25 stars on GitHub - 1 maintainer
rustai-core 0.3.0
Zero-cost local research pipeline: async search routing, TLS-fingerprint-aware fetching, SIMD DOM...2 versions - Latest release: 2 months ago - 24 downloads total - 1 stars on GitHub - 1 maintainer
Top 6.8% on crates.io
10 versions - Latest release: over 5 years ago - 14 dependent packages - 23 dependent repositories - 388 thousand downloads total - 125 stars on GitHub - 1 maintainer
nipper 0.1.9
HTML manipulation with CSS seletors10 versions - Latest release: over 5 years ago - 14 dependent packages - 23 dependent repositories - 388 thousand downloads total - 125 stars on GitHub - 1 maintainer
tail-fin-reddit 0.7.5
Reddit adapter for tail-fin: hot, frontpage, search, subreddit, thread, user profiles, upvote, sa...14 versions - Latest release: 7 months ago - 187 downloads total - 1 maintainer
turboscraper 0.1.1
A high-performance, concurrent web scraping framework for Rust with built-in support for retries,...2 versions - Latest release: over 1 year ago - 1.56 thousand downloads total - 2 stars on GitHub - 1 maintainer
scrape-core 0.2.14
High-performance HTML parsing library core22 versions - Latest release: 22 days ago - 22.8 thousand downloads total - 10 stars on GitHub - 1 maintainer
scrape-cli 0.2.14
Command-line HTML extraction tool powered by scrape-rs22 versions - Latest release: 22 days ago - 389 downloads total - 10 stars on GitHub - 1 maintainer
voyager 0.2.1
Web crawler and scraper4 versions - Latest release: almost 5 years ago - 1 dependent repositories - 13.9 thousand downloads total - 764 stars on GitHub - 1 maintainer
boilerstrip 0.4.2
Learn site boilerplate selectors from multiple pages and convert HTML to clean Markdown7 versions - Latest release: 5 months ago - 1.5 thousand downloads total - 0 stars on GitHub - 1 maintainer
scrape-le 2.6.0
Check whether a page is scrapeable before the scraper is written, and say when it cannot tell12 versions - Latest release: 16 days ago - 180 downloads total - 1 stars on GitHub - 1 maintainer
domq-cli 0.6.0
Query HTML from the command line with CSS selectors — get elements, attributes, readable text, Ma...3 versions - Latest release: 9 days ago - 34 downloads total - 9 stars on GitHub - 1 maintainer
domq-derive 0.6.0
#[derive(FromHtml)] for domq: declarative extraction of structs from HTML with CSS selectors. Use...3 versions - Latest release: 9 days ago - 41 downloads total - 9 stars on GitHub - 1 maintainer
spider_worker 2.53.9
The fastest web crawler as a worker or proxy.1,988 versions - Latest release: 2 months ago - 1.58 million downloads total - 2,820 stars on GitHub - 1 maintainer
spider_agent_html 2.53.9
HTML processing utilities for spider_agent — cleaning, content analysis, and diffing.400 versions - Latest release: 2 months ago - 22.8 thousand downloads total - 2,820 stars on GitHub - 1 maintainer
spider_utils 2.53.9
Utilities to use for Spider Web Crawler.1,479 versions - Latest release: 2 months ago - 820 thousand downloads total - 2,820 stars on GitHub - 1 maintainer
spider 2.53.9
A web crawler and scraper, building blocks for data curation workloads.2,227 versions - Latest release: 2 months ago - 6 dependent packages - 1 dependent repositories - 2.11 million downloads total - 2,820 stars on GitHub - 2 maintainers
http-global-cache 0.2.0
A global cache to use for http.6 versions - Latest release: 8 months ago - 34.4 thousand downloads total - 2,820 stars on GitHub - 1 maintainer
spider_mcp 2.53.9
MCP (Model Context Protocol) server exposing Spider web crawler capabilities as tools.270 versions - Latest release: 2 months ago - 4.61 thousand downloads total - 2,820 stars on GitHub - 1 maintainer
spider_cli 2.53.9
The fastest web crawler CLI written in Rust.2,153 versions - Latest release: 2 months ago - 1.82 million downloads total - 2,820 stars on GitHub - 1 maintainer
spider_agent 2.53.9
A concurrent-safe multimodal agent for web automation and research.448 versions - Latest release: 2 months ago - 22.7 thousand downloads total - 2,820 stars on GitHub - 1 maintainer
spider_agent_types 2.53.9
Pure data types and constants for spider_agent automation. Zero heavy dependencies.402 versions - Latest release: 2 months ago - 126 thousand downloads total - 2,820 stars on GitHub - 1 maintainer
rama-crypto 0.4.0 💰
All crypto logic used by rama6 versions - Latest release: 3 months ago - 78.2 thousand downloads total - 1,255 stars on GitHub - 1 maintainer
rama-unix 0.4.0 💰
Unix (Domain) socket support for rama7 versions - Latest release: 3 months ago - 3.61 million downloads total - 1,255 stars on GitHub - 1 maintainer
rama-macros 0.4.0 💰
procedural macross for rama24 versions - Latest release: 3 months ago - 4.01 million downloads total - 1,255 stars on GitHub - 1 maintainer
rama-ttrpc 0.4.0 💰
ttRPC (gRPC for low-memory environments) support for rama1 version - Latest release: 3 months ago - 408 downloads total - 1,255 stars on GitHub - 1 maintainer
rama-grpc-macros 0.4.0 💰
procedural macros for rama's grpc support2 versions - Latest release: 3 months ago - 16.6 thousand downloads total - 1,255 stars on GitHub - 1 maintainer
rama-cli 0.4.0 💰
rama cli to move and transform network packets20 versions - Latest release: 3 months ago - 9.53 thousand downloads total - 1,255 stars on GitHub - 1 maintainer
rama-tower 0.4.0 💰
tower support for rama11 versions - Latest release: 3 months ago - 104 thousand downloads total - 1,255 stars on GitHub - 1 maintainer
rama-core 0.4.0 💰
rama service core code, used by rama and service authors22 versions - Latest release: 3 months ago - 4 million downloads total - 1,248 stars on GitHub - 1 maintainer
rama-tls-boring 0.4.0 💰
tls implementations for rama using boring11 versions - Latest release: 3 months ago - 147 thousand downloads total - 1,255 stars on GitHub - 1 maintainer
rama-http-macros 0.4.0 💰
procedural macros for rama-http (html templating and friends)4 versions - Latest release: 3 months ago - 29.8 thousand downloads total - 1,248 stars on GitHub - 1 maintainer
rama-icap 0.0.0-reserved 💰
Internet Content Adaptation Protocol (ICAP) support for rama1 version - Latest release: 3 months ago - 13 downloads total - 1,255 stars on GitHub - 1 maintainer
rama-dns 0.4.0 💰
DNS support for rama21 versions - Latest release: 3 months ago - 3.94 million downloads total - 1,255 stars on GitHub
rama-socks5 0.4.0 💰
SOCKS5 support for rama22 versions - Latest release: 3 months ago - 3.91 million downloads total - 1,255 stars on GitHub - 1 maintainer
rama-http-headers 0.4.0 💰
typed http headers for rama8 versions - Latest release: 3 months ago - 3.98 million downloads total - 1,255 stars on GitHub - 1 maintainer
rama-ttrpc-build 0.4.0 💰
ttRPC codegen support for rama1 version - Latest release: 3 months ago - 430 downloads total - 1,255 stars on GitHub - 1 maintainer
rama-json 0.4.0 💰
streaming JSON tools for rama3 versions - Latest release: 3 months ago - 67.4 thousand downloads total - 1,255 stars on GitHub - 1 maintainer
rama-tcp 0.4.0 💰
TCP support for rama22 versions - Latest release: 3 months ago - 3.99 million downloads total - 1,248 stars on GitHub - 1 maintainer
rama-utils 0.4.0 💰
utilities crate for rama22 versions - Latest release: 3 months ago - 4.01 million downloads total - 1,248 stars on GitHub - 1 maintainer
rama-ws 0.4.0 💰
WebSocket (WS) support for rama7 versions - Latest release: 3 months ago - 46 thousand downloads total - 1,248 stars on GitHub - 1 maintainer
rama-quic 0.0.0-reserved 💰
QUIC (RFC 9000) transport for rama1 version - Latest release: about 2 months ago - 11 downloads total - 1,255 stars on GitHub - 1 maintainer
rama-ua 0.4.0 💰
user-agent (UA) support for rama22 versions - Latest release: 3 months ago - 127 thousand downloads total - 1,248 stars on GitHub - 1 maintainer
rama-net-apple-networkextension 0.4.0 💰
Apple Network Extension support for rama4 versions - Latest release: 3 months ago - 1.43 thousand downloads total - 1,248 stars on GitHub - 1 maintainer
rama-tls-rustls 0.4.0 💰
tls implementations for rama using rustls15 versions - Latest release: 3 months ago - 3.88 million downloads total - 1,248 stars on GitHub - 1 maintainer
rama-pac 0.4.0 💰
proxy auto-configuration (PAC) support for rama2 versions - Latest release: 3 months ago - 483 downloads total - 1,248 stars on GitHub - 1 maintainer
rama-http-core 0.4.0 💰
rama http protocol implementation and low level utilities20 versions - Latest release: 3 months ago - 3.92 million downloads total - 1,248 stars on GitHub - 1 maintainer
rama-inspect 0.0.0-reserved 💰
Protocol-independent inspection, interception and streaming capture storage for Rama1 version - Latest release: 2 months ago - 11 downloads total - 1,248 stars on GitHub - 1 maintainer
rama-haproxy 0.4.0 💰
rama HaProxy support22 versions - Latest release: 3 months ago - 28.2 thousand downloads total - 1,248 stars on GitHub - 1 maintainer
Related Keywords
rust
117
web-scraping
67
crawler
55
proxy
54
http
54
async
54
html
49
network
46
https
45
mitm
45
network-programming
45
networking
45
tls
45
automation
44
rama
42
scraper
38
browser-automation
36
web
35
cli
35
browser
33
llm
32
io
29
stealth
28
headless-chrome
23
markdown
22
parser
22
chrome-devtools-protocol
21
cdp
20
tokio
20
web-scraper
19
crawling
19
chromium
18
mcp
18
web-crawler
17
data-extraction
17
anti-bot
16
api
15
css
15
spider
15
dom
14
webscraping
13
search
12
ai
12
web-data
12
cloudflare-bypass
12
css-selectors
11
ai-agents
11
anti-detection
11
selector
11
ai-agent
11
headless-browser
11
ai-scraping
11
rag
11
bot
11
selectors
10
playwright
10
playwright-alternative
10
undetectable-chromedriver
10
web-testing
10
zendriver
10
rust-lang
9
headless
9
extraction
9
data
9
non-blocking
8
xpath
8
router
8
html-to-markdown
8
mcp-server
8
html-parser
8
dag
7
scraping-websites
7
async-rust
7
chrome
7
web-crawling
7
dsl
6
crawling-rust
6
wasm
6
programming-language
6
json
6
web-scraping-rust
6
google
6
fingerprint
6
agent
6
python
5
ai-crawler
5
claude-code
5
bypass
5
web-data-extraction
5
cloudflare
5
web-search
5
flaresolverr
4
ai-search
4
content-extraction
4
html5ever
4
javascript
4
readability
4
twitter
4
hacktoberfest
4
css-selector
4