crates.io "scraping" keyword
View the packages on the crates.io package registry that are tagged with the "scraping" keyword.
keyhunter 0.2.0
Check for leaked API keys and secrets on public websites5 versions - Latest release: about 1 year ago - 5.64 thousand downloads total - 24 stars on GitHub - 1 maintainer
Top 6.8% on crates.io
10 versions - Latest release: over 4 years ago - 14 dependent packages - 23 dependent repositories - 333 thousand downloads total - 123 stars on GitHub - 1 maintainer
nipper 0.1.9
HTML manipulation with CSS seletors10 versions - Latest release: over 4 years ago - 14 dependent packages - 23 dependent repositories - 333 thousand downloads total - 123 stars on GitHub - 1 maintainer
scrapi 0.2.0
A cli tool for scraping websites.2 versions - Latest release: 12 months ago - 1.87 thousand downloads total - 0 stars on GitHub - 1 maintainer
bibe 0.1.4
CLI tool to download from various man{ga,hua;hwa}s websites5 versions - Latest release: over 4 years ago - 6.6 thousand downloads total - 2 stars on GitHub - 1 maintainer
scout-lexer 0.7.2
A web crawling programming language7 versions - Latest release: about 1 year ago - 7.28 thousand downloads total - 115 stars on GitHub - 1 maintainer
scout-worker 0.7.2
A worker framework for ScoutLang2 versions - Latest release: about 1 year ago - 1.98 thousand downloads total - 115 stars on GitHub - 1 maintainer
scoutlang 0.7.2
A web crawling programming language6 versions - Latest release: about 1 year ago - 7.51 thousand downloads total - 115 stars on GitHub - 1 maintainer
scout-parser 0.7.2
A web crawling programming language7 versions - Latest release: about 1 year ago - 7.16 thousand downloads total - 115 stars on GitHub - 1 maintainer
scout-json 0.7.2
JSON representation of ScoutLang AST3 versions - Latest release: about 1 year ago - 3.26 thousand downloads total - 115 stars on GitHub - 1 maintainer
scout-interpreter 0.7.2
A web crawling programming language7 versions - Latest release: about 1 year ago - 6.92 thousand downloads total - 113 stars on GitHub - 1 maintainer
dom_finder 0.4.2
HTML parsing with CSS seletors15 versions - Latest release: 9 months ago - 15.4 thousand downloads total - 2 stars on GitHub - 1 maintainer
rama-http-core 0.2.0 💰
rama http protocol implementation and low level utilities16 versions - Latest release: 4 months ago - 10.9 thousand downloads total - 755 stars on GitHub - 1 maintainer
rama-tower 0.2.0 💰
tower support for rama7 versions - Latest release: 4 months ago - 4.22 thousand downloads total - 755 stars on GitHub - 1 maintainer
rama-socks5 0.2.0 💰
SOCKS5 support for rama18 versions - Latest release: 4 months ago - 9.25 thousand downloads total - 755 stars on GitHub - 1 maintainer
rama-utils 0.2.0 💰
utilities crate for rama18 versions - Latest release: 4 months ago - 14.3 thousand downloads total - 755 stars on GitHub - 1 maintainer
rama-udp 0.2.0 💰
UDP support for rama18 versions - Latest release: 4 months ago - 9.33 thousand downloads total - 755 stars on GitHub - 1 maintainer
rama-unix 0.3.0-alpha.3 💰
Unix (Domain) socket support for rama3 versions - Latest release: 8 days ago - 896 downloads total - 755 stars on GitHub - 1 maintainer
rama-http 0.2.0 💰
rama http layers, services and other utilities18 versions - Latest release: 4 months ago - 11.9 thousand downloads total - 755 stars on GitHub - 1 maintainer
rama-tls-acme 0.3.0-alpha.3 💰
ACME support for rama2 versions - Latest release: 8 days ago - 390 downloads total - 755 stars on GitHub - 1 maintainer
rama-haproxy 0.2.0 💰
rama HaProxy support18 versions - Latest release: 4 months ago - 10.2 thousand downloads total - 755 stars on GitHub - 1 maintainer
rama-http-headers 0.2.0 💰
typed http headers for rama4 versions - Latest release: 4 months ago - 2.86 thousand downloads total - 755 stars on GitHub - 1 maintainer
rama-proxy 0.2.0 💰
proxy types and utilities for rama18 versions - Latest release: 4 months ago - 10 thousand downloads total - 755 stars on GitHub - 1 maintainer
rama-ws 0.3.0-alpha.3 💰
WebSocket (WS) support for rama3 versions - Latest release: 8 days ago - 855 downloads total - 755 stars on GitHub - 1 maintainer
rama-error 0.2.0 💰
error types and utilities for rama18 versions - Latest release: 4 months ago - 14.2 thousand downloads total - 755 stars on GitHub - 1 maintainer
rama-http-types 0.2.0 💰
rama http type defintions and high level utilities18 versions - Latest release: 4 months ago - 12.7 thousand downloads total - 755 stars on GitHub - 1 maintainer
rama-core 0.2.0 💰
rama service core code, used by rama and service authors18 versions - Latest release: 4 months ago - 14 thousand downloads total - 755 stars on GitHub - 1 maintainer
rama-cli 0.2.0 💰
rama cli to move and transform network packets16 versions - Latest release: 4 months ago - 7.69 thousand downloads total - 755 stars on GitHub - 1 maintainer
rama-crypto 0.3.0-alpha.3 💰
All crypto logic used by rama2 versions - Latest release: 8 days ago - 494 downloads total - 755 stars on GitHub - 1 maintainer
rama-macros 0.2.0 💰
procedural macross for rama20 versions - Latest release: 4 months ago - 15.6 thousand downloads total - 755 stars on GitHub - 1 maintainer
rama-tls-boring 0.2.0 💰
tls implementations for rama using boring7 versions - Latest release: 4 months ago - 3.95 thousand downloads total - 755 stars on GitHub - 1 maintainer
rama-tls-rustls 0.2.0 💰
tls implementations for rama using rustls11 versions - Latest release: 4 months ago - 4.47 thousand downloads total - 755 stars on GitHub - 1 maintainer
rama-net 0.2.0 💰
rama network types and utilities18 versions - Latest release: 4 months ago - 13.7 thousand downloads total - 69 stars on GitHub - 1 maintainer
rama-tcp 0.2.0 💰
TCP support for rama18 versions - Latest release: 4 months ago - 13 thousand downloads total - 69 stars on GitHub - 1 maintainer
rama-ua 0.2.0 💰
user-agent (UA) support for rama18 versions - Latest release: 4 months ago - 11.9 thousand downloads total - 69 stars on GitHub - 1 maintainer
rama-tls 0.2.0-alpha.12 💰
tls implementations for rama11 versions - Latest release: 5 months ago - 7.43 thousand downloads total - 69 stars on GitHub - 1 maintainer
rama-http-backend 0.2.0 💰
error types and utilities for rama18 versions - Latest release: 4 months ago - 11.5 thousand downloads total - 69 stars on GitHub - 1 maintainer
rama 0.2.0 💰
modular service framework21 versions - Latest release: 4 months ago - 19.2 thousand downloads total - 69 stars on GitHub - 1 maintainer
google-scholar-query 0.1.6
The unofficial Google Scholar API7 versions - Latest release: 6 months ago - 4.17 thousand downloads total - 2 stars on GitHub - 1 maintainer
dom_query 0.22.0
HTML querying and manipulation with CSS selectors41 versions - Latest release: 4 days ago - 1 dependent package - 45.3 thousand downloads total - 7 stars on GitHub - 1 maintainer
github-heatmap 1.0.0
A CLI tool used to scrape a Github profile and mirror the SVG contribution heatmap as Unicode.2 versions - Latest release: almost 3 years ago - 2.55 thousand downloads total - 2 stars on GitHub - 1 maintainer
gignore 0.2.2
A command line tool to generate gitignore template files4 versions - Latest release: almost 4 years ago - 5 thousand downloads total - 3 stars on GitHub - 1 maintainer
shave 0.2.5 💰
A library for shaving data from websites.8 versions - Latest release: 2 months ago - 7.06 thousand downloads total - 0 stars on GitHub - 1 maintainer
shavecli 0.1.1 💰
A command line interface for the shave library.1 version - Latest release: 2 months ago - 321 downloads total - 0 stars on GitHub - 1 maintainer
thirtyfour-stealth 0.1.2
A stealthy, undetected implementation of thirtyfour for web automation1 version - Latest release: 5 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
rusaint 0.11.4
Easy-to-use SSU u-saint client30 versions - Latest release: about 2 months ago - 23.5 thousand downloads total - 20 stars on GitHub - 1 maintainer
ushift 0.0.0 💰
Multi-platform data extraction tool with a single Rust script1 version - Latest release: over 2 years ago - 1.35 thousand downloads total - 4 stars on GitHub - 1 maintainer
nos 0.1.11
HTML manipulation with CSS seletors2 versions - Latest release: over 4 years ago - 2.94 thousand downloads total - 0 stars on GitHub - 1 maintainer
xplore 0.1.12
X/Twitter scraper for Rust12 versions - Latest release: about 2 months ago - 3.88 thousand downloads total - 17 stars on GitHub - 1 maintainer
easy-scraper 0.2.0
HTML scraping library focused on easy to use3 versions - Latest release: almost 5 years ago - 5 dependent packages - 6 dependent repositories - 18.9 thousand downloads total - 194 stars on GitHub - 1 maintainer
queue_times 0.0.4
Client for scraping the queue times website.4 versions - Latest release: about 4 years ago - 4.79 thousand downloads total - 1 maintainer
medina 0.0.1
An asynchronous web crawling engine12 versions - Latest release: about 5 years ago - 14.7 thousand downloads total - 1 maintainer
rocketapi 0.1.1
Unofficial RocketAPI Rust SDK for Instagram & Threads Private API 20242 versions - Latest release: 8 months ago - 1.78 thousand downloads total - 0 stars on GitHub - 1 maintainer
lookout 0.1.1
👀 Declarative, asynchronous scraper utility.2 versions - Latest release: over 4 years ago - 3.06 thousand downloads total - 1 stars on GitHub - 1 maintainer
wdpe 0.1.1
WebDynpro Parse Engine3 versions - Latest release: about 1 month ago - 422 downloads total - 0 stars on GitHub - 1 maintainer
mlscraper-rust 0.1.2
Scrape structured data from HTML documents automatically3 versions - Latest release: over 2 years ago - 3.76 thousand downloads total - 22 stars on GitHub - 1 maintainer
scrapr-core 0.1.0
A Rust web scraping library for Python1 version - Latest release: about 1 month ago - 272 downloads total - 1 stars on GitHub - 1 maintainer
scrapr-bindings 0.1.0
A Rust web scraping library for Python1 version - Latest release: about 1 month ago - 267 downloads total - 1 stars on GitHub - 1 maintainer
scraprr 0.1.2
A Rust web scraping library for Python3 versions - Latest release: about 1 month ago - 675 downloads total - 1 stars on GitHub - 1 maintainer
coma 0.2.3
Coma is a lightweight command-line tool designed for crawling websites4 versions - Latest release: 11 months ago - 3.92 thousand downloads total - 26 stars on GitHub - 1 maintainer
pf_cmd 5.0.0
petit-filou scans wordpress websites to find videos16 versions - Latest release: 7 months ago - 7.49 thousand downloads total - 1 stars on GitHub - 1 maintainer
htmler 0.1.1
HTML parsing and querying with CSS selectors5 versions - Latest release: about 2 years ago - 1 dependent package - 1 dependent repositories - 6.49 thousand downloads total - 1 stars on GitHub - 1 maintainer
html-extractor 1.0.0
A Rust crate for extracting data from HTML7 versions - Latest release: about 5 years ago - 4 dependent packages - 1 dependent repositories - 13.2 thousand downloads total - 5 stars on GitHub - 1 maintainer
pangotls 0.1.0 💰
TLS Reverse Proxy using Tokio and Rustls1 version - Latest release: almost 3 years ago - 1.4 thousand downloads total - 741 stars on GitHub - 1 maintainer
maera 0.1.3 💰
A monitor for periodically scraping websites with genuine browser fingerprints7 versions - Latest release: over 2 years ago - 7.95 thousand downloads total - 16 stars on GitHub - 1 maintainer
lbc-rs 0.1.0
Unofficial client for Leboncoin API, inspired by the Python implementation etienne-hd/lbc1 version - Latest release: 14 days ago - 0 downloads total - 1 maintainer
spider_utils 2.37.153
Utilities to use for Spider Web Crawler.850 versions - Latest release: 14 days ago - 694 thousand downloads total - 842 stars on GitHub - 1 maintainer
stud_ip_scraper 2.0.0
Blazingly fast 🚀 library for interacting with Stud.IP 📚7 versions - Latest release: 3 months ago - 5.81 thousand downloads total - 2 stars on GitHub - 1 maintainer
spider_worker 2.37.152
The fastest web crawler as a worker or proxy.1,365 versions - Latest release: 16 days ago - 1.41 million downloads total - 1,922 stars on GitHub - 1 maintainer
spider 2.37.152
A web crawler and scraper, building blocks for data curation workloads.1,571 versions - Latest release: 16 days ago - 6 dependent packages - 1 dependent repositories - 1.75 million downloads total - 1,922 stars on GitHub - 2 maintainers
spider_cli 2.37.152
The fastest web crawler CLI written in Rust.1,525 versions - Latest release: 16 days ago - 1.63 million downloads total - 406 stars on GitHub - 1 maintainer
surfai 0.1.2
Advanced browser automation library with human-like interactions and stealth capabilities for web...3 versions - Latest release: about 2 months ago - 959 downloads total - 2 stars on GitHub - 1 maintainer
lanis-rs 0.3.0
A API for Lanis (Schulportal Hessen)4 versions - Latest release: 2 months ago - 1.34 thousand downloads total - 0 stars on GitHub - 1 maintainer
favicon-picker 1.1.0
A library for getting favicon from websites2 versions - Latest release: about 1 year ago - 7.27 thousand downloads total - 0 stars on GitHub - 1 maintainer
h2s 0.18.0
A declarative HTML parser, which works like a deserializer from HTML to struct9 versions - Latest release: about 2 years ago - 11 thousand downloads total - 5 stars on GitHub - 1 maintainer
mov-cli-rs 1.0.1
A CLI tool for scraping and playing TV, movies and anime.2 versions - Latest release: over 1 year ago - 2.74 thousand downloads total - 2 stars on GitHub - 1 maintainer
cinema_feed 0.1.4 💰
Scrape a cinema website and store the schedule into a DB, export it as RSS feed2 versions - Latest release: over 6 years ago - 3.18 thousand downloads total - 3 stars on GitHub - 1 maintainer
urls2disk 0.1.1
Http client to download urls to disk concurrently, optionally converting them to PDF2 versions - Latest release: over 7 years ago - 3.25 thousand downloads total - 25 stars on GitHub - 1 maintainer
frangipani 0.3.1 💰
Scraping framework for rust4 versions - Latest release: over 2 years ago - 4.74 thousand downloads total - 3 stars on GitHub - 1 maintainer
dom-content-extraction 0.3.11
Rust implementation of Content extraction via text density paper18 versions - Latest release: 4 months ago - 16.1 thousand downloads total - 32 stars on GitHub - 1 maintainer
tsukiyomi-fetch 0.1.2
A performance-optimized Rust-powered stats fetcher with async API calls, 24h intelligent caching,...3 versions - Latest release: 20 days ago - 205 downloads total - 0 stars on GitHub - 1 maintainer
atletiek_nu_api 0.2.7
A scraping library for the atletiek.nu website6 versions - Latest release: 2 months ago - 5.21 thousand downloads total - 6 stars on GitHub - 1 maintainer
Top 2.6% on crates.io
35 versions - Latest release: 20 days ago - 441 dependent packages - 1,043 dependent repositories - 8.56 million downloads total - 2,185 stars on GitHub - 2 maintainers
scraper 0.24.0
HTML parsing and querying with CSS selectors35 versions - Latest release: 20 days ago - 441 dependent packages - 1,043 dependent repositories - 8.56 million downloads total - 2,185 stars on GitHub - 2 maintainers
hyraigne 0.1.4
Web spiders to scrap various man{ga,hua;hwa}s websites5 versions - Latest release: over 4 years ago - 1 dependent package - 1 dependent repositories - 7.68 thousand downloads total - 2 stars on GitHub - 1 maintainer
get_user_agent 0.1.1
Get_User_Agent is an easy to use rust CLI program and library for extracting the latest user agen...2 versions - Latest release: over 3 years ago - 2.62 thousand downloads total - 5 stars on GitHub - 1 maintainer
firecrawl 1.2.1
Rust SDK for Firecrawl API.5 versions - Latest release: 25 days ago - 4.61 thousand downloads total - 48,469 stars on GitHub - 2 maintainers
firecrawl_rs 0.1.1
Rust SDK for Firecrawl API.2 versions - Latest release: about 1 year ago - 2.12 thousand downloads total - 48,469 stars on GitHub - 2 maintainers
stream_crawler 0.1.1
A crate for scraping web pages and extracting URLs and endpoints.2 versions - Latest release: about 1 year ago - 2.02 thousand downloads total - 2 stars on GitHub - 1 maintainer
tagparser 0.6.0
A lightweight Rust library for parsing HTML tags with powerful filtering capabilities6 versions - Latest release: 6 months ago - 1 dependent package - 4.92 thousand downloads total - 1 maintainer
webscrapingapi 0.1.0
WebScrapingApi is an API that allows scraping websites while using rotating proxies to prevent ba...1 version - Latest release: about 3 years ago - 1.35 thousand downloads total - 0 stars on GitHub - 1 maintainer
git-spy 0.1.2
command-line tool to efficiently collect github repository3 versions - Latest release: about 5 years ago - 4.01 thousand downloads total - 3 stars on GitHub - 1 maintainer
proxy-llama 💰
a proxy framework using Tokio written purely in Rust1 version - Latest release: 23 days ago - 1.15 thousand downloads total - 736 stars on GitHub - 1 maintainer
turboscraper 0.1.1
A high-performance, concurrent web scraping framework for Rust with built-in support for retries,...2 versions - Latest release: 7 months ago - 1.22 thousand downloads total - 2 stars on GitHub - 1 maintainer
scraper_forky 0.17.1
HTML parsing and querying with CSS selectors2 versions - Latest release: almost 2 years ago - 1 dependent package - 2.67 thousand downloads total - 2,185 stars on GitHub - 1 maintainer
jsdom 0.0.9
A rust javascript dom parser for web scraping11 versions - Latest release: over 2 years ago - 1 dependent package - 1 dependent repositories - 13.9 thousand downloads total - 4 stars on GitHub - 1 maintainer
piconbiere 0.3.1
Scrape and download media from Piccoma/ピッコマ9 versions - Latest release: almost 2 years ago - 9.91 thousand downloads total - 0 stars on GitHub - 1 maintainer
search_for_llms 0.1.0
A search tool suitable for LLMs, with structured and cleaned search results, written in Rust1 version - Latest release: 24 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
dom-manipulator 0.1.0
A library for HTML parsing, querying and serializing.1 version - Latest release: about 3 years ago - 1.81 thousand downloads total - 2,185 stars on GitHub - 1 maintainer
imdb 0.0.1
imdb is a library to retrieve information from IMDb1 version - Latest release: almost 8 years ago - 1.77 thousand downloads total - 6 stars on GitHub - 1 maintainer
nipper-trunk 0.1.9 💰
HTML manipulation with CSS seletors1 version - Latest release: over 4 years ago - 1 dependent package - 1 dependent repositories - 6.82 thousand downloads total - 0 stars on GitHub - 1 maintainer
simple_fetch 0.1.1
A simple, fast web content fetcher based on Spider2 versions - Latest release: 26 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
Related Keywords
rust
48
proxy
29
http
29
https
28
mitm
28
network
28
network-programming
28
networking
28
tls
28
async
27
rama
26
html
22
io
20
scraper
16
crawler
15
web
15
css
12
selector
10
parser
10
cli
8
crawling
8
web-scraping
8
non-blocking
7
spider
7
api
7
scraping-websites
7
dsl
6
web-crawling
6
programming-language
6
automation
6
indexer
4
headless-chrome
4
web-crawler
4
webscraping
4
selectors
4
hacktoberfest
4
webtoon
3
ai-scraping
3
manga
3
scrape
3
html5ever
3
service
3
css-selectors
3
llm
3
github
3
markdown
3
google
2
chromium
2
command-line-tool
2
spider_cli
2
parsing
2
mp4
2
ai
2
data
2
image
2
stealth
2
html-to-markdown
2
futures
2
security
2
instagram
2
manhua
2
manhwa
2
rag
2
movies
2
video
2
certificates
2
wordpress
2
headers
2
video-scraper
2
wp-scraper
2
twitter
2
wp-video
2
rust-lang
2
browser
2
user-agent
2
endpoint
1
url
1
tag
1
windows-10
1
user-agents
1
user-agent-parser
1
rust-cli
1
rusr
1
browser-identity
1
athletics
1
reddit
1
discord
1
codeforces
1
codechef
1
anilist
1
dom-based
1
content-extraction
1
dom-text-density
1
media
1
flaresolverr
1
wrapper
1
framework
1
lua
1
actix
1
cryptography
1