An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

crates.io "scraping" keyword

View the packages on the crates.io package registry that are tagged with the "scraping" keyword.

scout-parser 0.7.2
A web crawling programming language
7 versions - Latest release: 11 months ago - 6.74 thousand downloads total - 113 stars on GitHub - 1 maintainer
scout-json 0.7.2
JSON representation of ScoutLang AST
3 versions - Latest release: 11 months ago - 3.04 thousand downloads total - 113 stars on GitHub - 1 maintainer
scout-worker 0.7.2
A worker framework for ScoutLang
2 versions - Latest release: 11 months ago - 1.85 thousand downloads total - 113 stars on GitHub - 1 maintainer
scout-interpreter 0.7.2
A web crawling programming language
7 versions - Latest release: 11 months ago - 6.53 thousand downloads total - 113 stars on GitHub - 1 maintainer
scoutlang 0.7.2
A web crawling programming language
6 versions - Latest release: 11 months ago - 7.09 thousand downloads total - 113 stars on GitHub - 1 maintainer
scout-lexer 0.7.2
A web crawling programming language
7 versions - Latest release: 11 months ago - 6.83 thousand downloads total - 113 stars on GitHub - 1 maintainer
ushift 0.0.0 💰
Multi-platform data extraction tool with a single Rust script
1 version - Latest release: over 2 years ago - 1.28 thousand downloads total - 4 stars on GitHub - 1 maintainer
queue_times 0.0.4
Client for scraping the queue times website.
4 versions - Latest release: about 4 years ago - 4.6 thousand downloads total - 1 maintainer
rocketapi 0.1.1
Unofficial RocketAPI Rust SDK for Instagram & Threads Private API 2024
2 versions - Latest release: 7 months ago - 1.66 thousand downloads total - 0 stars on GitHub - 1 maintainer
scrapr-bindings 0.1.0
A Rust web scraping library for Python
1 version - Latest release: 3 days ago - 0 downloads total - 1 stars on GitHub - 1 maintainer
scrapr-core 0.1.0
A Rust web scraping library for Python
1 version - Latest release: 3 days ago - 0 downloads total - 1 stars on GitHub - 1 maintainer
scraprr 0.1.0
A Rust web scraping library for Python
1 version - Latest release: 3 days ago - 0 downloads total - 1 stars on GitHub - 1 maintainer
voyager 0.2.1
Web crawler and scraper
4 versions - Latest release: over 3 years ago - 1 dependent repositories - 10.9 thousand downloads total - 756 stars on GitHub - 1 maintainer
nos 0.1.11
HTML manipulation with CSS seletors
2 versions - Latest release: over 4 years ago - 2.78 thousand downloads total - 0 stars on GitHub - 1 maintainer
dom_query 0.19.2
HTML querying and manipulation with CSS selectors
36 versions - Latest release: 19 days ago - 1 dependent package - 38.3 thousand downloads total - 7 stars on GitHub - 1 maintainer
spider 2.37.136
A web crawler and scraper, building blocks for data curation workloads.
1,556 versions - Latest release: 4 days ago - 6 dependent packages - 1 dependent repositories - 1.67 million downloads total - 1,871 stars on GitHub - 2 maintainers
spider_worker 2.37.136
The fastest web crawler as a worker or proxy.
1,351 versions - Latest release: 4 days ago - 1.34 million downloads total - 1,871 stars on GitHub - 1 maintainer
spider_cli 2.37.136
The fastest web crawler CLI written in Rust.
1,510 versions - Latest release: 4 days ago - 1.56 million downloads total - 406 stars on GitHub - 1 maintainer
spider_utils 2.37.136
Utilities to use for Spider Web Crawler.
834 versions - Latest release: 4 days ago - 644 thousand downloads total - 842 stars on GitHub - 1 maintainer
gignore 0.2.2
A command line tool to generate gitignore template files
4 versions - Latest release: almost 4 years ago - 4.77 thousand downloads total - 3 stars on GitHub - 1 maintainer
lookout 0.1.1
👀 Declarative, asynchronous scraper utility.
2 versions - Latest release: over 4 years ago - 2.93 thousand downloads total - 1 stars on GitHub - 1 maintainer
maera 0.1.3 💰
A monitor for periodically scraping websites with genuine browser fingerprints
7 versions - Latest release: over 2 years ago - 7.59 thousand downloads total - 16 stars on GitHub - 1 maintainer
rama-socks5 0.2.0 💰
SOCKS5 support for rama
16 versions - Latest release: 3 months ago - 7.66 thousand downloads total - 711 stars on GitHub - 1 maintainer
rama-tower 0.2.0 💰
tower support for rama
5 versions - Latest release: 3 months ago - 2.72 thousand downloads total - 711 stars on GitHub - 1 maintainer
rama-http 0.2.0 💰
rama http layers, services and other utilities
16 versions - Latest release: 3 months ago - 9.58 thousand downloads total - 711 stars on GitHub - 1 maintainer
rama-http-types 0.2.0 💰
rama http type defintions and high level utilities
16 versions - Latest release: 3 months ago - 10.2 thousand downloads total - 711 stars on GitHub - 1 maintainer
rama-ws 0.3.0-alpha.1 💰
WebSocket (WS) support for rama (RFC 6455)
1 version - Latest release: 20 days ago - 244 downloads total - 711 stars on GitHub - 1 maintainer
rama-tls-rustls 0.2.0 💰
tls implementations for rama using rustls
9 versions - Latest release: 3 months ago - 3.4 thousand downloads total - 711 stars on GitHub - 1 maintainer
rama-http-headers 0.2.0 💰
typed http headers for rama
2 versions - Latest release: 3 months ago - 1.5 thousand downloads total - 711 stars on GitHub - 1 maintainer
rama-core 0.2.0 💰
rama service core code, used by rama and service authors
16 versions - Latest release: 3 months ago - 11.1 thousand downloads total - 711 stars on GitHub - 1 maintainer
rama-macros 0.2.0 💰
procedural macross for rama
18 versions - Latest release: 3 months ago - 12.5 thousand downloads total - 711 stars on GitHub - 1 maintainer
rama-unix 0.3.0-alpha.1 💰
Unix (Domain) socket support for rama
1 version - Latest release: 20 days ago - 250 downloads total - 711 stars on GitHub - 1 maintainer
rama-haproxy 0.2.0 💰
rama HaProxy support
16 versions - Latest release: 3 months ago - 8.55 thousand downloads total - 711 stars on GitHub - 1 maintainer
rama-udp 0.2.0 💰
UDP support for rama
16 versions - Latest release: 3 months ago - 7.71 thousand downloads total - 711 stars on GitHub - 1 maintainer
rama-http-core 0.2.0 💰
rama http protocol implementation and low level utilities
14 versions - Latest release: 3 months ago - 8.67 thousand downloads total - 711 stars on GitHub - 1 maintainer
rama-utils 0.2.0 💰
utilities crate for rama
16 versions - Latest release: 3 months ago - 11.2 thousand downloads total - 711 stars on GitHub - 1 maintainer
rama-cli 0.2.0 💰
rama cli to move and transform network packets
14 versions - Latest release: 3 months ago - 6.32 thousand downloads total - 711 stars on GitHub - 1 maintainer
rama-proxy 0.2.0 💰
proxy types and utilities for rama
16 versions - Latest release: 3 months ago - 8.42 thousand downloads total - 711 stars on GitHub - 1 maintainer
rama-tls-boring 0.2.0 💰
tls implementations for rama using boring
5 versions - Latest release: 3 months ago - 2.73 thousand downloads total - 711 stars on GitHub - 1 maintainer
rama-error 0.2.0 💰
error types and utilities for rama
16 versions - Latest release: 3 months ago - 11.2 thousand downloads total - 711 stars on GitHub - 1 maintainer
rama-ua 0.2.0 💰
user-agent (UA) support for rama
16 versions - Latest release: 3 months ago - 9.66 thousand downloads total - 69 stars on GitHub - 1 maintainer
rama-net 0.2.0 💰
rama network types and utilities
16 versions - Latest release: 3 months ago - 10.8 thousand downloads total - 69 stars on GitHub - 1 maintainer
rama-tcp 0.2.0 💰
TCP support for rama
16 versions - Latest release: 3 months ago - 10.3 thousand downloads total - 69 stars on GitHub - 1 maintainer
rama-tls 0.2.0-alpha.12 💰
tls implementations for rama
11 versions - Latest release: 3 months ago - 6.69 thousand downloads total - 69 stars on GitHub - 1 maintainer
rama 0.2.0 💰
modular service framework
19 versions - Latest release: 3 months ago - 15.9 thousand downloads total - 69 stars on GitHub - 1 maintainer
rama-http-backend 0.2.0 💰
error types and utilities for rama
16 versions - Latest release: 3 months ago - 9.54 thousand downloads total - 69 stars on GitHub - 1 maintainer
htmler 0.1.1
HTML parsing and querying with CSS selectors
5 versions - Latest release: almost 2 years ago - 1 dependent package - 1 dependent repositories - 6.19 thousand downloads total - 1 stars on GitHub - 1 maintainer
html-extractor 1.0.0
A Rust crate for extracting data from HTML
7 versions - Latest release: almost 5 years ago - 4 dependent packages - 1 dependent repositories - 12.8 thousand downloads total - 5 stars on GitHub - 1 maintainer
rusaint 0.11.3
Easy-to-use SSU u-saint client
29 versions - Latest release: 7 days ago - 21.3 thousand downloads total - 18 stars on GitHub - 1 maintainer
keyhunter 0.2.0
Check for leaked API keys and secrets on public websites
5 versions - Latest release: 11 months ago - 5.25 thousand downloads total - 24 stars on GitHub - 1 maintainer
coma 0.2.3
Coma is a lightweight command-line tool designed for crawling websites
4 versions - Latest release: 10 months ago - 3.67 thousand downloads total - 26 stars on GitHub - 1 maintainer
mlscraper-rust 0.1.2
Scrape structured data from HTML documents automatically
3 versions - Latest release: about 2 years ago - 3.57 thousand downloads total - 22 stars on GitHub - 1 maintainer
firecrawl 1.2.0
Rust SDK for Firecrawl API.
4 versions - Latest release: about 2 months ago - 4.14 thousand downloads total - 43,082 stars on GitHub - 2 maintainers
firecrawl_rs 0.1.1
Rust SDK for Firecrawl API.
2 versions - Latest release: about 1 year ago - 2.03 thousand downloads total - 43,082 stars on GitHub - 2 maintainers
surfai 0.1.2
Advanced browser automation library with human-like interactions and stealth capabilities for web...
3 versions - Latest release: 10 days ago - 187 downloads total - 2 stars on GitHub - 1 maintainer
get_user_agent 0.1.1
Get_User_Agent is an easy to use rust CLI program and library for extracting the latest user agen...
2 versions - Latest release: about 3 years ago - 2.53 thousand downloads total - 5 stars on GitHub - 1 maintainer
dom-content-extraction 0.3.11
Rust implementation of Content extraction via text density paper
18 versions - Latest release: 3 months ago - 15.4 thousand downloads total - 32 stars on GitHub - 1 maintainer
mov-cli-rs 1.0.1
A CLI tool for scraping and playing TV, movies and anime.
2 versions - Latest release: over 1 year ago - 2.6 thousand downloads total - 2 stars on GitHub - 1 maintainer
hyraigne 0.1.4
Web spiders to scrap various man{ga,hua;hwa}s websites
5 versions - Latest release: over 4 years ago - 1 dependent package - 1 dependent repositories - 7.45 thousand downloads total - 2 stars on GitHub - 1 maintainer
easy-scraper 0.2.0
HTML scraping library focused on easy to use
3 versions - Latest release: almost 5 years ago - 5 dependent packages - 6 dependent repositories - 18.1 thousand downloads total - 194 stars on GitHub - 1 maintainer
stud_ip_scraper 2.0.0
Blazingly fast 🚀 library for interacting with Stud.IP 📚
7 versions - Latest release: about 2 months ago - 5.4 thousand downloads total - 2 stars on GitHub - 1 maintainer
webscrapingapi 0.1.0
WebScrapingApi is an API that allows scraping websites while using rotating proxies to prevent ba...
1 version - Latest release: about 3 years ago - 1.29 thousand downloads total - 0 stars on GitHub - 1 maintainer
favicon-picker 1.1.0
A library for getting favicon from websites
2 versions - Latest release: 11 months ago - 7.01 thousand downloads total - 0 stars on GitHub - 1 maintainer
git-spy 0.1.2
command-line tool to efficiently collect github repository
3 versions - Latest release: almost 5 years ago - 3.88 thousand downloads total - 3 stars on GitHub - 1 maintainer
stream_crawler 0.1.1
A crate for scraping web pages and extracting URLs and endpoints.
2 versions - Latest release: about 1 year ago - 1.9 thousand downloads total - 2 stars on GitHub - 1 maintainer
h2s 0.18.0
A declarative HTML parser, which works like a deserializer from HTML to struct
9 versions - Latest release: almost 2 years ago - 10.5 thousand downloads total - 5 stars on GitHub - 1 maintainer
Top 2.6% on crates.io
scraper 0.23.1
HTML parsing and querying with CSS selectors
34 versions - Latest release: 5 months ago - 441 dependent packages - 1,043 dependent repositories - 7.91 million downloads total - 2,159 stars on GitHub - 2 maintainers
pangotls 0.1.0 💰
TLS Reverse Proxy using Tokio and Rustls
1 version - Latest release: almost 3 years ago - 1.32 thousand downloads total - 686 stars on GitHub - 1 maintainer
urls2disk 0.1.1
Http client to download urls to disk concurrently, optionally converting them to PDF
2 versions - Latest release: over 7 years ago - 3.13 thousand downloads total - 25 stars on GitHub - 1 maintainer
medina 0.0.1
An asynchronous web crawling engine
12 versions - Latest release: almost 5 years ago - 13.9 thousand downloads total - 1 maintainer
google-scholar-query 0.1.6
The unofficial Google Scholar API
7 versions - Latest release: 5 months ago - 3.58 thousand downloads total - 2 stars on GitHub - 1 maintainer
pf_lib 0.1.9
petit-filou core library
25 versions - Latest release: 26 days ago - 12.7 thousand downloads total - 1 stars on GitHub - 1 maintainer
pf_cmd 5.0.0
petit-filou scans wordpress websites to find videos
16 versions - Latest release: 6 months ago - 6.52 thousand downloads total - 1 stars on GitHub - 1 maintainer
jsdom 0.0.9
A rust javascript dom parser for web scraping
11 versions - Latest release: about 2 years ago - 1 dependent package - 1 dependent repositories - 13.4 thousand downloads total - 4 stars on GitHub - 1 maintainer
imdb 0.0.1
imdb is a library to retrieve information from IMDb
1 version - Latest release: over 7 years ago - 1.71 thousand downloads total - 6 stars on GitHub - 1 maintainer
tagparser 0.6.0
A lightweight Rust library for parsing HTML tags with powerful filtering capabilities
6 versions - Latest release: 5 months ago - 1 dependent package - 4.53 thousand downloads total - 1 maintainer
piconbiere 0.3.1
Scrape and download media from Piccoma/ピッコマ
9 versions - Latest release: over 1 year ago - 9.48 thousand downloads total - 0 stars on GitHub - 1 maintainer
proxy-llama 💰
a proxy framework using Tokio written purely in Rust
1 version - Latest release: 19 days ago - 1.1 thousand downloads total - 656 stars on GitHub - 1 maintainer
clanko_zbierac 0.1.6
Program for scraping slovak/czech articles from medias and turning them to pdfs
7 versions - Latest release: over 1 year ago - 7.99 thousand downloads total - 0 stars on GitHub - 1 maintainer
scraper_forky 0.17.1
HTML parsing and querying with CSS selectors
2 versions - Latest release: almost 2 years ago - 1 dependent package - 2.55 thousand downloads total - 2,146 stars on GitHub - 1 maintainer
turboscraper 0.1.1
A high-performance, concurrent web scraping framework for Rust with built-in support for retries,...
2 versions - Latest release: 5 months ago - 1.08 thousand downloads total - 2 stars on GitHub - 1 maintainer
nipper-trunk 0.1.9 💰
HTML manipulation with CSS seletors
1 version - Latest release: over 4 years ago - 1 dependent package - 1 dependent repositories - 6.75 thousand downloads total - 0 stars on GitHub - 1 maintainer
lanis-rs 0.3.0
A API for Lanis (Schulportal Hessen)
4 versions - Latest release: 21 days ago - 819 downloads total - 0 stars on GitHub - 1 maintainer
frangipani 0.3.1 💰
Scraping framework for rust
4 versions - Latest release: over 2 years ago - 4.48 thousand downloads total - 3 stars on GitHub - 1 maintainer
fsolver 1.0.0
A simple wrapper around the FlareSolverr API
1 version - Latest release: 8 months ago - 742 downloads total - 1 maintainer
accessibility-scraper 0.0.14 💰
HTML parsing and querying with CSS selectors with CSS binding styles to elements.
13 versions - Latest release: about 1 year ago - 2 dependent packages - 1 dependent repositories - 18.8 thousand downloads total - 9 stars on GitHub - 1 maintainer
atletiek_nu_api 0.2.7
A scraping library for the atletiek.nu website
6 versions - Latest release: 23 days ago - 4.51 thousand downloads total - 6 stars on GitHub - 1 maintainer
dom-manipulator 0.1.0
A library for HTML parsing, querying and serializing.
1 version - Latest release: almost 3 years ago - 1.71 thousand downloads total - 2,146 stars on GitHub - 1 maintainer
torchbear 0.11.5
Lua programming environment in Rust
28 versions - Latest release: over 6 years ago - 33.8 thousand downloads total - 148 stars on GitHub - 1 maintainer
cinema_feed 0.1.4 💰
Scrape a cinema website and store the schedule into a DB, export it as RSS feed
2 versions - Latest release: over 6 years ago - 3 thousand downloads total - 3 stars on GitHub - 1 maintainer
scrapi 0.2.0
A cli tool for scraping websites.
2 versions - Latest release: 11 months ago - 1.65 thousand downloads total - 0 stars on GitHub - 1 maintainer
bibe 0.1.4
CLI tool to download from various man{ga,hua;hwa}s websites
5 versions - Latest release: over 4 years ago - 5.96 thousand downloads total - 2 stars on GitHub - 1 maintainer
fast_scraper 0.14.5
HTML parsing and querying with CSS selectors
6 versions - Latest release: over 2 years ago - 2 dependent packages - 6.78 thousand downloads total - 2,146 stars on GitHub - 1 maintainer
shavecli 0.1.1
A command line interface for the shave library.
1 version - Latest release: 29 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
shave 0.2.4 💰
A library for shaving data from websites.
7 versions - Latest release: 5 months ago - 6.07 thousand downloads total - 0 stars on GitHub - 1 maintainer
html-filter 0.2.0
Crate to parse, filter, search and edit an HTML file.
2 versions - Latest release: 30 days ago - 443 downloads total - 1 stars on GitHub - 1 maintainer
Top 6.8% on crates.io
nipper 0.1.9
HTML manipulation with CSS seletors
10 versions - Latest release: over 4 years ago - 14 dependent packages - 23 dependent repositories - 325 thousand downloads total - 123 stars on GitHub - 1 maintainer
dom_finder 0.4.2
HTML parsing with CSS seletors
15 versions - Latest release: 7 months ago - 13.9 thousand downloads total - 2 stars on GitHub - 1 maintainer
github-heatmap 1.0.0
A CLI tool used to scrape a Github profile and mirror the SVG contribution heatmap as Unicode.
2 versions - Latest release: almost 3 years ago - 2.31 thousand downloads total - 2 stars on GitHub - 1 maintainer