An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

crates.io "scraper" keyword

View the packages on the crates.io package registry that are tagged with the "scraper" keyword.

sf6rs 0.3.5
A library for interfacing with various Street Figher 6 data forms.
6 versions - Latest release: about 1 year ago - 6.17 thousand downloads total - 0 stars on GitHub - 1 maintainer
scout-parser 0.7.2
A web crawling programming language
7 versions - Latest release: 11 months ago - 6.74 thousand downloads total - 113 stars on GitHub - 1 maintainer
scout-json 0.7.2
JSON representation of ScoutLang AST
3 versions - Latest release: 11 months ago - 3.04 thousand downloads total - 113 stars on GitHub - 1 maintainer
scout-worker 0.7.2
A worker framework for ScoutLang
2 versions - Latest release: 11 months ago - 1.85 thousand downloads total - 113 stars on GitHub - 1 maintainer
scout-interpreter 0.7.2
A web crawling programming language
7 versions - Latest release: 11 months ago - 6.53 thousand downloads total - 113 stars on GitHub - 1 maintainer
scoutlang 0.7.2
A web crawling programming language
6 versions - Latest release: 11 months ago - 7.09 thousand downloads total - 113 stars on GitHub - 1 maintainer
scout-lexer 0.7.2
A web crawling programming language
7 versions - Latest release: 11 months ago - 6.83 thousand downloads total - 113 stars on GitHub - 1 maintainer
spider-client 0.1.69
Spider Cloud client
64 versions - Latest release: 6 days ago - 29.4 thousand downloads total - 18 stars on GitHub - 1 maintainer
chan-downloader 0.3.0
CLI to download all images/webms of a 4chan thread
11 versions - Latest release: almost 3 years ago - 13.7 thousand downloads total - 44 stars on GitHub - 1 maintainer
buongiornissimo-rs 0.3.1 πŸ’°
Scrapes for the best Italian boomer flavoured images
5 versions - Latest release: 4 months ago - 2 dependent packages - 1 dependent repositories - 5.7 thousand downloads total - 7 stars on GitHub - 1 maintainer
scihub-scraper 0.5.2
Scraps paper informations from sci-hub.
9 versions - Latest release: over 4 years ago - 1 dependent package - 11.1 thousand downloads total - 5 stars on GitHub - 1 maintainer
reqwest-scraper-macros 0.7.0
Web scraping integration with reqwest
17 versions - Latest release: 3 days ago - 11.3 thousand downloads total - 7 stars on GitHub - 1 maintainer
reqwest-scraper 0.7.0
Web scraping integration with reqwest
27 versions - Latest release: 3 days ago - 17.1 thousand downloads total - 7 stars on GitHub - 1 maintainer
yfp 0.2.1
A Yahoo finance scraper
4 versions - Latest release: 6 months ago - 2.32 thousand downloads total - 8 stars on GitHub - 1 maintainer
wallpaper-dl 0.2.1
Wallpaper downloader for various websites
3 versions - Latest release: about 1 year ago - 3.05 thousand downloads total - 3 stars on GitHub - 1 maintainer
soar-dl 0.6.3
A fast download manager
20 versions - Latest release: about 2 months ago - 11.7 thousand downloads total - 23 stars on GitHub - 1 maintainer
spider 2.37.136
A web crawler and scraper, building blocks for data curation workloads.
1,556 versions - Latest release: 4 days ago - 6 dependent packages - 1 dependent repositories - 1.67 million downloads total - 1,871 stars on GitHub - 2 maintainers
skyscraper 0.6.4
XPath for HTML web scraping
19 versions - Latest release: about 1 year ago - 23.3 thousand downloads total - 30 stars on GitHub - 1 maintainer
jobshell 2.0.4
A CLI tool for job searching and scraping job boards
16 versions - Latest release: about 1 month ago - 11 thousand downloads total - 49 stars on GitHub - 1 maintainer
recluse 0.1.1
A web crawler framework for Rust
2 versions - Latest release: 5 days ago - 0 downloads total - 1 stars on GitHub - 1 maintainer
discord-webhook-proxy 1.0.0
DiscordWebhookProxy is a powerful Discord proxy service designed for Roblox, built to prevent abu...
1 version - Latest release: 2 months ago - 330 downloads total - 11 stars on GitHub - 1 maintainer
lookout 0.1.1
πŸ‘€ Declarative, asynchronous scraper utility.
2 versions - Latest release: over 4 years ago - 2.93 thousand downloads total - 1 stars on GitHub - 1 maintainer
tower-crawl
Tower middlewares, adapters and utilities useful for web crawling.
1 version - Latest release: 5 days ago - 1.08 thousand downloads total - 1 maintainer
ytmdl 0.3.4
Downloads albums from YouTube and automatically fills them with metadata from Discogs
6 versions - Latest release: almost 2 years ago - 6.31 thousand downloads total - 3 stars on GitHub - 1 maintainer
enma 0.9.2
A crate serving anime and manga information πŸ“¦
16 versions - Latest release: 6 months ago - 9.57 thousand downloads total - 0 stars on GitHub - 1 maintainer
elicznik 0.1.0
Utility for scraping energy meter data from Tauron eLicznik service and saving to PostgreSQL
1 version - Latest release: over 3 years ago - 1.42 thousand downloads total - 4 stars on GitHub - 1 maintainer
scrpr 0.1.0
Basic rust scraper and data selector
1 version - Latest release: 8 months ago - 789 downloads total - 0 stars on GitHub - 1 maintainer
proxy-scraper 0.2.0
A Rust command-line tool for scraping proxy information.
2 versions - Latest release: about 1 year ago - 2.35 thousand downloads total - 1 maintainer
scihub-scraper-cli 0.2.2
CLI utility to scrap paper informations from sci-hub.
5 versions - Latest release: over 4 years ago - 5.77 thousand downloads total - 5 stars on GitHub - 1 maintainer
discord_rust_scraper 1.0.7
DiscordRustScraper is a powerful Discord data scraper built in Rust, designed to extract and form...
7 versions - Latest release: 2 months ago - 3.1 thousand downloads total - 11 stars on GitHub - 2 maintainers
firecrawl 1.2.0
Rust SDK for Firecrawl API.
4 versions - Latest release: about 2 months ago - 4.14 thousand downloads total - 43,082 stars on GitHub - 2 maintainers
firecrawl_rs 0.1.1
Rust SDK for Firecrawl API.
2 versions - Latest release: about 1 year ago - 2.03 thousand downloads total - 43,082 stars on GitHub - 2 maintainers
tower-scrap
Tower middlewares, adapters and utilities useful for web scraping.
1 version - Latest release: 9 days ago - 1.05 thousand downloads total - 1 maintainer
se621 0.5.1
A multithreaded e621/e926 downloader
2 versions - Latest release: about 4 years ago - 2.48 thousand downloads total - 3 stars on GitHub - 1 maintainer
bvdl 0.1.0
Scrape product information from Bazaarvoice
1 version - Latest release: over 1 year ago - 1.33 thousand downloads total - 3 stars on GitHub - 1 maintainer
crabler 0.1.28 πŸ’°
Web scraper for Crabs
29 versions - Latest release: over 3 years ago - 2 dependent repositories - 36.4 thousand downloads total - 92 stars on GitHub - 1 maintainer
llmweb 0.1.7
Webpage to structured data in Rust & LLM
8 versions - Latest release: 10 days ago - 1.35 thousand downloads total - 0 stars on GitHub - 1 maintainer
proxy-rs 0.3.7
Fast Rust-based proxy checker
10 versions - Latest release: almost 2 years ago - 10.8 thousand downloads total - 70 stars on GitHub - 1 maintainer
browse 0.1.1
fast crawling framework
2 versions - Latest release: over 1 year ago - 1.4 thousand downloads total - 0 stars on GitHub - 1 maintainer
crabler-tokio 0.1.29
Web scraper for Crabs - tokio version
2 versions - Latest release: over 2 years ago - 2.39 thousand downloads total - 0 stars on GitHub - 1 maintainer
scrapyard 0.3.1
Automatic web scraper and RSS generator library
6 versions - Latest release: over 1 year ago - 1 dependent repositories - 6.66 thousand downloads total - 0 stars on GitHub - 1 maintainer
stud_ip_scraper 2.0.0
Blazingly fast πŸš€ library for interacting with Stud.IP πŸ“š
7 versions - Latest release: about 2 months ago - 5.4 thousand downloads total - 2 stars on GitHub - 1 maintainer
wdict 0.1.19
Create dictionaries by scraping webpages or crawling local files.
20 versions - Latest release: 3 months ago - 19.7 thousand downloads total - 2 stars on GitHub - 1 maintainer
crabler_derive 0.1.8 πŸ’°
Derive macro for crabler library
9 versions - Latest release: over 3 years ago - 1 dependent package - 3 dependent repositories - 14.8 thousand downloads total - 92 stars on GitHub - 1 maintainer
url-scraper 0.1.2
Simple HTML URL scraper
3 versions - Latest release: about 5 years ago - 1 dependent package - 1 dependent repositories - 6.67 thousand downloads total - 38 stars on GitHub - 1 maintainer
everyday-rewards-receipts 0.1.1
Command line tool to download all receipts from your everyday rewards account
2 versions - Latest release: about 1 year ago - 2.31 thousand downloads total - 5 stars on GitHub - 1 maintainer
zomato 0.1.1
A simple crate for retrievig daily menu from zomato.com
2 versions - Latest release: about 5 years ago - 2.78 thousand downloads total - 0 stars on GitHub - 1 maintainer
html-meta-scraper 0.1.0
Scrape and extract metadata like title, description, images, and favicon from HTML documents.
1 version - Latest release: 3 months ago - 468 downloads total - 0 stars on GitHub - 1 maintainer
google-somethin 0.1.4
A simple library that grabs Google search results...
5 versions - Latest release: over 6 years ago - 6.97 thousand downloads total - 1 maintainer
wco-rs 0.1.2
Play Cartoon & Animes from Wcostream
3 versions - Latest release: almost 2 years ago - 3.16 thousand downloads total - 1 maintainer
wreq 5.2.0 πŸ’°
A blazing-fast Rust HTTP Client with TLS fingerprint
3 versions - Latest release: 16 days ago - 3.1 thousand downloads total - 374 stars on GitHub - 1 maintainer
capricorn 0.1.93
Parse html according to configuration
13 versions - Latest release: over 4 years ago - 15.3 thousand downloads total - 3 stars on GitHub - 1 maintainer
proxy-scraper-checker 0.1.3
A command-line tool for scraping and checking HTTP and SOCKS5 proxies from the checkerproxy.net p...
4 versions - Latest release: about 1 year ago - 4.67 thousand downloads total - 6 stars on GitHub - 1 maintainer
html-url-scraper 0.1.1
Crate for scraping URLs from HTML pages
2 versions - Latest release: 6 months ago - 1.09 thousand downloads total - 0 stars on GitHub - 1 maintainer
pf_lib 0.1.9
petit-filou core library
25 versions - Latest release: 26 days ago - 12.7 thousand downloads total - 1 stars on GitHub - 1 maintainer
pf_cmd 5.0.0
petit-filou scans wordpress websites to find videos
16 versions - Latest release: 6 months ago - 6.52 thousand downloads total - 1 stars on GitHub - 1 maintainer
trackermeta 0.5.1
Simple library to get and parse modarchive module data
16 versions - Latest release: over 2 years ago - 16.6 thousand downloads total - 2 stars on GitHub - 1 maintainer
aurion_rs 0.2.1 πŸ’°
Aurion API in Rust
3 versions - Latest release: over 2 years ago - 3.67 thousand downloads total - 2 stars on GitHub - 1 maintainer
shinden-pl-api 0.1.3
A blazingly fast API client for Shinden.pl, written in Rust.
4 versions - Latest release: 18 days ago - 401 downloads total - 0 stars on GitHub - 1 maintainer
cyberdrop-dl 0.3.2
Cyberdrop.me album downloader written in Rust
5 versions - Latest release: almost 4 years ago - 12.5 thousand downloads total - 140 stars on GitHub - 1 maintainer
text2img 0.8.3
Creates a png image from text. Useful to protect sensitive information from bots and scrapers, su...
3 versions - Latest release: about 3 years ago - 3.39 thousand downloads total - 1 stars on GitHub - 1 maintainer
recursive_scraper 0.6.2
Constant-frequency recursive CLI web scraper with frequency, filtering, file directory, and many ...
9 versions - Latest release: over 2 years ago - 9.42 thousand downloads total - 9 stars on GitHub - 1 maintainer
line-stickers-scraper 0.1.1
Executable in Rust to scrap and save LINE sticker PNGs from URL
2 versions - Latest release: about 7 years ago - 3.06 thousand downloads total - 2 stars on GitHub - 1 maintainer
crabler-tokio_derive 0.1.8
Derive macro for crabler-tokio library
1 version - Latest release: over 2 years ago - 1 dependent package - 1 dependent repositories - 1.67 thousand downloads total - 0 stars on GitHub - 1 maintainer
metacritic-cli 1.2.4
A metacritic cli scraper
5 versions - Latest release: about 2 years ago - 5.34 thousand downloads total - 2 stars on GitHub - 1 maintainer
instagram-scraper-rs 0.1.0 πŸ’°
Scrapes an instagram user's photos and videos
1 version - Latest release: almost 3 years ago - 2 dependent packages - 2.72 thousand downloads total - 16 stars on GitHub - 1 maintainer
titans 0.4.8
Blazingly Fast scraper
29 versions - Latest release: 8 months ago - 27.5 thousand downloads total - 9 stars on GitHub - 1 maintainer
frangipani 0.3.1 πŸ’°
Scraping framework for rust
4 versions - Latest release: over 2 years ago - 4.48 thousand downloads total - 3 stars on GitHub - 1 maintainer
spire-macros 0.1.0
Macros for spire.
1 version - Latest release: almost 2 years ago - 1 dependent package - 1.45 thousand downloads total - 1 maintainer
concurrent_tor 1.0.0
A comprehensive scraping runtime.
2 versions - Latest release: 10 months ago - 2.3 thousand downloads total - 1 stars on GitHub - 1 maintainer
robotxt 0.6.1
The implementation of the Robots.txt (or URL exclusion) protocol with the support of crawl-delay,...
14 versions - Latest release: over 1 year ago - 17.2 thousand downloads total - 2 stars on GitHub - 1 maintainer
consumet-api-rs
Consumet API RIIR
13 versions - Latest release: 22 days ago - 12.9 thousand downloads total - 8 stars on GitHub - 1 maintainer
zju-jw-scraper 0.2.1
ζ΅™ζ±Ÿε€§ε­¦ζ•™εŠ‘η½‘ηˆ¬θ™«εΊ“
3 versions - Latest release: almost 6 years ago - 4.23 thousand downloads total - 7 stars on GitHub - 1 maintainer
favicon-rover 0.1.3
A web service and CLI tool to fetch the favicon of any website
4 versions - Latest release: 12 months ago - 4.29 thousand downloads total - 3 stars on GitHub - 1 maintainer
scraper-macros 0.2.0
Macros implementation of #[derive(Scraper)]
3 versions - Latest release: over 2 years ago - 1 dependent package - 3.82 thousand downloads total - 13 stars on GitHub - 1 maintainer
spire-core 0.1.0
Core types and traits for spire.
1 version - Latest release: almost 2 years ago - 2 dependent packages - 1.7 thousand downloads total - 1 maintainer
eren 0.3.5
Stream & Download Animes from your terminal
25 versions - Latest release: 8 months ago - 24.9 thousand downloads total - 9 stars on GitHub - 1 maintainer
flatcrawl-crawler 1.0.0
This is a rust implementation of a set of webpage crawlers. New crawlers can be easily configured...
1 version - Latest release: over 5 years ago - 1.46 thousand downloads total - 2 stars on GitHub - 1 maintainer
emails 1.0.0
A web scraper to extract email addresses from websites.
1 version - Latest release: 11 months ago - 1.02 thousand downloads total - 0 stars on GitHub - 1 maintainer
crabquery 0.1.9 πŸ’°
JQuery like HTML query library
10 versions - Latest release: over 3 years ago - 3 dependent packages - 3 dependent repositories - 27.4 thousand downloads total - 52 stars on GitHub - 1 maintainer
consumet-rs 0.0.8
Consumet API RIIR
8 versions - Latest release: almost 2 years ago - 8.27 thousand downloads total - 8 stars on GitHub - 1 maintainer
goodreads-metadata-scraper 0.2.1
A simple library to scrape book metadata from Goodreads
3 versions - Latest release: 4 months ago - 1.78 thousand downloads total - 1 stars on GitHub - 1 maintainer
crusty-core 0.82.0
Library for creating blazing fast and configurable web crawlers
87 versions - Latest release: over 3 years ago - 1 dependent package - 1 dependent repositories - 94.6 thousand downloads total - 16 stars on GitHub - 1 maintainer
webicon 0.3.4
Favicon and apple-touch-icon scraper for Rust
9 versions - Latest release: over 8 years ago - 1 dependent repositories - 17.5 thousand downloads total - 3 stars on GitHub - 1 maintainer
site_icons 0.6.4 πŸ’°
Website icon scraper that fetches sizes (with WASM support)
47 versions - Latest release: over 2 years ago - 6 dependent packages - 3 dependent repositories - 53.3 thousand downloads total - 30 stars on GitHub - 1 maintainer
cvmfs_server_scraper 0.0.5
A scraper for CVMFS servers
5 versions - Latest release: 9 months ago - 4.52 thousand downloads total - 0 stars on GitHub - 1 maintainer
amscrapper-rs 0.1.7 πŸ’°
Scrap and gather information from the AppleMusic windows application
6 versions - Latest release: 4 months ago - 2.67 thousand downloads total - 0 stars on GitHub - 1 maintainer
rustysozluk 0.2.0 πŸ’°
Eksi Sozluk API wrapper
11 versions - Latest release: over 1 year ago - 11.5 thousand downloads total - 7 stars on GitHub - 1 maintainer
unhtml_util 0.1.0
some utility traits and functions for unhtml
1 version - Latest release: over 6 years ago - 1.58 thousand downloads total - 196 stars on GitHub - 1 maintainer
Top 6.8% on crates.io
nipper 0.1.9
HTML manipulation with CSS seletors
10 versions - Latest release: over 4 years ago - 14 dependent packages - 23 dependent repositories - 325 thousand downloads total - 123 stars on GitHub - 1 maintainer
unhtml 0.8.0
A magic html parser
17 versions - Latest release: over 4 years ago - 7 dependent packages - 5 dependent repositories - 62.5 thousand downloads total - 196 stars on GitHub - 1 maintainer
wowcpe 0.2.2
Command-line tool for the classical radio station WCPE
9 versions - Latest release: almost 5 years ago - 11.3 thousand downloads total - 0 stars on GitHub - 1 maintainer
scraper-main 0.3.1
The core framework xpath parsing
4 versions - Latest release: over 2 years ago - 4.36 thousand downloads total - 13 stars on GitHub - 1 maintainer
spire 0.1.0
The flexible scraper framework powered by tokio and tower.
1 version - Latest release: almost 2 years ago - 1.22 thousand downloads total - 1 maintainer
unhtml_derive 0.8.0
proc macro derive for unhtml
17 versions - Latest release: over 4 years ago - 5 dependent packages - 4 dependent repositories - 62.8 thousand downloads total - 196 stars on GitHub - 1 maintainer
repo_icons 0.3.3 πŸ’°
Get icons for any github repo
22 versions - Latest release: over 2 years ago - 1 dependent package - 1 dependent repositories - 24 thousand downloads total - 242 stars on GitHub - 1 maintainer
okh-scraper 2.4.1
A scraper of Open Source Hardware (OSH) projects. based on the Open Know-How (OKH) standard.
2 versions - Latest release: about 1 month ago - 137 downloads total - 1 maintainer
website_crawler 0.9.9 πŸ’°
gRPC tokio based web crawler built with spider
203 versions - Latest release: 11 months ago - 168 thousand downloads total - 53 stars on GitHub - 1 maintainer
rustfm-scraper 0.2.23
Scrapes listening history from Last.fm and stores it in a file
3 versions - Latest release: over 4 years ago - 2.84 thousand downloads total - 2 stars on GitHub - 1 maintainer