Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
crates.io "crawler" keyword
isbot 0.1.3
Detect if a user-agent is a known bot4 versions - Latest release: almost 2 years ago - 1 dependent package - 1 dependent repositories - 22.8 thousand downloads total - 10 stars on GitHub - 1 maintainer
crypto-markets 1.3.11
Fetch trading markets from a cryptocurrency exchange90 versions - Latest release: about 1 year ago - 2 dependent packages - 1 dependent repositories - 42.9 thousand downloads total - 209 stars on GitHub - 1 maintainer
dyer 3.3.2
dyer is designed for reliable, flexible and fast Request-Response based service, including data ...19 versions - Latest release: almost 2 years ago - 1 dependent package - 1.3 million downloads total - 134 stars on GitHub - 1 maintainer
crypto-rest-client 1.0.1
An RESTful client for all cryptocurrency exchanges.77 versions - Latest release: about 1 year ago - 1 dependent package - 1 dependent repositories - 32.9 thousand downloads total - 206 stars on GitHub - 1 maintainer
spider_cli 1.94.5
The fastest web crawler CLI written in Rust.586 versions - Latest release: about 22 hours ago - 159 thousand downloads total - 406 stars on GitHub - 1 maintainer
crusty-core 0.82.0
Library for creating blazing fast and configurable web crawlers87 versions - Latest release: over 2 years ago - 1 dependent package - 1 dependent repositories - 29.9 thousand downloads total - 14 stars on GitHub - 1 maintainer
Top 9.8% on crates.io
26 versions - Latest release: 9 months ago - 9 dependent packages - 1 dependent repositories - 33.9 thousand downloads total - 206 stars on GitHub - 1 maintainer
crypto-market-type 1.1.6
Cryptocurrenty market type26 versions - Latest release: 9 months ago - 9 dependent packages - 1 dependent repositories - 33.9 thousand downloads total - 206 stars on GitHub - 1 maintainer
spider 1.94.4
The fastest web crawler written in Rust.613 versions - Latest release: 3 days ago - 6 dependent packages - 1 dependent repositories - 192 thousand downloads total - 406 stars on GitHub - 2 maintainers
crypto-crawler 4.7.9
A rock-solid cryprocurrency crawler.242 versions - Latest release: about 1 year ago - 1 dependent package - 80.8 thousand downloads total - 206 stars on GitHub - 1 maintainer
crypto-msg-type 1.0.12
Cryptocurrenty message type13 versions - Latest release: 9 months ago - 5 dependent packages - 1 dependent repositories - 14.9 thousand downloads total - 206 stars on GitHub - 1 maintainer
texting_robots 0.2.2
Texting Robots: A Rust native `robots.txt` parser with thorough unit testing.4 versions - Latest release: about 1 year ago - 6 dependent packages - 2 dependent repositories - 35.1 thousand downloads total - 22 stars on GitHub - 1 maintainer
wls 0.1.0
Easily crawl multiple sitemaps and list URLs1 version - Latest release: 3 months ago - 277 downloads total - 2 stars on GitHub - 1 maintainer
git-leave 1.6.2
Check for unsaved or uncommitted changes on your machine18 versions - Latest release: 3 days ago - 5.53 thousand downloads total - 10 stars on GitHub - 1 maintainer
browse 0.1.1
fast crawling framework2 versions - Latest release: 4 months ago - 382 downloads total - 0 stars on GitHub - 1 maintainer
frangipani 0.3.1
Scraping framework for rust4 versions - Latest release: about 1 year ago - 1.18 thousand downloads total - 3 stars on GitHub - 1 maintainer
wiktionary_crawler 💰
Crawl Wiktionary Courteously yet Correctly and Persistently1 version - Latest release: 4 days ago - 488 downloads total - 1 stars on GitHub - 1 maintainer
waxy 0.2.0
web crawler for community driven search engine7 versions - Latest release: about 2 years ago - 2.36 thousand downloads total - 2 stars on GitHub - 1 maintainer
sitemapo 0.2.0
The implementation of the Sitemap.xml (or URL inclusion) protocol with the support of txt & xml f...2 versions - Latest release: 10 months ago - 592 downloads total - 0 stars on GitHub - 1 maintainer
rsfile 0.1.2
A Rust library to operate files or web pages easily and quickly3 versions - Latest release: over 2 years ago - 1.04 thousand downloads total - 0 stars on GitHub - 1 maintainer
chan-downloader 0.3.0
CLI to download all images/webms of a 4chan thread11 versions - Latest release: over 1 year ago - 4.29 thousand downloads total - 43 stars on GitHub - 1 maintainer
mitsuba 1.10.0
Lightweight 4chan board archive software (like Foolfuuka), in Rust2 versions - Latest release: about 3 years ago - 815 downloads total - 25 stars on GitHub - 1 maintainer
kodict 0.2.1
Provides Korean Dictionary Implements and Crawler for Rust6 versions - Latest release: over 5 years ago - 3.41 thousand downloads total - 0 stars on GitHub - 1 maintainer
ptt-crawler 0.1.0 💰
A crawler for the web version of PTT, the largest online community in Taiwan1 version - Latest release: over 3 years ago - 485 downloads total - 0 stars on GitHub - 1 maintainer
flatcrawl-crawler 1.0.0
This is a rust implementation of a set of webpage crawlers. New crawlers can be easily configured...1 version - Latest release: over 4 years ago - 554 downloads total - 2 stars on GitHub - 1 maintainer
nos 0.1.11
HTML manipulation with CSS seletors2 versions - Latest release: about 3 years ago - 852 downloads total - 0 stars on GitHub - 1 maintainer
maman 0.13.1
Rust Web Crawler16 versions - Latest release: over 5 years ago - 12.7 thousand downloads total - 43 stars on GitHub - 1 maintainer
crusty 0.12.0
Fast && scalable Broad Web Crawler developed on top of crusty-core15 versions - Latest release: almost 3 years ago - 4.9 thousand downloads total - 80 stars on GitHub - 1 maintainer
finde-rs 0.1.4
Multi-threaded filesystem crawler.4 versions - Latest release: about 4 years ago - 1.82 thousand downloads total - 4 stars on GitHub - 1 maintainer
recursive_scraper 0.6.2
Constant-frequency recursive CLI web scraper with frequency, filtering, file directory, and many ...9 versions - Latest release: about 1 year ago - 2.48 thousand downloads total - 4 stars on GitHub - 1 maintainer
jsdom 0.0.9
A rust javascript dom parser for web scraping11 versions - Latest release: almost 1 year ago - 1 dependent package - 1 dependent repositories - 4.56 thousand downloads total - 2 stars on GitHub - 1 maintainer
nipper-trunk 0.1.9 💰
HTML manipulation with CSS seletors1 version - Latest release: about 3 years ago - 1 dependent package - 1 dependent repositories - 5.76 thousand downloads total - 0 stars on GitHub - 1 maintainer
kingslayer 0.5.5
A text adventure dungeon crawler game written in Rust13 versions - Latest release: about 2 years ago - 5.88 thousand downloads total - 34 stars on GitHub - 1 maintainer
wdict 0.1.12
Create dictionaries by scraping webpages.13 versions - Latest release: 2 months ago - 3.97 thousand downloads total - 1 stars on GitHub - 1 maintainer
Top 6.8% on crates.io
10 versions - Latest release: about 3 years ago - 14 dependent packages - 23 dependent repositories - 296 thousand downloads total - 121 stars on GitHub - 1 maintainer
nipper 0.1.9
HTML manipulation with CSS seletors10 versions - Latest release: about 3 years ago - 14 dependent packages - 23 dependent repositories - 296 thousand downloads total - 121 stars on GitHub - 1 maintainer
hltv 0.3.2
A client to fetch and parse data from HLTV.org6 versions - Latest release: almost 2 years ago - 1.83 thousand downloads total - 4 stars on GitHub - 1 maintainer
spider_worker 1.93.14
The fastest web crawler as a worker or proxy.388 versions - Latest release: 13 days ago - 104 thousand downloads total - 406 stars on GitHub - 1 maintainer
async_job 0.1.4
Simple async cron job crate for Rust5 versions - Latest release: 5 months ago - 1 dependent package - 3.35 thousand downloads total - 0 stars on GitHub - 1 maintainer
robotxt 0.6.1
The implementation of the Robots.txt (or URL exclusion) protocol with the support of crawl-delay,...14 versions - Latest release: 2 months ago - 3.62 thousand downloads total - 2 stars on GitHub - 1 maintainer
spire 0.1.0
The flexible scraper framework powered by tokio and tower.1 version - Latest release: 7 months ago - 301 downloads total - 1 maintainer
tower-crawl 0.1.0
Tower middlewares, adapters and utilities useful for web crawling.1 version - Latest release: 7 months ago - 272 downloads total - 1 maintainer
spire-core 0.1.0
Core types and traits for spire.1 version - Latest release: 7 months ago - 2 dependent packages - 497 downloads total - 1 maintainer
spire-macros 0.1.0
Macros for spire.1 version - Latest release: 7 months ago - 1 dependent package - 380 downloads total - 1 maintainer
tower-scrap 0.1.0
Tower middlewares, adapters and utilities useful for web scraping.1 version - Latest release: 7 months ago - 272 downloads total - 1 maintainer
web-crawler 0.1.2
Finds every page, image, and script on a website (and downloads it)1 version - Latest release: 12 months ago - 293 downloads total - 5 stars on GitHub - 1 maintainer
starfish-api 0.1.1 💰
StarfishQL - A graph database and query engine2 versions - Latest release: about 2 years ago - 1 dependent package - 1 dependent repositories - 1.13 thousand downloads total - 112 stars on GitHub - 1 maintainer
starfish-core 0.1.1 💰
StarfishQL - A graph database and query engine2 versions - Latest release: about 2 years ago - 2 dependent packages - 1 dependent repositories - 1.42 thousand downloads total - 112 stars on GitHub - 1 maintainer
starfish-ql 0.1.2 💰
StarfishQL - A graph database and query engine3 versions - Latest release: about 2 years ago - 996 downloads total - 112 stars on GitHub - 1 maintainer
url-crawler 0.3.1
Use crusty instead6 versions - Latest release: over 2 years ago - 1 dependent repositories - 4.61 thousand downloads total - 1 maintainer
yuki 0.1.3
multithreaded web archiver4 versions - Latest release: about 1 year ago - 966 downloads total - 1 stars on GitHub - 1 maintainer
medina 0.0.1
An asynchronous web crawling engine12 versions - Latest release: almost 4 years ago - 4.06 thousand downloads total - 1 maintainer
od-get 0.3.1
A Rust tool for recursively crawling & downloading data from open directories7 versions - Latest release: over 3 years ago - 2.41 thousand downloads total - 1 stars on GitHub - 1 maintainer
robotparser-fork 0.11.0 💰
robots.txt parser for Rust7 versions - Latest release: about 2 years ago - 2 dependent packages - 2 dependent repositories - 3.87 thousand downloads total - 17 stars on GitHub - 1 maintainer
robotparser 0.11.0 💰
robots.txt parser for Rust19 versions - Latest release: about 2 years ago - 3 dependent packages - 2 dependent repositories - 19.4 thousand downloads total - 17 stars on GitHub - 1 maintainer
reudh 0.2.1
A tool for parsing and indexing word etymologies from etymonline.com3 versions - Latest release: about 6 years ago - 1.83 thousand downloads total - 0 stars on GitHub - 1 maintainer
website_crawler 0.9.6
gRPC tokio based web crawler200 versions - Latest release: 29 days ago - 53.6 thousand downloads total - 39 stars on GitHub - 1 maintainer
ocapi 0.0.0
A Rust library for the Opencast REST API (unofficial)1 version - Latest release: about 1 year ago - 289 downloads total - 0 stars on GitHub - 1 maintainer
wrake 0.3.0
Collect links from the given URL4 versions - Latest release: over 2 years ago - 1.21 thousand downloads total - 0 stars on GitHub - 1 maintainer
ungoliant 2.0.0
The pipeline for the OSCAR corpus.5 versions - Latest release: about 1 year ago - 1.75 thousand downloads total - 145 stars on GitHub - 2 maintainers
dyer-macros 0.2.0
Dyer-macros is a collection of macros when compiling and building dyer.2 versions - Latest release: over 2 years ago - 1 dependent package - 1 dependent repositories - 131 thousand downloads total - 134 stars on GitHub - 1 maintainer
crypto-client 0.1.0
An unified restful client for all cryptocurrency exchanges.1 version - Latest release: over 3 years ago - 452 downloads total - 206 stars on GitHub - 1 maintainer
crypto-ws-client 4.12.11
A versatile websocket client that supports many cryptocurrency exchanges.179 versions - Latest release: about 1 year ago - 1 dependent package - 1 dependent repositories - 30.4 thousand downloads total - 197 stars on GitHub - 1 maintainer
Related Keywords
rust
20
spider
16
scraper
15
web
11
scraping
9
web-crawler
8
parser
7
websocket
7
cryptocurrency
7
blockchain
6
trading
6
html
4
async
4
framework
4
cli
4
hacktoberfest
3
robot
3
robots
3
visualization
3
sql
3
indexer
3
network
3
headless-chrome
3
http
3
web-scraping
3
dictionary
3
graph
3
database
3
crates-io
3
graph-query-engine
3
graph-database
3
selector
3
sqlite
3
mysql
3
postgres
3
css
3
robots-parser
2
sitemap
2
url
2
multi-threaded
2
spider_cli
2
rust-programming-language
2
web-framework
2
api
2
download
2
tower
2
interactive-fiction
1
robots-txt
1
dyer
1
ron
1
wasm
1
webassembly
1
reconnaissance
1
wordlist
1
css-selectors
1
html5ever
1
nipper
1
selectors
1
hltv
1
esports
1
csgo
1
async-jobs
1
async-task
1
cronjob
1
bytes
1
dyer-cli
1
oscar
1
nlp
1
language-classification
1
fasttext
1
corpus-linguistics
1
commoncrawl
1
common-crawl
1
api-client
1
client
1
rest
1
opencast
1
grpc
1
a11ywatch
1
web-indexer
1
site-map-generator
1
linguistics
1
english
1
etymonline
1
open-directory-downloader
1
open-directory
1
crawling
1
seo
1
sitemap-xml
1
web-page-helper
1
xml
1
url-inclusion-protocol
1
txt
1
sitemap-index
1
rss
1
google
1
pronunciation
1
machine-learning
1
cjk
1
wiktionary
1