Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

crates.io "crawling" keyword

View the packages on the crates.io package registry that are tagged with the "crawling" keyword.

warc-parquet 0.6.1 💰
A utility for converting WARC to Parquet.
10 versions - Latest release: almost 2 years ago - 309 thousand downloads total - 110 stars on GitHub - 1 maintainer
voyager 0.2.1
Web crawler and scraper
4 versions - Latest release: over 3 years ago - 1 dependent repositories - 10.9 thousand downloads total - 756 stars on GitHub - 1 maintainer
medina 0.0.1
An asynchronous web crawling engine
12 versions - Latest release: almost 5 years ago - 13.9 thousand downloads total - 1 maintainer
scout-json 0.7.2
JSON representation of ScoutLang AST
3 versions - Latest release: 11 months ago - 2.85 thousand downloads total - 112 stars on GitHub - 1 maintainer
scout-interpreter 0.7.2
A web crawling programming language
7 versions - Latest release: 11 months ago - 6.2 thousand downloads total - 112 stars on GitHub - 1 maintainer
scout-parser 0.7.2
A web crawling programming language
7 versions - Latest release: 11 months ago - 6.38 thousand downloads total - 112 stars on GitHub - 1 maintainer
scout-worker 0.7.2
A worker framework for ScoutLang
2 versions - Latest release: 11 months ago - 1.75 thousand downloads total - 112 stars on GitHub - 1 maintainer
scout-lexer 0.7.2
A web crawling programming language
7 versions - Latest release: 11 months ago - 6.46 thousand downloads total - 112 stars on GitHub - 1 maintainer
scoutlang 0.7.2
A web crawling programming language
6 versions - Latest release: 11 months ago - 6.66 thousand downloads total - 112 stars on GitHub - 1 maintainer
Related Keywords
scraping 8 programming-language 6 web-crawling 6 web-scraping 6 dsl 6 scraper 6 scraping-websites 6 warc 1 arrow 1 parquet 1 duckdb 1 web-archiving 1 html 1 crawler 1 async 1