An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

formulae.brew.sh "crawler" keyword

moodle-dl 2.3.13 💰
Downloads course content fast from Moodle (e.g., lecture PDFs)
1 version - Latest release: over 1 year ago - 40 downloads last month - 654 stars on GitHub
katana 1.8.0
Crawling and spidering framework
14 versions - Latest release: 15 days ago - 345 downloads last month - 17,694 stars on GitHub
lux 0.24.1
Fast and simple video downloader
14 versions - Latest release: over 2 years ago - 3 dependent repositories - 45 downloads last month - 31,772 stars on GitHub
cariddi 1.4.6 💰
Scan for endpoints, secrets, API keys, file extensions, tokens and more
12 versions - Latest release: 6 months ago - 4 downloads last month - 3,405 stars on GitHub