proxy.golang.org : github.com/alphagov/govuk_crawler_worker

A worker that will consume GOV.UK URLs from a message queue and crawl them, saving the output to disk

Registry - Source - Documentation - JSON - codemeta.json
purl: pkg:golang/github.com/alphagov/govuk_crawler_worker
Keywords: govuk
License: MIT
Latest release: almost 3 years ago
First release: over 4 years ago
Namespace: github.com/alphagov
Stars: 18 on GitHub
Forks: 8 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 4 months ago

• Readme
• Versions 2
• Dependent Packages 0
• Maintainers 0