Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
proxy.golang.org : github.com/pzaino/thecrowler
Package main (TheCROWler) is the application. It's responsible for starting the crawler and kickstart the configuration reading and the database connection. Actual crawling is performed by the pkg/crawler package. The database connection is handled by the pkg/database package. The configuration is handled by the pkg/config package. Page info extraction is handled by the pkg/scrapper package.
Registry
-
Source
- Documentation
- JSON
purl: pkg:golang/github.com/pzaino/thecrowler
Keywords: crawler, crawling, golang, indexer, indexing, search-engine
License: Apache-2.0
Latest release: about 1 month ago
First release: 4 months ago
Namespace: github.com/pzaino
Stars: 1 on GitHub
Forks: 1 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: about 21 hours ago