proxy.golang.org : github.com/pzaino/thecrowler
Package main (TheCROWler) is the application. It's responsible for starting the crawler and kickstart the configuration reading and the database connection. Actual crawling is performed by the pkg/crawler package. The database connection is handled by the pkg/database package. The configuration is handled by the pkg/config package. Page info extraction is handled by the pkg/scrapper package.
Registry
-
Source
- Documentation
- JSON
purl: pkg:golang/github.com/pzaino/thecrowler
Keywords:
automation
, blue-team-tool
, content-detection
, content-discovery
, crawler
, crawling
, cyber-security
, cybersecurity
, cybersecurity-tools
, data-collection
, data-science
, distributed-systems
, golang
, indexer
, indexing
, reconnaissance
, red-team-tools
, scraping
, search-engine
, vulnerability-detection
License: Apache-2.0
Latest release: 21 days ago
First release: over 1 year ago
Namespace: github.com/pzaino
Stars: 49 on GitHub
Forks: 9 on GitHub
See more repository details: repos.ecosyste.ms
Funding links: https://github.com/sponsors/pzaino
Last synced: 7 days ago