proxy.golang.org : github.com/celrenheit/spider
Installation: Usage of this package is around the usage of spiders and passing contexts. If you have many spider you can make use of a scheduler. This package provides a basic scheduler. This will launch 2 spiders every 20 seconds for the first and every 10 seconds for the second. You can create you own spider by implementing the Spider interface
Registry
-
Source
- Documentation
- JSON
purl: pkg:golang/github.com/celrenheit/spider
License: MIT
Latest release: over 9 years ago
First release: over 9 years ago
Namespace: github.com/celrenheit
Stars: 175 on GitHub
Forks: 5 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 9 days ago