Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
nuget.org : abotcore
.NET Core port of sjdirect/abot. Abot is an open source C# web crawler built for speed and flexibility. It takes care of the low level plumbing (multithreading, http requests, scheduling, link parsing, etc..). You just register for events to process the page data. You can also plugin your own implementations of core interfaces to take complete control over the crawl process.
Registry
- Homepage
- JSON
purl: pkg:nuget/abotcore
Keywords: crawler, robot, spider
License:
Latest release: over 7 years ago
First release: over 7 years ago
Last synced: 1 day ago