nuget.org : abot
Abot is an open source C# web crawler built for speed and flexibility. It takes care of the low level plumbing (multithreading, http requests, scheduling, link parsing, etc..). You just register for events to process the page data. You can also plugin your own implementations of core interfaces to take complete control over the crawl process.
Registry
-
Source
- JSON
purl: pkg:nuget/abot
Keywords:
crawler
, robot
, spider
, .net
, dotnet
, abot
, abot-nuget
, c-sharp
, cross-platform
, csharp
, csharp-library
, javascript-renderer
, netcore
, netcore2
, netcore3
, netsta
, netstandard20
, netstandard21
, parsing
, pluggable
, spiders
, unit-testing
, web-crawler
License: Apache-2.0
Latest release: almost 4 years ago
First release: over 125 years ago
Dependent packages: 1
Downloads: 890,903 total
Stars: 2,220 on GitHub
Forks: 555 on GitHub
Total Commits: 492
Committers: 28
Average commits per author: 17.571
Development Distribution Score (DDS): 0.114
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Last synced: 6 days ago