Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
Top 8.9% downloads on nuget.org
Top 5.1% dependent repos on nuget.org
nuget.org : crawlerlib.engine
The Crawler-Lib Engine is a general purpose workflow enabled task processor. It has evolved from a web crawler over data mining and information retrieval. It is throughput optimized and can perform thousands of tasks per second on standard hardware. Due to its workflow capabilities it allows to structure and parallelize even complex kind of work. Please visit the project page for the complete view of the Crawler-Lib Engine. A license for the Anonymous Edition is included in the package. A license for the more powerful free Community Edition can be generated on the project page. A unrestricted license is available too.
Registry
- Homepage
- JSON
purl: pkg:nuget/crawlerlib.engine
Keywords: crawler-lib, task, processor, workflow, action, async, await, crawler, spider, bot, scraper, twitter, facebook, google+, blog, http, html, xml, json, rss, feed, datamining, IAsync, tpl, webrequest, extracting
License:
Latest release: over 10 years ago
First release: almost 11 years ago
Dependent packages: 1
Dependent repositories: 2
Downloads: 32,852 total
Last synced: 18 days ago