Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

nuget.org "crawler" keyword

puppeteersharp 17.0.0 💰
Headless Browser .NET API
85 versions - Latest release: 27 days ago - 103 dependent packages - 11.2 million downloads total - 3,141 stars on GitHub - 1 maintainer
dotnetthirdpartynotices 0.3.3 💰
A .NET tool to generate file with third party legal notices
12 versions - Latest release: 2 months ago - 3.08 thousand downloads total - 19 stars on GitHub - 1 maintainer
fiftyone.devicedetection.hash.engine.onpremise 4.4.132
51Degrees Device Detection parses HTTP headers to return detailed hardware, operating system, bro...
142 versions - Latest release: 3 days ago - 1 dependent package - 294 thousand downloads total - 1 maintainer
fiftyone.devicedetection.cloud 4.4.132
51Degrees Device Detection parses HTTP headers to return detailed hardware, operating system, bro...
142 versions - Latest release: 3 days ago - 1 dependent package - 290 thousand downloads total - 1 maintainer
fiftyone.devicedetection.shared 4.4.132
51Degrees Device Detection parses HTTP headers to return detailed hardware, operating system, bro...
142 versions - Latest release: 3 days ago - 2 dependent packages - 337 thousand downloads total - 1 maintainer
fiftyone.devicedetection 4.4.132
51Degrees Device Detection parses HTTP headers to return detailed hardware, operating system, bro...
142 versions - Latest release: 3 days ago - 1 dependent package - 277 thousand downloads total - 1 maintainer
softcircuits.htmlmonkey 2.2.0
HtmlMonkey is a lightweight HTML/XML parser written in C#. It allows you to parse an HTML or XML ...
28 versions - Latest release: 2 months ago - 2 dependent packages - 42.1 thousand downloads total - 48 stars on GitHub - 1 maintainer
jx.dcsoup 1.0.1
此fork仅为了移植一些jsoup的代码,以便在.net core下使用。不保证维护。 dcsoup is a .NET library for working with rea...
2 versions - Latest release: about 1 year ago - 447 downloads total - 0 stars on GitHub - 1 maintainer
spidey 5.0.90
Spidey is a library designed to help with crawling and parsing web content.
129 versions - Latest release: 4 days ago - 36.4 thousand downloads total - 11 stars on GitHub - 1 maintainer
Top 8.5% on nuget.org
wangkanai.detection.crawler 2.0.1 💰
ASP.NET Core Detection Crawler resolver components
14 versions - Latest release: over 3 years ago - 1 dependent package - 693 thousand downloads total - 549 stars on GitHub - 1 maintainer
juro.extractors 1.3.10
Extractors for source providers.
21 versions - Latest release: 3 months ago - 2 dependent packages - 2.98 thousand downloads total - 10 stars on GitHub - 1 maintainer
juro.core 1.3.10
Core plugins for source providers.
21 versions - Latest release: 3 months ago - 4 dependent packages - 4 thousand downloads total - 10 stars on GitHub - 1 maintainer
Top 2.3% on nuget.org
htmlagilitypack.netcore 1.4.9
Deprecated as there's new maintainer for original HAP project. Please check the new repo at https...
4 versions - Latest release: over 124 years ago - 63 dependent packages - 151 dependent repositories - 3.29 million downloads total - 30 stars on GitHub - 1 maintainer
htmlagilitypack 1.11.61
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you a...
153 versions - Latest release: 20 days ago - 798 dependent packages - 167 million downloads total - 1 maintainer
dotnetspider 5.1.2
DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-le...
45 versions - Latest release: 11 months ago - 7 dependent packages - 87.3 thousand downloads total - 3,886 stars on GitHub - 1 maintainer
cspider.aspnetcore 1.1.0
This is a distributed crawler component library.
2 versions - Latest release: over 124 years ago - 2 dependent packages
aspose.total 24.4.0
Aspose.Total for .NET is the most complete package of all .NET file format APIs offered by Aspose...
70 versions - Latest release: 20 days ago - 3 dependent packages - 177 thousand downloads total - 2 maintainers
abot 2.0.70
Abot is an open source C# web crawler built for speed and flexibility. It takes care of the low l...
153 versions - Latest release: almost 3 years ago - 1 dependent package - 739 thousand downloads total - 2,198 stars on GitHub - 1 maintainer
Top 5.4% on nuget.org
dcsoup 1.0.0
dcsoup is a .NET library for working with real-world HTML. It provides a very convenient API for ...
3 versions - Latest release: almost 7 years ago - 1 dependent package - 9 dependent repositories - 99.8 thousand downloads total - 55 stars on GitHub - 1 maintainer
conholdate.total 24.3.0
Conholdate.Total for .NET is a complete package to work with a large number of file formats from ...
38 versions - Latest release: about 1 month ago - 129 thousand downloads total - 2 maintainers
juro.providers 1.3.10
Source providers.
21 versions - Latest release: 3 months ago - 2.13 thousand downloads total - 10 stars on GitHub - 1 maintainer
juro.providers.adult 1.3.10
Source providers.
14 versions - Latest release: 3 months ago - 1.44 thousand downloads total - 10 stars on GitHub - 1 maintainer
juro 1.3.10
Client for source providers.
62 versions - Latest release: 3 months ago - 9.83 thousand downloads total - 10 stars on GitHub - 1 maintainer
com.staticvoidlabs.nugetlibs.mediacrawler 0.0.1
Scan local storage for media files.
1 version - Latest release: over 124 years ago
dotnetspiderlite.anglesharp 0.2.0
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient...
2 versions - Latest release: almost 5 years ago - 1.44 thousand downloads total - 37 stars on GitHub - 1 maintainer
socialsense 1.2.0
Crawler for main social networks
4 versions - Latest release: over 10 years ago - 5.29 thousand downloads total - 17 stars on GitHub - 1 maintainer
Top 6.0% on nuget.org
dotnetspider2.core 2.4.5
A .NET Standard web crawling library similar to WebMagic and Scrapy. It is a lightweight ,efficie...
141 versions - Latest release: over 124 years ago - 2 dependent packages - 2 dependent repositories
totalrecall 0.2.3
Crawl and index your (static) asp.net website for searching using an MSBuild target. Simple searc...
1 version - Latest release: almost 13 years ago - 2.65 thousand downloads total - 5 stars on GitHub - 1 maintainer
zlzforever.test 2.2.0
A .NET Standard web crawling library similar to WebMagic and Scrapy. It is a lightweight ,efficie...
1 version - Latest release: over 124 years ago
Top 8.7% on nuget.org
htmlagilitypack.net45 2.0.20
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you a...
2 versions - Latest release: about 8 years ago - 3 dependent repositories - 226 thousand downloads total - 7 stars on GitHub - 1 maintainer
dotnetspider2.runner 2.0.10
Offical package. DotnetSpider is a high performance, light weight cralwer developed by C#.
27 versions - Latest release: over 124 years ago - 3,594 stars on GitHub
Top 9.5% on nuget.org
html2article 1.17.0
.NET平台下,一个高效的从Html中提取正文的工具。 正文提取采用了基于文本密度的提取算法,支持从压缩的Html文档中提取正文,每个页面平均提取时间为30ms,正确率在95%以上。
5 versions - Latest release: almost 11 years ago - 1 dependent repositories - 9.88 thousand downloads total - 485 stars on GitHub - 1 maintainer
backpacklogin 0.1.0
A .net core library to handle the login to Backpack.tf. Backpack.tf is a trading site for Team Fo...
1 version - Latest release: about 7 years ago - 1.8 thousand downloads total - 7 stars on GitHub - 1 maintainer
nscrape 0.4.1
A web scraping framework for .NET
5 versions - Latest release: about 5 years ago - 18.5 thousand downloads total - 61 stars on GitHub - 1 maintainer
staticvoidlabs.mediacrawler 0.0.3
Scan local storage for media files.
2 versions - Latest release: over 5 years ago - 1.58 thousand downloads total - 1 maintainer
Top 8.4% on nuget.org
skyscraper 1.0.46
Web scraper / crawler / spider. Supports robots protocol and user agent.
22 versions - Latest release: over 7 years ago - 3 dependent repositories - 38.6 thousand downloads total - 56 stars on GitHub - 1 maintainer
dataextractingsdk 1.0.1
Library allows you to extract different data from text or web sources, analyze text content, extr...
2 versions - Latest release: about 12 years ago - 4 dependent repositories - 4.12 thousand downloads total - 1 maintainer
scsearchcontrib.searcher 2.1.0
The searching/querying component of the Sitecore Search Contrib project
2 versions - Latest release: about 11 years ago - 9.08 thousand downloads total - 1 maintainer
taiwan-news-crawlers 1.4.11
台灣新聞網爬蟲
13 versions - Latest release: about 1 year ago - 2.61 thousand downloads total - 2 stars on GitHub - 1 maintainer
htmlagilitypack.netcorecodepages 1.5.0.2
This is a port of HtmlAgilityPack library created by Simon Mourrier and Jeff Klawiter for .NET Co...
1 version - Latest release: over 124 years ago
dotnetspider2.extension 2.4.5
A .NET Standard web crawling library similar to WebMagic and Scrapy. It is a lightweight ,efficie...
136 versions - Latest release: over 124 years ago - 2 dependent repositories
bcjobs.htmlagilitypack 1.4.11
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you a...
2 versions - Latest release: over 7 years ago - 2.77 thousand downloads total - 0 stars on GitHub - 1 maintainer
fakeagent.net 1.0.2
A fake agent random generater for cralwers.
3 versions - Latest release: almost 4 years ago - 1.5 thousand downloads total - 2 stars on GitHub - 1 maintainer
Top 9.2% on nuget.org
sloader.result 1.2.0
Package Description
11 versions - Latest release: over 2 years ago - 1 dependent package - 14.9 thousand downloads total - 4 stars on GitHub - 1 maintainer
Top 9.8% on nuget.org
spidersharp 1.0.25
Web Crawling and Scraping Framework
24 versions - Latest release: about 5 years ago - 30.3 thousand downloads total - 11 stars on GitHub - 1 maintainer
Top 9.3% on nuget.org
abotx 2.1.12
A powerful C# web crawler that makes advanced crawling features easy to use. AbotX builds upon th...
83 versions - Latest release: about 3 years ago - 3 dependent repositories - 209 thousand downloads total - 1 maintainer
dotnetspiderlite.scheduler.stackexchange.redis 0.2.0
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient...
2 versions - Latest release: almost 5 years ago - 1.35 thousand downloads total - 37 stars on GitHub - 1 maintainer
Top 7.5% on nuget.org
dotnetspider.htmlagilitypack 0.0.9-alpha
DotnetSpider.HtmlAgilityPack
2 versions - Latest release: over 124 years ago - 6 dependent packages - 3,594 stars on GitHub
dotnetspiderlite.scheduler.redis 0.2.0
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient...
2 versions - Latest release: almost 5 years ago - 1 dependent package - 1.73 thousand downloads total - 37 stars on GitHub - 1 maintainer
Top 8.3% on nuget.org
crawlerlib.engine 2.0.2
The Crawler-Lib Engine is a general purpose workflow enabled task processor. It has evolved from ...
18 versions - Latest release: over 10 years ago - 1 dependent package - 2 dependent repositories - 32.9 thousand downloads total - 1 maintainer
robotrules 1.5.2
A Simple and Powerful Library to Deal with Web Robots Control Strategy.
5 versions - Latest release: about 10 years ago - 6.57 thousand downloads total - 1 maintainer
dotnetspiderlite.nlog 0.2.0
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient...
2 versions - Latest release: almost 5 years ago - 1.43 thousand downloads total - 37 stars on GitHub - 1 maintainer
nfdotnetspider.agentcenter 5.0.1-beta6
DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-le...
1 version - Latest release: over 3 years ago
Top 9.6% on nuget.org
dotnetspider.redial 0.0.9
DotnetSpider.Redial
3 versions - Latest release: over 124 years ago - 2 dependent packages - 3,594 stars on GitHub
htmlagilitypack.plus 0.0.1-alpha
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you a...
1 version - Latest release: over 124 years ago
dotnetspider.mongo 5.1.2
DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-le...
23 versions - Latest release: 11 months ago - 10.6 thousand downloads total - 3,885 stars on GitHub - 1 maintainer
dotnetspiderlite.proxypools 0.2.0
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient...
2 versions - Latest release: almost 5 years ago - 2.29 thousand downloads total - 37 stars on GitHub - 1 maintainer
ncrawer 3.0.0
This is
1 version - Latest release: over 124 years ago
lrqwebcrawler 0.0.0.1
网页数据爬取
1 version - Latest release: over 5 years ago - 687 downloads total - 1 maintainer
Top 4.5% on nuget.org
dotnetspider.common 3.0.0
A .NET Standard web crawling library similar to WebMagic and Scrapy. It is a lightweight ,efficie...
2 versions - Latest release: over 124 years ago - 3 dependent packages - 3,593 stars on GitHub
Top 9.1% on nuget.org
corecompat.nscrape 0.4.0-r6
A web scraping framework for .Net
11 versions - Latest release: over 6 years ago - 1 dependent repositories - 56 stars on GitHub
sloader.crawler 1.3.0
Sloader Crawler
6 versions - Latest release: over 124 years ago - 4 stars on GitHub
sloader.results 1.2.0
Sloader Result Type Definitions
4 versions - Latest release: over 124 years ago - 1 dependent package - 4 stars on GitHub
webcrawler.core 1.0.0
这是一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。
1 version - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 1.32 thousand downloads total - 40 stars on GitHub - 1 maintainer
sloader.crawler.config 1.2.0
Sloader Crawler Config
5 versions - Latest release: over 124 years ago - 1 dependent package - 4 stars on GitHub
Top 4.7% on nuget.org
dotnetspider2.redial 1.0.9
Offical package. DotnetSpider is a high performance, light weight cralwer developed by C#.
7 versions - Latest release: over 124 years ago - 1 dependent package - 1 dependent repositories - 3,594 stars on GitHub
Top 6.2% on nuget.org
dotnetspider.extension 3.0.8
A .NET Standard web crawling library similar to WebMagic and Scrapy. It is a lightweight ,efficie...
18 versions - Latest release: over 124 years ago - 6 dependent repositories - 3,593 stars on GitHub
dotnetspider.postgresql 5.1.2
DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-le...
21 versions - Latest release: 11 months ago - 9.6 thousand downloads total - 3,885 stars on GitHub - 1 maintainer
sloader.engine 1.4.1
Package Description
27 versions - Latest release: over 2 years ago - 23.9 thousand downloads total - 4 stars on GitHub - 1 maintainer
scarpyrt.client 1.0.0
An SDK client to make calls to a scrapyrt http endpoint.
1 version - Latest release: almost 5 years ago - 524 downloads total - 1 maintainer
Top 8.8% on nuget.org
html2article.dll 1.13.0
.NET平台下,一个高效的从Html中提取正文的工具。 正文提取采用了基于文本密度的提取算法,支持从压缩的Html文档中提取正文,每个页面平均提取时间为30ms,正确率在95%以上。
1 version - Latest release: over 124 years ago - 473 stars on GitHub
Top 8.9% on nuget.org
sloader.config 1.2.1
Package Description
15 versions - Latest release: over 5 years ago - 1 dependent package - 19.2 thousand downloads total - 4 stars on GitHub - 1 maintainer
netcrawlerdetect 1.2.941
A .net standard port of JayBizzle's CrawlerDetect project (https://github.com/JayBizzle/Crawler-D...
28 versions - Latest release: over 124 years ago - 173 thousand downloads total - 18 stars on GitHub - 1 maintainer
fs.example.uk 1.3.2.1
Sloader Config
1 version - Latest release: over 6 years ago - 1.21 thousand downloads total - 4 stars on GitHub - 1 maintainer
crawlerlib.engine.testhelper 2.3.5544.21265
The Crawler-Lib Engine Test Helper simplifies the test of tasks. It can be used to develop...
14 versions - Latest release: about 9 years ago - 16.5 thousand downloads total - 1 maintainer
sop.dotnetspider 0.1.0
Sop.Spider a .NET Standard web crawling library. It is lightweight, efficient and fast high-level...
1 version - Latest release: over 4 years ago - 520 downloads total - 5 stars on GitHub - 1 maintainer
teamfortressoutpostapi 0.1.1
An API wrapper for the TF2 Outpost platform. A platform to find great deals for your Team Fortres...
2 versions - Latest release: about 7 years ago - 2.58 thousand downloads total - 3 stars on GitHub - 1 maintainer
dotnetspiderlite.core 0.2.0
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient...
3 versions - Latest release: almost 5 years ago - 3 dependent packages - 4.64 thousand downloads total - 37 stars on GitHub - 1 maintainer
dotnetspider.rabbitmq-private 5.0.1-beta6
this is a fork from DotnetSpider project,make some bug fixed for private use. DotnetSpider, a .NE...
1 version - Latest release: over 124 years ago - 1 dependent repositories
abotcore 0.1.13-beta
.NET Core port of sjdirect/abot. Abot is an open source C# web crawler built for speed and flexib...
14 versions - Latest release: over 7 years ago
collectioncrawler_i_s_miller 1.0.0
Extension for bi-directional collection traversal.
1 version - Latest release: over 124 years ago
mechanize.net.anglesharp 1.0.2
AngleSharp IHtmlParser Extension for Mechanize.NET
2 versions - Latest release: over 6 years ago - 1 dependent repositories - 2.24 thousand downloads total - 30 stars on GitHub - 1 maintainer
exoscraper 0.1.0
Declarative high performance web scraper in C#. Easily crawl any web site and parse the data, sav...
1 version - Latest release: over 1 year ago - 270 downloads total - 93 stars on GitHub - 1 maintainer
shaman.scraping 1.0.1.1
A library for reading/writing WARC files and scraping websites.
5 versions - Latest release: over 124 years ago - 7 stars on GitHub
Top 5.6% on nuget.org
httpcode.core 4.2.0
简单、易用、高效 一个有态度的开源.Net Http请求框架!可以用制作爬虫,api请求等等。让你感受一个简易到极致的HTTP编程. 让编程更简易,代码更简洁。用法请查看:https://git...
2 versions - Latest release: over 6 years ago - 3 dependent packages - 3 dependent repositories - 15.3 thousand downloads total - 159 stars on GitHub - 1 maintainer
scsearchcontrib.crawler 2.1.0
The crawling/indexing component of the Sitecore Search Contrib project
1 version - Latest release: about 11 years ago - 8.01 thousand downloads total - 1 maintainer
Top 9.0% on nuget.org
devzh.htmlagilitypack 1.4.9
HtmlAgilityPack for .NET Core
6 versions - Latest release: over 124 years ago - 1 dependent package - 1 dependent repositories
Top 9.8% on nuget.org
prmtoolkit.selenium 1.0.3
Facilita a intereção com Selenium através de comandos mais simples. Além de facilitar a realizaçã...
4 versions - Latest release: about 5 years ago - 1 dependent package - 3 dependent repositories - 5.3 thousand downloads total - 20 stars on GitHub - 1 maintainer
Top 3.2% on nuget.org
dotnetspider.downloader 3.0.8
A .NET Standard web crawling library similar to WebMagic and Scrapy. It is a lightweight ,efficie...
6 versions - Latest release: over 124 years ago - 2 dependent packages - 2 dependent repositories - 3,593 stars on GitHub
Top 6.0% on nuget.org
dotnetspider.proxy 3.0.0
A .NET Standard web crawling library similar to WebMagic and Scrapy. It is a lightweight ,efficie...
2 versions - Latest release: over 124 years ago - 2 dependent packages - 2 dependent repositories
crawlerwave.core 0.0.0.3
A fluent wrapper for Selenium and many usefull tools to web crawlers
1 version - Latest release: almost 5 years ago - 519 downloads total - 1 stars on GitHub - 1 maintainer
xmlcrawler 1.1.0
A package to make your life even more happy and simple when messing with XML files.
2 versions - Latest release: almost 3 years ago - 909 downloads total - 1 maintainer
dotnetspiderlite.htmlagilitypack 0.2.0
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient...
2 versions - Latest release: almost 5 years ago - 3.48 thousand downloads total - 36 stars on GitHub - 1 maintainer
aspose.total.beta 20.2.0
Aspose.Total for .NET is the most complete package of all .NET file format APIs offered by Aspose...
1 version - Latest release: over 124 years ago
Top 8.2% on nuget.org
dotnetspider.extraction.excelexpression 3.0.6
A .NET Standard web crawling library similar to WebMagic and Scrapy. It is a lightweight ,efficie...
2 versions - Latest release: over 124 years ago - 3,593 stars on GitHub
htmldexteritypack 1.5.1
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you a...
2 versions - Latest release: about 7 years ago - 3.02 thousand downloads total - 1 maintainer
webcrawler.pipelines 1.0.0
这是一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。
1 version - Latest release: over 6 years ago - 1 dependent repositories - 1.04 thousand downloads total - 40 stars on GitHub - 1 maintainer
Top 8.8% on nuget.org
dotnetspiderlite.abstractions 0.2.0
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient...
3 versions - Latest release: almost 5 years ago - 6 dependent packages - 7.65 thousand downloads total - 36 stars on GitHub - 1 maintainer
Top 9.8% on nuget.org
htmlmonkey 1.0.1
HtmlMonkey is a lightweight HTML/XML parser written in C#. It allows you to parse an HTML or XML ...
2 versions - Latest release: over 124 years ago - 42 stars on GitHub
mechanize.net 1.0.2
Stateful programmatic web browsing, based on Python-Mechanize, which is based on Andy Lester’s Pe...
3 versions - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 6.2 thousand downloads total - 30 stars on GitHub - 1 maintainer