Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

repo1.maven.org "crawler" keyword

ai.platon.pulsar:pulsar-boilerpipe 1.12.4
Scrape Web data at scale completely and accurately with high performance, distributed AI-RPA.
61 versions - Latest release: about 1 month ago - 5 dependent packages - 2 dependent repositories - 402 stars on GitHub
Top 1.7% on repo1.maven.org
us.codecraft:webmagic-extension 0.10.3
A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, conte...
29 versions - Latest release: 22 days ago - 27 dependent packages - 1,671 dependent repositories - 11,021 stars on GitHub
Top 1.5% on repo1.maven.org
us.codecraft:webmagic-core 0.10.3
A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, conte...
29 versions - Latest release: 22 days ago - 39 dependent packages - 1,670 dependent repositories - 11,022 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-crawler-fs 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
5 versions - Latest release: over 2 years ago - 2 dependent packages - 6 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-elasticsearch-client-v7 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
3 versions - Latest release: over 2 years ago - 2 dependent packages - 5 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-core 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
5 versions - Latest release: over 2 years ago - 4 dependent packages - 6 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-elasticsearch-client-v5 2.6
FS Crawler offers a simple way to index binary files into elasticsearch.
1 version - Latest release: over 5 years ago - 2 dependent packages - 3 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-es5 2.6
FS Crawler offers a simple way to index binary files into elasticsearch.
1 version - Latest release: over 5 years ago - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-docs 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
3 versions - Latest release: over 2 years ago - 1,178 stars on GitHub
Top 9.5% on repo1.maven.org
fr.pilato.elasticsearch.crawler:fscrawler-test-framework 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
5 versions - Latest release: over 2 years ago - 11 dependent packages - 6 dependent repositories - 1,178 stars on GitHub
Top 9.8% on repo1.maven.org
fr.pilato.elasticsearch.crawler:fscrawler-framework 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
5 versions - Latest release: over 2 years ago - 9 dependent packages - 6 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-es7 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
3 versions - Latest release: over 2 years ago - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-elasticsearch-client-v6 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
4 versions - Latest release: over 2 years ago - 2 dependent packages - 5 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-crawler 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
5 versions - Latest release: over 2 years ago - 1 dependent package - 6 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-it-common 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
4 versions - Latest release: over 2 years ago - 1 dependent package - 6 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-beans 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
5 versions - Latest release: over 2 years ago - 4 dependent packages - 6 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-test-documents 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
5 versions - Latest release: over 2 years ago - 6 dependent packages - 6 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler 2.0.0
FS Crawler offers a simple way to index binary files into elasticsearch.
6 versions - Latest release: over 8 years ago - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-elasticsearch-client-base 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
4 versions - Latest release: over 2 years ago - 6 dependent packages - 6 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-tika 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
5 versions - Latest release: over 2 years ago - 3 dependent packages - 6 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-cli 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
5 versions - Latest release: over 2 years ago - 3 dependent packages - 6 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-crawler-ssh 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
5 versions - Latest release: over 2 years ago - 2 dependent packages - 6 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-settings 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
5 versions - Latest release: over 2 years ago - 7 dependent packages - 6 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-workplacesearch-client 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
3 versions - Latest release: over 2 years ago - 3 dependent packages - 3 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-parent 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
5 versions - Latest release: over 2 years ago - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-3rdparty 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
3 versions - Latest release: over 2 years ago - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-crawler-abstract 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
5 versions - Latest release: over 2 years ago - 4 dependent packages - 6 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-elasticsearch-client 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
5 versions - Latest release: over 2 years ago - 3 dependent packages - 6 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-distribution 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
4 versions - Latest release: over 2 years ago - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-it 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
4 versions - Latest release: over 2 years ago - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-crawler-ftp 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
3 versions - Latest release: over 2 years ago - 2 dependent packages - 3 dependent repositories - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-es6 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
4 versions - Latest release: over 2 years ago - 1,178 stars on GitHub
fr.pilato.elasticsearch.crawler:fscrawler-rest 2.9
FS Crawler offers a simple way to index binary files into elasticsearch.
5 versions - Latest release: over 2 years ago - 3 dependent packages - 6 dependent repositories - 1,178 stars on GitHub
com.github.btheu.estivate:estivate 0.4.3
Estivate fills pojo from HTML with CSS Query Syntax and annotations
15 versions - Latest release: 8 months ago - 2 dependent packages - 1 dependent repositories - 2 stars on GitHub
com.github.xbynet:crawler-server 0.3.0
A simple and flexible web crawler framework for java.
1 version - Latest release: almost 7 years ago - 20 stars on GitHub
com.github.greengerong:prerender-java 1.6.4
Sonatype helps open source projects to set up Maven repositories on https://oss.sonatype.org/
11 versions - Latest release: over 8 years ago - 11 dependent repositories - 121 stars on GitHub
com.jibug.cetty:cetty-parent 0.1.8
cetty is an event dispatch crawler framework
9 versions - Latest release: about 5 years ago - 36 stars on GitHub
com.github.xbynet:crawler-core 0.3.0
A simple and flexible web crawler framework for java.
1 version - Latest release: almost 7 years ago - 2 dependent packages - 2 dependent repositories - 20 stars on GitHub
com.exasol:error-code-crawler-maven-plugin 2.0.3
Crawler for Exasol error codes.
26 versions - Latest release: about 1 month ago - 1 stars on GitHub
com.github.xbynet:crawler-parent 0.3.0
A simple and flexible web crawler framework for java.
1 version - Latest release: almost 7 years ago - 20 stars on GitHub
com.github.xbynet:crawler-selenium 0.3.0
A simple and flexible web crawler framework for java.
1 version - Latest release: almost 7 years ago - 1 dependent repositories - 20 stars on GitHub
com.jibug.cetty:cetty-core 0.1.8
cetty is an event dispatch crawler framework
9 versions - Latest release: about 5 years ago - 2 dependent repositories - 36 stars on GitHub
com.github.qlone:retrofit-crawler 1.1.3
help you get a html like json,thanks retrofit and Jsoup
4 versions - Latest release: about 3 years ago - 4 stars on GitHub
com.github.itechbear:robotstxt 0.0.1
A java clone of Google's robotst.txt parser: https://github.com/google/robotstxt
1 version - Latest release: about 4 years ago - 1 dependent repositories - 0 stars on GitHub
com.bluurr:quora_loader 1.7.0
A realtime read-only locator and extraction library for Quora questions and answers.
9 versions - Latest release: about 3 years ago - 7 stars on GitHub
org.codelibs.fess:fess-crawler-lasta 14.13.0
This is LastaFlute support.
128 versions - Latest release: about 1 month ago - 4 dependent packages - 6 dependent repositories - 25 stars on GitHub
org.codelibs.fess:fess-crawler 14.13.0
Fess Crawler is a crawler framework.
128 versions - Latest release: about 1 month ago - 6 dependent packages - 3 dependent repositories - 25 stars on GitHub
org.codelibs.fess:fess-crawler-es 14.13.0
Fess Crawler is Crawler Framework.
128 versions - Latest release: about 1 month ago - 1 dependent package - 5 dependent repositories - 25 stars on GitHub
com.github.mikrop:patrani-policie 1.0.6
Scraper webové aplikace pátrání policie české republiky. Umožňující strojové zpracování pátrání
3 versions - Latest release: over 5 years ago - 1 stars on GitHub
Top 9.3% on repo1.maven.org
org.codelibs.fess:fess 14.13.0
Fess is Full tExt Search System.
151 versions - Latest release: about 1 month ago - 23 dependent packages - 21 dependent repositories - 713 stars on GitHub
com.github.abola:crawler 1.1.1
This is a open project of Java. The project integrated Apache Commons-VFS and Jsoup. It can be gr...
9 versions - Latest release: over 7 years ago - 2 dependent repositories - 104 stars on GitHub
com.arthurivanets:google-play-scraper 1.1.2
Library for scraping of the application data from the Google Play Store
4 versions - Latest release: over 1 year ago - 2 stars on GitHub
org.codelibs.fess:fess-crawler-webdriver 3.16.0
This is a library for Web Driver.
109 versions - Latest release: over 2 years ago - 1 dependent repositories - 25 stars on GitHub
org.codelibs.fess:fess-crawler-db-mysql 1.0.12
Fess Crawler is Crawler Framework.
13 versions - Latest release: over 7 years ago - 25 stars on GitHub
org.codelibs.fess:fess-crawler-db-h2 1.0.12
Fess Crawler is Crawler Framework.
13 versions - Latest release: over 7 years ago - 25 stars on GitHub
org.codelibs.fess:fess-crawler-db 1.0.12
Fess Crawler is Crawler Framework.
13 versions - Latest release: over 7 years ago - 25 stars on GitHub
org.codelibs.fess:fess-crawler-parent 14.13.0
Fess Crawler is Crawler Framework.
127 versions - Latest release: about 1 month ago - 25 stars on GitHub
com.github.peterbencze:serritor 2.1.1
An open source web crawler framework built upon Selenium and written in Java
12 versions - Latest release: almost 4 years ago - 1 dependent repositories - 27 stars on GitHub
com.github.luohaha:jlitespider 0.4.3
jlitespider is a lite distributed Java spider framework
3 versions - Latest release: about 7 years ago - 150 stars on GitHub
it.unimi.di.law:bubing 0.9.15
BUbiNG is an open-source Java fully distributed crawler
8 versions - Latest release: about 5 years ago - 1 dependent package - 2 dependent repositories - 74 stars on GitHub
ai.platon.pulsar:pulsar-skeleton 1.12.4
Scrape Web data at scale completely and accurately with high performance, distributed AI-RPA.
61 versions - Latest release: about 1 month ago - 15 dependent packages - 2 dependent repositories - 402 stars on GitHub
it.skrape:skrapeit-browser-fetcher 1.2.2 💰
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data...
15 versions - Latest release: almost 2 years ago - 2 dependent packages - 1 dependent repositories - 623 stars on GitHub
it.skrape:skrapeit-base-fetcher 1.2.2 💰
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data...
15 versions - Latest release: almost 2 years ago - 6 dependent packages - 1 dependent repositories - 623 stars on GitHub
it.skrape:core 0.4.1 💰
skrape{it} is a Kotlin-based HTML testing and web scraping library that can be used seamlessly in...
9 versions - Latest release: about 5 years ago - 1 dependent repositories - 696 stars on GitHub
it.skrape:skrapeit-ktor-extension 1.2.2 💰
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data...
15 versions - Latest release: almost 2 years ago - 623 stars on GitHub
it.skrape:skrapeit-html-parser 1.2.2 💰
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data...
15 versions - Latest release: almost 2 years ago - 4 dependent packages - 2 dependent repositories - 623 stars on GitHub
it.skrape:skrape-it 1.0.0-alpha7 💰
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data...
1 version - Latest release: over 3 years ago - 1 dependent repositories - 625 stars on GitHub
it.skrape:skrapeit 1.2.2 💰
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data...
15 versions - Latest release: almost 2 years ago - 32 dependent repositories - 623 stars on GitHub
it.skrape:skrapeit-http-fetcher 1.2.2 💰
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data...
15 versions - Latest release: almost 2 years ago - 1 dependent package - 3 dependent repositories - 623 stars on GitHub
it.skrape:skrapeit-core 0.6.0 💰
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data...
13 versions - Latest release: about 5 years ago - 2 dependent packages - 6 dependent repositories - 625 stars on GitHub
it.skrape:skrapeit-assertions 1.2.2 💰
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data...
15 versions - Latest release: almost 2 years ago - 2 dependent packages - 623 stars on GitHub
it.skrape:skrapeit-mock-mvc-extension 1.2.2 💰
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data...
15 versions - Latest release: almost 2 years ago - 623 stars on GitHub
it.skrape:skrapeit-dsl 1.2.2 💰
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data...
15 versions - Latest release: almost 2 years ago - 4 dependent packages - 623 stars on GitHub
it.skrape:skrapeit-async-fetcher 1.2.2 💰
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data...
15 versions - Latest release: almost 2 years ago - 1 dependent package - 2 dependent repositories - 623 stars on GitHub
us.codecraft:webmagic-scripts 0.10.3
A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, conte...
23 versions - Latest release: 22 days ago - 1 dependent package - 39 dependent repositories - 11,022 stars on GitHub
Top 3.0% on repo1.maven.org
us.codecraft:webmagic-selenium 0.10.3
A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, conte...
17 versions - Latest release: 22 days ago - 10 dependent packages - 100 dependent repositories - 11,022 stars on GitHub
us.codecraft:webmagic-parent 0.10.3
A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, conte...
29 versions - Latest release: 22 days ago - 1 dependent package - 1 dependent repositories - 11,022 stars on GitHub
us.codecraft:webmagic-samples 0.10.3
A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, conte...
18 versions - Latest release: 22 days ago - 1 dependent package - 8 dependent repositories - 11,022 stars on GitHub
us.codecraft:webmagic-coverage 0.10.3
Compute aggregated test code coverage
9 versions - Latest release: 22 days ago - 10,754 stars on GitHub
us.codecraft:webmagic-saxon 0.10.3
A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, conte...
17 versions - Latest release: 22 days ago - 1 dependent package - 18 dependent repositories - 11,022 stars on GitHub
org.webjars.npm:ng-meta 0.3.9
WebJar for ng-meta
1 version - Latest release: almost 8 years ago - 153 stars on GitHub
org.webjars.bower:ngMeta 1.0.0
WebJar for ngMeta
1 version - Latest release: over 7 years ago - 153 stars on GitHub
de.hs-heilbronn.mi:crawler4j-with-sleepycat 5.0.2
Open Source Web Crawler for Java
22 versions - Latest release: 12 months ago - 2 dependent packages - 2 dependent repositories - 17 stars on GitHub
de.hs-heilbronn.mi:crawler4j-commons 5.0.2
Open Source Web Crawler for Java
22 versions - Latest release: 12 months ago - 4 dependent packages - 1 dependent repositories - 17 stars on GitHub
de.hs-heilbronn.mi:crawler4j-frontier-hsqldb 5.0.2
Open Source Web Crawler for Java
22 versions - Latest release: 12 months ago - 1 dependent package - 1 dependent repositories - 17 stars on GitHub
de.hs-heilbronn.mi:crawler4j-archetype 5.0.2 💰
Open Source Web Crawler for Java
2 versions - Latest release: 12 months ago - 17 stars on GitHub
de.hs-heilbronn.mi:crawler4j-examples-postgres 5.0.2
Open Source Web Crawler for Java
22 versions - Latest release: 12 months ago - 17 stars on GitHub
de.hs-heilbronn.mi:crawler4j-boms 5.0.2
Open Source Web Crawler for Java
22 versions - Latest release: 12 months ago - 17 stars on GitHub
de.hs-heilbronn.mi:crawler4j-frontier-urlfrontier 5.0.2
Open Source Web Crawler for Java
11 versions - Latest release: 12 months ago - 1 dependent package - 1 dependent repositories - 17 stars on GitHub
de.hs-heilbronn.mi:crawler4j-with-urlfrontier 5.0.2
Open Source Web Crawler for Java
11 versions - Latest release: 12 months ago - 1 dependent package - 2 dependent repositories - 17 stars on GitHub
de.hs-heilbronn.mi:crawler4j-frontier 5.0.2
Open Source Web Crawler for Java
22 versions - Latest release: 12 months ago - 17 stars on GitHub
de.hs-heilbronn.mi:crawler4j-core 5.0.2
Open Source Web Crawler for Java
22 versions - Latest release: 12 months ago - 3 dependent packages - 1 dependent repositories - 17 stars on GitHub
de.hs-heilbronn.mi:crawler4j-parent 5.0.2
Open Source Web Crawler for Java
21 versions - Latest release: 12 months ago - 17 stars on GitHub
de.hs-heilbronn.mi:crawler4j-with-hsqldb 5.0.2
Open Source Web Crawler for Java
22 versions - Latest release: 12 months ago - 1 dependent package - 2 dependent repositories - 17 stars on GitHub
de.hs-heilbronn.mi:crawler4j-examples-base 5.0.2
Open Source Web Crawler for Java
22 versions - Latest release: 12 months ago - 17 stars on GitHub
de.hs-heilbronn.mi:crawler4j-frontier-sleepycat 5.0.2
Open Source Web Crawler for Java
22 versions - Latest release: 12 months ago - 2 dependent packages - 1 dependent repositories - 17 stars on GitHub
de.hs-heilbronn.mi:crawler4j-examples 5.0.2
Open Source Web Crawler for Java
22 versions - Latest release: 12 months ago - 17 stars on GitHub
ai.platon.pulsar:pulsar-tests 1.10.15
Scrape Web data at scale completely and accurately with high performance, distributed RPA.
48 versions - Latest release: 11 months ago - 5 dependent packages - 4 dependent repositories - 291 stars on GitHub
com.crawljax:crawljax-core 5.2.3 💰
Crawling web applications through even-driven, dynamic analysis, and reconstruction of the UI sta...
18 versions - Latest release: 12 months ago - 7 dependent packages - 29 dependent repositories - 499 stars on GitHub
com.crawljax:crawljax-web 3.5.1 💰
Crawling Ajax applications through dynamic analysis and reconstruction of the UI state changes. C...
3 versions - Latest release: about 10 years ago - 499 stars on GitHub