Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
packagist.org "crawler" keyword
friends-of-hyva/magento2-crawler-session 1.0.1
Prevent crawlers from creating a session2 versions - Latest release: about 1 month ago - 55 downloads total - 6 stars on GitHub - 2 maintainers
bitandblack/sitemap 2.0.6 💰
Creates a sitemap.xml by parsing the whole website.12 versions - Latest release: 2 months ago - 1 dependent package - 1 dependent repositories - 1.88 thousand downloads total - 2 maintainers
nueip/curl 0.4.2
NuEIP Curl.14 versions - Latest release: over 2 years ago - 233 downloads total - 2 stars on GitHub - 2 maintainers
w3zone/crawler 1.0.1
php crawler based on service .1 version - Latest release: over 7 years ago - 115 downloads total - 5 stars on GitHub - 2 maintainers
yggverse/yggstate
Yggdrasil Network ExplorerLatest release: 4 days ago - 0 downloads total - 0 stars on GitHub - 2 maintainers
kiwa/sitemap 2.0.0 💰
Integrates the Bit&Black Sitemap into a Kiwa website to create sitemap files seamlessly.11 versions - Latest release: 3 months ago - 1 dependent package - 3.19 thousand downloads total - 2 maintainers
contextualcode/crawler v2.4.0
Flexible website crawler which stores the results in persistent storage21 versions - Latest release: 3 months ago - 1 dependent package - 1 dependent repositories - 526 downloads total - 0 stars on GitLab.com - 2 maintainers
Top 0.2% on packagist.org
158 versions - Latest release: 21 days ago - 170 dependent packages - 8,221 dependent repositories - 57.9 million downloads total - 1,911 stars on GitHub - 2 maintainers
jaybizzle/crawler-detect v1.2.118
CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent158 versions - Latest release: 21 days ago - 170 dependent packages - 8,221 dependent repositories - 57.9 million downloads total - 1,911 stars on GitHub - 2 maintainers
yggverse/yggo
YGGo! Distributed Web Search EngineLatest release: 5 days ago - 0 downloads total - 3 stars on GitHub - 2 maintainers
Top 6.8% on packagist.org
68 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 279 thousand downloads total - 53 stars on GitHub - 2 maintainers
aoepeople/crawler 11.0.7 💰
Crawler extension for TYPO368 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 279 thousand downloads total - 53 stars on GitHub - 2 maintainers
gaolujie1989/webmagic
A scalable web crawler framework for php.Latest release: 20 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
mvrc/php-email-crawler 💰
PHP Website Email Crawler, for crawling websites for emails.Latest release: 22 days ago - 7 downloads total - 3 stars on GitHub - 1 maintainer
piedweb/crawler 0.1.783
Web Crawler to check few SEO basics.53 versions - Latest release: 3 months ago - 70 downloads total - 1 stars on GitHub - 1 maintainer
webysther/packagist-mirror 1.1.1 💰
Build mirror of packagist7 versions - Latest release: over 4 years ago - 150 downloads total - 179 stars on GitHub - 1 maintainer
andrew-svirin/resource-crawler-bundle
Crawler for any sort of resources.Latest release: 27 days ago - 55 downloads total - 3 stars on GitHub - 1 maintainer
yangze/spiderx v2.1.35
php SpiderX25 versions - Latest release: about 2 years ago - 38 downloads total - 14 stars on GitHub - 1 maintainer
smochin/how-old-php-crawler 1.0.0
A simple PHP Crawler for how-old.net1 version - Latest release: over 7 years ago - 15 downloads total - 1 stars on GitHub - 1 maintainer
Top 8.7% on packagist.org
84 versions - Latest release: about 2 years ago - 10 dependent repositories - 4.31 thousand downloads total - 53 stars on GitHub - 1 maintainer
pablouser1/tikscraper v1.2.7
Get data from TikTok API84 versions - Latest release: about 2 years ago - 10 dependent repositories - 4.31 thousand downloads total - 53 stars on GitHub - 1 maintainer
maidmaid/cffie v0.4.0
CFFie query SBB/CFF/FFS connections from https://www.cff.ch.5 versions - Latest release: about 7 years ago - 19 downloads total - 0 stars on GitHub - 1 maintainer
sigmie/crawler v0.1.18
Sigmie Crawler is a PHP package for crawling websites and exporting their HTML contents.19 versions - Latest release: over 3 years ago - 25 downloads total - 0 stars on GitHub - 1 maintainer
dusk-browser/dusk-browser
Laravel Dusk Browser is Laravel Dusk for browsing capabilities only.Latest release: 9 days ago - 48 downloads total - 0 stars on GitHub - 1 maintainer
nekhbet/crawlers-laravel-pulse
Laravel Pulse Card to show crawlersLatest release: 20 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
Top 9.4% on packagist.org
13 versions - Latest release: over 2 years ago - 2 dependent repositories - 20.1 thousand downloads total - 253 stars on GitHub - 1 maintainer
zrashwani/arachnid 2.2.1
A crawler to find all unique internal pages on a given website13 versions - Latest release: over 2 years ago - 2 dependent repositories - 20.1 thousand downloads total - 253 stars on GitHub - 1 maintainer
51degrees/fiftyone.devicedetection 4.4.2
Device detection engines for 51Degrees Pipeline API. Parse HTTP headers to detect hardware, opera...50 versions - Latest release: almost 2 years ago - 1 dependent package - 1 dependent repositories - 6.93 thousand downloads total - 0 stars on GitHub - 1 maintainer
lefuturiste/google-photos-album-crawler v1.1
Google Photos public album crawler/fetcher2 versions - Latest release: almost 4 years ago - 61 downloads total - 8 stars on GitHub - 1 maintainer
crwlr/crawler-ext-browser v1.2.1
Extension for the crwlr/crawler package containing steps utilizing a headless browser.7 versions - Latest release: 2 months ago - 1 dependent package - 135 downloads total - 0 stars on GitHub - 1 maintainer
oyjz/querylist
PHP采集工具(爬虫),基于https://github.com/jae-jae/QueryList。Latest release: 27 days ago - 6 downloads total - 0 stars on GitHub - 1 maintainer
Top 2.8% on packagist.org
41 versions - Latest release: 9 months ago - 4 dependent packages - 23 dependent repositories - 90.4 thousand downloads total - 351 stars on GitHub - 1 maintainer
duzun/hquery 3.1.0
An extremely fast web scraper that parses megabytes of HTML in a blink of an eye. No dependencies...41 versions - Latest release: 9 months ago - 4 dependent packages - 23 dependent repositories - 90.4 thousand downloads total - 351 stars on GitHub - 1 maintainer
harm-smits/webcrawler-verifier 2.1.1
PHP library providing functionality to verify that user-agents are who they claim to be.6 versions - Latest release: over 2 years ago - 1 downloads total - 0 stars on GitHub - 1 maintainer
laurentvw/scrapher v2.3.1
A web scraper for PHP to easily extract data from web pages12 versions - Latest release: about 6 years ago - 1 dependent package - 3 dependent repositories - 2.51 thousand downloads total - 18 stars on GitHub - 1 maintainer
jupiterapi/ephoto360
Create text effects online , Effects online for free, photo frames, make face photo montages, cus...Latest release: 25 days ago - 10 downloads total - 5 stars on GitHub - 1 maintainer
zephir/luya-module-crawleradmin 1.0.0-beta8
Yii2 LUYA Crawler Admin-Module4 versions - Latest release: almost 8 years ago - 2 dependent packages - 1 dependent repositories - 143 downloads total - 1 maintainer
yidas/tw-stock-crawler 1.2.1
Taiwan Stock Opendata Crawler with realtime - 台灣股市股票資訊擷取器5 versions - Latest release: 6 months ago - 1 dependent package - 1 dependent repositories - 26 downloads total - 2 stars on GitHub - 1 maintainer
alrik11es/scrappy
A free proxy list based downloader for your crawling projects in PHPLatest release: 18 days ago - 2.14 thousand downloads total - 1 stars on GitHub - 1 maintainer
panakour/pkscraper v1.2.0
Get whatever data you want.10 versions - Latest release: 5 months ago - 181 downloads total - 1 stars on GitHub - 1 maintainer
olousouzian/akitabundle 1.0.1
Symfony 2.X bundle for easy crawling Facebook page3 versions - Latest release: about 8 years ago - 224 downloads total - 2 stars on GitHub - 1 maintainer
c4pone/yolo_crawler
An event based domain crawlerLatest release: 13 days ago - 4 dependent repositories - 39 downloads total - 2 stars on GitHub - 1 maintainer
louvian/pururin-crawler 0.0.1
Pururin Crawler1 version - Latest release: over 6 years ago - 12 downloads total - 4 stars on GitHub - 1 maintainer
brunodebarros/http-request 1.0.2
A web crawler, built to be easily dropped into PHP applications, which behaves just like a regula...3 versions - Latest release: about 9 years ago - 1 dependent package - 4 dependent repositories - 195 downloads total - 8 stars on GitHub - 1 maintainer
baqend/spider 1.0.0
URL spider which crawls a page and all its subpages1 version - Latest release: about 6 years ago - 434 downloads total - 6 stars on GitHub - 1 maintainer
crwlr/robots-txt v1.1.1
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping6 versions - Latest release: over 1 year ago - 1 dependent package - 1 dependent repositories - 5.36 thousand downloads total - 8 stars on GitHub - 1 maintainer
spacespell/laravel-crawler v0.1.0
Laravel queue based distributed web crawler framework.1 version - Latest release: over 6 years ago - 18 downloads total - 2 stars on GitHub - 1 maintainer
agilekeys/point-picker
Crawler package for online shoppingLatest release: 22 days ago - 800 downloads total - 0 stars on GitHub - 1 maintainer
tallesairan/crawler 1.0
Most powerful, popular and production crawling/scraping package for PHP1 version - Latest release: 9 months ago - 4 downloads total - 0 stars on GitHub - 1 maintainer
dz0x44/9pay-spider-telco v1.9
9Pay Crawler for Telco Promotion10 versions - Latest release: about 4 years ago - 31 downloads total - 0 stars on GitHub - 1 maintainer
blogdaren/phpcreeper v1.9.0
A new generation of multi-process async event-driven spider engine based on Workerman57 versions - Latest release: about 4 hours ago - 1 dependent package - 2 dependent repositories - 625 downloads total - 117 stars on GitHub - 1 maintainer
Top 1.6% on packagist.org
18 versions - Latest release: 5 months ago - 8 dependent packages - 23 dependent repositories - 143 thousand downloads total - 1,324 stars on GitHub - 1 maintainer
vdb/php-spider v0.7.2
A configurable and extensible PHP web spider18 versions - Latest release: 5 months ago - 8 dependent packages - 23 dependent repositories - 143 thousand downloads total - 1,324 stars on GitHub - 1 maintainer
radarlog/banks-spyder 1.0
Banks Spyder is free software to automatically generate bank statements in PDF format from your a...1 version - Latest release: about 8 years ago - 2 downloads total - 0 stars on GitHub - 1 maintainer
crwlr/crawler v1.7.2
Web crawling and scraping library.38 versions - Latest release: about 2 months ago - 3 dependent packages - 1 dependent repositories - 2.7 thousand downloads total - 295 stars on GitHub - 1 maintainer
seosazi/php-html-parser 1.2.11
simple crawl link and parser it19 versions - Latest release: over 2 years ago - 48 downloads total - 2 stars on GitHub - 1 maintainer
nadar/crawler 1.7.1 💰
A highly extendible, dependency free Crawler for HTML, PDFS or any other type of Documents.14 versions - Latest release: about 2 years ago - 2 dependent packages - 1 dependent repositories - 18.6 thousand downloads total - 10 stars on GitHub - 1 maintainer
eddieace/php-simple v1.0.4
HTML DOM parser for php 7.1+5 versions - Latest release: about 3 years ago - 1 dependent repositories - 34.4 thousand downloads total - 14 stars on GitHub - 1 maintainer
c2is/walker
A basic wrapper around Goutte to crawl a websiteLatest release: 12 days ago - 5 dependent repositories - 28 downloads total - 0 stars on GitHub - 1 maintainer
pithyone/zhihu-crawler 3.5.0
轻量级知乎爬虫17 versions - Latest release: over 5 years ago - 62 downloads total - 25 stars on GitHub - 1 maintainer
yosodog/htmlpagedom v2.0.1
jQuery-inspired DOM manipulation extension for Symfony's Crawler24 versions - Latest release: over 4 years ago - 30 downloads total - 0 stars on GitHub - 1 maintainer
dachcom-digital/dynamic-search-data-provider-crawler v3.0.1
A Spider Crawler Extension for Pimcore Dynamic Search.16 versions - Latest release: 5 months ago - 12.1 thousand downloads total - 8 stars on GitHub - 1 maintainer
blueways/bw-cache-uri v1.1.6
TYPO3 extension to parse remote content and save to tt_content element8 versions - Latest release: 7 months ago - 395 downloads total - 0 stars on GitHub - 1 maintainer
innmind/crawler 6.1.0
Library to extract meaningful informations out of a webpage23 versions - Latest release: about 3 years ago - 4 dependent packages - 4 dependent repositories - 936 downloads total - 1 stars on GitHub - 1 maintainer
delphiki/aprr 2.0.1
A simple crawler to get formated data from APRR website.5 versions - Latest release: about 7 years ago - 18 downloads total - 0 stars on GitHub - 1 maintainer
ngatngay/crawler-php 8.1.0
A simple PHP Web Crawler3 versions - Latest release: over 1 year ago - 47 downloads total - 0 stars on GitHub - 1 maintainer
Top 0.8% on packagist.org
20 versions - Latest release: 22 days ago - 19 dependent packages - 813 dependent repositories - 7.91 million downloads total - 212 stars on GitHub - 1 maintainer
spatie/robots-txt 2.2.0 💰
Determine if a page may be crawled from robots.txt and robots meta tags20 versions - Latest release: 22 days ago - 19 dependent packages - 813 dependent repositories - 7.91 million downloads total - 212 stars on GitHub - 1 maintainer
coooold/crawler v1.0.0
Most powerful, popular and production crawling/scraping package for PHP1 version - Latest release: over 4 years ago - 15 downloads total - 1 stars on GitHub - 1 maintainer
vangxh/beanbun
Beanbun 是用 PHP 编写的多进程网络爬虫框架,具有良好的开放性、高可扩展性Latest release: 16 days ago - 2 downloads total - 0 stars on GitHub - 1 maintainer
abelhalo/zolcrawler
Zol CrawlerLatest release: about 4 hours ago - 12 downloads total - 0 stars on GitHub - 1 maintainer
wykleph/html-scraper v0.1.0
An API for taking json sitemaps generated by the webscraper.io extension, and emulating webscrape...1 version - Latest release: over 8 years ago - 18 downloads total - 1 stars on GitHub - 1 maintainer
mr4-lc/content-protected 0.0.1
Laravel content protected1 version - Latest release: 6 months ago - 1 downloads total - 0 stars on GitHub - 1 maintainer
akane0151/target-crawler 0.9.7
target crawler - A simple Laravel crawler package to read element of any webpage.6 versions - Latest release: about 1 year ago - 9 downloads total - 0 stars on GitHub - 1 maintainer
codeblog/crawlerdetect v1.0.0
A CodeBlog CrawlerDetect class is easy and quick to use. Detecting bots/crawlers/spiders via the ...1 version - Latest release: about 5 years ago - 54 downloads total - 9 stars on GitHub - 1 maintainer
piopi/behatcrawler
A Behat extension that crawls links on a website and executes user-defined function on each one o...Latest release: 27 days ago - 16 downloads total - 1 stars on GitHub - 1 maintainer
artplus_f/browscap
The standalone PHP Browscap parser Crossjoin\Browscap detects browser properties as well as devic...Latest release: 1 day ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
wangta69/crawler 1.0.0
crawler1 version - Latest release: about 6 years ago - 14 downloads total - 1 stars on GitHub - 1 maintainer
Top 0.3% on packagist.org
104 versions - Latest release: 3 months ago - 45 dependent packages - 858 dependent repositories - 8.23 million downloads total - 2,471 stars on GitHub - 1 maintainer
spatie/crawler 8.2.0 💰
Crawl all internal links found on a website104 versions - Latest release: 3 months ago - 45 dependent packages - 858 dependent repositories - 8.23 million downloads total - 2,471 stars on GitHub - 1 maintainer
proclnas/curl-rox 3.0.0
Just another curl wrapper for webCrawling purposes3 versions - Latest release: about 5 years ago - 17 downloads total - 9 stars on GitHub - 1 maintainer
richardchey/fund 1.0.0 removed
Collect fund data1 version - Latest release: almost 9 years ago - 17 downloads total - 1 maintainer
loveorigami/lo-crawler
Crawler componentLatest release: 26 days ago - 29 downloads total - 0 stars on GitHub - 1 maintainer
blogdaren/webman-phpcreeper v1.0.4
PHPCreeper plugin for webman5 versions - Latest release: 17 days ago - 165 downloads total - 8 stars on GitHub - 1 maintainer
mediashare/crawler 0.2.8
Crawl urls from a webpage and provide a DomCrawler with Scraper Library26 versions - Latest release: over 2 years ago - 2 dependent packages - 1 dependent repositories - 245 downloads total - 3 stars on GitHub - 1 maintainer
lucassmacedo/mangas-downloader
PHP library to download mangas chaptersLatest release: 26 days ago - 0 downloads total - 12 stars on GitHub - 1 maintainer
xinrui5577/beanbun 1.1.0
老版本2018年4月份没有维护了.有bug,自己fork分支,自己维护,原来:Beanbun 是用 PHP 编写的多进程网络爬虫框架,具有良好的开放性、高可扩展性7 versions - Latest release: over 5 years ago - 18 downloads total - 1 stars on GitHub - 1 maintainer
hissezhaut/http-status-check 1.0.2
CLI tool to crawl a website and check HTTP status code4 versions - Latest release: over 7 years ago - 9 downloads total - 0 stars on GitHub - 1 maintainer
cdaguerre/robots-bundle v1.1.1
Add contextual robots meta headers7 versions - Latest release: over 6 years ago - 15.2 thousand downloads total - 0 stars on GitHub - 1 maintainer
acanto/crawler 6.0.2
Crawl all internal links found on a website1 version - Latest release: about 3 years ago - 1 dependent package - 2 dependent repositories - 2.72 thousand downloads total - 0 stars on GitLab.com - 1 maintainer
alexndreazevedo/crawler
Social PHP CrawlerLatest release: 22 days ago - 4 dependent repositories - 6 downloads total - 0 stars on GitHub - 1 maintainer
smochin/instagram-php-crawler 1.0.1
A simple PHP Crawler for Instagram2 versions - Latest release: about 6 years ago - 1 dependent repositories - 5.82 thousand downloads total - 46 stars on GitHub - 1 maintainer
howie6879/php-google 1.0
Google search results crawler, get google search results that you need.1 version - Latest release: almost 7 years ago - 537 downloads total - 29 stars on GitHub - 1 maintainer
dr4g0nsr/sitemap-crawler 1.0 removed
Crawler for any type of site using robots.txt and sitemap.xml as the source of URL. Useful for ca...1 version - Latest release: over 1 year ago - 20 downloads total - 2 stars on GitHub - 1 maintainer
exfriend/uncurl 1.0.5
Unfurl links in PHP4 versions - Latest release: about 5 years ago - 1 dependent repositories - 196 downloads total - 1 stars on GitHub - 1 maintainer
lndj/lcrawl v3.1.0
一只优雅的正方教务系统爬虫。7 versions - Latest release: over 7 years ago - 3 dependent repositories - 1.82 thousand downloads total - 114 stars on GitHub - 1 maintainer
sohib/crawler v1.0.1
Scan Http URLs from a url containing an HTML and get Json or Xml or Array3 versions - Latest release: over 8 years ago - 24 downloads total - 0 stars on GitHub - 1 maintainer
chemaclass/stock-ticker
An API to gather the latest info from your stocksLatest release: 4 days ago - 1 downloads total - 3 stars on GitHub - 1 maintainer
lenonleite/hacking v0.1
LenonLeite Component - Hakcing packages1 version - Latest release: almost 7 years ago - 19 downloads total - 0 stars on GitHub - 1 maintainer
gpupo/camelspider 1.0 abandoned
A class to help handle gateways to processing entities.1 version - Latest release: almost 9 years ago - 4 dependent repositories - 1 downloads total - 10 stars on GitHub - 1 maintainer
zrashwani/news-scrapper 1.0.3
scrapping news data from a webpage using structured data6 versions - Latest release: over 6 years ago - 256 downloads total - 13 stars on GitHub - 1 maintainer
thingston/crawler 0.7.0
Web crawler based on PHP Guzzle HTTP Client with concurrency support for faster operation.10 versions - Latest release: over 5 years ago - 9 downloads total - 2 stars on GitHub - 1 maintainer
filchos/imago
A library for reading and transforming content in a chainable wayLatest release: 20 days ago - 29 downloads total - 0 stars on GitHub - 1 maintainer
migliori/sitemap-crawler 0.0.3
Sitemap crawler/generator. For the given URL it will return sitemap XML file with URLs and images.3 versions - Latest release: about 5 years ago - 266 downloads total - 3 stars on GitHub - 1 maintainer
Top 6.8% on packagist.org
21 versions - Latest release: about 6 years ago - 7 dependent repositories - 61.4 thousand downloads total - 47 stars on GitHub - 1 maintainer
opensearchserver/opensearchserver 3.0.20
PHP library for OpenSearchServer: professionnal search engine, crawlers (web, file, database), RE...21 versions - Latest release: about 6 years ago - 7 dependent repositories - 61.4 thousand downloads total - 47 stars on GitHub - 1 maintainer
68publishers/crawler-client-php v1.2.0
:spider_web: PHP Client for https://github.com/68publishers/crawler4 versions - Latest release: 10 months ago - 280 downloads total - 1 stars on GitHub - 1 maintainer
jafaripur/varzesh3-crawler
Crawler for varzesh3.com livescoreLatest release: 1 day ago - 1 dependent repositories - 48 downloads total - 3 stars on GitHub - 1 maintainer
vanry/baike-spider
A simple spider crawling web pages from baike.baidu.comLatest release: 22 days ago - 6 downloads total - 2 stars on GitHub - 1 maintainer
Related Keywords
php
122
spider
62
scraper
47
scraping
28
laravel
23
crawling
23
parser
22
website
17
http
17
bot
16
hacktoberfest
15
symfony
15
seo
15
curl
15
dom
14
api
13
link
12
search
12
html
12
spatie
11
scrape
11
library
11
yii2
10
detect
9
web
9
Sitemap
9
crawl
8
module
8
composer
8
extension
7
bundle
6
luya
6
yii
6
framework
6
robot
6
browser
6
robots.txt
6
google
6
typo3
6
webcrawler
6
scrapper
6
user-agent
6
domcrawler
5
parse
5
crawler detect
5
crawler detector
5
extractor
5
php crawler detect
5
scraping-websites
5
crawlerdetect
5
news
5
index
5
bots
5
url
5
xml
5
robots-txt
5
luya-module
4
lastfm
4
webservice client
4
last.fm
4
content
4
QueryList
4
asynchronous
4
phpQuery
4
php-crawler
4
request
4
json
4
webservice-client
4
health
4
web-crawler
4
symfony-bundle
4
seo-optimization
3
checker
3
web-scraping
3
async
3
internet
3
multi
3
web-crawling
3
web crawler
3
crwlr
3
console
3
sitemap
3
rss
3
instagram
3
device
3
laravel-package
3
webscraping
3
selector
3
mining
3
wordpress
3
Match
3
user agent
3
indexer
3
guzzle
3
helper
3
Harvest
3
extract
3
matcher
3
cache-warmup
3
data
3