Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
packagist.org "crawler" keyword
jafaripur/varzesh3-crawler
Crawler for varzesh3.com livescoreLatest release: about 18 hours ago - 1 dependent repositories - 48 downloads total - 3 stars on GitHub - 1 maintainer
artplus_f/browscap
The standalone PHP Browscap parser Crossjoin\Browscap detects browser properties as well as devic...Latest release: 1 day ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
kvazar/crawler
KVAZAR Index CrawlerLatest release: 1 day ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
yggverse/yggstate
Yggdrasil Network ExplorerLatest release: 3 days ago - 0 downloads total - 0 stars on GitHub - 2 maintainers
hansputera/se-crawler
Search Engine Scraper/CrawlerLatest release: 3 days ago - 7 downloads total - 1 stars on GitHub - 1 maintainer
chemaclass/stock-ticker
An API to gather the latest info from your stocksLatest release: 4 days ago - 1 downloads total - 3 stars on GitHub - 1 maintainer
blogdaren/phpcreeper v1.8.9
A new generation of multi-process async event-driven spider engine based on Workerman56 versions - Latest release: 5 days ago - 1 dependent package - 2 dependent repositories - 623 downloads total - 117 stars on GitHub - 1 maintainer
yggverse/yggo
YGGo! Distributed Web Search EngineLatest release: 5 days ago - 0 downloads total - 3 stars on GitHub - 2 maintainers
smart-core/rich-editor-bundle
Rich editor bundle.Latest release: 5 days ago - 1 dependent package - 7 dependent repositories - 296 downloads total - 0 stars on GitHub - 1 maintainer
smart-core/sitemap-bundle
Symfony Sitemap Crawler Generator Bundle.Latest release: 5 days ago - 1 dependent package - 6 dependent repositories - 307 downloads total - 0 stars on GitHub - 1 maintainer
lucascoelhosantos/buscador-cursos
Projeto que busca os cursos no site da AluraLatest release: 7 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
blackfire/player v2.6.0
A powerful web crawler and web scraper with Blackfire support98 versions - Latest release: 8 days ago - 1 dependent repositories - 16 thousand downloads total - 484 stars on GitHub - 1 maintainer
dusk-browser/dusk-browser
Laravel Dusk Browser is Laravel Dusk for browsing capabilities only.Latest release: 9 days ago - 48 downloads total - 0 stars on GitHub - 1 maintainer
slendie/crawler
Slendie CrawlerLatest release: 11 days ago - 1 dependent repositories - 33 downloads total - 0 stars on GitHub - 1 maintainer
phramz/composer-repository-model
composer repository (aka `packages.json`) model builder componentLatest release: 12 days ago - 4 dependent repositories - 150 downloads total - 7 stars on GitHub - 1 maintainer
tetreum/kat
Kat.cr / KickAssTorrents PHP SDK (Unofficial)Latest release: 12 days ago - 1 dependent repositories - 12 downloads total - 1 stars on GitHub - 1 maintainer
c2is/walker
A basic wrapper around Goutte to crawl a websiteLatest release: 12 days ago - 5 dependent repositories - 28 downloads total - 0 stars on GitHub - 1 maintainer
c4pone/yolo_crawler
An event based domain crawlerLatest release: 12 days ago - 4 dependent repositories - 39 downloads total - 2 stars on GitHub - 1 maintainer
conradoojr/thief-links
Crawler For WebSites of SeriesLatest release: 13 days ago - 12 downloads total - 2 stars on GitHub - 1 maintainer
amir2b/instagram
Fetch data from InstagramLatest release: 13 days ago - 5 downloads total - 0 stars on GitHub - 1 maintainer
mcstreetguy/crawler
An advanced web-crawler written in PHP.Latest release: 13 days ago - 6 downloads total - 3 stars on GitHub - 1 maintainer
milu2003/flarum-ext-dxc
DXC采集 flraum接口Latest release: 14 days ago - 1 dependent repositories - 8 downloads total - 0 stars on GitHub - 1 maintainer
Top 0.6% on packagist.org
26 versions - Latest release: 14 days ago - 94 dependent packages - 279 dependent repositories - 553 thousand downloads total - 2,606 stars on GitHub - 1 maintainer
jaeger/querylist V4.4.3 💰
Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on p...26 versions - Latest release: 14 days ago - 94 dependent packages - 279 dependent repositories - 553 thousand downloads total - 2,606 stars on GitHub - 1 maintainer
vangxh/beanbun
Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性Latest release: 16 days ago - 2 downloads total - 0 stars on GitHub - 1 maintainer
pagemunch/pagemunch
A PHP wrapper for the PageMunch link unfurling APILatest release: 16 days ago - 4 dependent repositories - 31 downloads total - 6 stars on GitHub - 1 maintainer
lexxtor/easy-php-crawler
Simple yet flexible URL crawler.Latest release: 17 days ago - 8 downloads total - 1 stars on GitHub - 1 maintainer
blogdaren/webman-phpcreeper v1.0.4
PHPCreeper plugin for webman5 versions - Latest release: 17 days ago - 165 downloads total - 8 stars on GitHub - 1 maintainer
puzzle/crawler
web crawlerLatest release: 17 days ago - 4 dependent repositories - 13 downloads total - 0 stars on GitHub - 1 maintainer
alrik11es/scrappy
A free proxy list based downloader for your crawling projects in PHPLatest release: 18 days ago - 2.14 thousand downloads total - 1 stars on GitHub - 1 maintainer
fireguard/correios
Utilities for interaction with the post office of BrazilLatest release: 18 days ago - 6 downloads total - 1 stars on GitHub - 1 maintainer
tetreum/xupopter
Xupopter crawlea las principales páginas de compraventa de inmuebles de España como son Idealista...Latest release: 19 days ago - 45 downloads total - 11 stars on GitHub - 1 maintainer
io-jaegers/valkyrier
Latest release: 19 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainerfilchos/imago
A library for reading and transforming content in a chainable wayLatest release: 19 days ago - 29 downloads total - 0 stars on GitHub - 1 maintainer
nekhbet/crawlers-laravel-pulse
Laravel Pulse Card to show crawlersLatest release: 20 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
gaolujie1989/webmagic
A scalable web crawler framework for php.Latest release: 20 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
teamtnt/crawler
Distributed Crawler ArchitectureLatest release: 20 days ago - 1 downloads total - 8 stars on GitHub - 1 maintainer
allotmentandy/socialmedialinkextractor
extracts social media links for an array of links eg. twitter, facebook etc.Latest release: 20 days ago - 87 downloads total - 0 stars on GitHub - 1 maintainer
pabeda-bt/php-crawler
Crawl all internal links in a websiteLatest release: 20 days ago - 38 downloads total - 0 stars on GitHub - 1 maintainer
Top 0.2% on packagist.org
158 versions - Latest release: 20 days ago - 148 dependent packages - 8,221 dependent repositories - 57.9 million downloads total - 1,911 stars on GitHub - 2 maintainers
jaybizzle/crawler-detect v1.2.118
CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent158 versions - Latest release: 20 days ago - 148 dependent packages - 8,221 dependent repositories - 57.9 million downloads total - 1,911 stars on GitHub - 2 maintainers
phantazm/robotdetector
Detect robots and crawlers.Latest release: 21 days ago - 4 dependent repositories - 1.87 thousand downloads total - 5 stars on GitHub - 1 maintainer
haikson/sitemap-generator
Sitemap crawler and generator classLatest release: 21 days ago - 0 downloads total - 68 stars on GitHub - 1 maintainer
Top 0.8% on packagist.org
20 versions - Latest release: 21 days ago - 18 dependent packages - 813 dependent repositories - 7.84 million downloads total - 210 stars on GitHub - 1 maintainer
spatie/robots-txt 2.2.0 💰
Determine if a page may be crawled from robots.txt and robots meta tags20 versions - Latest release: 21 days ago - 18 dependent packages - 813 dependent repositories - 7.84 million downloads total - 210 stars on GitHub - 1 maintainer
alexndreazevedo/crawler
Social PHP CrawlerLatest release: 21 days ago - 4 dependent repositories - 6 downloads total - 0 stars on GitHub - 1 maintainer
vanry/baike-spider
A simple spider crawling web pages from baike.baidu.comLatest release: 22 days ago - 6 downloads total - 2 stars on GitHub - 1 maintainer
agilekeys/point-picker
Crawler package for online shoppingLatest release: 22 days ago - 800 downloads total - 0 stars on GitHub - 1 maintainer
mvrc/php-email-crawler 💰
PHP Website Email Crawler, for crawling websites for emails.Latest release: 22 days ago - 7 downloads total - 3 stars on GitHub - 1 maintainer
maxlen/webcrawler
Search engine crawlersLatest release: 23 days ago - 10 downloads total - 0 stars on GitHub - 1 maintainer
l91/seo-bundle 💰
Symfony based seo bundle to crawl websitesLatest release: 23 days ago - 15 downloads total - 1 stars on GitHub - 1 maintainer
morphodo/crawler-bundle
HTTP-Crawler for Symfony2Latest release: 23 days ago - 4 dependent repositories - 5 downloads total - 1 maintainer
cotapreco/captcha
Our library for CAPTCHA solving (through third-party services, DeathByCaptcha)Latest release: 24 days ago - 144 downloads total - 2 stars on GitHub - 1 maintainer
jupiterapi/ephoto360
Create text effects online , Effects online for free, photo frames, make face photo montages, cus...Latest release: 24 days ago - 10 downloads total - 5 stars on GitHub - 1 maintainer
joacub/uglify-js2
jsminLatest release: 25 days ago - 4 dependent repositories - 105 downloads total - 0 stars on GitHub - 1 maintainer
wangjian/spiderman
the high performance crawler frameworkLatest release: 25 days ago - 7 downloads total - 5 stars on GitHub - 1 maintainer
elboletaire/crawler
A simple crawler (spider) writen in php just for funLatest release: 25 days ago - 1 dependent repositories - 6.7 thousand downloads total - 41 stars on GitHub - 1 maintainer
fi1a/crawler
PHP crawlerLatest release: 25 days ago - 0 downloads total - 1 stars on GitHub - 1 maintainer
lucassmacedo/mangas-downloader
PHP library to download mangas chaptersLatest release: 26 days ago - 0 downloads total - 12 stars on GitHub - 1 maintainer
loveorigami/lo-crawler
Crawler componentLatest release: 26 days ago - 29 downloads total - 0 stars on GitHub - 1 maintainer
piopi/behatcrawler
A Behat extension that crawls links on a website and executes user-defined function on each one o...Latest release: 26 days ago - 16 downloads total - 1 stars on GitHub - 1 maintainer
oyjz/querylist
PHP采集工具(爬虫)，基于https://github.com/jae-jae/QueryList。Latest release: 27 days ago - 6 downloads total - 0 stars on GitHub - 1 maintainer
andrew-svirin/resource-crawler-bundle
Crawler for any sort of resources.Latest release: 27 days ago - 55 downloads total - 3 stars on GitHub - 1 maintainer
zhiyang/php-crawler
Lightweight web crawler for phpLatest release: 27 days ago - 14 downloads total - 8 stars on GitHub - 1 maintainer
matheusfaustino/phrawl
A web crawling framework in PHPLatest release: 28 days ago - 3 downloads total - 0 stars on GitHub - 1 maintainer
ow/crawler-rules
Crawling rules processorLatest release: 30 days ago - 4 dependent repositories - 14 downloads total - 0 stars on GitHub - 1 maintainer
abelhalo/zolcrawler
Zol CrawlerLatest release: 30 days ago - 12 downloads total - 0 stars on GitHub - 1 maintainer
friends-of-hyva/magento2-crawler-session 1.0.1
Prevent crawlers from creating a session2 versions - Latest release: about 1 month ago - 55 downloads total - 6 stars on GitHub - 2 maintainers
pmaxs/crawler v1.1.1
HTTP crawler on non-blocking sockets4 versions - Latest release: about 1 month ago - 73 downloads total - 0 stars on GitHub - 1 maintainer
nguyenanhung/my-crawler v1.1.3
Crawler helper, library - Basic, Simple and Lightweight45 versions - Latest release: about 1 month ago - 2 dependent packages - 1 dependent repositories - 725 downloads total - 1 stars on GitHub - 1 maintainer
vormkracht10/laravel-seo-scanner v3.11.1 💰
Laravel package to check if you used important SEO tags in your website.51 versions - Latest release: about 1 month ago - 7.41 thousand downloads total - 168 stars on GitHub - 1 maintainer
lobotomised/laravel-autocrawler 1.2.0
A tool to crawl your own laravel installation checking your HTTP status codes8 versions - Latest release: about 1 month ago - 15.8 thousand downloads total - 1 stars on GitHub - 1 maintainer
Top 9.8% on packagist.org
66 versions - Latest release: about 1 month ago - 1 dependent package - 1 dependent repositories - 89.7 thousand downloads total - 40 stars on GitHub - 1 maintainer
eliashaeussler/cache-warmup 3.0.1 💰
Composer package to warm up website caches, based on a given XML sitemap66 versions - Latest release: about 1 month ago - 1 dependent package - 1 dependent repositories - 89.7 thousand downloads total - 40 stars on GitHub - 1 maintainer
kaishiyoku/hera-rss-crawler 6.0.1 💰
Modern library to handle RSS/Atom feeds50 versions - Latest release: about 1 month ago - 2 dependent repositories - 1.81 thousand downloads total - 1 stars on GitHub - 1 maintainer
compolomus/rssreader 2.1
Small library for obtaining RSS feed with caching.3 versions - Latest release: about 2 months ago - 1 dependent repositories - 43 downloads total - 1 stars on GitHub - 1 maintainer
leowebguy/craft-crawler-detect 2.0.0
Craft plugin for detecting bots/crawlers/spiders5 versions - Latest release: about 2 months ago - 4.93 thousand downloads total - 1 stars on GitHub - 1 maintainer
vakata/downloader 1.0.2 💰
A PHP class for making a static copy (or indexing) a site3 versions - Latest release: about 2 months ago - 154 downloads total - 0 stars on GitHub - 1 maintainer
crwlr/crawler v1.7.2
Web crawling and scraping library.38 versions - Latest release: about 2 months ago - 1 dependent package - 1 dependent repositories - 2.7 thousand downloads total - 295 stars on GitHub - 1 maintainer
awanesia/scrap v2.0.1
A web scraper for PHP to easily extract data from web pages -> party of laurentvw1 version - Latest release: about 2 months ago - 3 downloads total - 0 stars on GitHub - 1 maintainer
cable8mm/water-melon v1.1.3
Water Melon is simple melon.com api sdk for php5 versions - Latest release: 2 months ago - 2.47 thousand downloads total - 16 stars on GitHub - 1 maintainer
airmole/tjustb-edusys v1.1.0
Tianjin college,USTB education system HTTP client15 versions - Latest release: 2 months ago - 24 downloads total - 1 stars on GitHub - 1 maintainer
crwlr/crawler-ext-browser v1.2.1
Extension for the crwlr/crawler package containing steps utilizing a headless browser.7 versions - Latest release: 2 months ago - 135 downloads total - 0 stars on GitHub - 1 maintainer
bitandblack/sitemap 2.0.6 💰
Creates a sitemap.xml by parsing the whole website.12 versions - Latest release: 2 months ago - 1 dependent package - 1 dependent repositories - 1.88 thousand downloads total - 2 maintainers
ixnode/php-web-crawler 0.1.24
PHP Web Crawler - This PHP class allows you to crawl recursively a given html page (or a given ht...25 versions - Latest release: 3 months ago - 25 downloads total - 2 stars on GitHub - 1 maintainer
piedweb/crawler 0.1.783
Web Crawler to check few SEO basics.53 versions - Latest release: 3 months ago - 70 downloads total - 1 stars on GitHub - 1 maintainer
contextualcode/crawler v2.4.0
Flexible website crawler which stores the results in persistent storage21 versions - Latest release: 3 months ago - 1 dependent package - 1 dependent repositories - 526 downloads total - 0 stars on GitLab.com - 2 maintainers
visuellverstehen/t3fetch 1.5.0
Fetches a website (including all subpages), so the TYPO3 cache gets filled.14 versions - Latest release: 3 months ago - 14 thousand downloads total - 7 stars on GitHub - 1 maintainer
Top 0.3% on packagist.org
104 versions - Latest release: 3 months ago - 44 dependent packages - 858 dependent repositories - 8.23 million downloads total - 2,471 stars on GitHub - 1 maintainer
spatie/crawler 8.2.0 💰
Crawl all internal links found on a website104 versions - Latest release: 3 months ago - 44 dependent packages - 858 dependent repositories - 8.23 million downloads total - 2,471 stars on GitHub - 1 maintainer
johnroyer/crawler-php 0.3.6
crawler implement in PHP13 versions - Latest release: 3 months ago - 1 dependent repositories - 60 downloads total - 3 stars on GitHub - 1 maintainer
kiwa/sitemap 2.0.0 💰
Integrates the Bit&Black Sitemap into a Kiwa website to create sitemap files seamlessly.11 versions - Latest release: 3 months ago - 1 dependent package - 3.19 thousand downloads total - 2 maintainers
skyblack/diz-scraping 0.1.3
Diz Scraping4 versions - Latest release: 3 months ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
depa/depa-middleware-redirect 1.0.8
Laminas mezzio middleware for redirecting7 versions - Latest release: 4 months ago - 18 downloads total - 0 stars on GitHub - 1 maintainer
sofyco/spider 2.0.0 💰
Crawler + Scraper + Parser library11 versions - Latest release: 4 months ago - 1 dependent package - 1 dependent repositories - 52 downloads total - 0 stars on GitHub - 1 maintainer
core23/lastfm-bundle 1.3.0 💰
This bundle provides services for using the last.fm API with symfony.11 versions - Latest release: 5 months ago - 104 downloads total - 3 stars on GitHub - 1 maintainer
nucleos/lastfm-bundle 1.3.0 💰
This bundle provides services for using the last.fm API with symfony.11 versions - Latest release: 5 months ago - 884 downloads total - 3 stars on GitHub - 1 maintainer
nucleos/lastfm 3.6.0 💰
Last.fm webservice client for php.20 versions - Latest release: 5 months ago - 2 dependent packages - 1 dependent repositories - 10.9 thousand downloads total - 14 stars on GitHub - 1 maintainer
core23/lastfm-api 3.6.0 💰
Last.fm webservice client for php.20 versions - Latest release: 5 months ago - 2 dependent packages - 2.78 thousand downloads total - 13 stars on GitHub - 1 maintainer
panakour/pkscraper v1.2.0
Get whatever data you want.10 versions - Latest release: 5 months ago - 181 downloads total - 1 stars on GitHub - 1 maintainer
dachcom-digital/dynamic-search-data-provider-crawler v3.0.1
A Spider Crawler Extension for Pimcore Dynamic Search.16 versions - Latest release: 5 months ago - 12.1 thousand downloads total - 8 stars on GitHub - 1 maintainer
Top 1.6% on packagist.org
18 versions - Latest release: 5 months ago - 7 dependent packages - 23 dependent repositories - 143 thousand downloads total - 1,324 stars on GitHub - 1 maintainer
vdb/php-spider v0.7.2
A configurable and extensible PHP web spider18 versions - Latest release: 5 months ago - 7 dependent packages - 23 dependent repositories - 143 thousand downloads total - 1,324 stars on GitHub - 1 maintainer
Top 0.7% on packagist.org
30 versions - Latest release: 5 months ago - 51 dependent packages - 125 dependent repositories - 2.64 million downloads total - 345 stars on GitHub - 1 maintainer
wa72/htmlpagedom v3.0.2
jQuery-inspired DOM manipulation extension for Symfony's Crawler30 versions - Latest release: 5 months ago - 51 dependent packages - 125 dependent repositories - 2.64 million downloads total - 345 stars on GitHub - 1 maintainer
danielbrendel/rfcrawler removed
PHP Reddit Feed CrawlerLatest release: 6 months ago - 49 downloads total - 0 stars on GitHub - 1 maintainer
Related Keywords
php
122
spider
62
scraper
47
scraping
28
laravel
23
crawling
23
parser
22
http
17
website
17
bot
16
curl
15
hacktoberfest
15
symfony
15
seo
15
dom
14
api
13
html
12
link
12
search
12
library
11
spatie
11
scrape
11
yii2
10
Sitemap
9
web
9
detect
9
crawl
8
composer
8
module
8
extension
7
scrapper
6
bundle
6
webcrawler
6
framework
6
typo3
6
robot
6
browser
6
robots.txt
6
user-agent
6
luya
6
yii
6
google
6
parse
5
crawler detector
5
url
5
xml
5
php crawler detect
5
crawler detect
5
crawlerdetect
5
scraping-websites
5
bots
5
extractor
5
index
5
robots-txt
5
news
5
domcrawler
5
phpQuery
4
health
4
QueryList
4
php-crawler
4
web-crawler
4
json
4
request
4
last.fm
4
webservice client
4
lastfm
4
symfony-bundle
4
webservice-client
4
content
4
asynchronous
4
luya-module
4
multi
3
instagram
3
console
3
Harvest
3
guzzle
3
facebook
3
Match
3
robots
3
extract
3
mining
3
internet
3
data
3
matcher
3
checker
3
wordpress
3
laravel-package
3
crwlr
3
cache-warmup
3
web-crawling
3
sitemap
3
web crawler
3
async
3
webscraping
3
rss
3
web-scraping
3
stock
3
device
3
user agent
3
selector
3