Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
packagist.org "crawler" keyword
tetreum/kat
Kat.cr / KickAssTorrents PHP SDK (Unofficial)Latest release: 13 days ago - 1 dependent repositories - 12 downloads total - 1 stars on GitHub - 1 maintainer
Top 9.8% on packagist.org
66 versions - Latest release: about 1 month ago - 1 dependent package - 1 dependent repositories - 89.7 thousand downloads total - 40 stars on GitHub - 1 maintainer
eliashaeussler/cache-warmup 3.0.1 💰
Composer package to warm up website caches, based on a given XML sitemap66 versions - Latest release: about 1 month ago - 1 dependent package - 1 dependent repositories - 89.7 thousand downloads total - 40 stars on GitHub - 1 maintainer
vrkansagara/common-crawler 1.0.2
Common Crawler3 versions - Latest release: over 6 years ago - 27 downloads total - 3 stars on GitHub - 1 maintainer
appstract/laravel-crawl-render 0.1.4
Pre-render your site for web crawlers5 versions - Latest release: about 6 years ago - 36 downloads total - 11 stars on GitHub - 1 maintainer
acanto/crawler 6.0.2
Crawl all internal links found on a website1 version - Latest release: about 3 years ago - 1 dependent package - 2 dependent repositories - 2.72 thousand downloads total - 0 stars on GitLab.com - 1 maintainer
c2is/walker
A basic wrapper around Goutte to crawl a websiteLatest release: 13 days ago - 5 dependent repositories - 28 downloads total - 0 stars on GitHub - 1 maintainer
compolomus/rssreader 2.1
Small library for obtaining RSS feed with caching.3 versions - Latest release: about 2 months ago - 1 dependent repositories - 43 downloads total - 1 stars on GitHub - 1 maintainer
c4pone/yolo_crawler
An event based domain crawlerLatest release: 13 days ago - 4 dependent repositories - 39 downloads total - 2 stars on GitHub - 1 maintainer
sfynx-project/tool-crawler-bundle v2.8.2
This Bundle provides handlers to work with xml and xsd files.4 versions - Latest release: over 5 years ago - 2 dependent packages - 2 dependent repositories - 473 downloads total - 1 stars on GitHub - 1 maintainer
godbout/htmlpagedom 3.0.0 💰
jQuery-inspired DOM manipulation extension for Symfony's Crawler25 versions - Latest release: over 3 years ago - 1 dependent package - 3 dependent repositories - 20.1 thousand downloads total - 1 stars on GitHub - 1 maintainer
kaishiyoku/hera-rss-crawler 6.0.1 💰
Modern library to handle RSS/Atom feeds50 versions - Latest release: about 2 months ago - 2 dependent repositories - 1.81 thousand downloads total - 1 stars on GitHub - 1 maintainer
Top 5.7% on packagist.org
4 versions - Latest release: over 1 year ago - 6 dependent packages - 11 dependent repositories - 257 thousand downloads total - 12 stars on GitHub - 1 maintainer
minicli/curly 0.2.2
Simple Curl Client4 versions - Latest release: over 1 year ago - 6 dependent packages - 11 dependent repositories - 257 thousand downloads total - 12 stars on GitHub - 1 maintainer
conradoojr/thief-links
Crawler For WebSites of SeriesLatest release: 14 days ago - 12 downloads total - 2 stars on GitHub - 1 maintainer
rfussien/leboncoin-crawler 2.3.0
Makes data extraction from leboncoin.fr easy13 versions - Latest release: about 7 years ago - 4 dependent repositories - 358 downloads total - 39 stars on GitHub - 1 maintainer
Top 6.8% on packagist.org
68 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 279 thousand downloads total - 53 stars on GitHub - 2 maintainers
aoepeople/crawler 11.0.7 💰
Crawler extension for TYPO368 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 279 thousand downloads total - 53 stars on GitHub - 2 maintainers
Top 7.0% on packagist.org
68 versions - Latest release: over 1 year ago - 1 dependent package - 2 dependent repositories - 197 thousand downloads total - 53 stars on GitHub - 1 maintainer
tomasnorre/crawler 11.0.7 💰
Crawler extension for TYPO368 versions - Latest release: over 1 year ago - 1 dependent package - 2 dependent repositories - 197 thousand downloads total - 53 stars on GitHub - 1 maintainer
mediashare/spider 0.4.7
Spider is a php library for crawling website that allows you to scrape informations & automated a...33 versions - Latest release: over 2 years ago - 112 downloads total - 14 stars on GitHub - 1 maintainer
slote/spider 0.4.7
Spider is a php library for crawling website that allows you to scrape informations & automated a...33 versions - Latest release: over 2 years ago - 4 downloads total - 14 stars on GitHub - 1 maintainer
amir2b/instagram
Fetch data from InstagramLatest release: 14 days ago - 5 downloads total - 0 stars on GitHub - 1 maintainer
mcstreetguy/crawler
An advanced web-crawler written in PHP.Latest release: 14 days ago - 6 downloads total - 3 stars on GitHub - 1 maintainer
mantoufan/yzhanip 1.0.1
Crawl, match, parse IP or IP range, check if IP or range is in another range. Support IPv4, IPv6,...2 versions - Latest release: over 1 year ago - 1 dependent repositories - 1.2 thousand downloads total - 58 stars on GitHub - 1 maintainer
awesam86/imlinscraper v1.0.1
Image And Link Scraper2 versions - Latest release: almost 6 years ago - 20 downloads total - 0 stars on GitHub - 1 maintainer
Top 10.0% on packagist.org
4 versions - Latest release: over 5 years ago - 3 dependent packages - 8 dependent repositories - 6.39 thousand downloads total - 3 stars on GitHub - 1 maintainer
ropendev/curl 1.0.3
PHP POO cURL wrapper (PSR friendly) : light and simple.4 versions - Latest release: over 5 years ago - 3 dependent packages - 8 dependent repositories - 6.39 thousand downloads total - 3 stars on GitHub - 1 maintainer
milu2003/flarum-ext-dxc
DXC采集 flraum接口Latest release: 15 days ago - 1 dependent repositories - 8 downloads total - 0 stars on GitHub - 1 maintainer
crwlr/robots-txt v1.1.1
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping6 versions - Latest release: over 1 year ago - 1 dependent package - 1 dependent repositories - 5.36 thousand downloads total - 8 stars on GitHub - 1 maintainer
shel/crawler 2.4.1 💰
Allows crawling of sitemaps and node-trees11 versions - Latest release: over 1 year ago - 1.15 thousand downloads total - 7 stars on GitHub - 1 maintainer
ixnode/php-web-crawler 0.1.24
PHP Web Crawler - This PHP class allows you to crawl recursively a given html page (or a given ht...25 versions - Latest release: 3 months ago - 25 downloads total - 2 stars on GitHub - 1 maintainer
webcoast/versatile-crawler v1.1.1
A versatile and extendable crawler for TYPO3 CMS4 versions - Latest release: almost 3 years ago - 6.41 thousand downloads total - 7 stars on GitHub - 1 maintainer
nguyenanhung/template-crawler-package v1.0.1
Structure Repository Template for Crawler Package2 versions - Latest release: 9 months ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
mehrabx/web-crawler v1.0
A web crawler package1 version - Latest release: over 2 years ago - 1 downloads total - 3 stars on GitHub - 1 maintainer
urguardian4ngel/flarum-ext-fb-crawler v0.1.0-beta.5
An extension that allows the Facebook Crawler to crawl protected pages.1 version - Latest release: over 7 years ago - 104 downloads total - 0 stars on GitHub - 1 maintainer
blogdaren/webman-phpcreeper v1.0.4
PHPCreeper plugin for webman5 versions - Latest release: 18 days ago - 165 downloads total - 8 stars on GitHub - 1 maintainer
delphiki/aprr 2.0.1
A simple crawler to get formated data from APRR website.5 versions - Latest release: about 7 years ago - 18 downloads total - 0 stars on GitHub - 1 maintainer
dz0x44/9pay-spider-telco v1.9
9Pay Crawler for Telco Promotion10 versions - Latest release: about 4 years ago - 31 downloads total - 0 stars on GitHub - 1 maintainer
vangxh/beanbun
Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性Latest release: 17 days ago - 2 downloads total - 0 stars on GitHub - 1 maintainer
Top 2.2% on packagist.org
13 versions - Latest release: over 7 years ago - 9 dependent packages - 40 dependent repositories - 142 thousand downloads total - 72 stars on GitHub - 1 maintainer
jyggen/curl v4.0.0
A simple and lightweight cURL library with support for asynchronous requests.13 versions - Latest release: over 7 years ago - 9 dependent packages - 40 dependent repositories - 142 thousand downloads total - 72 stars on GitHub - 1 maintainer
pagemunch/pagemunch
A PHP wrapper for the PageMunch link unfurling APILatest release: 17 days ago - 4 dependent repositories - 31 downloads total - 6 stars on GitHub - 1 maintainer
leowebguy/craft-crawler-detect 2.0.0
Craft plugin for detecting bots/crawlers/spiders5 versions - Latest release: about 2 months ago - 4.93 thousand downloads total - 1 stars on GitHub - 1 maintainer
heimrichhannot/crawler 6.0.0
Crawl all internal links found on a website92 versions - Latest release: over 3 years ago - 1.31 thousand downloads total - 1 stars on GitHub - 1 maintainer
lexxtor/easy-php-crawler
Simple yet flexible URL crawler.Latest release: 18 days ago - 8 downloads total - 1 stars on GitHub - 1 maintainer
puzzle/crawler
web crawlerLatest release: 18 days ago - 4 dependent repositories - 13 downloads total - 0 stars on GitHub - 1 maintainer
thingston/crawler 0.7.0
Web crawler based on PHP Guzzle HTTP Client with concurrency support for faster operation.10 versions - Latest release: over 5 years ago - 9 downloads total - 2 stars on GitHub - 1 maintainer
hissezhaut/http-status-check 1.0.2
CLI tool to crawl a website and check HTTP status code4 versions - Latest release: over 7 years ago - 9 downloads total - 0 stars on GitHub - 1 maintainer
pyaesoneaung/2d-crawler v1.1.0
2D crawler for set.or.th4 versions - Latest release: 12 months ago - 53 downloads total - 3 stars on GitHub - 1 maintainer
dachcom-digital/dynamic-search-data-provider-crawler v3.0.1
A Spider Crawler Extension for Pimcore Dynamic Search.16 versions - Latest release: 5 months ago - 12.1 thousand downloads total - 8 stars on GitHub - 1 maintainer
alrik11es/scrappy
A free proxy list based downloader for your crawling projects in PHPLatest release: 18 days ago - 2.14 thousand downloads total - 1 stars on GitHub - 1 maintainer
piedweb/crawler 0.1.783
Web Crawler to check few SEO basics.53 versions - Latest release: 3 months ago - 70 downloads total - 1 stars on GitHub - 1 maintainer
fireguard/correios
Utilities for interaction with the post office of BrazilLatest release: 19 days ago - 6 downloads total - 1 stars on GitHub - 1 maintainer
diggin/diggin-robotrules 0.10.0
parser/handler for Robots Exclusion Protocol (robots.txt and more)5 versions - Latest release: about 8 years ago - 5 dependent repositories - 184 downloads total - 7 stars on GitHub - 1 maintainer
depa/depa-middleware-redirect 1.0.8
Laminas mezzio middleware for redirecting7 versions - Latest release: 4 months ago - 18 downloads total - 0 stars on GitHub - 1 maintainer
crawlbase/crawlbase v1.0.0
A lightweight, dependency free PHP class that acts as wrapper for Crawlbase API1 version - Latest release: 12 months ago - 584 downloads total - 7 stars on GitHub - 1 maintainer
eightwire/magento2-module-primer 0.1.14
A cache primer extension for Magento 215 versions - Latest release: over 4 years ago - 15.7 thousand downloads total - 19 stars on GitHub - 1 maintainer
fran-diaz/itseo 0.1.1
Includes methods that extract SEO info from url or HTML code1 version - Latest release: over 10 years ago - 4 dependent repositories - 22 downloads total - 3 stars on GitHub - 1 maintainer
kynkai/search-engine-crawler v1.0
SearchEngineCrawler Dump the data from the search engines1 version - Latest release: over 4 years ago - 13 downloads total - 2 stars on GitHub - 1 maintainer
tetreum/xupopter
Xupopter crawlea las principales páginas de compraventa de inmuebles de España como son Idealista...Latest release: 19 days ago - 45 downloads total - 11 stars on GitHub - 1 maintainer
io-jaegers/valkyrier
Latest release: 20 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainerdanielbehrendt/web-scraper v1.1.0
This package can be used to scrape elements from websites.7 versions - Latest release: about 4 years ago - 3 downloads total - 1 stars on GitLab.com - 1 maintainer
sleimanx2/grawler 0.2.4
A guided html crawler with media meta extraction15 versions - Latest release: over 4 years ago - 295 downloads total - 13 stars on GitHub - 1 maintainer
Top 6.8% on packagist.org
21 versions - Latest release: about 6 years ago - 7 dependent repositories - 61.4 thousand downloads total - 47 stars on GitHub - 1 maintainer
opensearchserver/opensearchserver 3.0.20
PHP library for OpenSearchServer: professionnal search engine, crawlers (web, file, database), RE...21 versions - Latest release: about 6 years ago - 7 dependent repositories - 61.4 thousand downloads total - 47 stars on GitHub - 1 maintainer
filchos/imago
A library for reading and transforming content in a chainable wayLatest release: 20 days ago - 29 downloads total - 0 stars on GitHub - 1 maintainer
mr4-lc/content-protected 0.0.1
Laravel content protected1 version - Latest release: 6 months ago - 1 downloads total - 0 stars on GitHub - 1 maintainer
sohib/crawler v1.0.1
Scan Http URLs from a url containing an HTML and get Json or Xml or Array3 versions - Latest release: over 8 years ago - 24 downloads total - 0 stars on GitHub - 1 maintainer
coooold/crawler v1.0.0
Most powerful, popular and production crawling/scraping package for PHP1 version - Latest release: over 4 years ago - 15 downloads total - 1 stars on GitHub - 1 maintainer
baqend/spider 1.0.0
URL spider which crawls a page and all its subpages1 version - Latest release: about 6 years ago - 434 downloads total - 6 stars on GitHub - 1 maintainer
bdspider/crawler 0.5.1
crawler,spider for phpQuery。8 versions - Latest release: over 5 years ago - 46 downloads total - 0 stars on GitHub - 1 maintainer
proxycrawl/proxycrawl 3.0.0
A lightweight, dependency free PHP class that acts as wrapper for ProxyCrawl API13 versions - Latest release: almost 3 years ago - 60.4 thousand downloads total - 19 stars on GitHub - 1 maintainer
nekhbet/crawlers-laravel-pulse
Laravel Pulse Card to show crawlersLatest release: 20 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
codeblog/crawlerdetect v1.0.0
A CodeBlog CrawlerDetect class is easy and quick to use. Detecting bots/crawlers/spiders via the ...1 version - Latest release: about 5 years ago - 54 downloads total - 9 stars on GitHub - 1 maintainer
gaolujie1989/webmagic
A scalable web crawler framework for php.Latest release: 21 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
Top 7.8% on packagist.org
11 versions - Latest release: about 9 years ago - 12 dependent repositories - 4.41 thousand downloads total - 312 stars on GitHub - 1 maintainer
sleeping-owl/apist 1.3.7
Package to provide api-like access to foreign sites based on html parsing11 versions - Latest release: about 9 years ago - 12 dependent repositories - 4.41 thousand downloads total - 312 stars on GitHub - 1 maintainer
fgsl/crawler 0.0.1
Fgsl Crawler1 version - Latest release: over 6 years ago - 8 downloads total - 0 stars on GitHub - 1 maintainer
kiwa/sitemap 2.0.0 💰
Integrates the Bit&Black Sitemap into a Kiwa website to create sitemap files seamlessly.11 versions - Latest release: 3 months ago - 1 dependent package - 3.19 thousand downloads total - 2 maintainers
teamtnt/crawler
Distributed Crawler ArchitectureLatest release: 21 days ago - 1 downloads total - 8 stars on GitHub - 1 maintainer
allotmentandy/socialmedialinkextractor
extracts social media links for an array of links eg. twitter, facebook etc.Latest release: 21 days ago - 87 downloads total - 0 stars on GitHub - 1 maintainer
hissezhaut/laravel-link-checker v2.0.1
Check all links in a Laravel app7 versions - Latest release: over 7 years ago - 11 downloads total - 0 stars on GitHub - 1 maintainer
dayrev/extractor v1.2.2
Web Page Content Extractor7 versions - Latest release: about 7 years ago - 11 downloads total - 2 stars on GitHub - 1 maintainer
pabeda-bt/php-crawler
Crawl all internal links in a websiteLatest release: 21 days ago - 38 downloads total - 0 stars on GitHub - 1 maintainer
Top 3.2% on packagist.org
19 versions - Latest release: over 7 years ago - 4 dependent packages - 14 dependent repositories - 234 thousand downloads total - 43 stars on GitHub - 1 maintainer
crossjoin/browscap v3.0.5
The standalone PHP Browscap parser Crossjoin\Browscap detects browser properties as well as devic...19 versions - Latest release: over 7 years ago - 4 dependent packages - 14 dependent repositories - 234 thousand downloads total - 43 stars on GitHub - 1 maintainer
edwinhuish/querylist V5.0.9
Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on D...22 versions - Latest release: about 4 years ago - 15 downloads total - 1 stars on GitHub - 1 maintainer
upstream-team/laravel-crawler-detect 0.1.10
Wrapper for the crawler detection package6 versions - Latest release: 7 months ago - 3 downloads total - 1 stars on GitHub - 1 maintainer
filipsedivy/kontrola-tachometru 0.1.0 💰
🚘 MDČR - kontrola tachometru1 version - Latest release: almost 5 years ago - 3 downloads total - 0 stars on GitHub - 1 maintainer
nggiahao/crawler 0.1.0
Package này có nhiêm vụ thu thập dữ liệu từ các website khác sử dụng Guzzle, Phantomjs hay Puppet...1 version - Latest release: over 3 years ago - 8 downloads total - 4 stars on GitHub - 1 maintainer
creode/craft-page-crawler 1.1.0
This will allow a page to be crawled for useful content during an indexing process.10 versions - Latest release: about 1 year ago - 39 downloads total - 0 stars on GitHub - 1 maintainer
phantazm/robotdetector
Detect robots and crawlers.Latest release: 22 days ago - 4 dependent repositories - 1.87 thousand downloads total - 5 stars on GitHub - 1 maintainer
haikson/sitemap-generator
Sitemap crawler and generator classLatest release: 22 days ago - 0 downloads total - 68 stars on GitHub - 1 maintainer
visuellverstehen/t3fetch 1.5.0
Fetches a website (including all subpages), so the TYPO3 cache gets filled.14 versions - Latest release: 3 months ago - 14 thousand downloads total - 7 stars on GitHub - 1 maintainer
alexndreazevedo/crawler
Social PHP CrawlerLatest release: 22 days ago - 4 dependent repositories - 6 downloads total - 0 stars on GitHub - 1 maintainer
proclnas/curl-rox 3.0.0
Just another curl wrapper for webCrawling purposes3 versions - Latest release: about 5 years ago - 17 downloads total - 9 stars on GitHub - 1 maintainer
wangta69/crawler 1.0.0
crawler1 version - Latest release: about 6 years ago - 14 downloads total - 1 stars on GitHub - 1 maintainer
luyadev/luya-module-crawleradmin 1.0.0-beta8
Yii2 LUYA Crawler Admin-Module4 versions - Latest release: almost 8 years ago - 562 downloads total - 1 maintainer
pithyone/zhihu-crawler 3.5.0
轻量级知乎爬虫17 versions - Latest release: over 5 years ago - 62 downloads total - 25 stars on GitHub - 1 maintainer
vakata/downloader 1.0.2 💰
A PHP class for making a static copy (or indexing) a site3 versions - Latest release: about 2 months ago - 154 downloads total - 0 stars on GitHub - 1 maintainer
vanry/baike-spider
A simple spider crawling web pages from baike.baidu.comLatest release: 23 days ago - 6 downloads total - 2 stars on GitHub - 1 maintainer
radarlog/banks-spyder 1.0
Banks Spyder is free software to automatically generate bank statements in PDF format from your a...1 version - Latest release: about 8 years ago - 2 downloads total - 0 stars on GitHub - 1 maintainer
agilekeys/point-picker
Crawler package for online shoppingLatest release: 23 days ago - 800 downloads total - 0 stars on GitHub - 1 maintainer
brunodebarros/http-request 1.0.2
A web crawler, built to be easily dropped into PHP applications, which behaves just like a regula...3 versions - Latest release: about 9 years ago - 1 dependent package - 4 dependent repositories - 195 downloads total - 8 stars on GitHub - 1 maintainer
louvian/pururin-crawler 0.0.1
Pururin Crawler1 version - Latest release: over 6 years ago - 12 downloads total - 4 stars on GitHub - 1 maintainer
laurentvw/scrapher v2.3.1
A web scraper for PHP to easily extract data from web pages12 versions - Latest release: about 6 years ago - 1 dependent package - 3 dependent repositories - 2.51 thousand downloads total - 18 stars on GitHub - 1 maintainer
harm-smits/webcrawler-verifier 2.1.1
PHP library providing functionality to verify that user-agents are who they claim to be.6 versions - Latest release: over 2 years ago - 1 downloads total - 0 stars on GitHub - 1 maintainer
Related Keywords
php
122
spider
62
scraper
47
scraping
28
laravel
23
crawling
23
parser
22
http
17
website
17
bot
16
curl
15
hacktoberfest
15
seo
15
symfony
15
dom
14
api
13
search
12
link
12
html
12
spatie
11
library
11
scrape
11
yii2
10
detect
9
web
9
Sitemap
9
composer
8
crawl
8
module
8
extension
7
robots.txt
6
browser
6
typo3
6
webcrawler
6
luya
6
robot
6
google
6
scrapper
6
yii
6
framework
6
bundle
6
user-agent
6
crawlerdetect
5
url
5
bots
5
xml
5
php crawler detect
5
index
5
parse
5
robots-txt
5
scraping-websites
5
extractor
5
domcrawler
5
news
5
crawler detector
5
crawler detect
5
webservice client
4
lastfm
4
webservice-client
4
last.fm
4
content
4
json
4
web-crawler
4
asynchronous
4
request
4
health
4
php-crawler
4
symfony-bundle
4
luya-module
4
QueryList
4
phpQuery
4
multi
3
web-scraping
3
sitemap
3
facebook
3
robots
3
user agent
3
device
3
rss
3
cache
3
cache-warmup
3
indexer
3
seo-optimization
3
wordpress
3
stock
3
console
3
checker
3
helper
3
instagram
3
laravel-package
3
async
3
webscraping
3
selector
3
mining
3
guzzle
3
Match
3
Harvest
3
extract
3
matcher
3
data
3