Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
packagist.org "crawler" keyword
Top 0.2% on packagist.org
158 versions - Latest release: 20 days ago - 148 dependent packages - 8,221 dependent repositories - 57.9 million downloads total - 1,911 stars on GitHub - 2 maintainers
jaybizzle/crawler-detect v1.2.118
CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent158 versions - Latest release: 20 days ago - 148 dependent packages - 8,221 dependent repositories - 57.9 million downloads total - 1,911 stars on GitHub - 2 maintainers
Top 0.3% on packagist.org
104 versions - Latest release: 3 months ago - 44 dependent packages - 858 dependent repositories - 8.23 million downloads total - 2,471 stars on GitHub - 1 maintainer
spatie/crawler 8.2.0 💰
Crawl all internal links found on a website104 versions - Latest release: 3 months ago - 44 dependent packages - 858 dependent repositories - 8.23 million downloads total - 2,471 stars on GitHub - 1 maintainer
Top 0.8% on packagist.org
20 versions - Latest release: 22 days ago - 18 dependent packages - 813 dependent repositories - 7.84 million downloads total - 210 stars on GitHub - 1 maintainer
spatie/robots-txt 2.2.0 💰
Determine if a page may be crawled from robots.txt and robots meta tags20 versions - Latest release: 22 days ago - 18 dependent packages - 813 dependent repositories - 7.84 million downloads total - 210 stars on GitHub - 1 maintainer
Top 0.6% on packagist.org
26 versions - Latest release: 14 days ago - 94 dependent packages - 279 dependent repositories - 553 thousand downloads total - 2,606 stars on GitHub - 1 maintainer
jaeger/querylist V4.4.3 💰
Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on p...26 versions - Latest release: 14 days ago - 94 dependent packages - 279 dependent repositories - 553 thousand downloads total - 2,606 stars on GitHub - 1 maintainer
Top 1.1% on packagist.org
6 versions - Latest release: almost 2 years ago - 17 dependent packages - 183 dependent repositories - 1.55 million downloads total - 298 stars on GitHub - 1 maintainer
jaybizzle/laravel-crawler-detect v1.3.0
A Laravel package to detect web crawlers via the user agent6 versions - Latest release: almost 2 years ago - 17 dependent packages - 183 dependent repositories - 1.55 million downloads total - 298 stars on GitHub - 1 maintainer
Top 0.7% on packagist.org
30 versions - Latest release: 5 months ago - 51 dependent packages - 125 dependent repositories - 2.64 million downloads total - 345 stars on GitHub - 1 maintainer
wa72/htmlpagedom v3.0.2
jQuery-inspired DOM manipulation extension for Symfony's Crawler30 versions - Latest release: 5 months ago - 51 dependent packages - 125 dependent repositories - 2.64 million downloads total - 345 stars on GitHub - 1 maintainer
Top 2.2% on packagist.org
13 versions - Latest release: over 7 years ago - 9 dependent packages - 40 dependent repositories - 142 thousand downloads total - 72 stars on GitHub - 1 maintainer
jyggen/curl v4.0.0
A simple and lightweight cURL library with support for asynchronous requests.13 versions - Latest release: over 7 years ago - 9 dependent packages - 40 dependent repositories - 142 thousand downloads total - 72 stars on GitHub - 1 maintainer
Top 9.1% on packagist.org
9 versions - Latest release: about 3 years ago - 3 dependent packages - 25 dependent repositories - 707 thousand downloads total - 1 stars on GitHub - 1 maintainer
vipnytt/useragentparser v1.0.5
User-Agent parser for robot rule sets9 versions - Latest release: about 3 years ago - 3 dependent packages - 25 dependent repositories - 707 thousand downloads total - 1 stars on GitHub - 1 maintainer
Top 1.6% on packagist.org
18 versions - Latest release: 5 months ago - 7 dependent packages - 23 dependent repositories - 143 thousand downloads total - 1,324 stars on GitHub - 1 maintainer
vdb/php-spider v0.7.2
A configurable and extensible PHP web spider18 versions - Latest release: 5 months ago - 7 dependent packages - 23 dependent repositories - 143 thousand downloads total - 1,324 stars on GitHub - 1 maintainer
Top 2.8% on packagist.org
41 versions - Latest release: 9 months ago - 4 dependent packages - 23 dependent repositories - 90.4 thousand downloads total - 351 stars on GitHub - 1 maintainer
duzun/hquery 3.1.0
An extremely fast web scraper that parses megabytes of HTML in a blink of an eye. No dependencies...41 versions - Latest release: 9 months ago - 4 dependent packages - 23 dependent repositories - 90.4 thousand downloads total - 351 stars on GitHub - 1 maintainer
Top 3.2% on packagist.org
19 versions - Latest release: over 7 years ago - 4 dependent packages - 14 dependent repositories - 234 thousand downloads total - 43 stars on GitHub - 1 maintainer
crossjoin/browscap v3.0.5
The standalone PHP Browscap parser Crossjoin\Browscap detects browser properties as well as devic...19 versions - Latest release: over 7 years ago - 4 dependent packages - 14 dependent repositories - 234 thousand downloads total - 43 stars on GitHub - 1 maintainer
Top 3.4% on packagist.org
24 versions - Latest release: over 1 year ago - 2 dependent packages - 12 dependent repositories - 52.1 thousand downloads total - 259 stars on GitHub - 1 maintainer
spatie/laravel-link-checker 4.3.0 💰
Check all links in a Laravel app24 versions - Latest release: over 1 year ago - 2 dependent packages - 12 dependent repositories - 52.1 thousand downloads total - 259 stars on GitHub - 1 maintainer
Top 7.8% on packagist.org
11 versions - Latest release: about 9 years ago - 12 dependent repositories - 4.41 thousand downloads total - 312 stars on GitHub - 1 maintainer
sleeping-owl/apist 1.3.7
Package to provide api-like access to foreign sites based on html parsing11 versions - Latest release: about 9 years ago - 12 dependent repositories - 4.41 thousand downloads total - 312 stars on GitHub - 1 maintainer
Top 5.7% on packagist.org
4 versions - Latest release: over 1 year ago - 6 dependent packages - 11 dependent repositories - 257 thousand downloads total - 12 stars on GitHub - 1 maintainer
minicli/curly 0.2.2
Simple Curl Client4 versions - Latest release: over 1 year ago - 6 dependent packages - 11 dependent repositories - 257 thousand downloads total - 12 stars on GitHub - 1 maintainer
Top 8.7% on packagist.org
84 versions - Latest release: about 2 years ago - 10 dependent repositories - 4.31 thousand downloads total - 53 stars on GitHub - 1 maintainer
pablouser1/tikscraper v1.2.7
Get data from TikTok API84 versions - Latest release: about 2 years ago - 10 dependent repositories - 4.31 thousand downloads total - 53 stars on GitHub - 1 maintainer
Top 6.4% on packagist.org
14 versions - Latest release: almost 8 years ago - 3 dependent packages - 9 dependent repositories - 30.9 thousand downloads total - 10 stars on GitHub - 1 maintainer
tomverran/robots-txt-checker 1.12.1
Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a...14 versions - Latest release: almost 8 years ago - 3 dependent packages - 9 dependent repositories - 30.9 thousand downloads total - 10 stars on GitHub - 1 maintainer
Top 5.9% on packagist.org
22 versions - Latest release: 11 months ago - 9 dependent repositories - 47.2 thousand downloads total - 591 stars on GitHub - 1 maintainer
spatie/http-status-check 4.0.0 💰
CLI tool to crawl a website and check HTTP status code22 versions - Latest release: 11 months ago - 9 dependent repositories - 47.2 thousand downloads total - 591 stars on GitHub - 1 maintainer
Top 10.0% on packagist.org
4 versions - Latest release: over 5 years ago - 3 dependent packages - 8 dependent repositories - 6.39 thousand downloads total - 3 stars on GitHub - 1 maintainer
ropendev/curl 1.0.3
PHP POO cURL wrapper (PSR friendly) : light and simple.4 versions - Latest release: over 5 years ago - 3 dependent packages - 8 dependent repositories - 6.39 thousand downloads total - 3 stars on GitHub - 1 maintainer
Top 8.0% on packagist.org
2 versions - Latest release: over 9 years ago - 8 dependent repositories - 7.09 thousand downloads total - 58 stars on GitHub - 1 maintainer
mmerian/phpcrawl 0.8.3
PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-...2 versions - Latest release: over 9 years ago - 8 dependent repositories - 7.09 thousand downloads total - 58 stars on GitHub - 1 maintainer
Top 5.3% on packagist.org
13 versions - Latest release: over 2 years ago - 1 dependent package - 8 dependent repositories - 9.69 thousand downloads total - 253 stars on GitHub - 1 maintainer
codeguy/arachnid 2.2.1
A crawler to find all unique internal pages on a given website13 versions - Latest release: over 2 years ago - 1 dependent package - 8 dependent repositories - 9.69 thousand downloads total - 253 stars on GitHub - 1 maintainer
Top 6.8% on packagist.org
21 versions - Latest release: about 6 years ago - 7 dependent repositories - 61.4 thousand downloads total - 47 stars on GitHub - 1 maintainer
opensearchserver/opensearchserver 3.0.20
PHP library for OpenSearchServer: professionnal search engine, crawlers (web, file, database), RE...21 versions - Latest release: about 6 years ago - 7 dependent repositories - 61.4 thousand downloads total - 47 stars on GitHub - 1 maintainer
smart-core/rich-editor-bundle
Rich editor bundle.Latest release: 5 days ago - 1 dependent package - 7 dependent repositories - 296 downloads total - 0 stars on GitHub - 1 maintainer
smart-core/sitemap-bundle
Symfony Sitemap Crawler Generator Bundle.Latest release: 5 days ago - 1 dependent package - 6 dependent repositories - 307 downloads total - 0 stars on GitHub - 1 maintainer
seotracker/seocore 1.0.3
seo-core library for php4 versions - Latest release: over 6 years ago - 6 dependent repositories - 69 downloads total - 16 stars on GitHub - 1 maintainer
c2is/walker
A basic wrapper around Goutte to crawl a websiteLatest release: 12 days ago - 5 dependent repositories - 28 downloads total - 0 stars on GitHub - 1 maintainer
diggin/diggin-robotrules 0.10.0
parser/handler for Robots Exclusion Protocol (robots.txt and more)5 versions - Latest release: about 8 years ago - 5 dependent repositories - 184 downloads total - 7 stars on GitHub - 1 maintainer
vdaguenet/one-page-seo v1.0
Serve static content of a one-page website to crawlers (e.g. Facebook, Google or Twitter) using P...1 version - Latest release: almost 9 years ago - 5 dependent repositories - 37 downloads total - 7 stars on GitHub - 1 maintainer
bringyourownideas/laravel-sitemap 3.0.0 💰
A simple website crawler & sitemap generator without a headless browser for Laravel 5.8+19 versions - Latest release: over 1 year ago - 4 dependent repositories - 7.66 thousand downloads total - 9 stars on GitHub - 1 maintainer
morphodo/crawler-bundle
HTTP-Crawler for Symfony2Latest release: 24 days ago - 4 dependent repositories - 5 downloads total - 1 maintainer
laurentvw/lavacrawler v2.3.1
A web scraper for PHP to easily extract data from web pages12 versions - Latest release: about 6 years ago - 4 dependent repositories - 94 downloads total - 18 stars on GitHub - 1 maintainer
phramz/composer-repository-model
composer repository (aka `packages.json`) model builder componentLatest release: 12 days ago - 4 dependent repositories - 150 downloads total - 7 stars on GitHub - 1 maintainer
pagemunch/pagemunch
A PHP wrapper for the PageMunch link unfurling APILatest release: 16 days ago - 4 dependent repositories - 31 downloads total - 6 stars on GitHub - 1 maintainer
brunodebarros/http-request 1.0.2
A web crawler, built to be easily dropped into PHP applications, which behaves just like a regula...3 versions - Latest release: about 9 years ago - 1 dependent package - 4 dependent repositories - 195 downloads total - 8 stars on GitHub - 1 maintainer
innmind/crawler 6.1.0
Library to extract meaningful informations out of a webpage23 versions - Latest release: about 3 years ago - 4 dependent packages - 4 dependent repositories - 936 downloads total - 1 stars on GitHub - 1 maintainer
cobaia/marsvin v1.0.0
Marsvin it's a framework to write crawler applications1 version - Latest release: over 11 years ago - 4 dependent repositories - 111 downloads total - 12 stars on GitHub - 1 maintainer
alexndreazevedo/crawler
Social PHP CrawlerLatest release: 22 days ago - 4 dependent repositories - 6 downloads total - 0 stars on GitHub - 1 maintainer
fran-diaz/itseo 0.1.1
Includes methods that extract SEO info from url or HTML code1 version - Latest release: over 10 years ago - 4 dependent repositories - 22 downloads total - 3 stars on GitHub - 1 maintainer
gpupo/camelspider 1.0 abandoned
A class to help handle gateways to processing entities.1 version - Latest release: almost 9 years ago - 4 dependent repositories - 1 downloads total - 10 stars on GitHub - 1 maintainer
joacub/uglify-js2
jsminLatest release: 25 days ago - 4 dependent repositories - 105 downloads total - 0 stars on GitHub - 1 maintainer
c4pone/yolo_crawler
An event based domain crawlerLatest release: 12 days ago - 4 dependent repositories - 39 downloads total - 2 stars on GitHub - 1 maintainer
rfussien/leboncoin-crawler 2.3.0
Makes data extraction from leboncoin.fr easy13 versions - Latest release: about 7 years ago - 4 dependent repositories - 358 downloads total - 39 stars on GitHub - 1 maintainer
phantazm/robotdetector
Detect robots and crawlers.Latest release: 21 days ago - 4 dependent repositories - 1.87 thousand downloads total - 5 stars on GitHub - 1 maintainer
puzzle/crawler
web crawlerLatest release: 17 days ago - 4 dependent repositories - 13 downloads total - 0 stars on GitHub - 1 maintainer
ow/crawler-rules
Crawling rules processorLatest release: 30 days ago - 4 dependent repositories - 14 downloads total - 0 stars on GitHub - 1 maintainer
mihaeu/tarantula v1.3.0
Another PHP crawler based on Guzzle.7 versions - Latest release: almost 10 years ago - 4 dependent repositories - 49 downloads total - 15 stars on GitHub - 1 maintainer
gstjohn/thumbsnag v1.0.1
Thumbsnag crawls an HTML document and finds imagery that best represents the given page.2 versions - Latest release: about 9 years ago - 4 dependent repositories - 25 downloads total - 11 stars on GitHub - 1 maintainer
laurentvw/scrapher v2.3.1
A web scraper for PHP to easily extract data from web pages12 versions - Latest release: about 6 years ago - 1 dependent package - 3 dependent repositories - 2.51 thousand downloads total - 18 stars on GitHub - 1 maintainer
godbout/htmlpagedom 3.0.0 💰
jQuery-inspired DOM manipulation extension for Symfony's Crawler25 versions - Latest release: over 3 years ago - 1 dependent package - 3 dependent repositories - 20.1 thousand downloads total - 1 stars on GitHub - 1 maintainer
kiddyu/beanbun 1.0.4
Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性5 versions - Latest release: almost 7 years ago - 3 dependent repositories - 4.02 thousand downloads total - 1,231 stars on GitHub - 1 maintainer
lndj/lcrawl v3.1.0
一只优雅的正方教务系统爬虫。7 versions - Latest release: over 7 years ago - 3 dependent repositories - 1.82 thousand downloads total - 114 stars on GitHub - 1 maintainer
sfynx-project/tool-crawler-bundle v2.8.2
This Bundle provides handlers to work with xml and xsd files.4 versions - Latest release: over 5 years ago - 2 dependent packages - 2 dependent repositories - 473 downloads total - 1 stars on GitHub - 1 maintainer
kaishiyoku/hera-rss-crawler 6.0.1 💰
Modern library to handle RSS/Atom feeds50 versions - Latest release: about 1 month ago - 2 dependent repositories - 1.81 thousand downloads total - 1 stars on GitHub - 1 maintainer
Top 9.4% on packagist.org
13 versions - Latest release: over 2 years ago - 2 dependent repositories - 20.1 thousand downloads total - 253 stars on GitHub - 1 maintainer
zrashwani/arachnid 2.2.1
A crawler to find all unique internal pages on a given website13 versions - Latest release: over 2 years ago - 2 dependent repositories - 20.1 thousand downloads total - 253 stars on GitHub - 1 maintainer
mediashare/scraper 0.1.6
Scrapes the information from the targeted page and provides a DomCrawler15 versions - Latest release: over 2 years ago - 1 dependent package - 2 dependent repositories - 254 downloads total - 4 stars on GitHub - 1 maintainer
acanto/crawler 6.0.2
Crawl all internal links found on a website1 version - Latest release: about 3 years ago - 1 dependent package - 2 dependent repositories - 2.72 thousand downloads total - 0 stars on GitLab.com - 1 maintainer
alc/sitemap-crawler v2.0.0
Crawl sitemap.xml recursively and return collected urls as array2 versions - Latest release: about 3 years ago - 2 dependent packages - 2 dependent repositories - 2.43 thousand downloads total - 5 stars on GitHub - 1 maintainer
Top 7.0% on packagist.org
68 versions - Latest release: over 1 year ago - 1 dependent package - 2 dependent repositories - 197 thousand downloads total - 53 stars on GitHub - 1 maintainer
tomasnorre/crawler 11.0.7 💰
Crawler extension for TYPO368 versions - Latest release: over 1 year ago - 1 dependent package - 2 dependent repositories - 197 thousand downloads total - 53 stars on GitHub - 1 maintainer
blogdaren/phpcreeper v1.8.9
A new generation of multi-process async event-driven spider engine based on Workerman56 versions - Latest release: 5 days ago - 1 dependent package - 2 dependent repositories - 623 downloads total - 117 stars on GitHub - 1 maintainer
nucleos/lastfm 3.6.0 💰
Last.fm webservice client for php.20 versions - Latest release: 5 months ago - 2 dependent packages - 1 dependent repositories - 10.9 thousand downloads total - 14 stars on GitHub - 1 maintainer
sabri/tiktok v1.0.2
sabri/tiktok is php Tiktok scraper3 versions - Latest release: over 3 years ago - 1 dependent repositories - 446 downloads total - 70 stars on GitHub - 1 maintainer
xcrawler/xcrawler 1.0.41
A fast, simple and powerful PHP web crawler (scraper/spider) 快速、简洁且强大的爬虫/采集框架6 versions - Latest release: over 5 years ago - 1 dependent repositories - 866 downloads total - 339 stars on GitHub - 1 maintainer
crwlr/crawler v1.7.2
Web crawling and scraping library.38 versions - Latest release: about 2 months ago - 3 dependent packages - 1 dependent repositories - 2.7 thousand downloads total - 295 stars on GitHub - 1 maintainer
milu2003/flarum-ext-dxc
DXC采集 flraum接口Latest release: 14 days ago - 1 dependent repositories - 8 downloads total - 0 stars on GitHub - 1 maintainer
51degrees/fiftyone.devicedetection 4.4.2
Device detection engines for 51Degrees Pipeline API. Parse HTTP headers to detect hardware, opera...50 versions - Latest release: almost 2 years ago - 1 dependent package - 1 dependent repositories - 6.93 thousand downloads total - 0 stars on GitHub - 1 maintainer
jmajors/robotstxt v1.7.1
A small package for parsing websites' robots.txt files8 versions - Latest release: about 7 years ago - 1 dependent repositories - 20 downloads total - 3 stars on GitHub - 1 maintainer
nadar/crawler 1.7.1 💰
A highly extendible, dependency free Crawler for HTML, PDFS or any other type of Documents.14 versions - Latest release: about 2 years ago - 2 dependent packages - 1 dependent repositories - 18.6 thousand downloads total - 10 stars on GitHub - 1 maintainer
blackfire/player v2.6.0
A powerful web crawler and web scraper with Blackfire support98 versions - Latest release: 8 days ago - 1 dependent repositories - 16 thousand downloads total - 484 stars on GitHub - 1 maintainer
slendie/crawler
Slendie CrawlerLatest release: 11 days ago - 1 dependent repositories - 33 downloads total - 0 stars on GitHub - 1 maintainer
eddieace/php-simple v1.0.4
HTML DOM parser for php 7.1+5 versions - Latest release: about 3 years ago - 1 dependent repositories - 34.4 thousand downloads total - 14 stars on GitHub - 1 maintainer
jafaripur/varzesh3-crawler
Crawler for varzesh3.com livescoreLatest release: about 20 hours ago - 1 dependent repositories - 48 downloads total - 3 stars on GitHub - 1 maintainer
sofyco/spider 2.0.0 💰
Crawler + Scraper + Parser library11 versions - Latest release: 4 months ago - 1 dependent package - 1 dependent repositories - 52 downloads total - 0 stars on GitHub - 1 maintainer
snippetify/snippet-sniffer 1.2.4
Crawling and scraping web pages to extract snippets9 versions - Latest release: almost 4 years ago - 1 dependent package - 1 dependent repositories - 9 downloads total - 1 stars on GitHub - 1 maintainer
Top 6.8% on packagist.org
68 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 279 thousand downloads total - 53 stars on GitHub - 2 maintainers
aoepeople/crawler 11.0.7 💰
Crawler extension for TYPO368 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 279 thousand downloads total - 53 stars on GitHub - 2 maintainers
mediamonks/crawler 2.0.0
Crawl your own website with various clients for SEO and indexing purposes.4 versions - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 565 downloads total - 19 stars on GitHub - 1 maintainer
contextualcode/crawler v2.4.0
Flexible website crawler which stores the results in persistent storage21 versions - Latest release: 3 months ago - 1 dependent package - 1 dependent repositories - 526 downloads total - 0 stars on GitLab.com - 2 maintainers
nmure/crawler-detect-bundle v2.0.0
A Symfony bundle for the Crawler-Detect library (detects bots/crawlers/spiders via the user agent)3 versions - Latest release: over 6 years ago - 1 dependent repositories - 252 thousand downloads total - 25 stars on GitHub - 1 maintainer
exfriend/uncurl 1.0.5
Unfurl links in PHP4 versions - Latest release: about 5 years ago - 1 dependent repositories - 196 downloads total - 1 stars on GitHub - 1 maintainer
zephir/luya-module-crawleradmin 1.0.0-beta8
Yii2 LUYA Crawler Admin-Module4 versions - Latest release: almost 8 years ago - 2 dependent packages - 1 dependent repositories - 143 downloads total - 1 maintainer
crwlr/robots-txt v1.1.1
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping6 versions - Latest release: over 1 year ago - 1 dependent package - 1 dependent repositories - 5.36 thousand downloads total - 8 stars on GitHub - 1 maintainer
dobrosite/crawler 0.2.0
PHP component for recursive traversal of hierarchical data storages2 versions - Latest release: about 5 years ago - 1 dependent package - 1 dependent repositories - 24 downloads total - 0 stars on GitHub - 1 maintainer
podcastcrawler/podcastcrawler 1.1.1
PHP library to find podcasts10 versions - Latest release: almost 7 years ago - 1 dependent package - 1 dependent repositories - 2.61 thousand downloads total - 39 stars on GitHub - 1 maintainer
smochin/instagram-php-crawler 1.0.1
A simple PHP Crawler for Instagram2 versions - Latest release: about 6 years ago - 1 dependent repositories - 5.82 thousand downloads total - 46 stars on GitHub - 1 maintainer
yidas/tw-stock-crawler 1.2.1
Taiwan Stock Opendata Crawler with realtime - 台灣股市股票資訊擷取器5 versions - Latest release: 6 months ago - 1 dependent package - 1 dependent repositories - 26 downloads total - 2 stars on GitHub - 1 maintainer
elboletaire/crawler
A simple crawler (spider) writen in php just for funLatest release: 25 days ago - 1 dependent repositories - 6.7 thousand downloads total - 41 stars on GitHub - 1 maintainer
mantoufan/yzhanip 1.0.1
Crawl, match, parse IP or IP range, check if IP or range is in another range. Support IPv4, IPv6,...2 versions - Latest release: over 1 year ago - 1 dependent repositories - 1.2 thousand downloads total - 58 stars on GitHub - 1 maintainer
mediashare/crawler 0.2.8
Crawl urls from a webpage and provide a DomCrawler with Scraper Library26 versions - Latest release: over 2 years ago - 2 dependent packages - 1 dependent repositories - 245 downloads total - 3 stars on GitHub - 1 maintainer
czpechy/instagramprofilecrawler v1.0.1
Way to get latest news from instagram profile2 versions - Latest release: almost 2 years ago - 1 dependent repositories - 476 downloads total - 6 stars on GitHub - 1 maintainer
compolomus/rssreader 2.1
Small library for obtaining RSS feed with caching.3 versions - Latest release: about 2 months ago - 1 dependent repositories - 43 downloads total - 1 stars on GitHub - 1 maintainer
alikdex/yii2-crawler-detect 1.0
Yii2 extension for CrawlerDetect library1 version - Latest release: almost 8 years ago - 1 dependent repositories - 18 thousand downloads total - 13 stars on GitHub - 1 maintainer
brittainmedia/phpcrawl 0.10.1
PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-...26 versions - Latest release: about 1 year ago - 2 dependent packages - 1 dependent repositories - 2.94 thousand downloads total - 9 stars on GitHub - 1 maintainer
nguyenanhung/my-crawler v1.1.3
Crawler helper, library - Basic, Simple and Lightweight45 versions - Latest release: about 1 month ago - 2 dependent packages - 1 dependent repositories - 725 downloads total - 1 stars on GitHub - 1 maintainer
schliesser/sitecrawler v2.0.1
TYPO3 sitemap crawler7 versions - Latest release: about 1 year ago - 1 dependent repositories - 19.8 thousand downloads total - 10 stars on GitHub - 1 maintainer
tetreum/kat
Kat.cr / KickAssTorrents PHP SDK (Unofficial)Latest release: 12 days ago - 1 dependent repositories - 12 downloads total - 1 stars on GitHub - 1 maintainer
Top 9.8% on packagist.org
66 versions - Latest release: about 1 month ago - 1 dependent package - 1 dependent repositories - 89.7 thousand downloads total - 40 stars on GitHub - 1 maintainer
eliashaeussler/cache-warmup 3.0.1 💰
Composer package to warm up website caches, based on a given XML sitemap66 versions - Latest release: about 1 month ago - 1 dependent package - 1 dependent repositories - 89.7 thousand downloads total - 40 stars on GitHub - 1 maintainer
bitandblack/sitemap 2.0.6 💰
Creates a sitemap.xml by parsing the whole website.12 versions - Latest release: 2 months ago - 1 dependent package - 1 dependent repositories - 1.88 thousand downloads total - 2 maintainers
luyadev/luya-module-crawler 3.7.2
An full search page crawler to enable complex and customized searching abilities.40 versions - Latest release: 7 months ago - 1 dependent repositories - 32.7 thousand downloads total - 7 stars on GitHub - 1 maintainer
johnroyer/crawler-php 0.3.6
crawler implement in PHP13 versions - Latest release: 3 months ago - 1 dependent repositories - 60 downloads total - 3 stars on GitHub - 1 maintainer
wykleph/html-scraper v0.1.0
An API for taking json sitemaps generated by the webscraper.io extension, and emulating webscrape...1 version - Latest release: over 8 years ago - 18 downloads total - 1 stars on GitHub - 1 maintainer
mr4-lc/content-protected 0.0.1
Laravel content protected1 version - Latest release: 6 months ago - 1 downloads total - 0 stars on GitHub - 1 maintainer
crawlzone/crawlzone 4.0.0
Crawlzone is a fast asynchronous internet crawling framework aiming to provide open source web se...8 versions - Latest release: about 2 years ago - 5 thousand downloads total - 76 stars on GitHub - 1 maintainer
Related Keywords
php
122
spider
62
scraper
47
scraping
28
crawling
23
laravel
23
parser
22
http
17
website
17
bot
16
seo
15
curl
15
symfony
15
hacktoberfest
15
dom
14
api
13
search
12
html
12
link
12
library
11
scrape
11
spatie
11
yii2
10
web
9
Sitemap
9
detect
9
crawl
8
composer
8
module
8
extension
7
yii
6
bundle
6
user-agent
6
scrapper
6
robots.txt
6
google
6
robot
6
framework
6
luya
6
typo3
6
webcrawler
6
browser
6
index
5
robots-txt
5
parse
5
extractor
5
scraping-websites
5
news
5
php crawler detect
5
crawlerdetect
5
crawler detector
5
bots
5
crawler detect
5
url
5
domcrawler
5
xml
5
luya-module
4
phpQuery
4
health
4
QueryList
4
php-crawler
4
request
4
content
4
asynchronous
4
last.fm
4
webservice client
4
lastfm
4
webservice-client
4
json
4
symfony-bundle
4
web-crawler
4
web crawler
3
guzzle
3
multi
3
instagram
3
robots
3
stock
3
sitemap
3
laravel-package
3
rss
3
console
3
async
3
webscraping
3
selector
3
mining
3
Match
3
wordpress
3
Harvest
3
extract
3
matcher
3
data
3
text
3
cache-warmup
3
indexer
3
helper
3
facebook
3
crwlr
3
checker
3
web-crawling
3
web-scraping
3