Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
packagist.org "crawler" keyword
Top 0.2% on packagist.org
158 versions - Latest release: 21 days ago - 170 dependent packages - 8,221 dependent repositories - 58.4 million downloads total - 1,911 stars on GitHub - 2 maintainers
jaybizzle/crawler-detect v1.2.118
CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent158 versions - Latest release: 21 days ago - 170 dependent packages - 8,221 dependent repositories - 58.4 million downloads total - 1,911 stars on GitHub - 2 maintainers
Top 0.3% on packagist.org
104 versions - Latest release: 3 months ago - 45 dependent packages - 858 dependent repositories - 8.23 million downloads total - 2,471 stars on GitHub - 1 maintainer
spatie/crawler 8.2.0 ๐ฐ
Crawl all internal links found on a website104 versions - Latest release: 3 months ago - 45 dependent packages - 858 dependent repositories - 8.23 million downloads total - 2,471 stars on GitHub - 1 maintainer
Top 0.8% on packagist.org
20 versions - Latest release: 22 days ago - 19 dependent packages - 813 dependent repositories - 7.91 million downloads total - 212 stars on GitHub - 1 maintainer
spatie/robots-txt 2.2.0 ๐ฐ
Determine if a page may be crawled from robots.txt and robots meta tags20 versions - Latest release: 22 days ago - 19 dependent packages - 813 dependent repositories - 7.91 million downloads total - 212 stars on GitHub - 1 maintainer
Top 0.7% on packagist.org
30 versions - Latest release: 5 months ago - 51 dependent packages - 125 dependent repositories - 2.64 million downloads total - 345 stars on GitHub - 1 maintainer
wa72/htmlpagedom v3.0.2
jQuery-inspired DOM manipulation extension for Symfony's Crawler30 versions - Latest release: 5 months ago - 51 dependent packages - 125 dependent repositories - 2.64 million downloads total - 345 stars on GitHub - 1 maintainer
Top 1.1% on packagist.org
6 versions - Latest release: almost 2 years ago - 17 dependent packages - 183 dependent repositories - 1.55 million downloads total - 298 stars on GitHub - 1 maintainer
jaybizzle/laravel-crawler-detect v1.3.0
A Laravel package to detect web crawlers via the user agent6 versions - Latest release: almost 2 years ago - 17 dependent packages - 183 dependent repositories - 1.55 million downloads total - 298 stars on GitHub - 1 maintainer
Top 9.1% on packagist.org
9 versions - Latest release: about 3 years ago - 3 dependent packages - 25 dependent repositories - 707 thousand downloads total - 1 stars on GitHub - 1 maintainer
vipnytt/useragentparser v1.0.5
User-Agent parser for robot rule sets9 versions - Latest release: about 3 years ago - 3 dependent packages - 25 dependent repositories - 707 thousand downloads total - 1 stars on GitHub - 1 maintainer
Top 0.6% on packagist.org
26 versions - Latest release: 15 days ago - 96 dependent packages - 279 dependent repositories - 553 thousand downloads total - 2,606 stars on GitHub - 1 maintainer
jaeger/querylist V4.4.3 ๐ฐ
Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on p...26 versions - Latest release: 15 days ago - 96 dependent packages - 279 dependent repositories - 553 thousand downloads total - 2,606 stars on GitHub - 1 maintainer
Top 6.8% on packagist.org
68 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 279 thousand downloads total - 53 stars on GitHub - 2 maintainers
aoepeople/crawler 11.0.7 ๐ฐ
Crawler extension for TYPO368 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 279 thousand downloads total - 53 stars on GitHub - 2 maintainers
Top 5.7% on packagist.org
4 versions - Latest release: over 1 year ago - 6 dependent packages - 11 dependent repositories - 257 thousand downloads total - 12 stars on GitHub - 1 maintainer
minicli/curly 0.2.2
Simple Curl Client4 versions - Latest release: over 1 year ago - 6 dependent packages - 11 dependent repositories - 257 thousand downloads total - 12 stars on GitHub - 1 maintainer
nmure/crawler-detect-bundle v2.0.0
A Symfony bundle for the Crawler-Detect library (detects bots/crawlers/spiders via the user agent)3 versions - Latest release: over 6 years ago - 1 dependent repositories - 252 thousand downloads total - 25 stars on GitHub - 1 maintainer
Top 3.2% on packagist.org
19 versions - Latest release: over 7 years ago - 4 dependent packages - 14 dependent repositories - 234 thousand downloads total - 43 stars on GitHub - 1 maintainer
crossjoin/browscap v3.0.5
The standalone PHP Browscap parser Crossjoin\Browscap detects browser properties as well as devic...19 versions - Latest release: over 7 years ago - 4 dependent packages - 14 dependent repositories - 234 thousand downloads total - 43 stars on GitHub - 1 maintainer
Top 7.0% on packagist.org
68 versions - Latest release: over 1 year ago - 1 dependent package - 2 dependent repositories - 197 thousand downloads total - 53 stars on GitHub - 1 maintainer
tomasnorre/crawler 11.0.7 ๐ฐ
Crawler extension for TYPO368 versions - Latest release: over 1 year ago - 1 dependent package - 2 dependent repositories - 197 thousand downloads total - 53 stars on GitHub - 1 maintainer
Top 1.6% on packagist.org
18 versions - Latest release: 5 months ago - 8 dependent packages - 23 dependent repositories - 143 thousand downloads total - 1,324 stars on GitHub - 1 maintainer
vdb/php-spider v0.7.2
A configurable and extensible PHP web spider18 versions - Latest release: 5 months ago - 8 dependent packages - 23 dependent repositories - 143 thousand downloads total - 1,324 stars on GitHub - 1 maintainer
Top 2.2% on packagist.org
13 versions - Latest release: over 7 years ago - 9 dependent packages - 40 dependent repositories - 142 thousand downloads total - 72 stars on GitHub - 1 maintainer
jyggen/curl v4.0.0
A simple and lightweight cURL library with support for asynchronous requests.13 versions - Latest release: over 7 years ago - 9 dependent packages - 40 dependent repositories - 142 thousand downloads total - 72 stars on GitHub - 1 maintainer
Top 2.8% on packagist.org
41 versions - Latest release: 9 months ago - 4 dependent packages - 23 dependent repositories - 90.4 thousand downloads total - 351 stars on GitHub - 1 maintainer
duzun/hquery 3.1.0
An extremely fast web scraper that parses megabytes of HTML in a blink of an eye. No dependencies...41 versions - Latest release: 9 months ago - 4 dependent packages - 23 dependent repositories - 90.4 thousand downloads total - 351 stars on GitHub - 1 maintainer
Top 9.8% on packagist.org
66 versions - Latest release: about 1 month ago - 1 dependent package - 1 dependent repositories - 89.7 thousand downloads total - 40 stars on GitHub - 1 maintainer
eliashaeussler/cache-warmup 3.0.1 ๐ฐ
Composer package to warm up website caches, based on a given XML sitemap66 versions - Latest release: about 1 month ago - 1 dependent package - 1 dependent repositories - 89.7 thousand downloads total - 40 stars on GitHub - 1 maintainer
Top 6.8% on packagist.org
21 versions - Latest release: about 6 years ago - 7 dependent repositories - 61.4 thousand downloads total - 47 stars on GitHub - 1 maintainer
opensearchserver/opensearchserver 3.0.20
PHP library for OpenSearchServer: professionnal search engine, crawlers (web, file, database), RE...21 versions - Latest release: about 6 years ago - 7 dependent repositories - 61.4 thousand downloads total - 47 stars on GitHub - 1 maintainer
proxycrawl/proxycrawl 3.0.0
A lightweight, dependency free PHP class that acts as wrapper for ProxyCrawl API13 versions - Latest release: almost 3 years ago - 60.4 thousand downloads total - 19 stars on GitHub - 1 maintainer
Top 3.4% on packagist.org
24 versions - Latest release: over 1 year ago - 2 dependent packages - 12 dependent repositories - 52.1 thousand downloads total - 259 stars on GitHub - 1 maintainer
spatie/laravel-link-checker 4.3.0 ๐ฐ
Check all links in a Laravel app24 versions - Latest release: over 1 year ago - 2 dependent packages - 12 dependent repositories - 52.1 thousand downloads total - 259 stars on GitHub - 1 maintainer
Top 5.9% on packagist.org
22 versions - Latest release: 11 months ago - 9 dependent repositories - 47.2 thousand downloads total - 591 stars on GitHub - 1 maintainer
spatie/http-status-check 4.0.0 ๐ฐ
CLI tool to crawl a website and check HTTP status code22 versions - Latest release: 11 months ago - 9 dependent repositories - 47.2 thousand downloads total - 591 stars on GitHub - 1 maintainer
dachcom-digital/lucene-search v2.3.2
Pimcore 5.x Website Indexer (powered by Zend Search Lucene)26 versions - Latest release: over 4 years ago - 37.3 thousand downloads total - 26 stars on GitHub - 1 maintainer
eddieace/php-simple v1.0.4
HTML DOM parser for php 7.1+5 versions - Latest release: about 3 years ago - 1 dependent repositories - 34.4 thousand downloads total - 14 stars on GitHub - 1 maintainer
luyadev/luya-module-crawler 3.7.2
An full search page crawler to enable complex and customized searching abilities.40 versions - Latest release: 7 months ago - 1 dependent repositories - 32.7 thousand downloads total - 7 stars on GitHub - 1 maintainer
Top 6.4% on packagist.org
14 versions - Latest release: almost 8 years ago - 3 dependent packages - 9 dependent repositories - 30.9 thousand downloads total - 10 stars on GitHub - 1 maintainer
tomverran/robots-txt-checker 1.12.1
Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a...14 versions - Latest release: almost 8 years ago - 3 dependent packages - 9 dependent repositories - 30.9 thousand downloads total - 10 stars on GitHub - 1 maintainer
godbout/htmlpagedom 3.0.0 ๐ฐ
jQuery-inspired DOM manipulation extension for Symfony's Crawler25 versions - Latest release: over 3 years ago - 1 dependent package - 3 dependent repositories - 20.1 thousand downloads total - 1 stars on GitHub - 1 maintainer
Top 9.4% on packagist.org
13 versions - Latest release: over 2 years ago - 2 dependent repositories - 20.1 thousand downloads total - 253 stars on GitHub - 1 maintainer
zrashwani/arachnid 2.2.1
A crawler to find all unique internal pages on a given website13 versions - Latest release: over 2 years ago - 2 dependent repositories - 20.1 thousand downloads total - 253 stars on GitHub - 1 maintainer
schliesser/sitecrawler v2.0.1
TYPO3 sitemap crawler7 versions - Latest release: about 1 year ago - 1 dependent repositories - 19.8 thousand downloads total - 10 stars on GitHub - 1 maintainer
nadar/crawler 1.7.1 ๐ฐ
A highly extendible, dependency free Crawler for HTML, PDFS or any other type of Documents.14 versions - Latest release: about 2 years ago - 2 dependent packages - 1 dependent repositories - 18.6 thousand downloads total - 10 stars on GitHub - 1 maintainer
alikdex/yii2-crawler-detect 1.0
Yii2 extension for CrawlerDetect library1 version - Latest release: almost 8 years ago - 1 dependent repositories - 18 thousand downloads total - 13 stars on GitHub - 1 maintainer
blackfire/player v2.6.0
A powerful web crawler and web scraper with Blackfire support98 versions - Latest release: 8 days ago - 1 dependent repositories - 16 thousand downloads total - 484 stars on GitHub - 1 maintainer
lobotomised/laravel-autocrawler 1.2.0
A tool to crawl your own laravel installation checking your HTTP status codes8 versions - Latest release: about 1 month ago - 15.8 thousand downloads total - 1 stars on GitHub - 1 maintainer
eightwire/magento2-module-primer 0.1.14
A cache primer extension for Magento 215 versions - Latest release: over 4 years ago - 15.7 thousand downloads total - 19 stars on GitHub - 1 maintainer
cdaguerre/robots-bundle v1.1.1
Add contextual robots meta headers7 versions - Latest release: over 6 years ago - 15.2 thousand downloads total - 0 stars on GitHub - 1 maintainer
visuellverstehen/t3fetch 1.5.0
Fetches a website (including all subpages), so the TYPO3 cache gets filled.14 versions - Latest release: 3 months ago - 14 thousand downloads total - 7 stars on GitHub - 1 maintainer
dachcom-digital/dynamic-search-data-provider-crawler v3.0.1
A Spider Crawler Extension for Pimcore Dynamic Search.16 versions - Latest release: 5 months ago - 12.1 thousand downloads total - 8 stars on GitHub - 1 maintainer
nucleos/lastfm 3.6.0 ๐ฐ
Last.fm webservice client for php.20 versions - Latest release: 5 months ago - 2 dependent packages - 1 dependent repositories - 10.9 thousand downloads total - 14 stars on GitHub - 1 maintainer
repat/spatie-crawler-redis 0.2.1
Redis CrawlQueue for spatie/crawler4 versions - Latest release: over 2 years ago - 9.7 thousand downloads total - 4 stars on GitHub - 1 maintainer
Top 5.3% on packagist.org
13 versions - Latest release: over 2 years ago - 1 dependent package - 8 dependent repositories - 9.69 thousand downloads total - 253 stars on GitHub - 1 maintainer
codeguy/arachnid 2.2.1
A crawler to find all unique internal pages on a given website13 versions - Latest release: over 2 years ago - 1 dependent package - 8 dependent repositories - 9.69 thousand downloads total - 253 stars on GitHub - 1 maintainer
bringyourownideas/laravel-sitemap 3.0.0 ๐ฐ
A simple website crawler & sitemap generator without a headless browser for Laravel 5.8+19 versions - Latest release: over 1 year ago - 4 dependent repositories - 7.66 thousand downloads total - 9 stars on GitHub - 1 maintainer
vormkracht10/laravel-seo-scanner v3.11.1 ๐ฐ
Laravel package to check if you used important SEO tags in your website.51 versions - Latest release: about 1 month ago - 7.41 thousand downloads total - 168 stars on GitHub - 1 maintainer
Top 8.0% on packagist.org
2 versions - Latest release: over 9 years ago - 8 dependent repositories - 7.09 thousand downloads total - 58 stars on GitHub - 1 maintainer
mmerian/phpcrawl 0.8.3
PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-...2 versions - Latest release: over 9 years ago - 8 dependent repositories - 7.09 thousand downloads total - 58 stars on GitHub - 1 maintainer
51degrees/fiftyone.devicedetection 4.4.2
Device detection engines for 51Degrees Pipeline API. Parse HTTP headers to detect hardware, opera...50 versions - Latest release: almost 2 years ago - 1 dependent package - 1 dependent repositories - 6.93 thousand downloads total - 0 stars on GitHub - 1 maintainer
elboletaire/crawler
A simple crawler (spider) writen in php just for funLatest release: 26 days ago - 1 dependent repositories - 6.7 thousand downloads total - 41 stars on GitHub - 1 maintainer
webcoast/versatile-crawler v1.1.1
A versatile and extendable crawler for TYPO3 CMS4 versions - Latest release: almost 3 years ago - 6.41 thousand downloads total - 7 stars on GitHub - 1 maintainer
Top 10.0% on packagist.org
4 versions - Latest release: over 5 years ago - 3 dependent packages - 8 dependent repositories - 6.39 thousand downloads total - 3 stars on GitHub - 1 maintainer
ropendev/curl 1.0.3
PHP POO cURL wrapper (PSR friendly) : light and simple.4 versions - Latest release: over 5 years ago - 3 dependent packages - 8 dependent repositories - 6.39 thousand downloads total - 3 stars on GitHub - 1 maintainer
smochin/instagram-php-crawler 1.0.1
A simple PHP Crawler for Instagram2 versions - Latest release: about 6 years ago - 1 dependent repositories - 5.82 thousand downloads total - 46 stars on GitHub - 1 maintainer
crwlr/robots-txt v1.1.1
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping6 versions - Latest release: over 1 year ago - 1 dependent package - 1 dependent repositories - 5.36 thousand downloads total - 8 stars on GitHub - 1 maintainer
crawlzone/crawlzone 4.0.0
Crawlzone is a fast asynchronous internet crawling framework aiming to provide open source web se...8 versions - Latest release: about 2 years ago - 5 thousand downloads total - 76 stars on GitHub - 1 maintainer
leowebguy/craft-crawler-detect 2.0.0
Craft plugin for detecting bots/crawlers/spiders5 versions - Latest release: about 2 months ago - 4.93 thousand downloads total - 1 stars on GitHub - 1 maintainer
Top 7.8% on packagist.org
11 versions - Latest release: about 9 years ago - 12 dependent repositories - 4.41 thousand downloads total - 312 stars on GitHub - 1 maintainer
sleeping-owl/apist 1.3.7
Package to provide api-like access to foreign sites based on html parsing11 versions - Latest release: about 9 years ago - 12 dependent repositories - 4.41 thousand downloads total - 312 stars on GitHub - 1 maintainer
Top 8.7% on packagist.org
84 versions - Latest release: about 2 years ago - 10 dependent repositories - 4.37 thousand downloads total - 53 stars on GitHub - 1 maintainer
pablouser1/tikscraper v1.2.7
Get data from TikTok API84 versions - Latest release: about 2 years ago - 10 dependent repositories - 4.37 thousand downloads total - 53 stars on GitHub - 1 maintainer
kiddyu/beanbun 1.0.4
Beanbun ๆฏ็จ PHP ็ผๅ็ๅค่ฟ็จ็ฝ็ป็ฌ่ซๆกๆถ๏ผๅ ทๆ่ฏๅฅฝ็ๅผๆพๆงใ้ซๅฏๆฉๅฑๆง5 versions - Latest release: almost 7 years ago - 3 dependent repositories - 4.02 thousand downloads total - 1,231 stars on GitHub - 1 maintainer
kiwa/sitemap 2.0.0 ๐ฐ
Integrates the Bit&Black Sitemap into a Kiwa website to create sitemap files seamlessly.11 versions - Latest release: 3 months ago - 1 dependent package - 3.19 thousand downloads total - 2 maintainers
rebelinblue/fluent-web-crawler 1.0.5
A web crawler with a fluent interface6 versions - Latest release: about 4 years ago - 3.16 thousand downloads total - 8 stars on GitHub - 1 maintainer
brittainmedia/phpcrawl 0.10.1
PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-...26 versions - Latest release: about 1 year ago - 2 dependent packages - 1 dependent repositories - 2.94 thousand downloads total - 9 stars on GitHub - 1 maintainer
core23/lastfm-api 3.6.0 ๐ฐ
Last.fm webservice client for php.20 versions - Latest release: 5 months ago - 2 dependent packages - 2.78 thousand downloads total - 13 stars on GitHub - 1 maintainer
itgalaxy/webcrawler-verifier 2.1.0
PHP library providing functionality to verify that user-agents are who they claim to be.5 versions - Latest release: over 7 years ago - 2.75 thousand downloads total - 7 stars on GitHub - 1 maintainer
acanto/crawler 6.0.2
Crawl all internal links found on a website1 version - Latest release: about 3 years ago - 1 dependent package - 2 dependent repositories - 2.72 thousand downloads total - 0 stars on GitLab.com - 1 maintainer
crwlr/crawler v1.7.2
Web crawling and scraping library.38 versions - Latest release: about 2 months ago - 3 dependent packages - 1 dependent repositories - 2.7 thousand downloads total - 295 stars on GitHub - 1 maintainer
podcastcrawler/podcastcrawler 1.1.1
PHP library to find podcasts10 versions - Latest release: almost 7 years ago - 1 dependent package - 1 dependent repositories - 2.61 thousand downloads total - 39 stars on GitHub - 1 maintainer
laurentvw/scrapher v2.3.1
A web scraper for PHP to easily extract data from web pages12 versions - Latest release: about 6 years ago - 1 dependent package - 3 dependent repositories - 2.51 thousand downloads total - 18 stars on GitHub - 1 maintainer
cable8mm/water-melon v1.1.3
Water Melon is simple melon.com api sdk for php5 versions - Latest release: 2 months ago - 2.47 thousand downloads total - 16 stars on GitHub - 1 maintainer
alc/sitemap-crawler v2.0.0
Crawl sitemap.xml recursively and return collected urls as array2 versions - Latest release: about 3 years ago - 2 dependent packages - 2 dependent repositories - 2.43 thousand downloads total - 5 stars on GitHub - 1 maintainer
alrik11es/scrappy
A free proxy list based downloader for your crawling projects in PHPLatest release: 18 days ago - 2.14 thousand downloads total - 1 stars on GitHub - 1 maintainer
bitandblack/sitemap 2.0.6 ๐ฐ
Creates a sitemap.xml by parsing the whole website.12 versions - Latest release: 2 months ago - 1 dependent package - 1 dependent repositories - 1.88 thousand downloads total - 2 maintainers
phantazm/robotdetector
Detect robots and crawlers.Latest release: 22 days ago - 4 dependent repositories - 1.87 thousand downloads total - 5 stars on GitHub - 1 maintainer
lndj/lcrawl v3.1.0
ไธๅชไผ้ ็ๆญฃๆนๆๅก็ณป็ป็ฌ่ซใ7 versions - Latest release: over 7 years ago - 3 dependent repositories - 1.82 thousand downloads total - 114 stars on GitHub - 1 maintainer
kaishiyoku/hera-rss-crawler 6.0.1 ๐ฐ
Modern library to handle RSS/Atom feeds50 versions - Latest release: about 2 months ago - 2 dependent repositories - 1.81 thousand downloads total - 1 stars on GitHub - 1 maintainer
macsch15/crawler-detector 1.3.4
Fat-free, standalone and fast web crawler (bot) detector8 versions - Latest release: almost 6 years ago - 1.77 thousand downloads total - 3 stars on GitHub - 1 maintainer
heimrichhannot/crawler 6.0.0
Crawl all internal links found on a website92 versions - Latest release: over 3 years ago - 1.31 thousand downloads total - 1 stars on GitHub - 1 maintainer
mantoufan/yzhanip 1.0.1
Crawl, match, parse IP or IP range, check if IP or range is in another range. Support IPv4, IPv6,...2 versions - Latest release: over 1 year ago - 1 dependent repositories - 1.2 thousand downloads total - 58 stars on GitHub - 1 maintainer
shel/crawler 2.4.1 ๐ฐ
Allows crawling of sitemaps and node-trees11 versions - Latest release: over 1 year ago - 1.15 thousand downloads total - 7 stars on GitHub - 1 maintainer
hedii/php-crawler 2.2.0
A crawler application written with php and Laravel that finds email addresses on the internets.13 versions - Latest release: over 5 years ago - 1.07 thousand downloads total - 132 stars on GitHub - 1 maintainer
darvinstudio/darvin-crawler-bundle 6.0.4
This bundle provides console command that detects broken links on your website.5 versions - Latest release: about 3 years ago - 1.05 thousand downloads total - 0 stars on GitHub - 1 maintainer
innmind/crawler 6.1.0
Library to extract meaningful informations out of a webpage23 versions - Latest release: about 3 years ago - 4 dependent packages - 4 dependent repositories - 936 downloads total - 1 stars on GitHub - 1 maintainer
nucleos/lastfm-bundle 1.3.0 ๐ฐ
This bundle provides services for using the last.fm API with symfony.11 versions - Latest release: 5 months ago - 884 downloads total - 3 stars on GitHub - 1 maintainer
xcrawler/xcrawler 1.0.41
A fast, simple and powerful PHP web crawler (scraper/spider) ๅฟซ้ใ็ฎๆดไธๅผบๅคง็็ฌ่ซ/้้ๆกๆถ6 versions - Latest release: over 5 years ago - 1 dependent repositories - 866 downloads total - 339 stars on GitHub - 1 maintainer
unikka/neos-linkchecker 1.1.0 ๐ฐ
NeosCMS package that is able to crawl the whole page and check the links for broken links2 versions - Latest release: almost 3 years ago - 819 downloads total - 4 stars on GitHub - 1 maintainer
agilekeys/point-picker
Crawler package for online shoppingLatest release: 22 days ago - 800 downloads total - 0 stars on GitHub - 1 maintainer
esyon/crawlerblock 1.0.5
This module blocks all kind of bots / crawlers / spiders.6 versions - Latest release: 11 months ago - 795 downloads total - 0 stars on GitHub - 1 maintainer
nguyenanhung/my-crawler v1.1.3
Crawler helper, library - Basic, Simple and Lightweight45 versions - Latest release: about 1 month ago - 2 dependent packages - 1 dependent repositories - 725 downloads total - 1 stars on GitHub - 1 maintainer
spekulatius/spatie-crawler-toolkit-for-laravel 0.5.0 ๐ฐ
Handy classes for Spatie's crawler when using it with Laravel.9 versions - Latest release: over 1 year ago - 722 downloads total - 18 stars on GitHub - 1 maintainer
blogdaren/phpcreeper v1.9.0
A new generation of multi-process async event-driven spider engine based on Workerman57 versions - Latest release: about 14 hours ago - 1 dependent package - 2 dependent repositories - 625 downloads total - 117 stars on GitHub - 1 maintainer
crawlbase/crawlbase v1.0.0
A lightweight, dependency free PHP class that acts as wrapper for Crawlbase API1 version - Latest release: 12 months ago - 584 downloads total - 7 stars on GitHub - 1 maintainer
mediamonks/crawler 2.0.0
Crawl your own website with various clients for SEO and indexing purposes.4 versions - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 565 downloads total - 19 stars on GitHub - 1 maintainer
nelexa/roach-php-bundle 1.1.1
Symfony bundle for roach-php/core4 versions - Latest release: over 1 year ago - 564 downloads total - 9 stars on GitHub - 1 maintainer
luyadev/luya-module-crawleradmin 1.0.0-beta8
Yii2 LUYA Crawler Admin-Module4 versions - Latest release: almost 8 years ago - 562 downloads total - 1 maintainer
howie6879/php-google 1.0
Google search results crawler, get google search results that you need.1 version - Latest release: almost 7 years ago - 537 downloads total - 29 stars on GitHub - 1 maintainer
contextualcode/crawler v2.4.0
Flexible website crawler which stores the results in persistent storage21 versions - Latest release: 3 months ago - 1 dependent package - 1 dependent repositories - 526 downloads total - 0 stars on GitLab.com - 2 maintainers
czpechy/instagramprofilecrawler v1.0.1
Way to get latest news from instagram profile2 versions - Latest release: almost 2 years ago - 1 dependent repositories - 476 downloads total - 6 stars on GitHub - 1 maintainer
sfynx-project/tool-crawler-bundle v2.8.2
This Bundle provides handlers to work with xml and xsd files.4 versions - Latest release: over 5 years ago - 2 dependent packages - 2 dependent repositories - 473 downloads total - 1 stars on GitHub - 1 maintainer
bilginpro/agency-iha v1.0.3
Crawler for IHA News Agency in Turkey.4 versions - Latest release: over 4 years ago - 471 downloads total - 5 stars on GitHub - 1 maintainer
sabri/tiktok v1.0.2
sabri/tiktok is php Tiktok scraper3 versions - Latest release: over 3 years ago - 1 dependent repositories - 446 downloads total - 70 stars on GitHub - 1 maintainer
baqend/spider 1.0.0
URL spider which crawls a page and all its subpages1 version - Latest release: about 6 years ago - 434 downloads total - 6 stars on GitHub - 1 maintainer
blueways/bw-cache-uri v1.1.6
TYPO3 extension to parse remote content and save to tt_content element8 versions - Latest release: 7 months ago - 395 downloads total - 0 stars on GitHub - 1 maintainer
rfussien/leboncoin-crawler 2.3.0
Makes data extraction from leboncoin.fr easy13 versions - Latest release: about 7 years ago - 4 dependent repositories - 358 downloads total - 39 stars on GitHub - 1 maintainer
zanysoft/laravel-crawler-detect 1.0
A Laravel package to detect web crawlers via the user agent1 version - Latest release: over 3 years ago - 357 downloads total - 1 stars on GitHub - 1 maintainer
smart-core/sitemap-bundle
Symfony Sitemap Crawler Generator Bundle.Latest release: 6 days ago - 1 dependent package - 6 dependent repositories - 307 downloads total - 0 stars on GitHub - 1 maintainer
smart-core/rich-editor-bundle
Rich editor bundle.Latest release: 6 days ago - 1 dependent package - 7 dependent repositories - 296 downloads total - 0 stars on GitHub - 1 maintainer
sleimanx2/grawler 0.2.4
A guided html crawler with media meta extraction15 versions - Latest release: over 4 years ago - 295 downloads total - 13 stars on GitHub - 1 maintainer
Related Keywords
php
122
spider
62
scraper
47
scraping
28
crawling
23
laravel
23
parser
22
http
17
website
17
bot
16
curl
15
symfony
15
seo
15
hacktoberfest
15
dom
14
api
13
html
12
link
12
search
12
scrape
11
spatie
11
library
11
yii2
10
detect
9
Sitemap
9
web
9
composer
8
crawl
8
module
8
extension
7
typo3
6
google
6
webcrawler
6
bundle
6
scrapper
6
browser
6
framework
6
luya
6
robot
6
robots.txt
6
yii
6
user-agent
6
crawler detect
5
crawler detector
5
php crawler detect
5
index
5
crawlerdetect
5
bots
5
news
5
extractor
5
robots-txt
5
domcrawler
5
url
5
scraping-websites
5
xml
5
parse
5
asynchronous
4
web-crawler
4
symfony-bundle
4
php-crawler
4
luya-module
4
content
4
health
4
json
4
phpQuery
4
webservice-client
4
lastfm
4
webservice client
4
last.fm
4
request
4
QueryList
4
console
3
text
3
web crawler
3
web-scraping
3
rss
3
web-crawling
3
data
3
matcher
3
crwlr
3
robots
3
instagram
3
checker
3
internet
3
seo-optimization
3
guzzle
3
webscraping
3
selector
3
extract
3
mining
3
Match
3
Harvest
3
wordpress
3
user agent
3
async
3
cache
3
helper
3
laravel-package
3
device
3
stock
3