Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
packagist.org "crawler" keyword
alrik11es/scrappy
A free proxy list based downloader for your crawling projects in PHPLatest release: about 1 month ago - 2.15 thousand downloads total - 1 stars on GitHub - 1 maintainer
pyaesoneaung/2d-crawler v1.1.0
2D crawler for set.or.th4 versions - Latest release: about 1 year ago - 54 downloads total - 3 stars on GitHub - 1 maintainer
fireguard/correios
Utilities for interaction with the post office of BrazilLatest release: about 1 month ago - 6 downloads total - 1 stars on GitHub - 1 maintainer
depa/depa-middleware-redirect 1.0.8
Laminas mezzio middleware for redirecting7 versions - Latest release: 4 months ago - 18 downloads total - 0 stars on GitHub - 1 maintainer
diggin/diggin-robotrules 0.10.0
parser/handler for Robots Exclusion Protocol (robots.txt and more)5 versions - Latest release: over 8 years ago - 5 dependent repositories - 184 downloads total - 7 stars on GitHub - 1 maintainer
crawlbase/crawlbase v1.0.0
A lightweight, dependency free PHP class that acts as wrapper for Crawlbase API1 version - Latest release: about 1 year ago - 604 downloads total - 9 stars on GitHub - 1 maintainer
filchos/imago
A library for reading and transforming content in a chainable wayLatest release: about 1 month ago - 29 downloads total - 0 stars on GitHub - 1 maintainer
kynkai/search-engine-crawler v1.0
SearchEngineCrawler Dump the data from the search engines1 version - Latest release: over 4 years ago - 13 downloads total - 2 stars on GitHub - 1 maintainer
fran-diaz/itseo 0.1.1
Includes methods that extract SEO info from url or HTML code1 version - Latest release: over 10 years ago - 4 dependent repositories - 22 downloads total - 3 stars on GitHub - 1 maintainer
io-jaegers/valkyrier
Latest release: about 1 month ago - 0 downloads total - 0 stars on GitHub - 1 maintainerdanielbehrendt/web-scraper v1.1.0
This package can be used to scrape elements from websites.7 versions - Latest release: about 4 years ago - 3 downloads total - 1 stars on GitLab.com - 1 maintainer
tetreum/xupopter
Xupopter crawlea las principales páginas de compraventa de inmuebles de España como son Idealista...Latest release: about 1 month ago - 45 downloads total - 11 stars on GitHub - 1 maintainer
proxycrawl/proxycrawl 3.0.0
A lightweight, dependency free PHP class that acts as wrapper for ProxyCrawl API13 versions - Latest release: almost 3 years ago - 62.2 thousand downloads total - 19 stars on GitHub - 1 maintainer
codeblog/crawlerdetect v1.0.0
A CodeBlog CrawlerDetect class is easy and quick to use. Detecting bots/crawlers/spiders via the ...1 version - Latest release: about 5 years ago - 54 downloads total - 9 stars on GitHub - 1 maintainer
baqend/spider 1.0.0
URL spider which crawls a page and all its subpages1 version - Latest release: about 6 years ago - 437 downloads total - 6 stars on GitHub - 1 maintainer
mr4-lc/content-protected 0.0.1
Laravel content protected1 version - Latest release: 7 months ago - 1 downloads total - 0 stars on GitHub - 1 maintainer
Top 7.8% on packagist.org
11 versions - Latest release: about 9 years ago - 12 dependent repositories - 4.42 thousand downloads total - 311 stars on GitHub - 1 maintainer
sleeping-owl/apist 1.3.7
Package to provide api-like access to foreign sites based on html parsing11 versions - Latest release: about 9 years ago - 12 dependent repositories - 4.42 thousand downloads total - 311 stars on GitHub - 1 maintainer
sleimanx2/grawler 0.2.4
A guided html crawler with media meta extraction15 versions - Latest release: over 4 years ago - 295 downloads total - 13 stars on GitHub - 1 maintainer
coooold/crawler v1.0.0
Most powerful, popular and production crawling/scraping package for PHP1 version - Latest release: over 4 years ago - 15 downloads total - 1 stars on GitHub - 1 maintainer
Top 6.8% on packagist.org
21 versions - Latest release: about 6 years ago - 7 dependent repositories - 61.7 thousand downloads total - 47 stars on GitHub - 1 maintainer
opensearchserver/opensearchserver 3.0.20
PHP library for OpenSearchServer: professionnal search engine, crawlers (web, file, database), RE...21 versions - Latest release: about 6 years ago - 7 dependent repositories - 61.7 thousand downloads total - 47 stars on GitHub - 1 maintainer
sohib/crawler v1.0.1
Scan Http URLs from a url containing an HTML and get Json or Xml or Array3 versions - Latest release: over 8 years ago - 24 downloads total - 0 stars on GitHub - 1 maintainer
teamtnt/crawler
Distributed Crawler ArchitectureLatest release: about 2 months ago - 1 downloads total - 8 stars on GitHub - 1 maintainer
hissezhaut/laravel-link-checker v2.0.1
Check all links in a Laravel app7 versions - Latest release: over 7 years ago - 11 downloads total - 0 stars on GitHub - 1 maintainer
nekhbet/crawlers-laravel-pulse
Laravel Pulse Card to show crawlersLatest release: about 1 month ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
bdspider/crawler 0.5.1
crawler,spider for phpQuery。8 versions - Latest release: over 5 years ago - 46 downloads total - 0 stars on GitHub - 1 maintainer
gaolujie1989/webmagic
A scalable web crawler framework for php.Latest release: about 1 month ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
allotmentandy/socialmedialinkextractor
extracts social media links for an array of links eg. twitter, facebook etc.Latest release: about 2 months ago - 87 downloads total - 0 stars on GitHub - 1 maintainer
kiwa/sitemap 2.0.0 💰
Integrates the Bit&Black Sitemap into a Kiwa website to create sitemap files seamlessly.11 versions - Latest release: 4 months ago - 1 dependent package - 3.24 thousand downloads total - 2 maintainers
dayrev/extractor v1.2.2
Web Page Content Extractor7 versions - Latest release: about 7 years ago - 11 downloads total - 2 stars on GitHub - 1 maintainer
fgsl/crawler 0.0.1
Fgsl Crawler1 version - Latest release: over 6 years ago - 8 downloads total - 0 stars on GitHub - 1 maintainer
pabeda-bt/php-crawler
Crawl all internal links in a websiteLatest release: about 2 months ago - 38 downloads total - 0 stars on GitHub - 1 maintainer
upstream-team/laravel-crawler-detect 0.1.10
Wrapper for the crawler detection package6 versions - Latest release: 8 months ago - 3 downloads total - 1 stars on GitHub - 1 maintainer
filipsedivy/kontrola-tachometru 0.1.0 💰
🚘 MDČR - kontrola tachometru1 version - Latest release: almost 5 years ago - 3 downloads total - 0 stars on GitHub - 1 maintainer
Top 3.2% on packagist.org
19 versions - Latest release: over 7 years ago - 4 dependent packages - 14 dependent repositories - 234 thousand downloads total - 43 stars on GitHub - 1 maintainer
crossjoin/browscap v3.0.5
The standalone PHP Browscap parser Crossjoin\Browscap detects browser properties as well as devic...19 versions - Latest release: over 7 years ago - 4 dependent packages - 14 dependent repositories - 234 thousand downloads total - 43 stars on GitHub - 1 maintainer
edwinhuish/querylist V5.0.9
Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on D...22 versions - Latest release: about 4 years ago - 15 downloads total - 1 stars on GitHub - 1 maintainer
nggiahao/crawler 0.1.0
Package này có nhiêm vụ thu thập dữ liệu từ các website khác sử dụng Guzzle, Phantomjs hay Puppet...1 version - Latest release: over 3 years ago - 8 downloads total - 4 stars on GitHub - 1 maintainer
phantazm/robotdetector
Detect robots and crawlers.Latest release: about 2 months ago - 4 dependent repositories - 1.87 thousand downloads total - 5 stars on GitHub - 1 maintainer
haikson/sitemap-generator
Sitemap crawler and generator classLatest release: about 2 months ago - 0 downloads total - 68 stars on GitHub - 1 maintainer
blogdaren/webman-phpcreeper v1.0.4
PHPCreeper plugin for webman5 versions - Latest release: about 1 month ago - 171 downloads total - 8 stars on GitHub - 1 maintainer
brunodebarros/http-request 1.0.2
A web crawler, built to be easily dropped into PHP applications, which behaves just like a regula...3 versions - Latest release: about 9 years ago - 1 dependent package - 4 dependent repositories - 195 downloads total - 8 stars on GitHub - 1 maintainer
creode/craft-page-crawler 1.1.0
This will allow a page to be crawled for useful content during an indexing process.10 versions - Latest release: over 1 year ago - 39 downloads total - 0 stars on GitHub - 1 maintainer
wangta69/crawler 1.0.0
crawler1 version - Latest release: about 6 years ago - 14 downloads total - 1 stars on GitHub - 1 maintainer
visuellverstehen/t3fetch 1.5.0
Fetches a website (including all subpages), so the TYPO3 cache gets filled.14 versions - Latest release: 4 months ago - 14.1 thousand downloads total - 7 stars on GitHub - 1 maintainer
proclnas/curl-rox 3.0.0
Just another curl wrapper for webCrawling purposes3 versions - Latest release: about 5 years ago - 17 downloads total - 9 stars on GitHub - 1 maintainer
luyadev/luya-module-crawleradmin 1.0.0-beta8
Yii2 LUYA Crawler Admin-Module4 versions - Latest release: almost 8 years ago - 562 downloads total - 1 maintainer
alexndreazevedo/crawler
Social PHP CrawlerLatest release: about 2 months ago - 4 dependent repositories - 6 downloads total - 0 stars on GitHub - 1 maintainer
vakata/downloader 1.0.2 💰
A PHP class for making a static copy (or indexing) a site3 versions - Latest release: 3 months ago - 180 downloads total - 0 stars on GitHub - 1 maintainer
harm-smits/webcrawler-verifier 2.1.1
PHP library providing functionality to verify that user-agents are who they claim to be.6 versions - Latest release: over 2 years ago - 1 downloads total - 0 stars on GitHub - 1 maintainer
lefuturiste/google-photos-album-crawler v1.1
Google Photos public album crawler/fetcher2 versions - Latest release: almost 4 years ago - 62 downloads total - 8 stars on GitHub - 1 maintainer
pithyone/zhihu-crawler 3.5.0
轻量级知乎爬虫17 versions - Latest release: over 5 years ago - 62 downloads total - 25 stars on GitHub - 1 maintainer
webysther/packagist-mirror 1.1.1 💰
Build mirror of packagist7 versions - Latest release: over 4 years ago - 150 downloads total - 179 stars on GitHub - 1 maintainer
vanry/baike-spider
A simple spider crawling web pages from baike.baidu.comLatest release: about 2 months ago - 6 downloads total - 2 stars on GitHub - 1 maintainer
radarlog/banks-spyder 1.0
Banks Spyder is free software to automatically generate bank statements in PDF format from your a...1 version - Latest release: over 8 years ago - 2 downloads total - 0 stars on GitHub - 1 maintainer
agilekeys/point-picker
Crawler package for online shoppingLatest release: about 2 months ago - 800 downloads total - 0 stars on GitHub - 1 maintainer
snippetify/laravel-sniptbot 1.0.2
Sniptbot for laravel3 versions - Latest release: almost 4 years ago - 4 downloads total - 1 stars on GitHub - 1 maintainer
mvrc/php-email-crawler 💰
PHP Website Email Crawler, for crawling websites for emails.Latest release: about 2 months ago - 7 downloads total - 3 stars on GitHub - 1 maintainer
louvian/pururin-crawler 0.0.1
Pururin Crawler1 version - Latest release: over 6 years ago - 12 downloads total - 4 stars on GitHub - 1 maintainer
grab/spider 0.2
PHP async scrapper used multi curl and reactphp, and proxy inspired by python grab1 version - Latest release: about 7 years ago - 114 downloads total - 10 stars on GitHub - 1 maintainer
sigmie/crawler v0.1.18
Sigmie Crawler is a PHP package for crawling websites and exporting their HTML contents.19 versions - Latest release: over 3 years ago - 25 downloads total - 0 stars on GitHub - 1 maintainer
nelexa/roach-php-bundle 1.1.1
Symfony bundle for roach-php/core4 versions - Latest release: over 1 year ago - 564 downloads total - 9 stars on GitHub - 1 maintainer
laurentvw/scrapher v2.3.1
A web scraper for PHP to easily extract data from web pages12 versions - Latest release: about 6 years ago - 1 dependent package - 3 dependent repositories - 2.51 thousand downloads total - 18 stars on GitHub - 1 maintainer
laurentvw/lavacrawler v2.3.1
A web scraper for PHP to easily extract data from web pages12 versions - Latest release: about 6 years ago - 4 dependent repositories - 95 downloads total - 18 stars on GitHub - 1 maintainer
maxlen/webcrawler
Search engine crawlersLatest release: about 2 months ago - 10 downloads total - 0 stars on GitHub - 1 maintainer
zanysoft/laravel-crawler-detect 1.0
A Laravel package to detect web crawlers via the user agent1 version - Latest release: over 3 years ago - 357 downloads total - 1 stars on GitHub - 1 maintainer
repat/spatie-crawler-redis 0.2.1
Redis CrawlQueue for spatie/crawler4 versions - Latest release: over 2 years ago - 9.71 thousand downloads total - 4 stars on GitHub - 1 maintainer
maikelvanmaurik/schrapert v0.0.3
Non-blocking PHP crawler/spider3 versions - Latest release: about 4 years ago - 10 downloads total - 0 stars on GitHub - 1 maintainer
sofyco/spider 2.0.0 💰
Crawler + Scraper + Parser library11 versions - Latest release: 5 months ago - 1 dependent package - 1 dependent repositories - 53 downloads total - 0 stars on GitHub - 1 maintainer
yuan1994/z-crawler v1.0.0
【正方教务】爬虫，支持成绩查询、考试查询、课表查询、四六级成绩查询、四六级报名、选课查询、修改密码、获取用户菜单等功能，并且解析数据成易读格式，符合 psr 规范，拿来即用1 version - Latest release: over 7 years ago - 50 downloads total - 38 stars on GitHub - 1 maintainer
sofyco/spider-bundle 1.1.0 💰
Symfony Spider Bundle2 versions - Latest release: over 1 year ago - 31 downloads total - 0 stars on GitHub - 1 maintainer
l91/seo-bundle 💰
Symfony based seo bundle to crawl websitesLatest release: about 2 months ago - 15 downloads total - 1 stars on GitHub - 1 maintainer
robertbyrnes/phpcrawler 1.1
A PHP CLI links crawler using FIFO Queue data structure and Producer/Consumer model.1 version - Latest release: about 3 years ago - 7 downloads total - 2 stars on GitHub - 1 maintainer
howie6879/php-google 1.0
Google search results crawler, get google search results that you need.1 version - Latest release: almost 7 years ago - 550 downloads total - 30 stars on GitHub - 1 maintainer
mihaeu/tarantula v1.3.0
Another PHP crawler based on Guzzle.7 versions - Latest release: almost 10 years ago - 4 dependent repositories - 49 downloads total - 15 stars on GitHub - 1 maintainer
morphodo/crawler-bundle
HTTP-Crawler for Symfony2Latest release: about 2 months ago - 4 dependent repositories - 5 downloads total - 1 maintainer
Top 2.8% on packagist.org
41 versions - Latest release: 10 months ago - 4 dependent packages - 23 dependent repositories - 91.6 thousand downloads total - 351 stars on GitHub - 1 maintainer
duzun/hquery 3.1.0
An extremely fast web scraper that parses megabytes of HTML in a blink of an eye. No dependencies...41 versions - Latest release: 10 months ago - 4 dependent packages - 23 dependent repositories - 91.6 thousand downloads total - 351 stars on GitHub - 1 maintainer
upscale/swoole-warmup 1.5.0
URL crawler to warm-up Swoole web-server10 versions - Latest release: over 3 years ago - 19 downloads total - 0 stars on GitHub - 1 maintainer
czpechy/instagramprofilecrawler v1.0.1
Way to get latest news from instagram profile2 versions - Latest release: almost 2 years ago - 1 dependent repositories - 477 downloads total - 6 stars on GitHub - 1 maintainer
unikka/neos-linkchecker 1.1.0 💰
NeosCMS package that is able to crawl the whole page and check the links for broken links2 versions - Latest release: almost 3 years ago - 831 downloads total - 4 stars on GitHub - 1 maintainer
blueways/bw-cache-uri v1.1.6
TYPO3 extension to parse remote content and save to tt_content element8 versions - Latest release: 8 months ago - 395 downloads total - 0 stars on GitHub - 1 maintainer
lenonleite/simple-crawler v0.4
LenonLeite Component - Simple Crawler, for read pages4 versions - Latest release: over 6 years ago - 104 downloads total - 15 stars on GitHub - 1 maintainer
panakour/pkscraper v1.2.0
Get whatever data you want.10 versions - Latest release: 6 months ago - 181 downloads total - 1 stars on GitHub - 1 maintainer
lndj/lcrawl v3.1.0
一只优雅的正方教务系统爬虫。7 versions - Latest release: over 7 years ago - 3 dependent repositories - 1.86 thousand downloads total - 113 stars on GitHub - 1 maintainer
zephir/luya-module-crawleradmin 1.0.0-beta8
Yii2 LUYA Crawler Admin-Module4 versions - Latest release: almost 8 years ago - 2 dependent packages - 1 dependent repositories - 143 downloads total - 1 maintainer
nws/ultra-parser 2.2.3
Laravel package for easy scraping web pages38 versions - Latest release: about 5 years ago - 44 downloads total - 1 maintainer
cotapreco/captcha
Our library for CAPTCHA solving (through third-party services, DeathByCaptcha)Latest release: about 2 months ago - 144 downloads total - 2 stars on GitHub - 1 maintainer
akane0151/target-crawler 0.9.7
target crawler - A simple Laravel crawler package to read element of any webpage.6 versions - Latest release: over 1 year ago - 9 downloads total - 0 stars on GitHub - 1 maintainer
hedii/php-crawler 2.2.0
A crawler application written with php and Laravel that finds email addresses on the internets.13 versions - Latest release: over 5 years ago - 1.07 thousand downloads total - 132 stars on GitHub - 1 maintainer
jupiterapi/ephoto360
Create text effects online , Effects online for free, photo frames, make face photo montages, cus...Latest release: about 2 months ago - 10 downloads total - 5 stars on GitHub - 1 maintainer
ronnie/tra-crawler v1.0.0-beta.2
A package to crawl TRA web receipts and return the data in necessary format4 versions - Latest release: 8 months ago - 45 downloads total - 3 stars on GitHub - 1 maintainer
sabri/tiktok v1.0.2
sabri/tiktok is php Tiktok scraper3 versions - Latest release: over 3 years ago - 1 dependent repositories - 446 downloads total - 70 stars on GitHub - 1 maintainer
tjdsneto/jcnet-crawler 0.0.4
Extract (scrap) movie schedule info from JCNet movies page4 versions - Latest release: over 5 years ago - 3 downloads total - 0 stars on GitHub - 1 maintainer
nueip/curl 0.4.2
NuEIP Curl.14 versions - Latest release: over 2 years ago - 244 downloads total - 2 stars on GitHub - 2 maintainers
mahmudkuet11/webdriver 0.1.2
Web driver build on facebook php webdriver3 versions - Latest release: over 4 years ago - 46 downloads total - 1 stars on GitHub - 1 maintainer
onsa/fatsecret-crawler v1.0.1
FatSecretCrawler crawls fatsecret.co.uk and returns ingredients with density (if calculable) and ...2 versions - Latest release: over 6 years ago - 9 downloads total - 0 stars on GitHub - 1 maintainer
nucleos/lastfm 3.6.0 💰
Last.fm webservice client for php.20 versions - Latest release: 6 months ago - 2 dependent packages - 1 dependent repositories - 11 thousand downloads total - 14 stars on GitHub - 1 maintainer
core23/lastfm-api 3.6.0 💰
Last.fm webservice client for php.20 versions - Latest release: 6 months ago - 2 dependent packages - 2.78 thousand downloads total - 13 stars on GitHub - 1 maintainer
nucleos/lastfm-bundle 1.3.0 💰
This bundle provides services for using the last.fm API with symfony.11 versions - Latest release: 6 months ago - 884 downloads total - 3 stars on GitHub - 1 maintainer
core23/lastfm-bundle 1.3.0 💰
This bundle provides services for using the last.fm API with symfony.11 versions - Latest release: 6 months ago - 104 downloads total - 3 stars on GitHub - 1 maintainer
kiddyu/beanbun 1.0.4
Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性5 versions - Latest release: almost 7 years ago - 3 dependent repositories - 4.03 thousand downloads total - 1,231 stars on GitHub - 1 maintainer
Related Keywords
php
122
spider
62
scraper
47
scraping
28
laravel
23
crawling
23
parser
22
http
17
website
17
bot
16
seo
15
hacktoberfest
15
curl
15
symfony
15
dom
14
api
13
html
12
link
12
search
12
library
11
spatie
11
scrape
11
yii2
10
web
9
detect
9
Sitemap
9
composer
8
crawl
8
module
8
extension
7
yii
6
user-agent
6
luya
6
framework
6
browser
6
typo3
6
bundle
6
webcrawler
6
scrapper
6
google
6
robots.txt
6
robot
6
scraping-websites
5
news
5
extractor
5
index
5
crawler detect
5
crawler detector
5
php crawler detect
5
crawlerdetect
5
bots
5
domcrawler
5
url
5
xml
5
parse
5
robots-txt
5
phpQuery
4
QueryList
4
asynchronous
4
health
4
luya-module
4
web-crawler
4
content
4
last.fm
4
webservice client
4
request
4
lastfm
4
symfony-bundle
4
json
4
webservice-client
4
php-crawler
4
rss
3
laravel-package
3
internet
3
checker
3
multi
3
cache-warmup
3
web crawler
3
indexer
3
cache
3
crwlr
3
helper
3
sitemap
3
robots
3
facebook
3
seo-optimization
3
web-crawling
3
web-scraping
3
stock
3
guzzle
3
Harvest
3
extract
3
instagram
3
device
3
user agent
3
Match
3
async
3
console
3
matcher
3
data
3