Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
packagist.org "spider" keyword
Top 10.0% on packagist.org
4 versions - Latest release: over 5 years ago - 3 dependent packages - 8 dependent repositories - 6.39 thousand downloads total - 3 stars on GitHub - 1 maintainer
ropendev/curl 1.0.3
PHP POO cURL wrapper (PSR friendly) : light and simple.4 versions - Latest release: over 5 years ago - 3 dependent packages - 8 dependent repositories - 6.39 thousand downloads total - 3 stars on GitHub - 1 maintainer
milu2003/flarum-ext-dxc
DXC采集 flraum接口Latest release: 26 days ago - 1 dependent repositories - 8 downloads total - 0 stars on GitHub - 1 maintainer
crwlr/robots-txt v1.1.1
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping6 versions - Latest release: over 1 year ago - 1 dependent package - 1 dependent repositories - 5.36 thousand downloads total - 8 stars on GitHub - 1 maintainer
ixnode/php-web-crawler 0.1.24
PHP Web Crawler - This PHP class allows you to crawl recursively a given html page (or a given ht...25 versions - Latest release: 3 months ago - 25 downloads total - 2 stars on GitHub - 1 maintainer
mehrabx/web-crawler v1.0
A web crawler package1 version - Latest release: over 2 years ago - 1 downloads total - 3 stars on GitHub - 1 maintainer
toulen/tspider
spider with php cliLatest release: 27 days ago - 6 downloads total - 0 stars on GitHub - 1 maintainer
Top 3.7% on packagist.org
12 versions - Latest release: about 3 years ago - 5 dependent packages - 16 dependent repositories - 551 thousand downloads total - 24 stars on GitHub - 1 maintainer
vipnytt/robotstxtparser v2.1.0
Robots.txt parsing library, with full support for every directive and specification.12 versions - Latest release: about 3 years ago - 5 dependent packages - 16 dependent repositories - 551 thousand downloads total - 24 stars on GitHub - 1 maintainer
dz0x44/9pay-spider-telco v1.9
9Pay Crawler for Telco Promotion10 versions - Latest release: about 4 years ago - 31 downloads total - 0 stars on GitHub - 1 maintainer
vangxh/beanbun
Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性Latest release: 28 days ago - 2 downloads total - 0 stars on GitHub - 1 maintainer
Top 2.2% on packagist.org
13 versions - Latest release: over 7 years ago - 9 dependent packages - 40 dependent repositories - 142 thousand downloads total - 72 stars on GitHub - 1 maintainer
jyggen/curl v4.0.0
A simple and lightweight cURL library with support for asynchronous requests.13 versions - Latest release: over 7 years ago - 9 dependent packages - 40 dependent repositories - 142 thousand downloads total - 72 stars on GitHub - 1 maintainer
vipnytt/robotstagparser v0.2.1
X-Robots-Tag HTTP header parser class5 versions - Latest release: almost 8 years ago - 2 dependent repositories - 360 downloads total - 1 stars on GitHub - 1 maintainer
ervin-meng/phpspider
PHP多进程爬虫Latest release: 29 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
zodream/spider 1.0
web spider1 version - Latest release: 2 months ago - 1 dependent repositories - 42 downloads total - 0 stars on GitHub - 1 maintainer
diggin/diggin-robotrules 0.10.0
parser/handler for Robots Exclusion Protocol (robots.txt and more)5 versions - Latest release: about 8 years ago - 5 dependent repositories - 184 downloads total - 7 stars on GitHub - 1 maintainer
andersondrosa/spider v1.0
Smarty manager of array connections1 version - Latest release: over 7 years ago - 19 downloads total - 0 stars on GitHub - 1 maintainer
gpupo/camelspider 1.0 abandoned
A class to help handle gateways to processing entities.1 version - Latest release: almost 9 years ago - 4 dependent repositories - 1 downloads total - 10 stars on GitHub - 1 maintainer
sockstack/querylist V4.2.8 removed 💰
Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on p...1 version - Latest release: 9 months ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
bogddan/laravel-crawler-detect removed
A Laravel package to detect web crawlers via the user agentLatest release: 12 months ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
richardchey/fund 1.0.0 removed
Collect fund data1 version - Latest release: almost 9 years ago - 17 downloads total - 1 maintainer
rakshazi/multigrabber 1.0 removed
Download and parse HTML with multiple parallel requests and PicoFeed grabber1 version - Latest release: over 7 years ago - 7 downloads total - 1 maintainer
Related Keywords
crawler
62
php
34
QueryList
24
phpQuery
24
scraper
21
curl
13
http
11
parser
11
bot
11
scraping
9
scrape
8
crawling
7
seo
7
search
7
async
6
crawl
6
multi
6
robots.txt
6
laravel
6
symfony
6
robot
6
parallel
5
dom
5
user-agent
5
crawler detector
4
crawler detect
4
php crawler detect
4
crawlerdetect
4
detect
4
hacktoberfest
4
asynchronous
4
robots
4
request
4
web
4
requests
4
library
4
extractor
4
data
4
content
3
mining
3
parse
3
matcher
3
text
3
extract
3
Harvest
3
robots-txt
3
Match
3
html
3
web-crawler
3
google
3
client
3
array
3
website
3
webservice-client
2
lastfm
2
webservice client
2
last.fm
2
api
2
walkerspider
2
Walker Spider
2
walker
2
web-crawling
2
manager
2
Multi-thread
2
web-spider
2
index
2
webscraping
2
selector
2
crawl-page
2
9pay
2
wrapper
2
scrapper
2
internet
2
crawler modulable
2
proxy
2
collect
2
command-line
2
seo-optimization
2
node-crawler
2
amp
2
x-robots-tag
2
coroutine
2
event-loop
2
headless
2
multi-process
2
bots
2
Robots Exclusion Protocol
2
prerender.io
2
prerender
2
REP
2
robots-exclusion-protocol
2
yggdrasil
2
mysql
2
web spider
2
symfony-bundle
2
php collection
1
phpcrawler
1
escargot
1
rho
1
one
1