Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
packagist.org "crawler" keyword
cobaia/marsvin v1.0.0
Marsvin it's a framework to write crawler applications1 version - Latest release: over 11 years ago - 4 dependent repositories - 111 downloads total - 12 stars on GitHub - 1 maintainer
fran-diaz/itseo 0.1.1
Includes methods that extract SEO info from url or HTML code1 version - Latest release: over 10 years ago - 4 dependent repositories - 22 downloads total - 3 stars on GitHub - 1 maintainer
mihaeu/tarantula v1.3.0
Another PHP crawler based on Guzzle.7 versions - Latest release: almost 10 years ago - 4 dependent repositories - 49 downloads total - 15 stars on GitHub - 1 maintainer
Top 8.0% on packagist.org
2 versions - Latest release: over 9 years ago - 8 dependent repositories - 7.09 thousand downloads total - 58 stars on GitHub - 1 maintainer
mmerian/phpcrawl 0.8.3
PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-...2 versions - Latest release: over 9 years ago - 8 dependent repositories - 7.09 thousand downloads total - 58 stars on GitHub - 1 maintainer
Top 7.8% on packagist.org
11 versions - Latest release: about 9 years ago - 12 dependent repositories - 4.41 thousand downloads total - 312 stars on GitHub - 1 maintainer
sleeping-owl/apist 1.3.7
Package to provide api-like access to foreign sites based on html parsing11 versions - Latest release: about 9 years ago - 12 dependent repositories - 4.41 thousand downloads total - 312 stars on GitHub - 1 maintainer
gstjohn/thumbsnag v1.0.1
Thumbsnag crawls an HTML document and finds imagery that best represents the given page.2 versions - Latest release: about 9 years ago - 4 dependent repositories - 25 downloads total - 11 stars on GitHub - 1 maintainer
brunodebarros/http-request 1.0.2
A web crawler, built to be easily dropped into PHP applications, which behaves just like a regula...3 versions - Latest release: about 9 years ago - 1 dependent package - 4 dependent repositories - 195 downloads total - 8 stars on GitHub - 1 maintainer
richardchey/fund 1.0.0 removed
Collect fund data1 version - Latest release: almost 9 years ago - 17 downloads total - 1 maintainer
vdaguenet/one-page-seo v1.0
Serve static content of a one-page website to crawlers (e.g. Facebook, Google or Twitter) using P...1 version - Latest release: almost 9 years ago - 5 dependent repositories - 37 downloads total - 7 stars on GitHub - 1 maintainer
gpupo/camelspider 1.0 abandoned
A class to help handle gateways to processing entities.1 version - Latest release: almost 9 years ago - 4 dependent repositories - 1 downloads total - 10 stars on GitHub - 1 maintainer
sohib/crawler v1.0.1
Scan Http URLs from a url containing an HTML and get Json or Xml or Array3 versions - Latest release: over 8 years ago - 24 downloads total - 0 stars on GitHub - 1 maintainer
wykleph/curl v0.11
Simple synchronous and asynchronous cURL requests in php.2 versions - Latest release: over 8 years ago - 30 downloads total - 0 stars on GitHub - 1 maintainer
wykleph/html-scraper v0.1.0
An API for taking json sitemaps generated by the webscraper.io extension, and emulating webscrape...1 version - Latest release: over 8 years ago - 18 downloads total - 1 stars on GitHub - 1 maintainer
olousouzian/akitabundle 1.0.1
Symfony 2.X bundle for easy crawling Facebook page3 versions - Latest release: about 8 years ago - 224 downloads total - 2 stars on GitHub - 1 maintainer
diggin/diggin-robotrules 0.10.0
parser/handler for Robots Exclusion Protocol (robots.txt and more)5 versions - Latest release: about 8 years ago - 5 dependent repositories - 184 downloads total - 7 stars on GitHub - 1 maintainer
radarlog/banks-spyder 1.0
Banks Spyder is free software to automatically generate bank statements in PDF format from your a...1 version - Latest release: about 8 years ago - 2 downloads total - 0 stars on GitHub - 1 maintainer
euskadi31/crawler-detect-bundle v1.0.1
A Symfony 2 crawler detect bundle2 versions - Latest release: about 8 years ago - 48 downloads total - 1 stars on GitHub - 1 maintainer
Top 6.4% on packagist.org
14 versions - Latest release: almost 8 years ago - 3 dependent packages - 9 dependent repositories - 30.9 thousand downloads total - 10 stars on GitHub - 1 maintainer
tomverran/robots-txt-checker 1.12.1
Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a...14 versions - Latest release: almost 8 years ago - 3 dependent packages - 9 dependent repositories - 30.9 thousand downloads total - 10 stars on GitHub - 1 maintainer
luyadev/luya-module-crawleradmin 1.0.0-beta8
Yii2 LUYA Crawler Admin-Module4 versions - Latest release: almost 8 years ago - 562 downloads total - 1 maintainer
zephir/luya-module-crawleradmin 1.0.0-beta8
Yii2 LUYA Crawler Admin-Module4 versions - Latest release: almost 8 years ago - 2 dependent packages - 1 dependent repositories - 143 downloads total - 1 maintainer
gsavastano/dssg 0.5 removed
Generates XML sitemap file for any given URL - still under development7 versions - Latest release: almost 8 years ago
alikdex/yii2-crawler-detect 1.0
Yii2 extension for CrawlerDetect library1 version - Latest release: almost 8 years ago - 1 dependent repositories - 18 thousand downloads total - 13 stars on GitHub - 1 maintainer
dmoraschi/sitemap-common v1.1.0
Sitemap generator and crawler library2 versions - Latest release: over 7 years ago - 90 downloads total - 0 stars on GitHub - 1 maintainer
Top 2.2% on packagist.org
13 versions - Latest release: over 7 years ago - 9 dependent packages - 40 dependent repositories - 142 thousand downloads total - 72 stars on GitHub - 1 maintainer
jyggen/curl v4.0.0
A simple and lightweight cURL library with support for asynchronous requests.13 versions - Latest release: over 7 years ago - 9 dependent packages - 40 dependent repositories - 142 thousand downloads total - 72 stars on GitHub - 1 maintainer
urguardian4ngel/flarum-ext-fb-crawler v0.1.0-beta.5
An extension that allows the Facebook Crawler to crawl protected pages.1 version - Latest release: over 7 years ago - 104 downloads total - 0 stars on GitHub - 1 maintainer
hissezhaut/http-status-check 1.0.2
CLI tool to crawl a website and check HTTP status code4 versions - Latest release: over 7 years ago - 9 downloads total - 0 stars on GitHub - 1 maintainer
lndj/lcrawl v3.1.0
一只优雅的正方教务系统爬虫。7 versions - Latest release: over 7 years ago - 3 dependent repositories - 1.82 thousand downloads total - 114 stars on GitHub - 1 maintainer
itgalaxy/webcrawler-verifier 2.1.0
PHP library providing functionality to verify that user-agents are who they claim to be.5 versions - Latest release: over 7 years ago - 2.75 thousand downloads total - 7 stars on GitHub - 1 maintainer
mediamonks/crawler-bundle v1.0.0
Integrates the mediamonks/crawler package into Symfony1 version - Latest release: over 7 years ago - 41 downloads total - 7 stars on GitHub - 1 maintainer
hissezhaut/laravel-link-checker v2.0.1
Check all links in a Laravel app7 versions - Latest release: over 7 years ago - 11 downloads total - 0 stars on GitHub - 1 maintainer
smochin/how-old-php-crawler 1.0.0
A simple PHP Crawler for how-old.net1 version - Latest release: over 7 years ago - 15 downloads total - 1 stars on GitHub - 1 maintainer
Top 3.2% on packagist.org
19 versions - Latest release: over 7 years ago - 4 dependent packages - 14 dependent repositories - 234 thousand downloads total - 43 stars on GitHub - 1 maintainer
crossjoin/browscap v3.0.5
The standalone PHP Browscap parser Crossjoin\Browscap detects browser properties as well as devic...19 versions - Latest release: over 7 years ago - 4 dependent packages - 14 dependent repositories - 234 thousand downloads total - 43 stars on GitHub - 1 maintainer
w3zone/crawler 1.0.1
php crawler based on service .1 version - Latest release: over 7 years ago - 115 downloads total - 5 stars on GitHub - 2 maintainers
delphiki/aprr 2.0.1
A simple crawler to get formated data from APRR website.5 versions - Latest release: about 7 years ago - 18 downloads total - 0 stars on GitHub - 1 maintainer
maidmaid/cffie v0.4.0
CFFie query SBB/CFF/FFS connections from https://www.cff.ch.5 versions - Latest release: about 7 years ago - 19 downloads total - 0 stars on GitHub - 1 maintainer
yuan1994/z-crawler v1.0.0
【正方教务】爬虫，支持成绩查询、考试查询、课表查询、四六级成绩查询、四六级报名、选课查询、修改密码、获取用户菜单等功能，并且解析数据成易读格式，符合 psr 规范，拿来即用1 version - Latest release: about 7 years ago - 50 downloads total - 38 stars on GitHub - 1 maintainer
dayrev/extractor v1.2.2
Web Page Content Extractor7 versions - Latest release: about 7 years ago - 11 downloads total - 2 stars on GitHub - 1 maintainer
jmajors/robotstxt v1.7.1
A small package for parsing websites' robots.txt files8 versions - Latest release: about 7 years ago - 1 dependent repositories - 20 downloads total - 3 stars on GitHub - 1 maintainer
grab/spider 0.2
PHP async scrapper used multi curl and reactphp, and proxy inspired by python grab1 version - Latest release: about 7 years ago - 114 downloads total - 10 stars on GitHub - 1 maintainer
rfussien/leboncoin-crawler 2.3.0
Makes data extraction from leboncoin.fr easy13 versions - Latest release: about 7 years ago - 4 dependent repositories - 358 downloads total - 39 stars on GitHub - 1 maintainer
kiddyu/beanbun 1.0.4
Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性5 versions - Latest release: almost 7 years ago - 3 dependent repositories - 4.02 thousand downloads total - 1,231 stars on GitHub - 1 maintainer
howie6879/php-google 1.0
Google search results crawler, get google search results that you need.1 version - Latest release: almost 7 years ago - 537 downloads total - 29 stars on GitHub - 1 maintainer
podcastcrawler/podcastcrawler 1.1.1
PHP library to find podcasts10 versions - Latest release: almost 7 years ago - 1 dependent package - 1 dependent repositories - 2.61 thousand downloads total - 39 stars on GitHub - 1 maintainer
lenonleite/hacking v0.1
LenonLeite Component - Hakcing packages1 version - Latest release: almost 7 years ago - 19 downloads total - 0 stars on GitHub - 1 maintainer
zrashwani/news-scrapper 1.0.3
scrapping news data from a webpage using structured data6 versions - Latest release: over 6 years ago - 256 downloads total - 13 stars on GitHub - 1 maintainer
cdaguerre/robots-bundle v1.1.1
Add contextual robots meta headers7 versions - Latest release: over 6 years ago - 15.2 thousand downloads total - 0 stars on GitHub - 1 maintainer
spacespell/laravel-crawler v0.1.0
Laravel queue based distributed web crawler framework.1 version - Latest release: over 6 years ago - 18 downloads total - 2 stars on GitHub - 1 maintainer
seotracker/seocore 1.0.3
seo-core library for php4 versions - Latest release: over 6 years ago - 6 dependent repositories - 69 downloads total - 16 stars on GitHub - 1 maintainer
lenonleite/simple-crawler v0.4
LenonLeite Component - Simple Crawler, for read pages4 versions - Latest release: over 6 years ago - 104 downloads total - 15 stars on GitHub - 1 maintainer
nmure/crawler-detect-bundle v2.0.0
A Symfony bundle for the Crawler-Detect library (detects bots/crawlers/spiders via the user agent)3 versions - Latest release: over 6 years ago - 1 dependent repositories - 252 thousand downloads total - 25 stars on GitHub - 1 maintainer
mediamonks/crawler 2.0.0
Crawl your own website with various clients for SEO and indexing purposes.4 versions - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 565 downloads total - 19 stars on GitHub - 1 maintainer
fgsl/crawler 0.0.1
Fgsl Crawler1 version - Latest release: over 6 years ago - 8 downloads total - 0 stars on GitHub - 1 maintainer
louvian/pururin-crawler 0.0.1
Pururin Crawler1 version - Latest release: over 6 years ago - 12 downloads total - 4 stars on GitHub - 1 maintainer
onsa/fatsecret-crawler v1.0.1
FatSecretCrawler crawls fatsecret.co.uk and returns ingredients with density (if calculable) and ...2 versions - Latest release: over 6 years ago - 9 downloads total - 0 stars on GitHub - 1 maintainer
vrkansagara/common-crawler 1.0.2
Common Crawler3 versions - Latest release: over 6 years ago - 27 downloads total - 3 stars on GitHub - 1 maintainer
famdirksen/crawler 3.3.1
Crawl all internal links found on a website - used for custom crawler42 versions - Latest release: over 6 years ago - 13 downloads total - 1 stars on GitHub - 1 maintainer
laurentvw/scrapher v2.3.1
A web scraper for PHP to easily extract data from web pages12 versions - Latest release: about 6 years ago - 1 dependent package - 3 dependent repositories - 2.51 thousand downloads total - 18 stars on GitHub - 1 maintainer
laurentvw/lavacrawler v2.3.1
A web scraper for PHP to easily extract data from web pages12 versions - Latest release: about 6 years ago - 4 dependent repositories - 94 downloads total - 18 stars on GitHub - 1 maintainer
smochin/instagram-php-crawler 1.0.1
A simple PHP Crawler for Instagram2 versions - Latest release: about 6 years ago - 1 dependent repositories - 5.82 thousand downloads total - 46 stars on GitHub - 1 maintainer
baqend/spider 1.0.0
URL spider which crawls a page and all its subpages1 version - Latest release: about 6 years ago - 434 downloads total - 6 stars on GitHub - 1 maintainer
wangta69/crawler 1.0.0
crawler1 version - Latest release: about 6 years ago - 14 downloads total - 1 stars on GitHub - 1 maintainer
appstract/laravel-crawl-render 0.1.4
Pre-render your site for web crawlers5 versions - Latest release: about 6 years ago - 36 downloads total - 11 stars on GitHub - 1 maintainer
Top 6.8% on packagist.org
21 versions - Latest release: about 6 years ago - 7 dependent repositories - 61.4 thousand downloads total - 47 stars on GitHub - 1 maintainer
opensearchserver/opensearchserver 3.0.20
PHP library for OpenSearchServer: professionnal search engine, crawlers (web, file, database), RE...21 versions - Latest release: about 6 years ago - 7 dependent repositories - 61.4 thousand downloads total - 47 stars on GitHub - 1 maintainer
danack/sitetool 0.1.2 💰
Event based site tool and tester.6 versions - Latest release: almost 6 years ago - 31 downloads total - 5 stars on GitHub - 1 maintainer
macsch15/crawler-detector 1.3.4
Fat-free, standalone and fast web crawler (bot) detector8 versions - Latest release: almost 6 years ago - 1.77 thousand downloads total - 3 stars on GitHub - 1 maintainer
awesam86/imlinscraper v1.0.1
Image And Link Scraper2 versions - Latest release: almost 6 years ago - 20 downloads total - 0 stars on GitHub - 1 maintainer
rafaelglikis/sinama 0.0.2
Web scraping library4 versions - Latest release: over 5 years ago - 13 downloads total - 3 stars on GitHub - 1 maintainer
sfynx-project/tool-crawler-bundle v2.8.2
This Bundle provides handlers to work with xml and xsd files.4 versions - Latest release: over 5 years ago - 2 dependent packages - 2 dependent repositories - 473 downloads total - 1 stars on GitHub - 1 maintainer
xcrawler/xcrawler 1.0.41
A fast, simple and powerful PHP web crawler (scraper/spider) 快速、简洁且强大的爬虫/采集框架6 versions - Latest release: over 5 years ago - 1 dependent repositories - 866 downloads total - 339 stars on GitHub - 1 maintainer
wikitext/query v1.1.1
A query object that helps you crawl through wikitext.4 versions - Latest release: over 5 years ago - 11 downloads total - 0 stars on GitHub - 1 maintainer
marabesi/social-crawler v0.0.1
Easy way to find emails through social networks1 version - Latest release: over 5 years ago - 4 downloads total - 2 stars on GitHub - 1 maintainer
thingston/crawler 0.7.0
Web crawler based on PHP Guzzle HTTP Client with concurrency support for faster operation.10 versions - Latest release: over 5 years ago - 9 downloads total - 2 stars on GitHub - 1 maintainer
ghalambaz/googleplay-spider 1
Another GooglePlay Website Scraper based on goutte2 versions - Latest release: over 5 years ago - 231 downloads total - 6 stars on GitHub - 1 maintainer
pithyone/zhihu-crawler 3.5.0
轻量级知乎爬虫17 versions - Latest release: over 5 years ago - 62 downloads total - 25 stars on GitHub - 1 maintainer
tjdsneto/jcnet-crawler 0.0.4
Extract (scrap) movie schedule info from JCNet movies page4 versions - Latest release: over 5 years ago - 3 downloads total - 0 stars on GitHub - 1 maintainer
bdspider/crawler 0.5.1
crawler,spider for phpQuery。8 versions - Latest release: over 5 years ago - 46 downloads total - 0 stars on GitHub - 1 maintainer
Top 10.0% on packagist.org
4 versions - Latest release: over 5 years ago - 3 dependent packages - 8 dependent repositories - 6.39 thousand downloads total - 3 stars on GitHub - 1 maintainer
ropendev/curl 1.0.3
PHP POO cURL wrapper (PSR friendly) : light and simple.4 versions - Latest release: over 5 years ago - 3 dependent packages - 8 dependent repositories - 6.39 thousand downloads total - 3 stars on GitHub - 1 maintainer
xinrui5577/beanbun 1.1.0
老版本2018年4月份没有维护了.有bug,自己fork分支,自己维护,原来:Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性7 versions - Latest release: over 5 years ago - 18 downloads total - 1 stars on GitHub - 1 maintainer
hedii/php-crawler 2.2.0
A crawler application written with php and Laravel that finds email addresses on the internets.13 versions - Latest release: over 5 years ago - 1.07 thousand downloads total - 132 stars on GitHub - 1 maintainer
scribilicious/tinylistscraper 1.0.2
TinyListScraper is an easy to use page list scraper. Its main goal is to scrape news and search r...2 versions - Latest release: about 5 years ago - 17 downloads total - 1 stars on GitHub - 1 maintainer
codeblog/crawlerdetect v1.0.0
A CodeBlog CrawlerDetect class is easy and quick to use. Detecting bots/crawlers/spiders via the ...1 version - Latest release: about 5 years ago - 54 downloads total - 9 stars on GitHub - 1 maintainer
dobrosite/crawler 0.2.0
PHP component for recursive traversal of hierarchical data storages2 versions - Latest release: about 5 years ago - 1 dependent package - 1 dependent repositories - 24 downloads total - 0 stars on GitHub - 1 maintainer
dobrosite/http-crawler 0.3.0
PHP component for recursive web sites traversal3 versions - Latest release: about 5 years ago - 18 downloads total - 0 stars on GitHub - 1 maintainer
migliori/sitemap-crawler 0.0.3
Sitemap crawler/generator. For the given URL it will return sitemap XML file with URLs and images.3 versions - Latest release: about 5 years ago - 266 downloads total - 3 stars on GitHub - 1 maintainer
exfriend/uncurl 1.0.5
Unfurl links in PHP4 versions - Latest release: about 5 years ago - 1 dependent repositories - 196 downloads total - 1 stars on GitHub - 1 maintainer
proclnas/curl-rox 3.0.0
Just another curl wrapper for webCrawling purposes3 versions - Latest release: about 5 years ago - 17 downloads total - 9 stars on GitHub - 1 maintainer
jfcherng/wiki-cgroup-crawler 1.2.6 removed
此腳本用於抓取維基百科的公共轉換組詞庫，並將結果儲存為外部檔案。20 versions - Latest release: about 5 years ago - 2 downloads total - 1 stars on GitHub
nws/ultra-parser 2.2.3
Laravel package for easy scraping web pages38 versions - Latest release: about 5 years ago - 44 downloads total - 1 maintainer
sobak/scrawler v0.3.0
Scrawler is an extensible, declarative web robot and scrapper3 versions - Latest release: almost 5 years ago - 11 downloads total - 10 stars on GitHub - 1 maintainer
cviniciussdias/google-crawler v2.0.3 💰
A simple Crawler for getting Google results20 versions - Latest release: almost 5 years ago - 132 downloads total - 32 stars on GitHub - 1 maintainer
inbo/google-crawler v2.0.3
A simple Crawler for getting Google results20 versions - Latest release: almost 5 years ago - 0 downloads total - 1 stars on GitHub - 1 maintainer
filipsedivy/kontrola-tachometru 0.1.0 💰
🚘 MDČR - kontrola tachometru1 version - Latest release: over 4 years ago - 3 downloads total - 0 stars on GitHub - 1 maintainer
sleimanx2/grawler 0.2.4
A guided html crawler with media meta extraction15 versions - Latest release: over 4 years ago - 295 downloads total - 13 stars on GitHub - 1 maintainer
dachcom-digital/lucene-search v2.3.2
Pimcore 5.x Website Indexer (powered by Zend Search Lucene)26 versions - Latest release: over 4 years ago - 37.3 thousand downloads total - 26 stars on GitHub - 1 maintainer
webysther/packagist-mirror 1.1.1 💰
Build mirror of packagist7 versions - Latest release: over 4 years ago - 150 downloads total - 179 stars on GitHub - 1 maintainer
mahmudkuet11/webdriver 0.1.2
Web driver build on facebook php webdriver3 versions - Latest release: over 4 years ago - 46 downloads total - 1 stars on GitHub - 1 maintainer
yosodog/htmlpagedom v2.0.1
jQuery-inspired DOM manipulation extension for Symfony's Crawler24 versions - Latest release: over 4 years ago - 30 downloads total - 0 stars on GitHub - 1 maintainer
coooold/crawler v1.0.0
Most powerful, popular and production crawling/scraping package for PHP1 version - Latest release: over 4 years ago - 15 downloads total - 1 stars on GitHub - 1 maintainer
eightwire/magento2-module-primer 0.1.14
A cache primer extension for Magento 215 versions - Latest release: over 4 years ago - 15.7 thousand downloads total - 19 stars on GitHub - 1 maintainer
Related Keywords
php
122
spider
62
scraper
47
scraping
28
crawling
23
laravel
23
parser
22
website
17
http
17
bot
16
hacktoberfest
15
curl
15
symfony
15
seo
15
dom
14
api
13
search
12
link
12
html
12
spatie
11
library
11
scrape
11
yii2
10
detect
9
web
9
Sitemap
9
crawl
8
module
8
composer
8
extension
7
framework
6
yii
6
luya
6
scrapper
6
user-agent
6
robots.txt
6
bundle
6
typo3
6
browser
6
google
6
robot
6
webcrawler
6
news
5
robots-txt
5
crawler detect
5
bots
5
xml
5
extractor
5
index
5
domcrawler
5
crawlerdetect
5
parse
5
php crawler detect
5
crawler detector
5
scraping-websites
5
url
5
webservice-client
4
lastfm
4
request
4
symfony-bundle
4
json
4
health
4
web-crawler
4
content
4
luya-module
4
phpQuery
4
php-crawler
4
webservice client
4
last.fm
4
QueryList
4
asynchronous
4
seo-optimization
3
web crawler
3
console
3
helper
3
instagram
3
webscraping
3
cache
3
selector
3
web-scraping
3
mining
3
async
3
Match
3
Harvest
3
extract
3
matcher
3
data
3
text
3
stock
3
web-crawling
3
crwlr
3
wordpress
3
guzzle
3
indexer
3
cache-warmup
3
robots
3
sitemap
3
multi
3
laravel-package
3
facebook
3