Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
packagist.org "crawler" keyword
ronnie/tra-crawler v1.0.0-beta.2
A package to crawl TRA web receipts and return the data in necessary format4 versions - Latest release: 8 months ago - 45 downloads total - 3 stars on GitHub - 1 maintainer
sabri/tiktok v1.0.2
sabri/tiktok is php Tiktok scraper3 versions - Latest release: over 3 years ago - 1 dependent repositories - 446 downloads total - 70 stars on GitHub - 1 maintainer
tjdsneto/jcnet-crawler 0.0.4
Extract (scrap) movie schedule info from JCNet movies page4 versions - Latest release: over 5 years ago - 3 downloads total - 0 stars on GitHub - 1 maintainer
nueip/curl 0.4.2
NuEIP Curl.14 versions - Latest release: over 2 years ago - 244 downloads total - 2 stars on GitHub - 2 maintainers
mahmudkuet11/webdriver 0.1.2
Web driver build on facebook php webdriver3 versions - Latest release: over 4 years ago - 46 downloads total - 1 stars on GitHub - 1 maintainer
onsa/fatsecret-crawler v1.0.1
FatSecretCrawler crawls fatsecret.co.uk and returns ingredients with density (if calculable) and ...2 versions - Latest release: over 6 years ago - 9 downloads total - 0 stars on GitHub - 1 maintainer
nucleos/lastfm 3.6.0 💰
Last.fm webservice client for php.20 versions - Latest release: 6 months ago - 2 dependent packages - 1 dependent repositories - 11 thousand downloads total - 14 stars on GitHub - 1 maintainer
core23/lastfm-api 3.6.0 💰
Last.fm webservice client for php.20 versions - Latest release: 6 months ago - 2 dependent packages - 2.78 thousand downloads total - 13 stars on GitHub - 1 maintainer
nucleos/lastfm-bundle 1.3.0 💰
This bundle provides services for using the last.fm API with symfony.11 versions - Latest release: 6 months ago - 884 downloads total - 3 stars on GitHub - 1 maintainer
core23/lastfm-bundle 1.3.0 💰
This bundle provides services for using the last.fm API with symfony.11 versions - Latest release: 6 months ago - 104 downloads total - 3 stars on GitHub - 1 maintainer
kiddyu/beanbun 1.0.4
Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性5 versions - Latest release: almost 7 years ago - 3 dependent repositories - 4.03 thousand downloads total - 1,231 stars on GitHub - 1 maintainer
gyaaniguy/pcrawl 0.01-beta
PHP web scraping and crawling library. With support for multiple clients, fast parsing, debugging...11 versions - Latest release: 12 months ago - 8 downloads total - 2 stars on GitHub - 1 maintainer
crawlzone/crawlzone 4.0.0
Crawlzone is a fast asynchronous internet crawling framework aiming to provide open source web se...8 versions - Latest release: over 2 years ago - 5.01 thousand downloads total - 77 stars on GitHub - 1 maintainer
mediashare/scraper 0.1.6
Scrapes the information from the targeted page and provides a DomCrawler15 versions - Latest release: over 2 years ago - 1 dependent package - 2 dependent repositories - 258 downloads total - 4 stars on GitHub - 1 maintainer
itgalaxy/webcrawler-verifier 2.1.0
PHP library providing functionality to verify that user-agents are who they claim to be.5 versions - Latest release: over 7 years ago - 2.75 thousand downloads total - 7 stars on GitHub - 1 maintainer
ngatngay/crawler-php 8.1.0
A simple PHP Web Crawler4 versions - Latest release: over 1 year ago - 1 downloads total - 0 stars on GitHub - 1 maintainer
nickdekruijk/laravel-robots 0.0.1
Dynamic robots.txt files for Laravel projects1 version - Latest release: about 1 year ago - 4 downloads total - 0 stars on GitHub - 1 maintainer
wangjian/spiderman
the high performance crawler frameworkLatest release: about 2 months ago - 7 downloads total - 5 stars on GitHub - 1 maintainer
joacub/uglify-js2
jsminLatest release: about 2 months ago - 4 dependent repositories - 105 downloads total - 0 stars on GitHub - 1 maintainer
fi1a/crawler
PHP crawlerLatest release: about 2 months ago - 0 downloads total - 1 stars on GitHub - 1 maintainer
elboletaire/crawler
A simple crawler (spider) writen in php just for funLatest release: about 2 months ago - 1 dependent repositories - 6.7 thousand downloads total - 41 stars on GitHub - 1 maintainer
wikitext/query v1.1.1
A query object that helps you crawl through wikitext.4 versions - Latest release: over 5 years ago - 11 downloads total - 0 stars on GitHub - 1 maintainer
rafaelglikis/sinama 0.0.2
Web scraping library4 versions - Latest release: almost 6 years ago - 13 downloads total - 3 stars on GitHub - 1 maintainer
reader/fetch-fans v1.2.1
fetch nickname&fans count in bilibili|douyin|redbook4 versions - Latest release: over 3 years ago - 16 downloads total - 7 stars on GitHub - 1 maintainer
smochin/how-old-php-crawler 1.0.0
A simple PHP Crawler for how-old.net1 version - Latest release: over 7 years ago - 15 downloads total - 1 stars on GitHub - 1 maintainer
cacing69/cquery v1.4.0 💰
PHP Scraper with language expression, could be used to scrape data from a website that uses javas...6 versions - Latest release: 9 months ago - 1 dependent package - 20 downloads total - 2 stars on GitHub - 1 maintainer
migliori/sitemap-crawler 0.0.3
Sitemap crawler/generator. For the given URL it will return sitemap XML file with URLs and images.3 versions - Latest release: about 5 years ago - 418 downloads total - 3 stars on GitHub - 1 maintainer
piopi/behatcrawler
A Behat extension that crawls links on a website and executes user-defined function on each one o...Latest release: 23 days ago - 16 downloads total - 1 stars on GitHub - 1 maintainer
lenonleite/hacking v0.1
LenonLeite Component - Hakcing packages1 version - Latest release: almost 7 years ago - 19 downloads total - 0 stars on GitHub - 1 maintainer
xinrui5577/beanbun 1.1.0
老版本2018年4月份没有维护了.有bug,自己fork分支,自己维护,原来:Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性7 versions - Latest release: over 5 years ago - 18 downloads total - 1 stars on GitHub - 1 maintainer
lucassmacedo/mangas-downloader
PHP library to download mangas chaptersLatest release: 23 days ago - 0 downloads total - 12 stars on GitHub - 1 maintainer
seosazi/php-html-parser 1.2.11
simple crawl link and parser it19 versions - Latest release: over 2 years ago - 48 downloads total - 2 stars on GitHub - 1 maintainer
loveorigami/lo-crawler
Crawler componentLatest release: 23 days ago - 29 downloads total - 0 stars on GitHub - 1 maintainer
bringyourownideas/laravel-sitemap 3.0.0 💰
A simple website crawler & sitemap generator without a headless browser for Laravel 5.8+19 versions - Latest release: over 1 year ago - 4 dependent repositories - 7.68 thousand downloads total - 10 stars on GitHub - 1 maintainer
innmind/crawler 6.1.0
Library to extract meaningful informations out of a webpage23 versions - Latest release: over 3 years ago - 4 dependent packages - 4 dependent repositories - 936 downloads total - 1 stars on GitHub - 1 maintainer
yosodog/htmlpagedom v2.0.1
jQuery-inspired DOM manipulation extension for Symfony's Crawler24 versions - Latest release: over 4 years ago - 30 downloads total - 0 stars on GitHub - 1 maintainer
rebelinblue/fluent-web-crawler 1.0.5
A web crawler with a fluent interface6 versions - Latest release: about 4 years ago - 3.2 thousand downloads total - 8 stars on GitHub - 1 maintainer
yangze/spiderx v2.1.35
php SpiderX25 versions - Latest release: over 2 years ago - 38 downloads total - 14 stars on GitHub - 1 maintainer
awanesia/scrap v2.0.1
A web scraper for PHP to easily extract data from web pages -> party of laurentvw1 version - Latest release: 3 months ago - 3 downloads total - 0 stars on GitHub - 1 maintainer
oyjz/querylist
PHP采集工具(爬虫)，基于https://github.com/jae-jae/QueryList。Latest release: 23 days ago - 6 downloads total - 0 stars on GitHub - 1 maintainer
andrew-svirin/resource-crawler-bundle
Crawler for any sort of resources.Latest release: 23 days ago - 55 downloads total - 3 stars on GitHub - 1 maintainer
zhiyang/php-crawler
Lightweight web crawler for phpLatest release: 23 days ago - 14 downloads total - 8 stars on GitHub - 1 maintainer
Top 5.9% on packagist.org
22 versions - Latest release: 12 months ago - 9 dependent repositories - 47.2 thousand downloads total - 593 stars on GitHub - 1 maintainer
spatie/http-status-check 4.0.0 💰
CLI tool to crawl a website and check HTTP status code22 versions - Latest release: 12 months ago - 9 dependent repositories - 47.2 thousand downloads total - 593 stars on GitHub - 1 maintainer
eddieace/php-simple v1.0.4
HTML DOM parser for php 7.1+5 versions - Latest release: about 3 years ago - 1 dependent repositories - 35.9 thousand downloads total - 14 stars on GitHub - 1 maintainer
51degrees/fiftyone.devicedetection 4.4.2
Device detection engines for 51Degrees Pipeline API. Parse HTTP headers to detect hardware, opera...51 versions - Latest release: about 2 years ago - 1 dependent package - 1 dependent repositories - 7.19 thousand downloads total - 0 stars on GitHub - 1 maintainer
darvinstudio/darvin-crawler-bundle 6.0.4
This bundle provides console command that detects broken links on your website.5 versions - Latest release: about 3 years ago - 1.06 thousand downloads total - 0 stars on GitHub - 1 maintainer
contextualcode/crawler v2.4.0
Flexible website crawler which stores the results in persistent storage21 versions - Latest release: 4 months ago - 1 dependent package - 1 dependent repositories - 533 downloads total - 0 stars on GitLab.com - 2 maintainers
dmoraschi/sitemap-common v1.1.0
Sitemap generator and crawler library2 versions - Latest release: almost 8 years ago - 90 downloads total - 0 stars on GitHub - 1 maintainer
alc/sitemap-crawler v2.0.0
Crawl sitemap.xml recursively and return collected urls as array2 versions - Latest release: about 3 years ago - 2 dependent packages - 2 dependent repositories - 2.45 thousand downloads total - 5 stars on GitHub - 1 maintainer
dz0x44/9pay-mi-spider v1.3
9Pay Micro Invest NAV Crawler5 versions - Latest release: over 3 years ago - 213 downloads total - 0 stars on GitHub - 1 maintainer
tallesairan/crawler 1.0
Most powerful, popular and production crawling/scraping package for PHP1 version - Latest release: 10 months ago - 4 downloads total - 0 stars on GitHub - 1 maintainer
dachcom-digital/lucene-search v2.3.2
Pimcore 5.x Website Indexer (powered by Zend Search Lucene)26 versions - Latest release: over 4 years ago - 37.5 thousand downloads total - 26 stars on GitHub - 1 maintainer
matheusfaustino/phrawl
A web crawling framework in PHPLatest release: 24 days ago - 3 downloads total - 0 stars on GitHub - 1 maintainer
bilginpro/agency-iha v1.0.3
Crawler for IHA News Agency in Turkey.4 versions - Latest release: over 4 years ago - 479 downloads total - 5 stars on GitHub - 1 maintainer
scribilicious/tinylistscraper 1.0.2
TinyListScraper is an easy to use page list scraper. Its main goal is to scrape news and search r...2 versions - Latest release: over 5 years ago - 17 downloads total - 1 stars on GitHub - 1 maintainer
euskadi31/crawler-detect-bundle v1.0.1
A Symfony 2 crawler detect bundle2 versions - Latest release: about 8 years ago - 48 downloads total - 1 stars on GitHub - 1 maintainer
yidas/taifex-report 1.0.0
Taiwan Futures Exchange difference report (臺灣期貨交易所差異報表)1 version - Latest release: over 2 years ago - 1 downloads total - 0 stars on GitHub - 1 maintainer
wykleph/curl v0.11
Simple synchronous and asynchronous cURL requests in php.2 versions - Latest release: over 8 years ago - 30 downloads total - 0 stars on GitHub - 1 maintainer
wykleph/html-scraper v0.1.0
An API for taking json sitemaps generated by the webscraper.io extension, and emulating webscrape...1 version - Latest release: over 8 years ago - 18 downloads total - 1 stars on GitHub - 1 maintainer
Top 9.4% on packagist.org
13 versions - Latest release: over 2 years ago - 2 dependent repositories - 20.2 thousand downloads total - 254 stars on GitHub - 1 maintainer
zrashwani/arachnid 2.2.1
A crawler to find all unique internal pages on a given website13 versions - Latest release: over 2 years ago - 2 dependent repositories - 20.2 thousand downloads total - 254 stars on GitHub - 1 maintainer
schliesser/sitecrawler v3.0.0
TYPO3 sitemap crawler8 versions - Latest release: 26 days ago - 1 dependent repositories - 19.8 thousand downloads total - 10 stars on GitHub - 1 maintainer
olousouzian/akitabundle 1.0.1
Symfony 2.X bundle for easy crawling Facebook page3 versions - Latest release: over 8 years ago - 224 downloads total - 2 stars on GitHub - 1 maintainer
yidas/tw-stock-crawler 1.3.0
Taiwan Stock Opendata Crawler with realtime - 台灣股市股票資訊擷取器6 versions - Latest release: about 2 months ago - 1 dependent package - 1 dependent repositories - 28 downloads total - 2 stars on GitHub - 1 maintainer
Top 5.3% on packagist.org
13 versions - Latest release: over 2 years ago - 1 dependent package - 8 dependent repositories - 9.7 thousand downloads total - 254 stars on GitHub - 1 maintainer
codeguy/arachnid 2.2.1
A crawler to find all unique internal pages on a given website13 versions - Latest release: over 2 years ago - 1 dependent package - 8 dependent repositories - 9.7 thousand downloads total - 254 stars on GitHub - 1 maintainer
ow/crawler-rules
Crawling rules processorLatest release: 26 days ago - 4 dependent repositories - 14 downloads total - 0 stars on GitHub - 1 maintainer
Top 8.7% on packagist.org
84 versions - Latest release: about 2 years ago - 10 dependent repositories - 4.37 thousand downloads total - 53 stars on GitHub - 1 maintainer
pablouser1/tikscraper v1.2.7
Get data from TikTok API84 versions - Latest release: about 2 years ago - 10 dependent repositories - 4.37 thousand downloads total - 53 stars on GitHub - 1 maintainer
sobak/scrawler v0.3.0
Scrawler is an extensible, declarative web robot and scrapper3 versions - Latest release: about 5 years ago - 11 downloads total - 10 stars on GitHub - 1 maintainer
adabra/curl v4.0.4
A simple and lightweight cURL library with support for asynchronous requests.17 versions - Latest release: over 3 years ago - 1 dependent package - 29 downloads total - 0 stars on GitHub - 1 maintainer
abelhalo/zolcrawler
Zol CrawlerLatest release: 27 days ago - 12 downloads total - 0 stars on GitHub - 1 maintainer
macsch15/crawler-detector 1.3.4
Fat-free, standalone and fast web crawler (bot) detector8 versions - Latest release: almost 6 years ago - 1.77 thousand downloads total - 3 stars on GitHub - 1 maintainer
jafaripur/varzesh3-crawler
Crawler for varzesh3.com livescoreLatest release: 27 days ago - 1 dependent repositories - 48 downloads total - 3 stars on GitHub - 1 maintainer
Top 6.4% on packagist.org
14 versions - Latest release: about 8 years ago - 3 dependent packages - 9 dependent repositories - 30.9 thousand downloads total - 10 stars on GitHub - 1 maintainer
tomverran/robots-txt-checker 1.12.1
Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a...14 versions - Latest release: about 8 years ago - 3 dependent packages - 9 dependent repositories - 30.9 thousand downloads total - 10 stars on GitHub - 1 maintainer
brittainmedia/phpcrawl 0.10.1
PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-...26 versions - Latest release: about 1 year ago - 2 dependent packages - 1 dependent repositories - 2.94 thousand downloads total - 9 stars on GitHub - 1 maintainer
artplus_f/browscap
The standalone PHP Browscap parser Crossjoin\Browscap detects browser properties as well as devic...Latest release: 28 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
kvazar/crawler
KVAZAR Index CrawlerLatest release: 28 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
nirjharlo/complete-google-seo-scan v3.5
WordPress Plugin with inbuilt SEO crawler2 versions - Latest release: over 2 years ago - 7 downloads total - 2 stars on GitHub - 1 maintainer
marabesi/social-crawler v0.0.1
Easy way to find emails through social networks1 version - Latest release: over 5 years ago - 4 downloads total - 2 stars on GitHub - 1 maintainer
blackfire/player v2.6.0
A powerful web crawler and web scraper with Blackfire support98 versions - Latest release: about 1 month ago - 1 dependent repositories - 16 thousand downloads total - 484 stars on GitHub - 1 maintainer
yggverse/yggstate
Yggdrasil Network ExplorerLatest release: 30 days ago - 0 downloads total - 0 stars on GitHub - 2 maintainers
cable8mm/water-melon v1.1.3
Water Melon is simple melon.com api sdk for php5 versions - Latest release: 3 months ago - 2.47 thousand downloads total - 16 stars on GitHub - 1 maintainer
szczyglis/php-ultra-small-proxy v2.1.2
Light-weight proxy with full support for sessions, cookies, POST/FORMS submiting and URLs rewriting3 versions - Latest release: about 2 years ago - 69 downloads total - 5 stars on GitHub - 1 maintainer
hansputera/se-crawler
Search Engine Scraper/CrawlerLatest release: about 1 month ago - 7 downloads total - 1 stars on GitHub - 1 maintainer
commencement.technology/botcheck 1.0.1
The package which identify the Bot or Crawler which help to identify the how many bots or crawler...2 versions - Latest release: over 1 year ago - 3 downloads total - 0 stars on GitHub - 1 maintainer
mediamonks/crawler-bundle v1.0.0
Integrates the mediamonks/crawler package into Symfony1 version - Latest release: over 7 years ago - 41 downloads total - 7 stars on GitHub - 1 maintainer
zrashwani/news-scrapper 1.0.3
scrapping news data from a webpage using structured data6 versions - Latest release: almost 7 years ago - 256 downloads total - 13 stars on GitHub - 1 maintainer
open20/open2-crawler 1.3.0
An full search page crawler to enable complex and customized searching abilities.6 versions - Latest release: about 1 year ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
chemaclass/stock-ticker
An API to gather the latest info from your stocksLatest release: about 1 month ago - 1 downloads total - 3 stars on GitHub - 1 maintainer
koffleart/crawler 4.7.2 💰
Crawl all internal links found on a website79 versions - Latest release: about 4 years ago - 2 downloads total - 0 stars on GitHub - 1 maintainer
friends-of-hyva/magento2-crawler-session 1.0.1
Prevent crawlers from creating a session2 versions - Latest release: 2 months ago - 55 downloads total - 6 stars on GitHub - 2 maintainers
gpupo/camelspider 1.0 abandoned
A class to help handle gateways to processing entities.1 version - Latest release: almost 9 years ago - 4 dependent repositories - 1 downloads total - 10 stars on GitHub - 1 maintainer
danielbrendel/rfcrawler removed
PHP Reddit Feed CrawlerLatest release: 6 months ago - 49 downloads total - 0 stars on GitHub - 1 maintainer
aleksandrhorkavyi/yii2-crawler removed
Crawler based on Selenium webdriverLatest release: about 1 year ago - 14 downloads total - 0 stars on GitHub - 1 maintainer
aleksandrhorkavyi/yii2-crawler-dashboard removed
Crawler dashboardLatest release: about 1 year ago - 2 downloads total - 0 stars on GitHub - 1 maintainer
jfcherng/wiki-cgroup-crawler 1.2.6 removed
此腳本用於抓取維基百科的公共轉換組詞庫，並將結果儲存為外部檔案。20 versions - Latest release: about 5 years ago - 2 downloads total - 1 stars on GitHub
bogddan/laravel-crawler-detect removed
A Laravel package to detect web crawlers via the user agentLatest release: about 1 year ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
utahapi/link-checker removed
Check all linksLatest release: over 1 year ago - 2 downloads total - 0 stars on GitHub - 1 maintainer
dr4g0nsr/sitemap-crawler 1.0 removed
Crawler for any type of site using robots.txt and sitemap.xml as the source of URL. Useful for ca...1 version - Latest release: over 1 year ago - 20 downloads total - 2 stars on GitHub - 1 maintainer
richardchey/fund 1.0.0 removed
Collect fund data1 version - Latest release: almost 9 years ago - 17 downloads total - 1 maintainer
hekmatinasser/selector removed
This Package helps developers to select element html in PHPLatest release: about 2 years ago
Related Keywords
php
122
spider
62
scraper
47
scraping
28
crawling
23
laravel
23
parser
22
http
17
website
17
bot
16
curl
15
symfony
15
seo
15
hacktoberfest
15
dom
14
api
13
link
12
search
12
html
12
library
11
scrape
11
spatie
11
yii2
10
Sitemap
9
detect
9
web
9
crawl
8
composer
8
module
8
extension
7
framework
6
bundle
6
google
6
browser
6
scrapper
6
webcrawler
6
yii
6
robot
6
user-agent
6
robots.txt
6
luya
6
typo3
6
parse
5
php crawler detect
5
crawler detector
5
crawlerdetect
5
xml
5
crawler detect
5
bots
5
domcrawler
5
url
5
news
5
robots-txt
5
extractor
5
scraping-websites
5
index
5
luya-module
4
webservice client
4
last.fm
4
webservice-client
4
content
4
request
4
web-crawler
4
lastfm
4
QueryList
4
phpQuery
4
json
4
symfony-bundle
4
health
4
asynchronous
4
php-crawler
4
stock
3
rss
3
indexer
3
crwlr
3
web-crawling
3
web-scraping
3
web crawler
3
guzzle
3
extract
3
Harvest
3
Match
3
mining
3
cache
3
selector
3
instagram
3
console
3
cache-warmup
3
laravel-package
3
sitemap
3
seo-optimization
3
webscraping
3
async
3
internet
3
user agent
3
device
3
robots
3
data
3
matcher
3
checker
3