Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

packagist.org "robots-txt" keyword

sobak/scrawler v0.3.0
Scrawler is an extensible, declarative web robot and scrapper
3 versions - Latest release: almost 5 years ago - 11 downloads total - 10 stars on GitHub - 1 maintainer
Top 0.8% on packagist.org
spatie/robots-txt 2.2.0 💰
Determine if a page may be crawled from robots.txt and robots meta tags
20 versions - Latest release: 22 days ago - 19 dependent packages - 813 dependent repositories - 7.91 million downloads total - 212 stars on GitHub - 1 maintainer
Top 4.8% on packagist.org
tractorcow/silverstripe-robots 4.1.0
Simple robots generation module for Silverstripe
6 versions - Latest release: 9 months ago - 6 dependent packages - 30 dependent repositories - 70.8 thousand downloads total - 13 stars on GitHub - 1 maintainer
figuren-theater/ft-seo 1.2.0
Integrations dedicated to search engines and social media plattforms for all sites of the WordPre...
3 versions - Latest release: 3 months ago - 1 dependent package - 0 downloads total - 0 stars on GitHub - 1 maintainer
schliesser/sitecrawler v2.0.1
TYPO3 sitemap crawler
7 versions - Latest release: about 1 year ago - 1 dependent repositories - 19.8 thousand downloads total - 10 stars on GitHub - 1 maintainer
Top 2.4% on packagist.org
t1gor/robots-txt-parser v0.2.5
PHP class to parse robots.txt rules according to Google, Yandex, W3C and The Web Robots Pages spe...
6 versions - Latest release: over 3 years ago - 4 dependent packages - 20 dependent repositories - 406 thousand downloads total - 82 stars on GitHub - 2 maintainers
fifty-deg/sylius-robots-plugin v1.0.1
Channel defined robots.txt plugin for Sylius.
2 versions - Latest release: 9 months ago - 2.24 thousand downloads total - 0 stars on GitHub - 1 maintainer
bnomei/kirby3-robots-txt 1.8.0 💰
Manage the robots.txt from the Kirby config file
23 versions - Latest release: 5 months ago - 1 dependent package - 6 dependent repositories - 32.8 thousand downloads total - 19 stars on GitHub - 1 maintainer
Top 8.4% on packagist.org
marcortola/behat-seo-contexts 4.0.0
Behat extension for testing some On-Page SEO factors: meta title/description, canonical, hreflang...
12 versions - Latest release: over 1 year ago - 11 dependent repositories - 88.3 thousand downloads total - 12 stars on GitHub - 1 maintainer
ranvis/robots-txt-processor v1.0.2
robots.txt filter and tester for untrusted source.
3 versions - Latest release: over 2 years ago - 1 dependent repositories - 19 downloads total - 1 stars on GitHub - 1 maintainer
Top 9.1% on packagist.org
vipnytt/useragentparser v1.0.5
User-Agent parser for robot rule sets
9 versions - Latest release: about 3 years ago - 3 dependent packages - 25 dependent repositories - 707 thousand downloads total - 1 stars on GitHub - 1 maintainer
mguinea/laravel-robots 3.1.1
Laravel package to manage robots in an easy way
15 versions - Latest release: about 3 years ago - 2 dependent repositories - 35.6 thousand downloads total - 13 stars on GitHub - 1 maintainer
steein/robots 1.4
Generator robots.txt
5 versions - Latest release: over 6 years ago - 1 dependent repositories - 6.33 thousand downloads total - 2 stars on GitHub - 1 maintainer
eliashaeussler/typo3-sitemap-robots 0.1.2 💰
Extension for TYPO3 CMS to enhance robots.txt with sitemap configurations
3 versions - Latest release: 2 months ago - 690 downloads total - 0 stars on GitHub - 1 maintainer
mortola/behat-seo-contexts 4.0.0
Behat extension for testing some On-Page SEO factors: meta title/description, canonical, hreflang...
12 versions - Latest release: over 1 year ago - 5.29 thousand downloads total - 13 stars on GitHub - 1 maintainer
innmind/robots-txt 6.2.0
Robots.txt parser
9 versions - Latest release: 6 months ago - 1 dependent package - 1 dependent repositories - 407 downloads total - 0 stars on GitHub - 1 maintainer
fuelviews/laravel-robots-txt v0.0.1-RC3 💰
Fuelviews laravel robots.txt package
3 versions - Latest release: about 2 months ago - 13 downloads total - 0 stars on GitHub - 2 maintainers
crwlr/robots-txt v1.1.1
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
6 versions - Latest release: over 1 year ago - 1 dependent package - 1 dependent repositories - 5.36 thousand downloads total - 8 stars on GitHub - 1 maintainer
Top 3.7% on packagist.org
vipnytt/robotstxtparser v2.1.0
Robots.txt parsing library, with full support for every directive and specification.
12 versions - Latest release: about 3 years ago - 5 dependent packages - 16 dependent repositories - 551 thousand downloads total - 24 stars on GitHub - 1 maintainer
razorcreations/nova-robots-editor 2.0.0
A Laravel Nova tool.
4 versions - Latest release: about 2 years ago - 7.29 thousand downloads total - 0 stars on GitHub - 1 maintainer
php-middleware/block-robots 1.1.0
PSR-15 middleware to avoid search engine indexing with PSR-7
3 versions - Latest release: about 7 years ago - 33.2 thousand downloads total - 5 stars on GitHub - 1 maintainer
middlewares/robots v2.0.1
Middleware to enable/disable the robots of the search engines
10 versions - Latest release: over 3 years ago - 1 dependent repositories - 8.78 thousand downloads total - 4 stars on GitHub - 1 maintainer
phrozenbyte/pico-robots v1.0.0
This is Pico's official robots plugin to add a robots.txt and sitemap.xml to your website. Pico i...
1 version - Latest release: over 6 years ago - 1 dependent repositories - 779 downloads total - 8 stars on GitHub - 1 maintainer
nepttune/robots v2.0.2
Robots generator component
9 versions - Latest release: over 4 years ago - 1 dependent package - 5.22 thousand downloads total - 2 stars on GitHub - 1 maintainer
tekord/robots-txt-provider 1.0
Provides various framework-agnostic ways to generate the contents of the robots.txt file
1 version - Latest release: almost 3 years ago - 3 downloads total - 0 stars on GitHub - 1 maintainer
schnti/robots 1.0.0
simple kirby robots.txt plugin
2 versions - Latest release: about 1 year ago - 1 dependent package - 469 downloads total - 1 stars on GitHub - 1 maintainer
becklyn/robots-txt 1.1.0
A library to build robots.txt
5 versions - Latest release: about 2 years ago - 6.14 thousand downloads total - 2 stars on GitHub - 1 maintainer
alexonbstudio/website-project 2.0.8 removed
Website Project WP | No DB requirement
11 versions - Latest release: about 3 years ago - 1 stars on