npmjs.org : @webstandard/robots
A standards-compliant generator for producing robots.txt files
Registry
- Homepage
- JSON
purl: pkg:npm/%40webstandard/robots
Keywords:
robots.txt
, robots
, sitemap
, seo
, search-engines
, crawler
, crawl-rules
, fluent-api
, javascript
, web
, automation
, web-crawling
, web-scraping
, site-indexing
, robots-txt-generator
License: Apache-2.0
Latest release: 1 day ago
First release: 1 day ago
Namespace: webstandard
Last synced: 1 day ago
Loading...
Readme
Loading...