variotools / Web / SEO / Robots.txt Generator

Robots.txt Generator

Name: Robots.txt Generator Free Online — Build robots.txt files with per-user-agent rules, sitemap and host
Availability: InStock

Build robots.txt files with per-user-agent rules, sitemap and host

Templates

Rule 1

User-agent

Allow

Disallow

Crawl-delay (seconds)

Sitemap URL

Host

robots.txt

User-agent: *
Allow: /