robots.txt Generator

Check common rules and generate robots.txt text.

robots.txt

User-agent: *
Allow: /
Disallow: /admin/
Disallow: /private/
Sitemap: https://example.com/sitemap.xml