robots.txt generator

Allowed and blocked paths - a ready robots.txt appears instantly.

Disallow paths (one per line)

Allow paths (one per line, optional)

Sitemap URL (optional)

Output

robots.txt tells search engine crawlers which paths to skip. Block private and internal folders, allow what should be indexed, and point to your sitemap. All in your browser.