🤖 Robots.txt Generator

Generate and validate robots.txt files to control search engine crawling

Mode

Template

Rules

User-agent

Disallow Paths

Allow Paths

Sitemap URL (Optional)

Crawl Delay (seconds, optional)

About robots.txt:

Place robots.txt in your website's root directory (https://example.com/robots.txt)
Use * to apply rules to all bots, or specify bot names like Googlebot
Disallow blocks paths, Allow can override for specific subdirectories
Test with Google Search Console's robots.txt Tester
robots.txt is publicly accessible - don't use it to hide sensitive content

🔒

This tool requires lifetime premium access. Get unlimited access to all premium tools with a one-time payment!