Web & SEO Tools ›
Robots.txt Generator
Generate a clean robots.txt file by picking which user agents to allow or block, and where your sitemap lives.
Private - runs in your browser
No signup required
Free forever
How to use Robots.txt Generator
- Pick allow/disallow paths.
- Add your sitemap URL.
- Copy or download the file.
Features
- Common bot presets
- Sitemap reference
- Multi-line disallow
Why use it
- Avoid syntax mistakes
- Quick start for new sites
Frequently asked questions
Where do I put robots.txt?
At the root of your domain - for example https://yourdomain.com/robots.txt.