Robots.txt Generator
Build a robots.txt file for your site.
About this tool
Build a valid robots.txt file to control how search engine crawlers access your site.
Key Features
- Allow or disallow all
- Custom disallow paths
- Sitemap directive
- Copy-ready output
How to Use
- Choose a default policy.
- Add any paths to block.
- Generate and upload to your site root.
Benefits
- Guide search crawlers
- Protect private areas
- Point bots to your sitemap
Frequently Asked Questions
Place it at the root of your domain, e.g. https://example.com/robots.txt.