Robots.txt Generator
Create search engine crawler instructions for your website instantly.
General Settings
Sitemaps
Add your XML sitemap URLs to help search engines index your site.
Custom Rules
Advanced
robots.txt
Quick Tips
- Place the file in your root directory:
yoursite.com/robots.txt - Use
Disallow: /carefully to block entire site. - Always include your sitemap for better indexing.