🤖 Robots.txt Generator
Basic settings
Sitemap URL
Crawler delay (seconds, optional)
Quick preset
Allow all
Forbidden All
Custom rules
Custom rules
User-Agent
All crawlers (*)
Googlebot
Bingbot
Baidu Spider
Sogou Spider
Allow
Disallow
Delete
+ Add rule
Generated robots.txt
Copy code
Tools
About
Privacy
Feedback
Guides