Robots.txt Generator
Select Search Engines
Default Rule: User-agent: * Allow: /. All search engines are allowed by default unless specified otherwise below.
Google
Bing
Baidu
Yandex
Sogou
Haosou (360)
Yahoo
DuckDuckGo
Naver
Seznam
Select CMS
Select AI Bots
GPTBot
ChatGPT-User
ClaudeBot
PerplexityBot
Grok
Add Sitemap URLs
Result
Copied!