Robots.txt Generator

Robots.txt Generator

Select Search Engines

Default Rule: User-agent: * Allow: /. All search engines are allowed by default unless specified otherwise below.

Google
Bing
Baidu
Yandex
Sogou
Haosou (360)
Yahoo
DuckDuckGo
Naver
Seznam

Select CMS

Select AI Bots

GPTBot
ChatGPT-User
ClaudeBot
PerplexityBot
Grok

Add Sitemap URLs

Result

Copied!

Select Language