Home
Dev
SEO
Design
Home
SEO & Marketing
Robots.txt Generator
Robots.txt Generator
Build a robots.txt file to control crawler access
Sitemap URL
Crawl Delay
(optional)
Rules
Add Rule
All bots (*)
Googlebot
Bingbot
GPTBot
CCBot
anthropic-ai
Disallow
Allow
Quick add
+ Block AI bots
+ Block /admin
+ Block /wp-admin
+ Allow all
Generated robots.txt
User-agent: * Disallow: /admin
Copy
Download robots.txt
☕
Buy me a coffee
Coffee