Skip to content
SE Masters
Free SEO tool

Robots.txt generator

Write a correct robots.txt without guessing the syntax. Pick a template, list the paths you want kept out of search, and decide whether AI training bots get access — the file updates as you type.

  • Valid syntax guaranteed
  • AI bot controls
  • Copy or download
Book Free SEO Strategy SessionAll free tools
Run the check

Build the file, then upload it

Blocking AI training crawlers is a business decision, not an SEO one. We keep AI search crawlers allowed by default so you can still be cited in answers.

Your robots.txt

Live preview
# robots.txt generated by SEO Masters

User-agent: *
Disallow: /admin
Disallow: /cart
Disallow: /checkout

Sitemap: https://yourdomain.com.au/sitemap.xml

Upload this file to the root of your site so it lives at https://yourdomain.com.au/robots.txt.

Ready to be found everywhere people search?

Book a free 30-minute strategy session. You will leave with a clear picture of your Google and AI search opportunity — no obligation, no jargon.

Book Free SEO Strategy SessionFree Website Audit