Robots.txt Generator — Allow/Disallow Rules & Sitemaps
Build a robots.txt file with allow/disallow rules, crawl-delay, and sitemap URLs. Copy or download the result. 100% browser-based — your config stays private.
Keywords: robots.txt generator, robots txt, seo robots, crawl rules, search engine bots, sitemap
Frequently Asked Questions
Where should robots.txt be placed?
Robots.txt should live at the root of your domain (e.g., https://example.com/robots.txt).
Does robots.txt block indexing?
It tells crawlers what they may access, but it doesn't guarantee removal from search results.
Should I include a sitemap?
Yes. Including a sitemap URL helps search engines discover your pages faster.