# Robots.txt Generator

> Generate a valid robots.txt with allow/disallow rules, sitemap and crawl-delay. Copy and paste in seconds.

Free tool: https://mars.cx/tools/robots-txt-generator

Tell search engines what to crawl. Build a clean robots.txt with sensible defaults and your sitemap.

## How to use

1. Choose allow-all or block specific paths.
2. Add your sitemap URL.
3. Copy the robots.txt to your site root.

## FAQ

### Where does robots.txt go?

At the root of your domain, e.g. https://example.com/robots.txt

### Does it prevent indexing?

robots.txt controls crawling, not indexing. Use a noindex meta tag to keep a page out of results.

### Is it free?

Yes, free with no signup.

Provided by MarsGeo — https://mars.cx