Robots.txt生成器

生成robots.txt文件

浏览器处理您的数据绝不离开浏览器

User Agents

Sitemaps

Enter sitemap URLs, one per line

Quick Templates

robots.txt Preview

User-agent: *
Disallow: /private
Disallow: /admin

Sitemap: https://example.com/sitemap.xml

About robots.txt

The robots.txt file tells search engine crawlers which pages or files they can or cannot request from your site. Place the file in the root directory of your website (e.g., example.com/robots.txt).

About Robots.txt生成器

生成robots.txt文件

Use this free online 生成器 tool to work faster without installing extra software. The interface is built for quick input, clear output, and straightforward results on desktop and mobile devices.

Processing

This tool runs in your browser whenever possible, which keeps your inputs private and reduces unnecessary round-trips to the server.