robots.txt generator

One User-agent group; each line is Allow: /path or Disallow: /path. Empty path rules are ignored. Blank lines are ignored. Paths start with /, allow * and one final $, and reject whitespace, control characters, # and malformed percent escapes. Optional Sitemap is an HTTP/HTTPS address without credentials or fragment. Download the file for your own site. These rules request crawler behavior; they do not secure content or guarantee indexing.

User-agent≤1 · Allow/Disallow≤100 · /≤1024 UTF-16 · Sitemap≤1 · Input/Result≤16KiB UTF-8 · ≤5s

Your text stays here

Input and results stay in this tab's memory. No upload, browser storage, analytics, logs, URL or history data. Clear, mode change or leaving removes them. Only language/theme/consent-choice preferences may be saved.