robots.txt Generator
Build a robots.txt from user-agent rules, allow/disallow paths, and an optional sitemap URL.
Example
User-agent *, Disallow /admin, Sitemap set → a standard robots.txt block ready to host at your site root.
FAQ
Serve it at
https://yourdomain.com/robots.txt (site root).Crawl-delay is not part of the original robots.txt RFC; some crawlers honor it, others ignore it.
Markup Tools
CSS Minifier / Formatter
Format or minify CSS. Remove comments. Copy result.
JavaScript Minifier / Formatter
Beautify or minify JavaScript. Copy result.
HTML Formatter & Minifier
Pretty format or minify HTML. Indentation control and optional comment removal.
Markdown Preview
Write Markdown, see rendered preview side by side.
XML Formatter & Minifier
Pretty-print or minify XML with indentation control.
Meta Tag Generator
Generate HTML meta and Open Graph tags from title and description.