Searchtern/Tools/Robots.txt Generator Robots.txt Generator Default - All Robots are: Allowed Disallowed Crawl-Delay (seconds): Sitemap URL: Search Robots: Google: Default Allow Disallow Bing: Default Allow Disallow Yahoo: Default Allow Disallow Baidu: Default Allow Disallow URL Directories (one per line, e.g., /admin/): Generated robots.txt: Copy robots.txt Other Popular SEO Tools AI Meta Title & Description Generator Redirect Checker Heading Checker Canonical Checker Paraphrasing Tool Schema Markup Generator PNG to JPG Converter WebP to PNG Convertor Compress Images Text-to-HTML Ratio Checker Google Ads AI Ad Copywriter