Awaidah
Sign in

SEO

Robots.txt & Sitemap Starter

Generate a robots.txt and a starter XML sitemap for a domain.

All tools

robots.txt

User-agent: *
Allow: /
User-agent: GPTBot
Allow: /
User-agent: Google-Extended
Allow: /
Sitemap: https://awaidah.com/sitemap.xml

sitemap.xml

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <url>
    <loc>https://awaidah.com/</loc>
  </url>
  <url>
    <loc>https://awaidah.com/blog</loc>
  </url>
  <url>
    <loc>https://awaidah.com/about</loc>
  </url>
  <url>
    <loc>https://awaidah.com/tools</loc>
  </url>
</urlset>