Sitemap Directive (robots.txt)

Definition

The Sitemap directive in robots.txt declares the absolute URL of an XML sitemap so crawlers can discover the site’s URL list.

By Vinespire Editorial Team, Editorial ·

See our sourcing methodology →

Crawlers & botsAI search glossary

This term is part of the full AI search glossary.

Full definition

A line such as Sitemap: https://example.com/sitemap.xml may appear outside User-agent groups and points crawlers to one or more sitemap files. Multiple Sitemap lines are allowed. The directive complements—but does not replace—submitting sitemaps in Search Console-style tools.

Listing a sitemap does not guarantee indexing of every URL. Keep sitemaps accurate, exclude non-canonical junk, and ensure referenced URLs return healthy status codes.

AI and search crawlers that read robots.txt can use the directive as a discovery hint for documentation and product URLs important to GEO. See Sitemap, lastmod, and robots.txt.

Example

Sitemap: https://example.com/sitemap.xml Sitemap: https://example.com/news-sitemap.xml

← All glossary terms