Trusted by 10,000+ marketers

  • Private planning
  • Instant access
  • Publication insights

Find your next useful tool

Popular tools and guides

Technical SEO

Plan a sitemap around approved public pages

Build a sitemap from the public URLs you actually want discovered, with accurate modification information. Keep drafts, private account pages and utility endpoints out of the list. A sitemap is a discovery aid, not proof that an article has been crawled, indexed or ranked.

Illustration of technical tools, gears and chart bars

The short answer

Build a sitemap from the public URLs you actually want discovered, with accurate modification information. Keep drafts, private account pages and utility endpoints out of the list. A sitemap is a discovery aid, not proof that an article has been crawled, indexed or ranked.

A worked example

A fictional rebuild has an active catalog, a private cart and an unfinished policy page. The launch team should not include all three merely because their routes exist. The sitemap decision follows the approved public indexing plan, while a human-readable page directory can still help visitors navigate useful preview pages.

A practical checklist

  1. Separate route existence from indexing approval. Create an explicit inventory of public pages, their canonical destinations and their launch readiness.
  2. Generate entries from that inventory or published content records. Record real substantive modification dates rather than stamping every URL with the current date on each request.
  3. Check sample URLs and the submitted file on the final host. Monitor discovery and indexing through appropriate tools instead of interpreting submission as completion.

What to avoid

Avoid listing every filter combination or copying private route names into the sitemap. Do not enable production discovery for a preview simply because more articles were added. This project's migration settings remain separate from its new content and tool implementation.

A useful follow-up

Is a page directory the same as an XML sitemap?

No. A page directory serves visitors; an XML sitemap supplies discovery information to crawlers.

Sources and further reading

Sources support the referenced facts, not a business endorsement or promised outcome.

Editorial note. Review the stated author, sources and publication scope before applying this guidance. Examples are illustrative, not customer results. No ranking, citation or commercial outcome is guaranteed.

Continue with context

Related reading

A canonical URL checklist for a rebuilt website

Choose the intended public URL for each article and make its canonical metadata consistent with that destination. A canonical identifies the preferred equivalent version; it is not a shortcut for merging unrelated pages. Review URL choices before migration rather than relying on whatever route happens to render first.

Read the guide ↗

Internal links that make an article library easier to use

Link to the next explanation a reader is likely to need, using text that describes the destination. A related-reading list should connect different useful tasks rather than repeat the same question on several pages. Build navigation from the reader's decision path, not an arbitrary link quota.

Read the guide ↗

Noindex and robots.txt are different controls

Use the correct control for the actual goal: managing crawler access is different from excluding a page from search indexing. Google's documentation distinguishes robots.txt from a noindex directive. A development preview should have an explicit indexing policy, not an accidental combination of unrelated rules.

Read the guide ↗