Sitemap & Crawlers

Two core features for search engines and bots. Sitemap generates XML and HTML sitemaps, optionally on a schedule, from static pages, entities, publishing posts and shop products. Crawlers controls a global noindex switch, per-bot-group access that drives the generated robots.txt, a generated llms.txt for AI assistants, and search-engine verification meta tags.

Use it when

• You want sitemaps regenerated automatically as content changes
• You need to block a staging site from indexing or decide which bot groups may crawl

What it gives you

• XML and HTML sitemap generation with scheduled regeneration
• Sitemap sources: static pages, entities, publishing, posts, shop
• Generated robots.txt from per-bot-group access toggles, with optional application-level blocking
• Generated llms.txt served at /llms.txt
• Global noindex, nofollow switch and Google/Bing verification meta tags
• Settings at /admin/settings/sitemap and /admin/settings/crawlers

Nothing posted about Sitemap & Crawlers yet. Read its changelog or see all PhoenixKit news.