Disabling Indexing

When viewing your sitemap.xml for the first time, you may notice some URLs you don't want to be included.

These URLs are most likely coming from Application Sources.

If you don't want to disable these sources but want to remove these URLs you have a couple of options.

Disabling Page Indexing

If you don't want a URL in your sitemap because you don't want search engines to crawl it, then you can make use of the index route rule.

To actually block search engines, you will need to use this with the Nuxt Simple Robots module.

Disabling indexing for a pattern of URLs

If you have a pattern of URLs that you want hidden from search you can use route rules.

export default defineNuxtConfig({
  routeRules: {
    // Don't add any /secret/** URLs to the sitemap.xml
    '/secret/**': { robots: false },
  }
})

Disabling indexing for a Page

If you just have some specific pages, you can use the experimental defineRouteRules

<script setup>
defineRouteRules({
  robots: false
})
</script>

Filter URLs with include / exclude

For all other cases, you can use the include and exclude module options to filter URLs.

export default defineNuxtConfig({
  sitemap: {
    // exclude all URLs that start with /secret
    exclude: ['/secret/**'],
    // include all URLs that start with /public
    include: ['/public/**'],
  }
})

These can be regex or a string path.

It's important to know that when providing a string, you can't use variable path segments in front of static ones.

export default defineNuxtConfig({
  sitemap: {
    exclude: ['/**/secret-pages'], // this won't work
  }
})