Yandex: Clean-param
Nuxt Robots is built around first-party robots.txt specifications from Google and Bing.
Some users may want to configure Yandex, a popular search engine in Russia, and find that rules aren't working. To use Yandex you will need to provide alternative directives.
Clean-param
The
It can either be configured directly through robots.txt when targeting Yandex or through the module configuration.
Robots.txt
To configure the
User-agent: Yandex
Clean-param: param1 param2
This will remove the
Module Configuration
To configure the
export default defineNuxtConfig({
robots: {
groups: [
{
userAgent: ['Yandex'],
cleanParam: ['param1', 'param2']
}
]
}
})
Host & Crawl-delay
These directives are deprecated and should not be used. All search engines will ignore them.