Troubleshooting Nuxt Robots
Debugging
Nuxt DevTools. The best tool for debugging is the Nuxt DevTools integration with Nuxt Robots. This will show you the current robot rules and your robots.txt file.
The panel needs the nuxtseo-devtools-host package as a dev dependency. Install it with pnpm add -D nuxtseo-devtools-host, then restart the dev server.
Debug config. You can enable the debug option which will give you more granular output. This is enabled by default in development mode.
Google still uses the previous rules
Check the deployed robots.txt response first. Google generally caches robots.txt for up to 24 hours, and fetch errors can extend caching. Compare its robots.txt report with your current response.
Google Search timelines explains why Google may still use earlier rules after your live file changes.
Debugging Tools
- Robots.txt Generator & Tester - Validate your robots.txt output and test against Googlebot, GPTBot, ClaudeBot and 50+ user agents
Submitting an Issue
When submitting an issue, it's important to provide as much information as possible.
The easiest way to do this is to create a minimal reproduction using the StackBlitz playgrounds: