Next.js Discord

Discord Forum

Why is .next folder indexable by robots?

Answered
New Guinea Freshwater Crocodile posted this in #help-forum
Open in Discord
New Guinea Freshwater CrocodileOP
As written in the title I want to know if it's a 'normal' behavior for next to show .next folder to bot like google and if I have to disallow it with robots.txt or it's a dangerous way for SEO?
Answered by New Guinea Freshwater Crocodile
Thank you for your reply. For the moment I've just added this to my robots.txt
# *
User-agent: *
Allow: /

# *
User-agent: *
Disallow: /.next/
View full answer

13 Replies

riský
it should be fine unless google actually shows the contents on search, if its just in dashboard than they are just waisting resources
and it can be slightly bad as they give every site a crawl budget, but aside from blocking googlebot there, i don't think you should stress
New Guinea Freshwater CrocodileOP
Thank you for your reply. For the moment I've just added this to my robots.txt
# *
User-agent: *
Allow: /

# *
User-agent: *
Disallow: /.next/
Answer
riský
i think that should be fine as i don't think any actual user browser check robots
New Guinea Freshwater CrocodileOP
Good to know Thank you again 😅
riský
im still superised google even considered indexing some of that

but if you think this thread as solved as possible then mark it as solved so others dont try and help/can maybe see that its not too bad (its up to you tho)
New Guinea Freshwater CrocodileOP
No It's not google that index this i've just seen it has reachable by crawler so it intrigued me. But yes that"s solved thanks to you
How do I add the tag?
riský
just wondernig which page showed you it... like the normal page view 😭
@riský just wondernig which page showed you it... like the normal page view 😭
riský
oh i see it lots for mine 😭
@riský oh i see it lots for mine 😭
New Guinea Freshwater CrocodileOP
I've quite the same ^^
riský
@New Guinea Freshwater Crocodile btw i think i have just discoverd that you should keep it being index because: https://twitter.com/cramforce/status/1763338011440558273 (tho nextjs ssr is good, it can't hurt for google to get best version)