Hello,

I am trying to have a different robots.txt depending of the environment (allow: / on production, otherwise disallow: /).

However, I did try with the robots.ts file or robots.txt/route.ts to generate it based on serverRuntimeConfig but it seems to be statically generated.

I am using app router

Here's my code

import getConfig from 'next/config';
import { resolveRobots } from 'next/dist/build/webpack/loaders/metadata/resolve-route-data';

export async function GET() {
  const { serverRuntimeConfig } = getConfig();
  const isProduction = serverRuntimeConfig.environment === 'production';
  const cacheControl = 'public, max-age=31536000'; // 31536000 seconds is approximately 1 year

  console.log(serverRuntimeConfig, isProduction);

  const headers = new Headers();
  headers.set('Cache-Control', cacheControl);
  headers.set('Content-Type', 'text/plain');

  const robots = resolveRobots({
    rules: {
      userAgent: '*',
      ...(isProduction && { allow: '/' }),
      ...(!isProduction && { disallow: '/' }),
    },
    sitemap: 'https://google.com/sitemap.xml',
  });

  return new Response(robots, { headers });
}

Thanks in advance! 🙏