Everyday I have a script build my sitemaps and Ive added them in Google Search Console. But after months, its still 0 pages discovered :For example I have this sitemaps for users : https://recomend.app/sitemaps/users/0.xml.gz 2026-06-07 And after something like : https://recomend.app/@loup 2026-04-27T08:12:05.348064 0.6 https://recomend.app/@yozer 2026-04-12T14:54:16.532520 0.6 https://recomend.app/@clemggn 2026-04-16T20:13:42.896964 0.6 https://recomend.app/@safresh 2026-03-31T09:28:45.568701 0.6 https://recomend.app/@lab_arthe 2025-01-01T15:24:46.307980 0.6 https://recomend.app/@meymey 2024-10-27T18:15:23.519259 0.6 https://recomend.app/@skixio 2024-11-07T00:57:36.820655 0.6 https://recomend.app/@mariec 2024-11-07T16:52:18.991859 0.6 https://recomend.app/@naialine Also my website 2 years ago had around 10k pages in Google Search Console, now only 2 which is crazy 😂 . I dont understand how we are supposed to debug without waiting 5 months to now if its worse or better...Thx for your help !

Why Google can't read my sitemaps ?

Unanswered

Pacific herring posted this in #help-forum

Pacific herringOP

2026-06-09T16:37:37.726Z

Everyday I have a script build my sitemaps and Ive added them in Google Search Console. But after months, its still 0 pages discovered :
For example I have this sitemaps for users :

<?xml version="1.0" encoding="UTF-8"?><sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"><sitemap><loc>https://recomend.app/sitemaps/users/0.xml.gz</loc><lastmod>2026-06-07</lastmod></sitemap></sitemapindex>

And after something like :

<?xml version="1.0" encoding="UTF-8"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"><url><loc>https://recomend.app/@loup</loc><lastmod>2026-04-27T08:12:05.348064</lastmod><priority>0.6</priority></url><url><loc>https://recomend.app/@yozer</loc><lastmod>2026-04-12T14:54:16.532520</lastmod><priority>0.6</priority></url><url><loc>https://recomend.app/@clemggn</loc><lastmod>2026-04-16T20:13:42.896964</lastmod><priority>0.6</priority></url><url><loc>https://recomend.app/@safresh</loc><lastmod>2026-03-31T09:28:45.568701</lastmod><priority>0.6</priority></url><url><loc>https://recomend.app/@lab_arthe</loc><lastmod>2025-01-01T15:24:46.307980</lastmod><priority>0.6</priority></url><url><loc>https://recomend.app/@meymey</loc><lastmod>2024-10-27T18:15:23.519259</lastmod><priority>0.6</priority></url><url><loc>https://recomend.app/@skixio</loc><lastmod>2024-11-07T00:57:36.820655</lastmod><priority>0.6</priority></url><url><loc>https://recomend.app/@mariec</loc><lastmod>2024-11-07T16:52:18.991859</lastmod><priority>0.6</priority></url><url><loc>https://recomend.app/@naialine</loc>

Also my website 2 years ago had around 10k pages in Google Search Console, now only 2 which is crazy 😂 . I dont understand how we are supposed to debug without waiting 5 months to now if its worse or better...
Thx for your help !

21 Replies

B33fb0n3

2026-06-09T19:25:47.455Z

how do you generate your sitemap? via npm next-sitemap?

@B33fb0n3 how do you generate your sitemap? via npm `next-sitemap`?

Pacific herringOP

2026-06-09T20:50:36.544Z

Well no, I build my sitemap with python script because there is to many element to calculate. For example i have 1 millions movies, 4 millions personnalities, so I have to build .xml file each day with script

@Pacific herring Well no, I build my sitemap with python script because there is to many element to calculate. For example i have 1 millions movies, 4 millions personnalities, so I have to build .xml file each day with script

B33fb0n3

2026-06-09T21:08:26.628Z

nextjs can handle that too using indexed sitemaps, so I wonder why an extra python script is needed to create that many elements and calculations: https://nextjs.org/docs/app/api-reference/file-conventions/metadata/sitemap#generating-multiple-sitemaps

When thats solved, then you get your sitemap with the correct links and google can index the index sitemaps, that then refers to the actual sitemaps, that contain the 5 million links. Like that google will index all index sitemaps and like that also all the links

@B33fb0n3 nextjs can handle that too using indexed sitemaps, so I wonder why an extra python script is needed to create that many elements and calculations: https://nextjs.org/docs/app/api-reference/file-conventions/metadata/sitemap#generating-multiple-sitemaps When thats solved, then you get your sitemap with the correct links and google can index the index sitemaps, that then refers to the actual sitemaps, that contain the 5 million links. Like that google will index all index sitemaps and like that also all the links

Pacific herringOP

2026-06-10T08:20:16.498Z

Ive alrerady try using only nextjs but it was too slow to generate compare to using a python script on powerful computer just during the build

I was wondering which should I use :

ContentType='application/xml',
ContentEncoding='gzip'

or :

ContentType='application/gzip'

B33fb0n3

2026-06-10T09:43:49.542Z

I like to use the xml format. But does your python generated Sitemaps contain all the desired links? And do you have indexed Sitemaps?

@B33fb0n3 I like to use the xml format. But does your python generated Sitemaps contain all the desired links? And do you have indexed Sitemaps?

Pacific herringOP

2026-06-10T12:52:46.745Z

yes my script generate every indexed sitempas. For example :
https://recomend.app/sitemaps/persons/index.xml.gz

And after I have :
https://recomend.app/sitemaps/persons/0.xml.gz
https://recomend.app/sitemaps/persons/1.xml.gz

@Pacific herring yes my script generate every indexed sitempas. For example : https://recomend.app/sitemaps/persons/index.xml.gz And after I have : https://recomend.app/sitemaps/persons/0.xml.gz https://recomend.app/sitemaps/persons/1.xml.gz

B33fb0n3

2026-06-10T13:36:35.542Z

Alr, then change to normal xml Sitemaps (without .gz) at the end and submit them like you normally do to the search console. Do you know see „detected X pages“?

@B33fb0n3 Alr, then change to normal xml Sitemaps (without .gz) at the end and submit them like you normally do to the search console. Do you know see „detected X pages“?

Pacific herringOP

2026-06-10T16:18:07.336Z

It should be instant ?

@Pacific herring It should be instant ?

B33fb0n3

2026-06-11T06:06:01.259Z

At least for me it’s always nearly instant. Like 5 seconds or something like that

B33fb0n3

2026-06-13T04:29:42.480Z

@Pacific herring ?

Mahmood | full-stack

2026-06-13T05:12:27.514Z

One thing I'd verify right away is what Google actually receives when it fetches that sub-sitemap URL.

Since Search Console shows the sitemap is processed successfully but still discovers 0 pages, I'd want to confirm it's not a delivery or response mismatch issue.

Could you try running a quick check on one of the child sitemaps?

``bash
curl -I https://recomend.app/sitemaps/users/0.xml.gz

I'd mainly look at:

- Content-Type (is it actually

application/x-gzip` or something else?)
- Any redirects happening
- Whether it's possibly serving a fallback HTML page instead of the actual file

What do the response headers look like?

@Mahmood | full-stack One thing I'd verify right away is what Google actually receives when it fetches that sub-sitemap URL. Since Search Console shows the sitemap is processed successfully but still discovers 0 pages, I'd want to confirm it's not a delivery or response mismatch issue. Could you try running a quick check on one of the child sitemaps? bash curl -I https://recomend.app/sitemaps/users/0.xml.gz I'd mainly look at: - Content-Type (is it actually `application/x-gzip` or something else?) - Any redirects happening - Whether it's possibly serving a fallback HTML page instead of the actual file What do the response headers look like?

B33fb0n3

2026-06-13T07:41:15.369Z

just to make sure: AI responses are against the rules. Stay safe

@B33fb0n3 just to make sure: AI responses are against the rules. Stay safe

Mahmood | full-stack

2026-06-13T08:18:14.714Z

Yes, I think the way I phrased things gave you that impression. You are partially right; I only used that style to organize my thoughts and make the text easier to read. However, if it violates the rules or causes issues, I won't use it again—even if the text ends up looking very long. Thanks for pointing that out!

@B33fb0n3 <@451257549589577728> ?

Pacific herringOP

2026-06-13T15:15:51.782Z

Sry for the late, well when I resend the same url sitemap, google not refresh at all. But for example I have this one, which contain :

<sitemapindex>
<sitemap>
<loc>https://recomend.app/sitemaps/statics.xml</loc>
</sitemap>
<sitemap>
<loc>https://recomend.app/sitemaps/movies/index.xml.gz</loc>
</sitemap>
<sitemap>
<loc>
https://recomend.app/sitemaps/tv-series/index.xml.gz
</loc>
</sitemap>
<sitemap>
<loc>https://recomend.app/sitemaps/persons/index.xml.gz</loc>
</sitemap>
<sitemap>
<loc>https://recomend.app/sitemaps/users/index.xml.gz</loc>
</sitemap>
<sitemap>
<loc>
https://recomend.app/sitemaps/playlists/index.xml.gz
</loc>
</sitemap>
</sitemapindex>

But Google see nothing...

I really need the xml because without sitempa gonna be to big in size

The weird stuff its google find only for 2 sitemaps but not for others like the one with user which is the pretty much the same in term of size

Btw googe dont index all playlists he find in sitemap. Why ? no ideeeaaa (1 page indexed aahah)

@Pacific herring Btw googe dont index all playlists he find in sitemap. Why ? no ideeeaaa (1 page indexed aahah)

Mahmood | full-stack

2026-06-13T16:16:43.243Z

Google is reading the sitemaps, but most URLs are being filtered out during indexing due to quality/trust signals, not sitemap parsing issues. The fact that some sections (like playlists/statistics) still get indexed confirms this is selective indexing, not a technical ingestion problem.

@Pacific herring Btw googe dont index all playlists he find in sitemap. Why ? no ideeeaaa (1 page indexed aahah)

B33fb0n3

2026-06-13T17:20:19.351Z

if you scroll a bit down then you can see why a lot of pages are not indexed right now. Can you share that?

B33fb0n3

2026-06-15T05:14:46.729Z

@Pacific herring ?