Skip to content

fix(seo): keep schematic downloads out of the search index - #610

Merged
TheMeinerLP merged 1 commit into
mainfrom
fix/schematic-download-headers
Nov 7, 2026
Merged

TheMeinerLP merged 1 commit into
mainfrom
fix/schematic-download-headers

Conversation

@TheMeinerLP

@TheMeinerLP TheMeinerLP commented Nov 7, 2026 •

Copy link
Copy Markdown
Collaborator

Problem

Search Console listed the Minecraft schematic downloads on POI pages (.schem and .litematic builds, around 10 MB each) under "Crawled - currently not indexed". Google treated the build files as pages: they were served without a content type or a robots header, so nothing told crawlers they are downloads.

Change

Each schematic download now declares itself as an attachment that should not be indexed: X-Robots-Tag: noindex, application/octet-stream and Content-Disposition: attachment. The rules name the four files one by one, so the cover and progress images next to them, which POI pages embed, keep their normal type. The POI pages themselves (/en/…, /de/…) are not affected.

Verification

  • tests/seo/schematic-download-headers.spec.ts checks that every schematic file has its own noindex rule and that no splat rule exists.
  • Production build and wrangler dev on .output: a schematic download returns the new headers; /community-poi/labyrinth/cover.webp returns image/webp without attachment or noindex; /en/community-poi/maze still returns index, follow.
  • pnpm quality: no regression.

@TheMeinerLP
TheMeinerLP force-pushed the fix/schematic-download-headers branch from aac0bc2 to 931fa4e Compare November 7, 2026 17:47
@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Nov 7, 2026 •

Copy link
Copy Markdown

Deploying with  Cloudflare Workers  Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status Name Latest Commit Preview URL Updated (UTC)
✅ Deployment successful!
View logs
launchpad 931fa4e Commit Preview URL

Branch Preview URL
Nov 07 2026, 05:49 PM

@TheMeinerLP
TheMeinerLP merged commit f5be15c into main Nov 7, 2026
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant