Skip to content

fix(seo): keep thin reference and empty topic pages out of the index - #64

Merged
rafalyovson merged 1 commit into
mainfrom
t3/seo-health-review
Nov 19, 2026
Merged

rafalyovson merged 1 commit into
mainfrom
t3/seo-health-review

Conversation

@rafalyovson

Copy link
Copy Markdown
Member

Why

Search Console (export, Nov 19): 88 pages indexed, 80 not, of which 16 are "Crawled – currently not indexed" and 18 "Discovered – currently not indexed". A crawl of the live sitemap found 50 of 105 URLs were reference hubs with a median of 41 visible words (a catalog blurb plus a citing post's card) and 13 topic pages with a median of 38 (/topics/sport and /topics/poetry empty). Google has sent no clicks to any of them; all search clicks land on posts.

Causes and fixes

  • Reference hubs: hubHasOwnWords counted a citing post as the Lyovsons' own words, but the hub shows only that post's card. Now only an activity note or written review counts. The page robots tag and the sitemap share this one predicate.
  • Empty topics: these were indexable and listed in the sitemap. They are now noindex, follow and dropped from the sitemap.
  • Author pages: the [lyovson] layout's Suspense fallback rendered {children} as well as the skeleton, so each author page's HTML held its content twice: two H1s, and every card and JSON-LD block doubled (e.g. /rafa 358 KB). The fallback is now <ProfileSkeleton /> only.

Checks

  • tsc --noEmit, pnpm lint, pnpm test, pnpm seo:check: pass.
  • Read-only preview build (pnpm preview:experience:build) against a Neon dev branch copied from production today, crawl-diffed against production with the visual-review scripts:
    • Sitemap goes from 107 to 64 URLs (41 references and 2 empty topics dropped). Those pages render noindex, follow; hubs with notes (e.g. /references/siddhartha) stay index, follow.
    • /rafa headings go from 29 to 15 and JSON-LD blocks from 3 to 2, with exactly the duplicates removed and nothing added. The same holds on every /rafa/* and /jess/* page.
    • Screenshots of /rafa and /jess/posts (desktop and phone, light and dark) match production, except blob images, which the local preview rejects ("url" parameter is not allowed) on every page.
  • Playwright against the preview: 63 of 68 pass. The 5 failures also fail on unmodified main built and served the same way, at the same lines:
    • the video-pause test in all browsers (blob video fails to load locally);
    • two webkit navigation tests (public-navigation.spec.ts:113/115, :27).
  • Separately, playwright.config.ts hardcodes outputDir: /private/tmp/... (a macOS path); on Linux I ran with --output.

Review

Independent reviewer agent (Opus) on 06e4ecf..c49a910: no findings. It confirmed:

  • the sitemap and robots predicates match for references and topics;
  • the extra metadata query reuses the cached getTopicPosts entry;
  • the layout change leaves notFound handling and client navigation unchanged.

REVIEW: PASS c49a910

🤖 Generated with Claude Code

Search Console (Nov 19) shows 34 pages crawled or discovered but not
indexed, and 50 of the 105 sitemap URLs were reference hubs with about
40 visible words: a catalog blurb plus a citing post's card.

- Reference hubs count as having the Lyovsons' own words only when they
  show an activity note or written review. A citing post shows only its
  card there, and the post page is the one that should rank.
- Topics without published posts are noindex and leave the sitemap.
- The author layout's Suspense fallback rendered the page as well, so
  every author page's HTML held its content twice (two H1s, every card
  doubled for crawlers). The fallback is now the profile skeleton only.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@vercel

vercel Bot commented Nov 19, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
lyovsoncom Ready Ready Preview Nov 19, 2026 7:44pm UTC

Request Review

@rafalyovson
rafalyovson merged commit 4f0ec29 into main Nov 19, 2026
3 checks passed
@rafalyovson
rafalyovson deleted the t3/seo-health-review branch November 19, 2026 19:52

This branch was successfully deployed

1 active deployment
Preview — c49a910d Deployed Nov 19, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant