Skip to content

fix(content): correct two citation/spec errors; fix the rule that missed one - #87

Merged
sameerkhansf merged 1 commit into
mainfrom
fix/citations-and-context-length
Sep 8, 2026
Merged

sameerkhansf merged 1 commit into
mainfrom
fix/citations-and-context-length

Conversation

@sameerkhansf

@sameerkhansf sameerkhansf commented Sep 8, 2026 •

Copy link
Copy Markdown
Owner

Three live posts corrected. Also replaces the guardrail I added in #86, because it would not have caught the case that prompted it.

1. #85 cites the wrong paper (now live)

The post lists arXiv:2506.07900 as MiniCPM5-2B's "Technical Report". I read both tags off the model card straight from arxiv.org:

ID Actual title Date
2506.07900 MiniCPM4: Ultra-Efficient LLMs on End Devices 2025-06-09
2602.09003 Data Science and Technology Towards AGI Part I: Tiered Data Management 2026-02-09

The first describes the previous generation; the second is an unrelated lab paper. Neither is a MiniCPM5 technical report, and the card links none. The post now says that outright rather than promoting the closest-looking tag.

2. "300K context" is a footnote, not a spec — in two posts

Both GLM posts state a 300K context length. That figure is the evaluation context for the HLE benchmark in the model cards' footnotes. The authoritative value from config.json:

zai-org/GLM-5.3        max_position_embeddings = 1048576
zai-org/GLM-5.3-Flash  max_position_embeddings = 1048576

Both are 1M. Z.ai's own evaluations cap context per benchmark — 300K for HLE, 400K for DeepSWE and Terminal-Bench 3.0, 1M for NL2Repo and ALE — so 300K was never the model limit. Exact same failure as the pricing bug in #80: a number lifted out of a footnote and promoted to a spec.

3. My #86 rule was wrong

#86 said: "prefer the newest arxiv tag unless the card explicitly ties an older ID to this version."

Applied to MiniCPM5-2B that selects 2602.09003 — the data-management paper. My rule would have produced a different wrong citation. Any ordering heuristic fails, because the tag list carries no guarantee about subject at all.

Replaced with the only thing that actually works: fetch https://arxiv.org/abs/<id>, read the title, cite it only if the title names this model and version, and otherwise state that no technical report is linked. I should have verified the rule against the case before shipping it in #86.

Verification

  • Both arXiv titles read from citation_title on arxiv.org/abs
  • Both max_position_embeddings read from each model's config.json
  • updated: frontmatter and dated correction notes added to the two changed posts
  • gh aw compile, npm run lint, npm run typecheck, npm run validate:content all clean

🤖 Generated with Claude Code

https://claude.ai/code/session_01Vru5xPN55JPU7dyVS3uswd

Summary by CodeRabbit

  • Documentation

    • Corrected GLM-5.3-Flash context-window information to 1M tokens and clarified benchmark-specific limits.
    • Updated GLM-5.3 review details with the corrected context length, evaluation limits, and supporting notes.
    • Clarified that the referenced MiniCPM paper covers MiniCPM4, and documented the absence of a linked MiniCPM5 technical report.
    • Improved citation guidance to verify paper titles and accurately report missing technical reports.
  • Chores

    • Updated workflow metadata to reflect the latest documentation changes.

…sed one

Three live posts corrected, and the guardrail I added in #86 replaced because
it would not have caught the case that prompted it.

1. minicpm5-2b-review-2026: cited arXiv:2506.07900 as MiniCPM5-2B's technical
   report. That paper is "MiniCPM4: Ultra-Efficient LLMs on End Devices"
   (June 2025) — the previous generation. The card's other tag, 2602.09003, is
   "Data Science and Technology Towards AGI Part I: Tiered Data Management".
   Neither describes MiniCPM5, so the post now says so instead of promoting a
   near-miss. Both titles read off arxiv.org/abs/<id>.

2. glm-5-3-review-2026 and glm-5-3-flash-vs-qwen3-8-flash-next-comparison-2026:
   both listed the context length as 300K. That number is the evaluation
   context for the HLE benchmark in the cards' footnotes; config.json gives
   max_position_embeddings = 1048576 for both models. Same failure as the
   pricing bug — a footnote figure promoted to a spec.

3. The #86 rule said "prefer the newest arxiv tag unless the card ties an older
   one to this version". Applied to MiniCPM5-2B that picks 2602.09003, which is
   also wrong. Any ordering heuristic fails here, because the tag list carries
   no guarantee at all. Replaced with: fetch arxiv.org/abs/<id>, read the
   title, and cite it only if the title names this model and version.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Vru5xPN55JPU7dyVS3uswd
@vercel

vercel Bot commented Sep 8, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
sameer-khan Ready Ready Preview Sep 8, 2026 7:00pm UTC

@coderabbitai

coderabbitai Bot commented Sep 8, 2026 •

Copy link
Copy Markdown

Review Change StackReview Change Stack

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Advanced

Run ID: 73e8db0c-635e-463b-b0d7-35a98ed51ea0

📥 Commits

Reviewing files that changed from the base of the PR and between 8f1ff2f and d6168dc.

📒 Files selected for processing (5)
  • .github/workflows/daily-til.lock.yml
  • .github/workflows/daily-til.md
  • content/blog/glm-5-3-flash-vs-qwen3-8-flash-next-comparison-2026.mdx
  • content/blog/glm-5-3-review-2026.mdx
  • content/blog/minicpm5-2b-review-2026.mdx

📝 Walkthrough

Walkthrough

The changes update citation verification guidance, correct GLM-5.3 context claims, and correct the MiniCPM5 technical-report citation. The compiled workflow metadata reflects the guidance change.

Changes

Content corrections

Layer / File(s) Summary
Citation verification guidance
.github/workflows/daily-til.md, .github/workflows/daily-til.lock.yml
The workflow requires arXiv title verification before citing a model report. The compiled lock metadata now matches the updated source.
GLM-5.3 context corrections
content/blog/glm-5-3-flash-vs-qwen3-8-flash-next-comparison-2026.mdx, content/blog/glm-5-3-review-2026.mdx
The articles document a 1M-token model window, benchmark-specific limits, and the correction to the previous 300K figure.
MiniCPM5 technical-report correction
content/blog/minicpm5-2b-review-2026.mdx
The article identifies the cited paper as a MiniCPM4 predecessor report and records the citation correction.

Estimated code review effort: 2 (Simple) | ~10 minutes

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch fix/citations-and-context-length

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@sameerkhansf
sameerkhansf merged commit 526d0a8 into main Sep 8, 2026
19 of 20 checks passed
@sameerkhansf
sameerkhansf deleted the fix/citations-and-context-length branch September 8, 2026 19:01

This branch was successfully deployed

1 active deployment
Preview — d6168dc5 Deployed Sep 8, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant