Skip to content

ci(til): cite the paper that describes this release, not the first arxiv tag - #86

Merged
sameerkhansf merged 1 commit into
mainfrom
ci/til-citation-of-record
Sep 8, 2026
Merged

sameerkhansf merged 1 commit into
mainfrom
ci/til-citation-of-record

Conversation

@sameerkhansf

@sameerkhansf sameerkhansf commented Sep 8, 2026 •

Copy link
Copy Markdown
Owner

Caught while reviewing #85, the first post the pipeline has produced since it was unblocked.

Second recurrence of one pattern — lifting an identifier off a model card without checking which artifact it refers to:

PR Cited Actually
#77 arXiv 2310.10688 as "TimesFM 3.0 specifications" Das et al. 2023, the original TimesFM paper, on the card for lineage only
#85 arXiv 2506.07900 as MiniCPM5-2B's "Technical Report" card carries two tags, arxiv:2506.07900 and arxiv:2602.09003 — it took the older

Same shape as the pricing bug fixed in #80, so the rule sits directly next to it: read every arxiv: tag, prefer the newest unless the card explicitly ties an older ID to this version, and say the technical report was not identified rather than guess.

Verified against the source

openbmb/MiniCPM5-2B
  tags:     arxiv:2506.07900, arxiv:2602.09003, license:apache-2.0
  created:  2026-09-06
  params:   2,516,756,480

Everything else in #85 checks out — Apache-2.0, en/zh, text-generation, genuinely 2 days old.

Verification

  • gh aw compile — 4 workflows succeeded
  • npm run lint clean

🤖 Generated with Claude Code

https://claude.ai/code/session_01Vru5xPN55JPU7dyVS3uswd

Summary by CodeRabbit

  • Documentation
    • Updated guidance for generated release content to improve citation accuracy.
    • Technical references now prioritize the paper describing the specific release being reviewed, rather than defaulting to the earliest paper listed on a model card.
    • When the appropriate technical paper cannot be identified, the model card is cited and the missing reference is noted.

…xiv tag

Second recurrence of one pattern: lifting an identifier off a model card
without checking which artifact it refers to.

- PR #77 listed arXiv 2310.10688 under "TimesFM 3.0 specifications". That is
  Das et al. 2023, the original TimesFM paper, cited on the card only for
  project lineage.
- PR #85 cites arXiv 2506.07900 as MiniCPM5-2B's technical report. The card
  carries two arxiv tags, 2506.07900 and 2602.09003; the agent took the older.

Same shape as the pricing bug fixed in #80, which is why the rule sits next to
it: read every arxiv tag, prefer the newest unless the card ties an older ID to
this version, and say the report was not identified rather than guess.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Vru5xPN55JPU7dyVS3uswd
@vercel

vercel Bot commented Sep 8, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
sameer-khan Ready Ready Preview Sep 8, 2026 6:48pm UTC

@sameerkhansf
sameerkhansf enabled auto-merge (squash) September 8, 2026 18:47
@sameerkhansf
sameerkhansf merged commit 5a5b242 into main Sep 8, 2026
19 of 20 checks passed
@sameerkhansf
sameerkhansf deleted the ci/til-citation-of-record branch September 8, 2026 18:48
@coderabbitai

coderabbitai Bot commented Sep 8, 2026 •

Copy link
Copy Markdown

Review Change StackReview Change Stack

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Advanced

Run ID: a6e0c30e-6c78-431e-ab7c-f408e98b4871

📥 Commits

Reviewing files that changed from the base of the PR and between d34909a and b7e29e4.

📒 Files selected for processing (2)
  • .github/workflows/daily-til.lock.yml
  • .github/workflows/daily-til.md

📝 Walkthrough

Walkthrough

The workflow now instructs the agent to identify the technical report for the reviewed release. The generated lock metadata hash was updated to match the workflow content.

Changes

Citation guidance

Layer / File(s) Summary
Release citation rules
.github/workflows/daily-til.md, .github/workflows/daily-til.lock.yml
The writing guidance now checks all arxiv: tags, prefers the report tied to the current release, and documents the fallback when no report is identified. The lock metadata hash was updated accordingly.

Estimated code review effort: 1 (Trivial) | ~2 minutes

Severity of issue fixed: Low

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch ci/til-citation-of-record

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

sameerkhansf added a commit that referenced this pull request Sep 8, 2026
…sed one (#87)

Three live posts corrected, and the guardrail I added in #86 replaced because
it would not have caught the case that prompted it.

1. minicpm5-2b-review-2026: cited arXiv:2506.07900 as MiniCPM5-2B's technical
   report. That paper is "MiniCPM4: Ultra-Efficient LLMs on End Devices"
   (June 2025) — the previous generation. The card's other tag, 2602.09003, is
   "Data Science and Technology Towards AGI Part I: Tiered Data Management".
   Neither describes MiniCPM5, so the post now says so instead of promoting a
   near-miss. Both titles read off arxiv.org/abs/<id>.

2. glm-5-3-review-2026 and glm-5-3-flash-vs-qwen3-8-flash-next-comparison-2026:
   both listed the context length as 300K. That number is the evaluation
   context for the HLE benchmark in the cards' footnotes; config.json gives
   max_position_embeddings = 1048576 for both models. Same failure as the
   pricing bug — a footnote figure promoted to a spec.

3. The #86 rule said "prefer the newest arxiv tag unless the card ties an older
   one to this version". Applied to MiniCPM5-2B that picks 2602.09003, which is
   also wrong. Any ordering heuristic fails here, because the tag list carries
   no guarantee at all. Replaced with: fetch arxiv.org/abs/<id>, read the
   title, and cite it only if the title names this model and version.


Claude-Session: https://claude.ai/code/session_01Vru5xPN55JPU7dyVS3uswd

Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>

This branch was successfully deployed

1 active deployment
Preview — b7e29e41 Deployed Sep 8, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant