Skip to content

[test] fact-check negative case - DO NOT MERGE - #105

Closed
sameerkhansf wants to merge 3 commits into
mainfrom
test/fact-check-negative
Closed

sameerkhansf wants to merge 3 commits into
mainfrom
test/fact-check-negative

Conversation

@sameerkhansf

@sameerkhansf sameerkhansf commented Sep 28, 2026 •

Copy link
Copy Markdown
Owner

Negative test for #104. Copy of the Nex-N2.5-mini post, which has verified-wrong claims checkable from its own cited sources: 'Parameters: Not specified' (config.json/HF API: 35.1B MoE), 'Text-generation model' (config: Qwen3_5MoeForConditionalGeneration with vision), Claude Opus 5 at $15/$75 (OpenRouter: $5/$25). Expected: fact-check = failure. Will be closed, never merged.

🤖 Generated with Claude Code

TIL PRs passed CI and then expired unreviewed (#92, #101), and the
one-pending-post gate turned a week of scout runs into noops. Publish
autonomously, using only vendor-native gh-aw controls:

- create-pull-request auto-merge: squash, expires 2d (daily-til, til-writer)
- threat-detection continue-on-error: false; the default let a flagged
  detection (#92, prompt_injection=true) still open the PR
- til-fact-check: new gh-aw workflow (governance pattern) that verifies
  every claim against its primary source and posts a `fact-check` check run
- skip-if-match: blocked scout runs no longer spend model calls
- arxiv.org allowlisted; til-writer can now reach its research sources
- stale "human merge" prompt text removed

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@vercel

vercel Bot commented Sep 28, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
sameer-khan Ready Ready Preview Sep 28, 2026 7:24am UTC

@coderabbitai

coderabbitai Bot commented Sep 28, 2026 •

Copy link
Copy Markdown

Warning

Review limit reached

Next included review available in 30 minutes.

Check out review usage here.

View limit details

Limit details: You’ve used the included review currently available.

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Learn how review limits work.

Review configuration:

⚙️ Run configuration

Configuration used: Repository: sameerkhansf/Sameer-Khan/.coderabbit.yaml

Review profile: CHILL

Plan: Advanced

Run ID: d399bfb4-4e52-4922-a5a2-7a43ebad185e

📥 Commits

Reviewing files that changed from the base of the PR and between e46bd38 and 023cc6c.

📒 Files selected for processing (8)
  • .github/workflows/agentics-maintenance.yml
  • .github/workflows/daily-til.lock.yml
  • .github/workflows/daily-til.md
  • .github/workflows/til-fact-check.lock.yml
  • .github/workflows/til-fact-check.md
  • .github/workflows/til-writer.lock.yml
  • .github/workflows/til-writer.md
  • content/blog/fact-check-negative-test.mdx

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

sameerkhansf and others added 2 commits September 28, 2026 00:22
… verdict to analyzed SHA

Run 36388743650 hit invocation_cap_exceeded (250/250) re-running curl|grep on
one README. DeterministicOps: steps: downloads every cited URL (plus HF raw
README/config.json) once. Review fixes: add labeled trigger; drop target so
the check attaches to the triggering event's head SHA.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@sameerkhansf

Copy link
Copy Markdown
Owner Author

Superseded by per-model eval PRs.

@sameerkhansf
sameerkhansf deleted the test/fact-check-negative branch September 28, 2026 08:04

This branch was successfully deployed

1 active deployment
Preview — 023cc6c7 Deployed Sep 28, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant