A live, contamination-resistant benchmark for evaluating LLM agents on U.S. macroeconomic nowcasting.
-
Updated
Aug 29, 2026 - Python
#
contamination-free
Here are 7 public repositories matching this topic...
WC2026-Agents: Claude, ChatGPT (GPT-5.5), Gemini and Grok forecast and bet on all 104 FIFA World Cup 2026 matches vs real betting odds. Open data + code. arXiv:2607.17765
benchmark soccer dataset calibration gemini forecasting football grok prediction-markets claude sports-betting betting-odds sports-analytics world-cup ai-evaluation llm chatgpt llm-agents fifa-world-cup-2026 contamination-free
-
Updated
Sep 14, 2026 - Python
Inverted generation: construct the label first, render the sentence second. Strictly-labelled, contamination-free synthetic data without a judge.
nlp icalendar japanese dataset-generation rrule synthetic-data constrained-decoding small-language-models contamination-free inverted-generation
-
Updated
Aug 23, 2026 - Python
A deduction benchmark that verifies itself: every instance provably unique, provably solvable without guessing, machine-graded.
benchmark puzzle evaluation constraint-satisfaction reasoning deduction verifiable llm-evaluation contamination-free
-
Updated
Sep 13, 2026 - JavaScript
Predict how a policy games a reward. RL environments scored by an executable-exploit verifier.
benchmark machine-learning reinforcement-learning ai-alignment llm-evaluation agent-evaluation reward-hacking evaluation-harness specification-gaming contamination-free
-
Updated
Aug 20, 2026 - Python
Do models catch flawed ML results? Flawed reports with byte-identical matched controls.
benchmark machine-learning research-integrity evaluation-methodology llm-evaluation sycophancy llm-judge agent-evaluation evaluation-harness contamination-free
-
Updated
Aug 20, 2026 - Python
ML training defects that never crash. An agentic benchmark with patch-and-rerun, unit-test verification.
debugging benchmark machine-learning pytorch ml-engineering llm-evaluation agentic-ai agent-evaluation evaluation-harness contamination-free
-
Updated
Aug 20, 2026 - Python
Add this topic to your repo
To associate your repository with the contamination-free topic, visit your repo's landing page and select "manage topics."