Skip to content

Add GPT-5.6 Terra high TensorCircuit benchmark results - #20

Open
QingyunQian wants to merge 4 commits into
sxzgroup:v2from
QingyunQian:codex/gpt-5.6-terra-high-benchmark-upstream
Open

Add GPT-5.6 Terra high TensorCircuit benchmark results#20
QingyunQian wants to merge 4 commits into
sxzgroup:v2from
QingyunQian:codex/gpt-5.6-terra-high-benchmark-upstream

Conversation

@QingyunQian

@QingyunQian QingyunQian commented Aug 1, 2026

Copy link
Copy Markdown

Summary

Archive the single-trial GPT-5.6 Terra/high TensorCircuit benchmark across all 12 ORBIT-Q challenges, independently audited by GPT-5.6 Sol/high.

  • 9 / 12 valid solutions; failures on Tasks 01, 08, and 10
  • Docker-isolated, sequential execution with one valid model outcome per task
  • Includes selected solutions, functional/static/audit outputs, logs, configs, provenance, normalized summary data, and reproducible figures
  • Excludes terminal TLS/network failures and documents the byte-identical verifier-only recovery for Task 06

Validation

  • Verified solver model gpt-5.6-terra with reasoning effort high
  • Verified audit model gpt-5.6-sol with reasoning effort high
  • Verified one non-infrastructure outcome for every task
  • Archive regeneration and consistency checks pass

See results/gpt56terra-high/README.md for the complete result table and protocol.

Result figures

Final task outcomes

GPT-5.6 Terra high final task outcomes

Agent-side resource use

GPT-5.6 Terra high agent-side resource use

@QingyunQian
QingyunQian marked this pull request as ready for review August 1, 2026 15:07
@QingyunQian QingyunQian changed the title Benchmark GPT-5.6 Terra high with Sol high audit Add GPT-5.6 Terra high TensorCircuit benchmark results Aug 1, 2026
@QingyunQian
QingyunQian changed the base branch from main to v2 August 3, 2026 06:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant