Skip to content

test: stabilize local UAT perf validation#94

Merged
RyshMan merged 1 commit intomainfrom
codex/uat-bench-stability-v1.3.4
Mar 17, 2026
Merged

test: stabilize local UAT perf validation#94
RyshMan merged 1 commit intomainfrom
codex/uat-bench-stability-v1.3.4

Conversation

@RyshMan
Copy link
Copy Markdown
Contributor

@RyshMan RyshMan commented Mar 17, 2026

Problem
Local post-release UAT for v1.3.4 was failing in quality_perf_bench_check because the UAT path was reusing the strict baseline-regression perf gate after a long local validation run, which made the outcome sensitive to local host variance.

Changes

  • add a dedicated bench-uat-check target for local UAT that keeps absolute perf/context budget validation without reusing the stricter pre-release regression gate
  • run the UAT perf block earlier and allow one retry for that UAT-only perf step
  • document the separation between pre-release perf regression validation and local UAT perf validation

Validation

  • ./gait doctor --json
  • make prepush-full
  • make bench-uat-check
  • GAIT_UAT_RELEASE_VERSION=v1.3.4 bash scripts/test_uat_local.sh

@RyshMan RyshMan requested a review from davidahmann as a code owner March 17, 2026 17:40
@RyshMan RyshMan merged commit 6369ad9 into main Mar 17, 2026
7 checks passed
@RyshMan RyshMan deleted the codex/uat-bench-stability-v1.3.4 branch March 17, 2026 17:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant