Skip to content

[BENCH-822] Fix Coval LLM run-template payload - #603

Merged
coval-cale merged 1 commit into
mainfrom
cale/bench-822-fix-the-coval-llm-run-template-payload
Sep 4, 2026
Merged

[BENCH-822] Fix Coval LLM run-template payload#603
coval-cale merged 1 commit into
mainfrom
cale/bench-822-fix-the-coval-llm-run-template-payload

Conversation

@coval-cale

Copy link
Copy Markdown
Contributor

Summary

  • send Coval run-template agent_ids and test_set_ids as arrays
  • send iteration_count at the top level
  • assert the live payload contract in the sync test

Production finding

The first llm-sync execution (llm-sync-xch9w) failed with Coval INVALID_ARGUMENT because the old singular fields were rejected. The scheduler is paused until this fix is released.

Validation

  • Ruff check and format
  • strict mypy
  • tests/unit/test_coval_agent_sync.py: 10 passed

@coval-cale
coval-cale requested a review from a team as a code owner September 4, 2026 21:16

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Your trial has ended. Reactivate Greptile to resume code reviews.

@coderabbitai

coderabbitai Bot commented Sep 4, 2026

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Team

Run ID: cb294178-36c3-45ee-a90b-6e79f16638f1

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@coval-cale
coval-cale enabled auto-merge September 4, 2026 21:19
@coval-cale
coval-cale added this pull request to the merge queue Sep 4, 2026
Merged via the queue into main with commit 452713a Sep 4, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants