Skip to content
This repository was archived by the owner on Oct 16, 2026. It is now read-only.

docs(evals): clarify grader wire format - #1404

Merged
christso merged 1 commit into
mainfrom
docs/grader-wire-format
Jun 17, 2026
Merged

christso merged 1 commit into
mainfrom
docs/grader-wire-format

Conversation

@christso

Copy link
Copy Markdown
Collaborator

Summary

  • Document raw grader stdin as snake_case wire format and @agentv/eval handler fields as camelCase SDK format
  • Update code-grader, custom assertion, prompt-template, SDK, and agentv-eval-writer examples for the 4.38 final-answer output contract
  • Fix canonical SDK examples to use output as the final answer string, add prompt-template-sdk package metadata, and smoke-test the examples

Verification

  • bun --filter @agentv/eval typecheck
  • bun --filter @agentv/eval test
  • bun --filter @agentv/eval build
  • bun run lint
  • git diff --check
  • Smoke: code-grader-sdk verify-attachments with final-answer output string
  • Smoke: sdk-custom-assertion word-count with final-answer output string
  • Smoke: prompt-template-sdk custom-evaluator with final-answer output string

@cloudflare-workers-and-pages

Copy link
Copy Markdown

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: 728daa8
Status: ✅  Deploy successful!
Preview URL: https://e3d95d4c.agentv.pages.dev
Branch Preview URL: https://docs-grader-wire-format.agentv.pages.dev

View logs

@christso
christso merged commit 83ac9a2 into main Jun 17, 2026
8 checks passed
@christso
christso deleted the docs/grader-wire-format branch June 17, 2026 12:30
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant