Skip to content
This repository was archived by the owner on Oct 16, 2026. It is now read-only.

chore(sdk): remove deprecated aliases and scaffold drift - #1407

Merged
christso merged 3 commits into
mainfrom
chore/sdk-dx-remove-deprecated-aliases
Jun 18, 2026
Merged

christso merged 3 commits into
mainfrom
chore/sdk-dx-remove-deprecated-aliases

Conversation

@christso

Copy link
Copy Markdown
Collaborator

Summary

  • remove deprecated _text / reference_answer alias plumbing from CLI and core grader prompt validation
  • align agentv create assertion scaffolds, SDK docs, package README, and eval-writer skill/reference docs with the canonical assertions[] contract
  • add CLI regression coverage for canonical wire payloads and assertion scaffold output

Verification

  • bun run build
  • bun test apps/cli/test/commands/eval/assert.test.ts apps/cli/test/commands/create/assertion.test.ts
  • bun test packages/core/test/evaluation/validation/prompt-validator.test.ts packages/core/test/evaluation/graders/prompt-resolution.test.ts

Red/Green Evidence

  • Red on origin/main: apps/cli/src/commands/create/commands.ts scaffolded defineAssertion examples with reasoning and treated output as a message array via getMessageText(output ?? []).
  • Green on this branch: bun --no-env-file apps/cli/src/cli.ts create assertion sample --template score now generates a scaffold that reads const text = output ?? '' and returns assertions: [{ text: 'Output has content', passed: score === 1.0 }].
  • Red on origin/main: deprecated prompt variables such as {{ output_text }} were still recognized by validation / prompt-resolution tests.
  • Green on this branch: prompt-validator.test.ts and prompt-resolution.test.ts assert those legacy variables are rejected / not detected.

Remaining Intentional Aliases

  • assertions[] remains the canonical result/grader output contract and is unchanged.
  • answer remains available in SDK handler context and docs where it is an ergonomic in-process alias for output; this bead only removes true deprecated surface aliases (input_text, output_text, expected_output_text, reference_answer) and stale reasoning-based scaffolds.
  • YAML assertions is intentionally unchanged; assert convergence is tracked separately in av-bv4.10.

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Jun 17, 2026 •

Copy link
Copy Markdown

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: b9eebd0
Status: ✅  Deploy successful!
Preview URL: https://23dcac33.agentv.pages.dev
Branch Preview URL: https://chore-sdk-dx-remove-deprecat.agentv.pages.dev

View logs

@christso
christso merged commit b78c918 into main Jun 18, 2026
8 checks passed
@christso
christso deleted the chore/sdk-dx-remove-deprecated-aliases branch June 18, 2026 00:47
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant