Skip to content
This repository was archived by the owner on Oct 16, 2026. It is now read-only.

feat(sdk): add minimal python authoring helpers - #1408

Merged
christso merged 1 commit into
mainfrom
feat/sdk-dx-python-yaml-sdk
Jun 18, 2026
Merged

christso merged 1 commit into
mainfrom
feat/sdk-dx-python-yaml-sdk

Conversation

@christso

@christso christso commented Jun 17, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

  • add repo-local Python helper examples under examples/features/sdk-python/ for canonical code-grader stdin/stdout handling and YAML/JSONL eval authoring
  • keep the helper example aligned to AgentV wire/schema names, with deprecated aliases such as output_text, input_text, expected_output_text, and reference_answer rejected
  • document the helper scope as example-local: no published Python package, no .eval.py discovery, and no Python runner parallel to the AgentV CLI

Scope

  • agentv_py.grader wraps Python code-grader scripts over canonical snake_case stdin fields and canonical stdout JSON.
  • agentv_py.evals emits existing AgentV YAML/JSONL shapes.
  • TargetClient.from_env() mirrors the existing target proxy contract for grader-side calls when a grader has a target config.
  • biome.json now ignores **/.venv/** so the documented uv run pytest workflow does not make repo lint scan local Python virtualenv files.

Red / Green

  • Red: origin/main had no examples/features/sdk-python/ helper tree.
  • Green: uv run pytest in examples/features/sdk-python => 7 passed.
  • Green: uv run python scripts/build_eval.py reproduced checked-in evals/dataset.eval.yaml, evals/dataset.jsonl, and uv.lock with no diff.
  • Green: .env preflight copied into the worktree before eval dogfood.
  • Green: bun run build passed; dashboard chunk-size warning only.
  • Green: bun apps/cli/src/cli.ts eval examples/features/sdk-python/evals/dataset.eval.yaml --target local_cli --output /tmp/agentv-pr1408-python-helper-run => PASS 1/1, score 1.0, code-grader score 1, execution_status: ok.
  • Green: bun run validate:examples => 62/62 valid.
  • Green: bun run lint passed.
  • GitHub CI is green on head 83cf86fb: Build, Check Links, Cloudflare Pages, Lint, Test, Typecheck, Validate Evals, and Validate Marketplace.

Beads

  • av-bv4.4 and av-bv4.5 were updated with the rebase, conflict resolution, pushed SHA, verification, and remaining review/merge state.

Post-Deploy Monitoring & Validation

No additional operational monitoring required. This PR adds an example-local helper, docs, skill references, and validation coverage; it does not change AgentV runtime execution paths for existing evals.

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Jun 17, 2026 •

Copy link
Copy Markdown

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: 83cf86f
Status: ✅  Deploy successful!
Preview URL: https://be6a49e6.agentv.pages.dev
Branch Preview URL: https://feat-sdk-dx-python-yaml-sdk.agentv.pages.dev

View logs

@christso
christso force-pushed the feat/sdk-dx-python-yaml-sdk branch from d31b0b8 to 83cf86f Compare June 18, 2026 04:37
@christso
christso marked this pull request as ready for review June 18, 2026 04:44
@christso
christso merged commit 195acb2 into main Jun 18, 2026
8 checks passed
@christso
christso deleted the feat/sdk-dx-python-yaml-sdk branch June 18, 2026 04:44
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant