Rename Vercel AI experimental_decide spans from evaluate to decide #25251
Copy link
Copy link
Closed
Description
Follow getsentry/sentry-conventions#696: gen_ai.evaluate is deprecated in favor of gen_ai.decide.
ai 7.0.128 renamed experimental_evaluate to experimental_decide. The old name is a deprecated alias, and the tracing channel always publishes type: 'experimental_decide'. Vercel's own @ai-sdk/otel now names the span decide <model> with gen_ai.operation.name: decide. Our channel subscriber still makes evaluate <model> spans.
Target span
- Name:
decide <model>(wasevaluate <model>) - Op:
gen_ai.decide(wasgen_ai.evaluate) gen_ai.operation.name: decide(wasevaluate)- No other change.
gen_ai.input.messages/gen_ai.output.messageskeeptype: 'evaluation'.
Scope
packages/server-utils/src/integrations/vercel-ai/vercel-ai-dc-subscriber.ts. Keep theexperimental_evaluatechannel type forai7.0.111 to 7.0.127.- Update the tests: unit test
test/integrations/vercel-ai/evaluate.test.ts;node-integration-testssuitevercelai/v6_v7; e2e appnode-eve. - Change the test scenarios to call
experimental_decide. They still call the deprecatedexperimental_evaluateand will break when Vercel removes the alias.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels
Activity
linear-code commentedon Oct 12, 2026
JS-3911
feat(server-utils): Record Vercel AI experimental_decide calls as gen…
github-actions commentedon Oct 12, 2026
A PR closing this issue has just been released 🚀
This issue was referenced by PR #25274, which was included in the 11.7.0 release.