Skip to content

feat(eve): record Vercel AI Gateway cost on local trace spans - #1388

Open
chadhietala wants to merge 2 commits into
mainfrom
gateway-cost-tracing
Open

feat(eve): record Vercel AI Gateway cost on local trace spans#1388
chadhietala wants to merge 2 commits into
mainfrom
gateway-cost-tracing

Conversation

@chadhietala

Copy link
Copy Markdown
Contributor

Description

Adds per-model-call cost attribution to the local trace spool. When a call is served by Vercel AI Gateway, the agent.step span now records what the gateway reported:

  • gen_ai.usage.cost — raw inference cost (USD)
  • gen_ai.usage.gateway_cost — with the gateway surcharge
  • gen_ai.usage.input_cost / gen_ai.usage.output_cost — the split
  • gen_ai.generation.id — reconciliation key for the gateway dashboard

The attributes only exist for gateway-served calls — direct provider connections emit nothing (per the requirement).

How it works

The AI SDK's Telemetry.onStepEnd hook delivers the full StepResult, including providerMetadata. ai-sdk-hook-bridge publishes it as a new attempt.metadata lifecycle event, and agent-otel-provider writes the parsed providerMetadata.gateway cost fields onto the still-open agent.step span (values arrive as USD strings and are parsed to numbers; anything missing/non-numeric is skipped). Cost per turn is a view-time sum across the turn's step spans.

Verification

  • New unit tests: bridge publishes attempt.metadata (and skips metadata-less steps); provider writes cost attributes for gateway shapes and omits them for other providers.
  • End-to-end against the real gateway (weather fixture): segments on disk carry e.g. {"gen_ai.usage.cost":0.000734,"gen_ai.usage.gateway_cost":0.000834,"gen_ai.usage.input_cost":0.000004,"gen_ai.usage.output_cost":0.00073,"gen_ai.generation.id":"gen_01KYR8XZH46VNKTDRMCNXXXX49"} per step — matching the dashboard.
  • Full suite green: fmt, lint, typecheck, unit (5554), integration, scenario, guard:invariants, docs:check.

@vercel

vercel Bot commented Jul 30, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
eve-docs Ready Ready Preview Jul 30, 2026 1:40am
eve-docs-4759 Ready Ready Preview, v0 Jul 30, 2026 1:40am

@github-actions

github-actions Bot commented Jul 30, 2026

Copy link
Copy Markdown
Contributor

Bundle + Package Summary: apps/fixtures/weather-agent

Key takeaways

  • No notable deltas vs main (46c6ce3).

Delta vs main (46c6ce3)

Area Metric Baseline Current Delta
Package Packed tarball 7.62 MB 7.62 MB +926 B ⚠️
Package Unpacked publish size 28.79 MB 28.79 MB +2.1 kB ⚠️
Package Installed footprint 91.09 MB 91.09 MB +2.1 kB ⚠️
Package Published files 2875 2875 0
Package Installed files 6662 6662 0
Runtime Unique function payloads 2 2 0
Runtime Total function bytes 16.80 MB 16.80 MB +320 B ⚠️
Runtime Public routes 11 11 0
Changed function payloads vs main (46c6ce3) (2)
Function Status Baseline Current Delta Route changes
functions/__server.func changed 8.40 MB 8.40 MB +160 B ⚠️ none
functions/.well-known/workflow/v1/flow.func changed 8.40 MB 8.40 MB +160 B ⚠️ none

eve init install

Metric Baseline Current Delta
Installed footprint 129.49 MB 129.50 MB +2.1 kB ⚠️
Installed packages 130 130 0
dependencies 4 4 0
devDependencies 2 2 0
Dependency package bytes 43.12 MB 43.12 MB +2.1 kB ⚠️
devDependency package bytes 5.04 MB 5.04 MB 0 B ➖
Build Metadata
  • Preset: vercel
  • Nitro: nitro@3.0.260610-beta
  • Output directory: apps/fixtures/weather-agent/.vercel/output
  • Build metadata timestamp: 2026-07-30T01:41:35.966Z
  • Route aliases: 11 public, 1 internal (12 total aliases)
  • Vercel routes in config: 14
  • Severity legend: 🔴 dominant/large, 🟠 notable, 🟡 watch, ⚪ small
Package Drill-Down

Package Details

  • Package: eve@0.27.13
  • Package directory: packages/eve
  • Tarball: 7.62 MB (eve-0.27.13.tgz)
  • Unpacked payload: 28.79 MB across 2875 published files
  • Installed footprint: 91.09 MB across 6662 installed files
  • Installed root package: 27.43 MB
  • Installed dependencies: 63.66 MB
  • Runtime dependencies: 2
  • Peer dependencies: 5 (4 optional)

Installed footprint is measured from an isolated temporary npm install of the packed tarball.

Heavy installed dependencies

  • eve: 27.43 MB (30.1%)
  • @rolldown/binding-linux-x64-gnu: 19.28 MB (21.2%)
  • @rolldown/binding-wasm32-wasi: 10.66 MB (11.7%)
  • ai: 6.53 MB (7.2%)
  • @napi-rs/wasm-runtime: 6.39 MB (7.0%)
Publish payload breakdown
Published file size
🔴 dist/src/compiled/shadcn-registry/index.js       [########################] 13.15 MB 45.7%
🟠 dist/src/compiled/experimental-ai-sdk-code-mo... [###.....................] 1.51 MB 5.2%
🟡 dist/src/compiled/@vercel/sandbox/index.js       [#.......................] 632.5 kB 2.2%
🟡 dist/src/compiled/_chunks/workflow/undici-DWL... [#.......................] 502.4 kB 1.7%
🟡 dist/src/compiled/@chat-adapter/slack/index.js   [#.......................] 440.5 kB 1.5%
🔴 Other published files                            [#######################.] 12.56 MB 43.6%
Installed footprint breakdown
Installed package size
🔴 eve                             [########################] 27.43 MB 30.1%
🔴 @rolldown/binding-linux-x64-gnu [#################.......] 19.28 MB 21.2%
🔴 @rolldown/binding-wasm32-wasi   [#########...............] 10.66 MB 11.7%
🔴 ai                              [######..................] 6.53 MB 7.2%
🔴 @napi-rs/wasm-runtime           [######..................] 6.39 MB 7.0%
🔴 zod                             [####....................] 5.07 MB 5.6%
🔴 Other installed packages        [##############..........] 15.73 MB 17.3%
Runtime dependencies (2)
Package Range Notes
nitro 3.0.260610-beta
undici 8.9.0
Peer dependencies (5)
Package Range Notes
@opentelemetry/api ^1.0.0 optional peer
ai catalog:
braintrust ^3.0.0 optional peer
just-bash ^3.0.0 optional peer
microsandbox ^0.5.0 optional peer
eve init install drill-down

eve init install details

  • Command: eve init my-agent
  • Package manager: npm
  • Installed footprint: 129.50 MB across 8530 installed files
  • Installed packages: 130 total (124 transitive-only)
  • dependencies: 4 direct packages totaling 43.12 MB
  • devDependencies: 2 direct packages totaling 5.04 MB
  • Other transitive package files: 81.33 MB

Installed footprint is measured from an isolated temporary eve init my-agent using the current packed eve tarball.

Heavy installed dependencies

  • @typescript/typescript-linux-x64: 27.95 MB (21.6%)
  • eve: 27.43 MB (21.2%)
  • @rolldown/binding-linux-x64-gnu: 19.28 MB (14.9%)
  • @rolldown/binding-wasm32-wasi: 10.66 MB (8.2%)
  • zod: 9.02 MB (7.0%)
Installed footprint breakdown
Installed package size
🔴 @typescript/typescript-linux-x64 [########################] 27.95 MB 21.6%
🔴 eve                              [########################] 27.43 MB 21.2%
🔴 @rolldown/binding-linux-x64-gnu  [#################.......] 19.28 MB 14.9%
🔴 @rolldown/binding-wasm32-wasi    [#########...............] 10.66 MB 8.2%
🔴 zod                              [########................] 9.02 MB 7.0%
🔴 ai                               [######..................] 6.53 MB 5.0%
🔴 @napi-rs/wasm-runtime            [#####...................] 6.39 MB 4.9%
🔴 Other installed packages         [###################.....] 22.23 MB 17.2%
dependencies (4)
Package Range Installed size Share
@vercel/connect 0.4.2 135.8 kB 0.1%
ai ^7.0.38 6.53 MB 5.0%
eve file:eve-0.27.13.tgz 27.43 MB 21.2%
zod 4.4.3 9.02 MB 7.0%
devDependencies (2)
Package Range Installed size Share
@types/node 24.x 2.54 MB 2.0%
typescript 7.0.2 2.50 MB 1.9%
Function Drill-Down

Payload Size Graph

Unique function payload size and share of total
🔴 functions/.well-known/workflow/v1/flow.func     [########################] 8.40 MB 50.0%
🔴 functions/__server.func                         [########################] 8.40 MB 50.0%

Top Function Payloads

🟠 functions/.well-known/workflow/v1/flow.func • 1 public route • 8.40 MB
Metric Value
Public routes /.well-known/workflow/v1/flow
Runtime nodejs24.x
Handler index.mjs
Payload 8.40 MB
Function files 8.40 MB across 44 files
Traced dependencies 0 B
Signal 🟠 Bundled file index.mjs is 2.30 MB (27.4%)

🟠 🔎 Dependency Analysis

📦 Bundled files:

Bundled file size
🟠 index.mjs                       [########################] 2.30 MB 27.4%
🟠 _chunks/runtime-artifacts.mjs   [################........] 1.59 MB 18.9%
🟡 _libs/undici.mjs                [##########..............] 980.5 kB 11.7%
🟡 _chunks/sandbox.mjs             [########................] 768.8 kB 9.2%
🟡 _libs/@ai-sdk/gateway+[...].mjs [####....................] 432.8 kB 5.2%
🟠 Other bundled files             [########################] 2.33 MB 27.7%

🧾 Vercel Config

{
  "handler": "index.mjs",
  "launcherType": "Nodejs",
  "shouldAddHelpers": false,
  "supportsResponseStreaming": true,
  "runtime": "nodejs24.x",
  "maxDuration": "max",
  "experimentalTriggers": [
    {
      "type": "queue/v2beta",
      "topic": "__eve776561746865722d6167656e74_wkf_workflow_*",
      "consumer": "default",
      "retryAfterSeconds": 5,
      "initialDelaySeconds": 0
    }
  ],
  "environment": {
    "WORKFLOW_PRECONDITION_GUARD": "1"
  }
}

🟠 functions/__server.func • 10 public routes, 1 internal alias • 8.40 MB
Metric Value
Public routes /
/eve/v1/callback/[token]
/eve/v1/connections/[name]/callback/[token]
/eve/v1/health
/eve/v1/info
/eve/v1/session
/eve/v1/session/[sessionId]
/eve/v1/session/[sessionId]/cancel
/eve/v1/session/[sessionId]/stream
/eve/v1/session/reset
Internal aliases /__server
Runtime nodejs24.x
Handler index.mjs
Payload 8.40 MB
Function files 8.40 MB across 44 files
Traced dependencies 0 B
Signal 🟠 Bundled file index.mjs is 2.30 MB (27.4%)

🟠 🔎 Dependency Analysis

📦 Bundled files:

Bundled file size
🟠 index.mjs                       [########################] 2.30 MB 27.4%
🟠 _chunks/runtime-artifacts.mjs   [################........] 1.59 MB 18.9%
🟡 _libs/undici.mjs                [##########..............] 980.5 kB 11.7%
🟡 _chunks/sandbox.mjs             [########................] 768.8 kB 9.2%
🟡 _libs/@ai-sdk/gateway+[...].mjs [####....................] 432.8 kB 5.2%
🟠 Other bundled files             [########################] 2.32 MB 27.7%

🧾 Vercel Config

{
  "handler": "index.mjs",
  "launcherType": "Nodejs",
  "shouldAddHelpers": false,
  "supportsResponseStreaming": true,
  "runtime": "nodejs24.x"
}

Build Timing: e2e/fixtures/agent-tools-sandbox

This is an informational timing measurement inside eve build, from preflight through publication. Output-size measurement and profile writing are excluded.

Build mode: deployable Vercel build with sandbox template prewarm included.

  • Build pipeline: 2.13 s -> 1.84 s (-290.3 ms) vs main (46c6ce3).
  • Timing is informational: shared GitHub runners are too variable for a hard timing budget.
Detailed phase timings vs `main (46c6ce3)`
Phase Baseline Current Delta
extension.check 6.1 ms 1.1 ms -5.0 ms
project.resolve 1.4 ms 0.6 ms -0.8 ms
workspace.create 6.1 ms 0.7 ms -5.4 ms
host.prepare 372.7 ms 156.2 ms -216.5 ms
vercel.service-prefix.resolve 1.8 ms 2.1 ms +0.3 ms
nitro.create 185.9 ms 209.5 ms +23.6 ms
sandbox.prewarm 232.9 ms 219.9 ms -13.0 ms
nitro.cache.prepare 0.2 ms 0.2 ms 0.0 ms
nitro.prepare 0.8 ms 0.8 ms 0.0 ms
nitro.public-assets 0.7 ms 0.8 ms +0.1 ms
nitro.prerender 0.4 ms 0.4 ms 0.0 ms
nitro.bundle 1.21 s 1.22 s +9.7 ms
nitro.cache.write 0.4 ms 0.3 ms -0.1 ms
vercel.workflow-function.materialize 45.9 ms 20.3 ms -25.6 ms
agent-summary.emit 0.5 ms 0.5 ms 0.0 ms
nitro.close 0.1 ms 0.1 ms 0.0 ms
output.publish 60.4 ms 3.0 ms -57.4 ms
workspace.remove 1.9 ms 1.8 ms -0.1 ms

agent.step spans now carry the cost the gateway reports per model call:
gen_ai.usage.cost (raw inference USD), gen_ai.usage.gateway_cost (with
surcharge), gen_ai.usage.input_cost / output_cost, and
gen_ai.generation.id for dashboard reconciliation. The bridge publishes
step provider metadata from the AI SDK's onStepEnd hook, and attributes
are written only when the gateway section exists — other providers emit
nothing.

Signed-off-by: Chad Hietala <chadhietala@gmail.com>
Signed-off-by: Chad Hietala <chadhietala@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants