feat(eve): record Vercel AI Gateway cost on local trace spans - #1388
Open
chadhietala wants to merge 2 commits into
Open
feat(eve): record Vercel AI Gateway cost on local trace spans#1388chadhietala wants to merge 2 commits into
chadhietala wants to merge 2 commits into
Conversation
Contributor
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
Contributor
Bundle + Package Summary:
|
| Area | Metric | Baseline | Current | Delta |
|---|---|---|---|---|
| Package | Packed tarball | 7.62 MB | 7.62 MB | +926 B |
| Package | Unpacked publish size | 28.79 MB | 28.79 MB | +2.1 kB |
| Package | Installed footprint | 91.09 MB | 91.09 MB | +2.1 kB |
| Package | Published files | 2875 | 2875 | 0 |
| Package | Installed files | 6662 | 6662 | 0 |
| Runtime | Unique function payloads | 2 | 2 | 0 |
| Runtime | Total function bytes | 16.80 MB | 16.80 MB | +320 B |
| Runtime | Public routes | 11 | 11 | 0 |
Changed function payloads vs main (46c6ce3) (2)
| Function | Status | Baseline | Current | Delta | Route changes |
|---|---|---|---|---|---|
functions/__server.func |
changed | 8.40 MB | 8.40 MB | +160 B |
none |
functions/.well-known/workflow/v1/flow.func |
changed | 8.40 MB | 8.40 MB | +160 B |
none |
eve init install
| Metric | Baseline | Current | Delta |
|---|---|---|---|
| Installed footprint | 129.49 MB | 129.50 MB | +2.1 kB |
| Installed packages | 130 | 130 | 0 |
| dependencies | 4 | 4 | 0 |
| devDependencies | 2 | 2 | 0 |
| Dependency package bytes | 43.12 MB | 43.12 MB | +2.1 kB |
| devDependency package bytes | 5.04 MB | 5.04 MB | 0 B ➖ |
Build Metadata
- Preset:
vercel - Nitro:
nitro@3.0.260610-beta - Output directory:
apps/fixtures/weather-agent/.vercel/output - Build metadata timestamp: 2026-07-30T01:41:35.966Z
- Route aliases: 11 public, 1 internal (12 total aliases)
- Vercel routes in config: 14
- Severity legend: 🔴 dominant/large, 🟠 notable, 🟡 watch, ⚪ small
Package Drill-Down
Package Details
- Package:
eve@0.27.13 - Package directory:
packages/eve - Tarball: 7.62 MB (
eve-0.27.13.tgz) - Unpacked payload: 28.79 MB across 2875 published files
- Installed footprint: 91.09 MB across 6662 installed files
- Installed root package: 27.43 MB
- Installed dependencies: 63.66 MB
- Runtime dependencies: 2
- Peer dependencies: 5 (4 optional)
Installed footprint is measured from an isolated temporary npm install of the packed tarball.
Heavy installed dependencies
eve: 27.43 MB (30.1%)@rolldown/binding-linux-x64-gnu: 19.28 MB (21.2%)@rolldown/binding-wasm32-wasi: 10.66 MB (11.7%)ai: 6.53 MB (7.2%)@napi-rs/wasm-runtime: 6.39 MB (7.0%)
Publish payload breakdown
Published file size
🔴 dist/src/compiled/shadcn-registry/index.js [########################] 13.15 MB 45.7%
🟠 dist/src/compiled/experimental-ai-sdk-code-mo... [###.....................] 1.51 MB 5.2%
🟡 dist/src/compiled/@vercel/sandbox/index.js [#.......................] 632.5 kB 2.2%
🟡 dist/src/compiled/_chunks/workflow/undici-DWL... [#.......................] 502.4 kB 1.7%
🟡 dist/src/compiled/@chat-adapter/slack/index.js [#.......................] 440.5 kB 1.5%
🔴 Other published files [#######################.] 12.56 MB 43.6%
Installed footprint breakdown
Installed package size
🔴 eve [########################] 27.43 MB 30.1%
🔴 @rolldown/binding-linux-x64-gnu [#################.......] 19.28 MB 21.2%
🔴 @rolldown/binding-wasm32-wasi [#########...............] 10.66 MB 11.7%
🔴 ai [######..................] 6.53 MB 7.2%
🔴 @napi-rs/wasm-runtime [######..................] 6.39 MB 7.0%
🔴 zod [####....................] 5.07 MB 5.6%
🔴 Other installed packages [##############..........] 15.73 MB 17.3%
Runtime dependencies (2)
| Package | Range | Notes |
|---|---|---|
nitro |
3.0.260610-beta |
|
undici |
8.9.0 |
Peer dependencies (5)
| Package | Range | Notes |
|---|---|---|
@opentelemetry/api |
^1.0.0 |
optional peer |
ai |
catalog: |
|
braintrust |
^3.0.0 |
optional peer |
just-bash |
^3.0.0 |
optional peer |
microsandbox |
^0.5.0 |
optional peer |
eve init install drill-down
eve init install details
- Command:
eve init my-agent - Package manager:
npm - Installed footprint: 129.50 MB across 8530 installed files
- Installed packages: 130 total (124 transitive-only)
- dependencies: 4 direct packages totaling 43.12 MB
- devDependencies: 2 direct packages totaling 5.04 MB
- Other transitive package files: 81.33 MB
Installed footprint is measured from an isolated temporary eve init my-agent using the current packed eve tarball.
Heavy installed dependencies
@typescript/typescript-linux-x64: 27.95 MB (21.6%)eve: 27.43 MB (21.2%)@rolldown/binding-linux-x64-gnu: 19.28 MB (14.9%)@rolldown/binding-wasm32-wasi: 10.66 MB (8.2%)zod: 9.02 MB (7.0%)
Installed footprint breakdown
Installed package size
🔴 @typescript/typescript-linux-x64 [########################] 27.95 MB 21.6%
🔴 eve [########################] 27.43 MB 21.2%
🔴 @rolldown/binding-linux-x64-gnu [#################.......] 19.28 MB 14.9%
🔴 @rolldown/binding-wasm32-wasi [#########...............] 10.66 MB 8.2%
🔴 zod [########................] 9.02 MB 7.0%
🔴 ai [######..................] 6.53 MB 5.0%
🔴 @napi-rs/wasm-runtime [#####...................] 6.39 MB 4.9%
🔴 Other installed packages [###################.....] 22.23 MB 17.2%
dependencies (4)
| Package | Range | Installed size | Share |
|---|---|---|---|
@vercel/connect |
0.4.2 |
135.8 kB | 0.1% |
ai |
^7.0.38 |
6.53 MB | 5.0% |
eve |
file:eve-0.27.13.tgz |
27.43 MB | 21.2% |
zod |
4.4.3 |
9.02 MB | 7.0% |
devDependencies (2)
| Package | Range | Installed size | Share |
|---|---|---|---|
@types/node |
24.x |
2.54 MB | 2.0% |
typescript |
7.0.2 |
2.50 MB | 1.9% |
Function Drill-Down
Payload Size Graph
Unique function payload size and share of total
🔴 functions/.well-known/workflow/v1/flow.func [########################] 8.40 MB 50.0%
🔴 functions/__server.func [########################] 8.40 MB 50.0%
Top Function Payloads
🟠 functions/.well-known/workflow/v1/flow.func • 1 public route • 8.40 MB
| Metric | Value |
|---|---|
| Public routes | /.well-known/workflow/v1/flow |
| Runtime | nodejs24.x |
| Handler | index.mjs |
| Payload | 8.40 MB |
| Function files | 8.40 MB across 44 files |
| Traced dependencies | 0 B |
| Signal | 🟠 Bundled file index.mjs is 2.30 MB (27.4%) |
🟠 🔎 Dependency Analysis
📦 Bundled files:
Bundled file size
🟠 index.mjs [########################] 2.30 MB 27.4%
🟠 _chunks/runtime-artifacts.mjs [################........] 1.59 MB 18.9%
🟡 _libs/undici.mjs [##########..............] 980.5 kB 11.7%
🟡 _chunks/sandbox.mjs [########................] 768.8 kB 9.2%
🟡 _libs/@ai-sdk/gateway+[...].mjs [####....................] 432.8 kB 5.2%
🟠 Other bundled files [########################] 2.33 MB 27.7%
🧾 Vercel Config
{
"handler": "index.mjs",
"launcherType": "Nodejs",
"shouldAddHelpers": false,
"supportsResponseStreaming": true,
"runtime": "nodejs24.x",
"maxDuration": "max",
"experimentalTriggers": [
{
"type": "queue/v2beta",
"topic": "__eve776561746865722d6167656e74_wkf_workflow_*",
"consumer": "default",
"retryAfterSeconds": 5,
"initialDelaySeconds": 0
}
],
"environment": {
"WORKFLOW_PRECONDITION_GUARD": "1"
}
}🟠 functions/__server.func • 10 public routes, 1 internal alias • 8.40 MB
| Metric | Value |
|---|---|
| Public routes | //eve/v1/callback/[token]/eve/v1/connections/[name]/callback/[token]/eve/v1/health/eve/v1/info/eve/v1/session/eve/v1/session/[sessionId]/eve/v1/session/[sessionId]/cancel/eve/v1/session/[sessionId]/stream/eve/v1/session/reset |
| Internal aliases | /__server |
| Runtime | nodejs24.x |
| Handler | index.mjs |
| Payload | 8.40 MB |
| Function files | 8.40 MB across 44 files |
| Traced dependencies | 0 B |
| Signal | 🟠 Bundled file index.mjs is 2.30 MB (27.4%) |
🟠 🔎 Dependency Analysis
📦 Bundled files:
Bundled file size
🟠 index.mjs [########################] 2.30 MB 27.4%
🟠 _chunks/runtime-artifacts.mjs [################........] 1.59 MB 18.9%
🟡 _libs/undici.mjs [##########..............] 980.5 kB 11.7%
🟡 _chunks/sandbox.mjs [########................] 768.8 kB 9.2%
🟡 _libs/@ai-sdk/gateway+[...].mjs [####....................] 432.8 kB 5.2%
🟠 Other bundled files [########################] 2.32 MB 27.7%
🧾 Vercel Config
{
"handler": "index.mjs",
"launcherType": "Nodejs",
"shouldAddHelpers": false,
"supportsResponseStreaming": true,
"runtime": "nodejs24.x"
}Build Timing: e2e/fixtures/agent-tools-sandbox
This is an informational timing measurement inside eve build, from preflight through publication. Output-size measurement and profile writing are excluded.
Build mode: deployable Vercel build with sandbox template prewarm included.
- Build pipeline: 2.13 s -> 1.84 s (-290.3 ms) vs
main (46c6ce3). - Timing is informational: shared GitHub runners are too variable for a hard timing budget.
Detailed phase timings vs `main (46c6ce3)`
| Phase | Baseline | Current | Delta |
|---|---|---|---|
extension.check |
6.1 ms | 1.1 ms | -5.0 ms |
project.resolve |
1.4 ms | 0.6 ms | -0.8 ms |
workspace.create |
6.1 ms | 0.7 ms | -5.4 ms |
host.prepare |
372.7 ms | 156.2 ms | -216.5 ms |
vercel.service-prefix.resolve |
1.8 ms | 2.1 ms | +0.3 ms |
nitro.create |
185.9 ms | 209.5 ms | +23.6 ms |
sandbox.prewarm |
232.9 ms | 219.9 ms | -13.0 ms |
nitro.cache.prepare |
0.2 ms | 0.2 ms | 0.0 ms |
nitro.prepare |
0.8 ms | 0.8 ms | 0.0 ms |
nitro.public-assets |
0.7 ms | 0.8 ms | +0.1 ms |
nitro.prerender |
0.4 ms | 0.4 ms | 0.0 ms |
nitro.bundle |
1.21 s | 1.22 s | +9.7 ms |
nitro.cache.write |
0.4 ms | 0.3 ms | -0.1 ms |
vercel.workflow-function.materialize |
45.9 ms | 20.3 ms | -25.6 ms |
agent-summary.emit |
0.5 ms | 0.5 ms | 0.0 ms |
nitro.close |
0.1 ms | 0.1 ms | 0.0 ms |
output.publish |
60.4 ms | 3.0 ms | -57.4 ms |
workspace.remove |
1.9 ms | 1.8 ms | -0.1 ms |
chadhietala
enabled auto-merge (squash)
July 30, 2026 01:23
AndrewBarba
approved these changes
Jul 30, 2026
agent.step spans now carry the cost the gateway reports per model call: gen_ai.usage.cost (raw inference USD), gen_ai.usage.gateway_cost (with surcharge), gen_ai.usage.input_cost / output_cost, and gen_ai.generation.id for dashboard reconciliation. The bridge publishes step provider metadata from the AI SDK's onStepEnd hook, and attributes are written only when the gateway section exists — other providers emit nothing. Signed-off-by: Chad Hietala <chadhietala@gmail.com>
Signed-off-by: Chad Hietala <chadhietala@gmail.com>
chadhietala
force-pushed
the
gateway-cost-tracing
branch
from
July 30, 2026 01:39
400d0a3 to
7387948
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Adds per-model-call cost attribution to the local trace spool. When a call is served by Vercel AI Gateway, the
agent.stepspan now records what the gateway reported:gen_ai.usage.cost— raw inference cost (USD)gen_ai.usage.gateway_cost— with the gateway surchargegen_ai.usage.input_cost/gen_ai.usage.output_cost— the splitgen_ai.generation.id— reconciliation key for the gateway dashboardThe attributes only exist for gateway-served calls — direct provider connections emit nothing (per the requirement).
How it works
The AI SDK's
Telemetry.onStepEndhook delivers the fullStepResult, includingproviderMetadata.ai-sdk-hook-bridgepublishes it as a newattempt.metadatalifecycle event, andagent-otel-providerwrites the parsedproviderMetadata.gatewaycost fields onto the still-openagent.stepspan (values arrive as USD strings and are parsed to numbers; anything missing/non-numeric is skipped). Cost per turn is a view-time sum across the turn's step spans.Verification
attempt.metadata(and skips metadata-less steps); provider writes cost attributes for gateway shapes and omits them for other providers.{"gen_ai.usage.cost":0.000734,"gen_ai.usage.gateway_cost":0.000834,"gen_ai.usage.input_cost":0.000004,"gen_ai.usage.output_cost":0.00073,"gen_ai.generation.id":"gen_01KYR8XZH46VNKTDRMCNXXXX49"}per step — matching the dashboard.