Skip to content

feat(usage): register Cognition/Devin list prices for both devin surfaces #4466

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
lidge-jun merged 1 commit into from
Sep 13, 2026
+99 −2
Merged

feat(usage): register Cognition/Devin list prices for both devin surfaces #4466

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
58 changes: 58 additions & 0 deletions src/usage/expected-prices.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -143,6 +143,31 @@ const BIGMODEL_NOTE = "z.ai international list price shown as estimate; domestic
// under a vendor-price label would be a wrong value wearing a verified badge.
const QWEN38_MAX_PRICING = "https://qwen.ai/blog?id=qwen3.8 (Qwen release announcement; no Model Studio billing row yet; cache rates unpublished -> 0)";

/*
* Cognition/Devin list prices (USD / 1M tokens), verified 2026-09-13 against the
* official "AI Models" page — its embedded modelCostData table publishes
* input / cache-read / cache-write / output per model uid. Self-serve extra
* usage and enterprise ACU conversion both bill at these list rates, so the
* tuples are the vendor's own published numbers; every row still stays
* verified-derived because the surface itself is subscription/ACU, not a
* per-token API.
* Time-boxed promos are NOT baked in: SWE-2 shows $0 self-serve through
* 2026-10-08 and 75%-off enterprise through 2026-12-31, and the doc states the
* list rate is what applies afterward, so the list rate is the durable catalog
* value. swe-1-7 keeps its list rate for the same reason even though the
* self-serve column currently shows 0. gemini-3-8-flash is absent from the
* table entirely, so its row derives from Google's published rate instead.
*/
const DEVIN_SWE_2: Cost4 = { input: 3, output: 15, cacheRead: 0.3, cacheWrite: 0 };
const DEVIN_SWE_17: Cost4 = { input: 0.5, output: 2.5, cacheRead: 0.2, cacheWrite: 0 };
const DEVIN_SWE_17_LIGHTNING: Cost4 = { input: 2.5, output: 12.5, cacheRead: 1, cacheWrite: 0 };
const DEVIN_SONNET_5: Cost4 = { input: 2, output: 10, cacheRead: 0.2, cacheWrite: 2.5 };
const DEVIN_KIMI_K3: Cost4 = { input: 3, output: 15, cacheRead: 0.3, cacheWrite: 0 };
const DEVIN_KIMI_K27: Cost4 = { input: 0.95, output: 4, cacheRead: 0.19, cacheWrite: 0 };
const DEVIN_GROK: Cost4 = { input: 2, output: 6, cacheRead: 0.3, cacheWrite: 0 };
const DEVIN_PRICING = "https://docs.devin.ai/desktop/models (official modelCostData table, 2026-09-13; list rates for self-serve overage / enterprise ACU conversion on a subscription surface)";
const DEVIN_SWE2_NOTE = "list rate; $0 self-serve through 2026-10-08 and 75%-off enterprise through 2026-12-31 are time-boxed promos, not baked in";

export const EXPECTED_PRICE_OVERLAYS: readonly ExpectedPriceOverlay[] = [
{ provider: "openai-apikey", modelId: "gpt-6-astra", cost4: GPT6_ASTRA, source: ASTRA_API_PRICING, verifiedAt: "2026-09-05", status: "verified" },
// Display estimates use API prices for both login and API-key routes, including cache writes.
Expand Down Expand Up @@ -305,6 +330,39 @@ export const EXPECTED_PRICE_OVERLAYS: readonly ExpectedPriceOverlay[] = [
// turbo id is CNY-only upstream and stays unregistered (see the GLM_* note).
{ provider: "zhipu-bigmodel-responses", modelId: "glm-5.3", cost4: GLM_53, source: `${ZAI_CODING_PLAN_NOTE}; ${ZAI_PRICING}`, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "zhipu-bigmodel-responses", modelId: "glm-5.3-flash", cost4: GLM_53_FLASH, source: `${ZAI_CODING_PLAN_NOTE}; ${ZAI_PRICING}`, verifiedAt: "2026-09-13", status: "verified-derived" },
// Cognition/Devin — the two OAuth surfaces resolve by exact provider id, so
// each carries the roster its liveModels discovery can surface. swe-2 and
// swe-1-6 are listed on both even though each static seed names only one
// side: the live catalog is authoritative and drifts between them.
Comment on lines +333 to +336

@chatgpt-codex-connector chatgpt-codex-connector Bot Sep 13, 2026

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Cover the complete live roster on both Devin provider IDs

The two lists are still based mostly on their static seeds even though fetchDevinUsableModels applies no provider-specific filtering and both registry entries share the union-like DEVIN_MODEL_CONTEXT_WINDOWS. If a devin-cli account discovers gpt-5-6-luna/gpt-5-6-terra, or a devin account discovers gpt-6-astra, the exact overlay lookup misses; the dashed GPT IDs do not match the generated dotted metadata IDs, and Astra has no generated vendor row, so those attempts remain price_unmatched. Register the full discoverable base-model union for both provider namespaces, with tests for the cross-surface cases.

Useful? React with 👍 / 👎.

// gpt-5-6-sol uses the enterprise list column — the same table's self-serve
// column shows a discounted 1.2/6, and the doc calls the list rate the
// billing rate for overage. glm-5-2 likewise takes the nonzero list column.
{ provider: "devin-cli", modelId: "swe-2", cost4: DEVIN_SWE_2, source: `${DEVIN_SWE2_NOTE}; ${DEVIN_PRICING}`, verifiedAt: "2026-09-13", status: "verified-derived" },

@chatgpt-codex-connector chatgpt-codex-connector Bot Sep 13, 2026

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Update every structure owner for the pricing change

This changes pricing behavior under src/usage/, but the source-to-doc map assigns that area to both structure/runtime.md and structure/gui-and-management-api.md, and neither is updated; the latter's expected-price-overlay contract currently discusses only the Z.AI derived rows. Update both owning documents in this commit to reflect the new Devin overlays and their subscription/list-rate semantics.

AGENTS.md reference: src/AGENTS.md:L11-L11

Useful? React with 👍 / 👎.

{ provider: "devin-cli", modelId: "swe-1-7", cost4: DEVIN_SWE_17, source: `list rate; self-serve column currently shows 0 (unannounced promo); ${DEVIN_PRICING}`, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin-cli", modelId: "swe-1-7-lightning", cost4: DEVIN_SWE_17_LIGHTNING, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin-cli", modelId: "swe-1-6", cost4: DEVIN_SWE_17, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin-cli", modelId: "gpt-5-6-sol", cost4: GPT56_SOL, source: `enterprise list column (self-serve shows discounted 1.2/6); ${DEVIN_PRICING}`, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin-cli", modelId: "gpt-6-astra", cost4: GPT6_ASTRA, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin-cli", modelId: "claude-opus-5", cost4: CLAUDE_OPUS_46, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin-cli", modelId: "claude-fable-5-1", cost4: CLAUDE_FABLE_51, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin-cli", modelId: "claude-sonnet-5", cost4: DEVIN_SONNET_5, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin-cli", modelId: "glm-5-3", cost4: GLM_53, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin-cli", modelId: "kimi-k3", cost4: DEVIN_KIMI_K3, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin-cli", modelId: "gemini-3-8-flash", cost4: GEMINI_38_FLASH, source: `derived: absent from Devin's modelCostData table; Google published promotional rate through 2026-12-31 shown as estimate ${GEMINI_38_PRICING}`, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin-cli", modelId: "grok-4-6", cost4: DEVIN_GROK, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin", modelId: "swe-2", cost4: DEVIN_SWE_2, source: `${DEVIN_SWE2_NOTE}; ${DEVIN_PRICING}`, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin", modelId: "swe-1-7", cost4: DEVIN_SWE_17, source: `list rate; self-serve column currently shows 0 (unannounced promo); ${DEVIN_PRICING}`, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin", modelId: "swe-1-7-lightning", cost4: DEVIN_SWE_17_LIGHTNING, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin", modelId: "swe-1-6", cost4: DEVIN_SWE_17, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin", modelId: "gpt-5-6-sol", cost4: GPT56_SOL, source: `enterprise list column (self-serve shows discounted 1.2/6); ${DEVIN_PRICING}`, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin", modelId: "gpt-5-6-luna", cost4: GPT56_LUNA, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin", modelId: "gpt-5-6-terra", cost4: GPT56_TERRA, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin", modelId: "claude-opus-4-8", cost4: CLAUDE_OPUS_46, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin", modelId: "claude-fable-5-1", cost4: CLAUDE_FABLE_51, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin", modelId: "claude-sonnet-5", cost4: DEVIN_SONNET_5, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin", modelId: "glm-5-2", cost4: GLM_52, source: `enterprise list column (self-serve shows an unannounced 0 promo); ${DEVIN_PRICING}`, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin", modelId: "kimi-k2-7", cost4: DEVIN_KIMI_K27, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
{ provider: "devin", modelId: "grok-4-5", cost4: DEVIN_GROK, source: DEVIN_PRICING, verifiedAt: "2026-09-13", status: "verified-derived" },
];

/**
Expand Down
43 changes: 41 additions & 2 deletions tests/usage/usage-cost.test.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -298,8 +298,8 @@ describe("resolveMatchedPrice", () => {
expect(resolveMatchedPrice("openrouter", "anthropic-claude-3.5-sonnet")).toBeNull();
});

test("16. shipped overlay membership: 95 keys, including canonical Fable 5.1, Opus 5 and compatibility prices", () => {
expect(EXPECTED_PRICE_OVERLAYS.length).toBe(95);
test("16. shipped overlay membership: 121 keys, including canonical Fable 5.1, Opus 5 and compatibility prices", () => {
expect(EXPECTED_PRICE_OVERLAYS.length).toBe(121);
expect(EXPECTED_PRICE_OVERLAYS.some(row => row.status === "unverified")).toBe(false);
const keys = new Set(EXPECTED_PRICE_OVERLAYS.map(row => `${row.provider}/${row.modelId}`));
for (const expected of [
Expand Down Expand Up @@ -397,6 +397,35 @@ describe("resolveMatchedPrice", () => {
"zhipu-bigmodel-coding/glm-4.6",
"zhipu-bigmodel-responses/glm-5.3",
"zhipu-bigmodel-responses/glm-5.3-flash",
// Cognition/Devin — both OAuth surfaces carry their own rows keyed by
// exact provider id; tuples come from the official docs.devin.ai
// modelCostData table (2026-09-13).
"devin-cli/swe-2",
"devin-cli/swe-1-7",
"devin-cli/swe-1-7-lightning",
"devin-cli/swe-1-6",
"devin-cli/gpt-5-6-sol",
"devin-cli/gpt-6-astra",
"devin-cli/claude-opus-5",
"devin-cli/claude-fable-5-1",
"devin-cli/claude-sonnet-5",
"devin-cli/glm-5-3",
"devin-cli/kimi-k3",
"devin-cli/gemini-3-8-flash",
"devin-cli/grok-4-6",
"devin/swe-2",
"devin/swe-1-7",
"devin/swe-1-7-lightning",
"devin/swe-1-6",
"devin/gpt-5-6-sol",
"devin/gpt-5-6-luna",
"devin/gpt-5-6-terra",
"devin/claude-opus-4-8",
"devin/claude-fable-5-1",
"devin/claude-sonnet-5",
"devin/glm-5-2",
"devin/kimi-k2-7",
"devin/grok-4-5",
]) {
expect(keys.has(expected)).toBe(true);
}
Expand Down Expand Up @@ -428,6 +457,16 @@ describe("resolveMatchedPrice", () => {
const price = resolveMatchedPrice(provider, modelId);
expect(price, `${provider}/${modelId}`).toMatchObject({ cost4, source: "expected", status: "verified-derived" });
}
// Devin overlays: SWE-2's list rate is exactly the Kimi K3 tuple, and the
// time-boxed $0 promos are deliberately not baked in.
for (const [provider, modelId, cost4] of [
["devin-cli", "swe-2", { input: 3, output: 15, cacheRead: 0.3, cacheWrite: 0 }],
["devin", "swe-1-7-lightning", { input: 2.5, output: 12.5, cacheRead: 1, cacheWrite: 0 }],
["devin", "gpt-5-6-luna", { input: 0.2, output: 1.2, cacheRead: 0.02, cacheWrite: 0.25 }],
] as const) {
const price = resolveMatchedPrice(provider, modelId);
expect(price, `${provider}/${modelId}`).toMatchObject({ cost4, source: "expected", status: "verified-derived" });
}
for (const modelId of [
"gemini-3.5-flash-extra-low",
"gemini-3.5-flash-low",
Expand Down
Loading