Skip to content

fix(models): forward caller prompt cache keys - #57

Merged
rezaho merged 1 commit into
mainfrom
fix/caller-prompt-cache-key
Sep 9, 2026
Merged

fix(models): forward caller prompt cache keys#57
rezaho merged 1 commit into
mainfrom
fix/caller-prompt-cache-key

Conversation

@rezaho

@rezaho rezaho commented Sep 9, 2026

Copy link
Copy Markdown
Owner

OpenAI and Azure payload builders silently drop a caller's prompt_cache_key; the OAuth builder replaces it with a new random value on every request. Forward the supplied key unchanged on all three legs and omit the field when it is absent or None.

Validation: 73 offline adapter tests passed, including payload assertions for synchronous and asynchronous OpenAI, Azure and OAuth adapters. These checks prove request construction; live cache-hit measurements remain the consuming application's gate.

API contract: https://developers.openai.com/api/reference/cli/resources/responses/methods/create

@rezaho
rezaho marked this pull request as ready for review September 9, 2026 12:19
@rezaho
rezaho merged commit 8cf8f37 into main Sep 9, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant