Skip to content

[Agentic] Prompt prefix caching #2

@eloe

Description

@eloe

Status: ✅ Complete\n\nBranch: feature/prompt-cache | Combined: feature/combined-bastion | Tests: 6 | Upstream PR: pending\n\n## Summary\nWire existing PromptCacheState into server endpoints. Skips ~15K token system prompt re-prefill on follow-up turns (~35s → ~2-3s).

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions