Skip to content

fix(agents): accept exact remote KV hits in gate - #185

Merged
FluffyAIcode merged 1 commit into
mainfrom
AgentMemory/remote-hit-gate-0717
Jul 17, 2026
Merged

fix(agents): accept exact remote KV hits in gate#185
FluffyAIcode merged 1 commit into
mainfrom
AgentMemory/remote-hit-gate-0717

Conversation

@FluffyAIcode

Copy link
Copy Markdown
Owner

Summary

  • accept strict complete allens KV hits whether sourced from an existing snapshot or a new remote Prefill job
  • require reused tokens, zero local computation, zero fallbacks, and zero remote job failures
  • retain the Primary local-hit requirement for the actual inference pass
  • add regression coverage for both remote-compute and exact remote-cache warmups

Root cause

Deterministic prompts introduced in PR #183 correctly enabled exact allens cache hits. The old benchmark gate still required remote_jobs >= 1, so it rejected the superior remote_hits=1, remote_jobs=0 path after successful Generator output.

Observed failing turn counters were remote_hits=1, local_hits=1, tokens_computed=0, and fallbacks=0; inference and KV reuse were correct.

Tests

  • targeted Agent GAN gate suite — 13 passed
  • full platform-neutral suite — 859 passed, 1 skipped
  • diff checks pass

Made with Cursor

Treat a complete allens cache restore as a valid warmup without requiring redundant remote recomputation before the Primary hot-hit inference pass.

Co-authored-by: Cursor <cursoragent@cursor.com>
@cursor

cursor Bot commented Jul 17, 2026

Copy link
Copy Markdown

Bugbot is not enabled for your account, so this pull request was not reviewed.

Enable Bugbot in the Cursor dashboard to get automatic reviews on future PRs.

@FluffyAIcode
FluffyAIcode merged commit 5a10dd4 into main Jul 17, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant