Skip to content

feat(agents): add Generator-Critic inference demo - #175

Merged
FluffyAIcode merged 1 commit into
mainfrom
AgentMemory/agent-gan-inference-demo-0716
Jul 16, 2026
Merged

feat(agents): add Generator-Critic inference demo#175
FluffyAIcode merged 1 commit into
mainfrom
AgentMemory/agent-gan-inference-demo-0716

Conversation

@FluffyAIcode

Copy link
Copy Markdown
Owner

Summary

  • add a real Generator/Critic adversarial inference loop with separate logical histories and two revision rounds
  • warm each exact agent context through allens prefill, then run actual generation from the promoted Primary hot KV
  • print real model proposal/critique text in terminal while persisting only output hash/length and redacted metrics
  • report per-agent TTFT, prefill throughput, decode tok/s, generation ms/token, E2E tok/s, hit source and cache deltas
  • report both inference-only KV token hit rate and honest whole-workload hit rate including warmup cost
  • extend the Benchmarks UI with KV hit rate, generation latency, Agent/round labels and live latest-stage metrics

Tests

  • Agent gate/privacy and report aggregation tests — 5 passed
  • full platform-neutral Python suite — 848 passed, 1 skipped
  • network/dashboard regression — 10 passed
  • Python compile, shell syntax and diff checks pass

Live validation after merge

Run bash scripts/run_agent_gan_demo.sh --rounds 2 --output-tokens 64, inspect real terminal output, then verify the agent_gan_inference_demo history/detail on kakeya.ai.

Made with Cursor

Run real multi-round Generator/Critic model inference over allens prefill and Primary decode, and report per-agent plus aggregate token throughput, generation latency, and honest workload KV hit rates.

Co-authored-by: Cursor <cursoragent@cursor.com>
@cursor

cursor Bot commented Jul 16, 2026

Copy link
Copy Markdown

Bugbot is not enabled for your account, so this pull request was not reviewed.

Enable Bugbot in the Cursor dashboard to get automatic reviews on future PRs.

@FluffyAIcode
FluffyAIcode merged commit 0bf8c23 into main Jul 16, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant