Skip to content

feat(agents): add interactive streaming GAN REPL - #177

Merged
FluffyAIcode merged 1 commit into
mainfrom
AgentMemory/interactive-agent-gan-repl-0716
Jul 16, 2026
Merged

feat(agents): add interactive streaming GAN REPL#177
FluffyAIcode merged 1 commit into
mainfrom
AgentMemory/interactive-agent-gan-repl-0716

Conversation

@FluffyAIcode

Copy link
Copy Markdown
Owner

Summary

  • add an interactive prompt> REPL that starts missing Gemma services and leaves them running
  • warm each Generator/Critic context through allens prefill, then stream actual Primary hot-hit tokens to Terminal in real time
  • print per-prompt KV hit rate, decode tok/s, generation ms/token, E2E tok/s and benchmark run id
  • persist only redacted output hash/length and metrics to kakeya.ai; terminal alone shows model text
  • support repeated prompts until /quit or EOF

Tests

  • streaming suffix, cache gate and privacy report tests — 7 passed
  • full platform-neutral Python suite — 850 passed, 1 skipped
  • Python compile, shell syntax and diff checks pass

Live validation after merge

Open Terminal with bash scripts/run_agent_gan_repl.sh, enter a real prompt, verify token streaming for Generator and Critic, then inspect the resulting run in kakeya.ai Benchmarks.

Made with Cursor

Accept prompts in Terminal, ensure the two-Mac Gemma services, stream Generator and Critic tokens as they arrive, and publish redacted per-turn KV and throughput metrics to the benchmark dashboard.

Co-authored-by: Cursor <cursoragent@cursor.com>
@cursor

cursor Bot commented Jul 16, 2026

Copy link
Copy Markdown

Bugbot is not enabled for your account, so this pull request was not reviewed.

Enable Bugbot in the Cursor dashboard to get automatic reviews on future PRs.

@FluffyAIcode
FluffyAIcode merged commit d9847ae into main Jul 16, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant