Harden Primary decode lifecycle and isolate MLX worker - #227
Merged
FluffyAIcode merged 9 commits intoJul 21, 2026
Merged
Conversation
Unify session cleanup and move blocking RPC work off asyncio while adding cancellation guards, memory governance, liveness diagnostics, and external watchdog recovery. Co-authored-by: Cursor <cursoragent@cursor.com>
Reduce primary decode synchronization and materialization while preserving the full speculative block contract, with exact logits/KV parity and focused performance coverage. Co-authored-by: Cursor <cursoragent@cursor.com>
Keep model and session KV in a recoverable UDS child so router liveness and cancellation no longer depend on an in-process Metal forward. Co-authored-by: Cursor <cursoragent@cursor.com>
Provide fixed release gates and a worker-neutral control contract so decode isolation can be validated without coupling the harness to runtime internals. Co-authored-by: Cursor <cursoragent@cursor.com>
Expose local-only worker state, fault injection, and snapshot restore parity so the Mac acceptance harness can validate the process-isolated runtime end to end. Co-authored-by: Cursor <cursoragent@cursor.com>
Keep the complete origin/main integration diff free of trailing whitespace before CI handoff. Co-authored-by: Cursor <cursoragent@cursor.com>
|
Bugbot is not enabled for your account, so this pull request was not reviewed. Enable Bugbot in the Cursor dashboard to get automatic reviews on future PRs. |
Exercise worker snapshot imports, proxy appends, cancellation, concurrency, and memory-drain paths so the platform-neutral gate remains deterministic at 100% coverage. Co-authored-by: Cursor <cursoragent@cursor.com>
Guard terminal gRPC streams from late cancellation cleanup and replace ps-based footprint sampling so long-running decode workers cannot deadlock gRPC during memory checks. Co-authored-by: Cursor <cursoragent@cursor.com>
Capture the release-blocking Gemma hardware evidence so deployment is tied to the verified runtime commit and recovery behavior. Co-authored-by: Cursor <cursoragent@cursor.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Test plan
The 4-hour hardware gate remains blocking before production deployment and proof restart.
Made with Cursor