Repository navigation
feat(container)!: Update image ghcr.io/gufo-org/toolboxes/gufo-runtime (0.22.0 ➔ 0.23.0) - #1772
Conversation
…e (0.22.0 ➔ 0.23.0)
konflate · #1772 — feat(container)!: Update image ghcr.io/gufo-org/toolboxes/gufo-runtime (0.22.0 ➔ 0.23.0)Tip Routine: only container-image and chart-version changes; 1 resource across 1 app
konflate 0.6.6 · rendered |
Confidence Score: 5/5[Medium risk] The pre-1.0 minor runtime update affects a single inference service and can interrupt active sessions during rollout or cause serving regressions, with the image change reversible by rollback. Approved SummaryBumps the gufo-runtime image for Flash-Next to 0.23.0 Upstream gufo 0.23.0 adds EmbeddingGemma 2 serving, reads GGUF shards through a new mapped_file leaf, and lets greedy requests with penalties or constraints use the small MTP draft head; its CHANGELOG lists no removals, renames or changed defaults, and none of the flags this service passes (--sessions, --max-pending-per-client, --max-request-bytes, --speculative mtp, --mtp-model, --context, --max-tokens, --reasoning-effort, --cache-disk, --cache-disk-bytes) is documented as gone in the v0.23.0 docs/SERVER.md. konflate renders the change as one InferenceService, so merging restarts the qwen3.8-flash-next-strix pod, which must re-read the ~111GB of weights under the 2h startup probe, and rolloutPolicy.waitForIdle: false means it will not wait for in-flight sessions to drain. The image still carries ROCM_PATH at clr-7.2.3, so the ROCm 10.1 leaf the toolboxes flake picked up in the same window is not what this image runs. Open question the notes do not answer: upstream rewrites src/cache/disk.cpp between v0.22.0 and v0.23.0, so after merging confirm the /cache/continuation directory under llmkube-strix-cache is still reused rather than treated as unreferenced and evicted down to the 64GiB budget — expect a prompt-checkpoint hit on a repeated long conversation instead of a cold prefill. The upstream toolboxes repository publishes no releases or tags, so the changelog for the runtime image is the gufo-org/gufo release notes for v0.23.0, which were read in full; there is no 0.22.0→0.23.0 toolboxes-level changelog beyond the flake.lock bump to that tag. Review context · 15 sources · 4/7 commands
The review's agent was told to submit what it had found on the last step it may take, so it may not cover all it meant to check. Reviews (1) · Last reviewed commit: "feat(container)!: Update image ghcr.io/g..." · self-qwen3.8-flash-next/low |
![faust-review[bot]](https://avatars.githubusercontent.com/in/5152594?s=60&v=4){kind=small}
There was a problem hiding this comment.
kritika: confidence 5/5 with medium risk at ea9b788.
This PR contains the following updates:
0.22.0→0.23.0Configuration
📅 Schedule: (UTC)
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR has been generated by Mend Renovate CLI.