From 37fa107d92a6db9db39ceda07f62931226a35961 Mon Sep 17 00:00:00 2001 From: Claude Date: Thu, 25 Jun 2026 05:45:40 +0000 Subject: [PATCH 1/6] Use Qwen3-Coder-30B-A3B-Instruct-UD-Q4_K_XL for both AI summary phases Add a single aiDefinition (key Qwen3-Coder-30B-A3B-Instruct-UD-Q4_K_XL-C64k) pointing at the locally-present 17.7 GB UD-Q4_K_XL GGUF, and reference it from both the ai-generate (file-body) and ai-aggregate-packages (package-body) executions. - contextSize 65536: generous but CPU-feasible (native 262144; 256k prefill is unusable on CPU). - maxOutputTokens 1536: short dense bullet summaries, not long code gen. - Official Qwen3-Coder sampling: temp 0.7 / top_p 0.8 / top_k 20 / repeat 1.05. - Non-thinking model: no enable_thinking flag set. - Remove the two stale Qwen3-Coder Q4_K_M entries (C32k/C256k) that pointed at a file not present locally; update the model-selection legend accordingly. Co-Authored-By: Claude Opus 4.8 Claude-Session: https://claude.ai/code/session_017i6A5bMhgCSbiKibQhxwuz --- pom.xml | 69 +++++++++++++++++++++++---------------------------------- 1 file changed, 28 insertions(+), 41 deletions(-) diff --git a/pom.xml b/pom.xml index 8894b19..8b061cd 100644 --- a/pom.xml +++ b/pom.xml @@ -840,18 +840,14 @@ SPDX-License-Identifier: Apache-2.0 Gemma 4 entries; only pick Q6_K_P if Q4_K_M quality is visibly short. Use when: a light model keeps refusing, or you need the lightest Gemma 4. - Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-C32k (RECOMMENDED default for code) - + MoE 30B total / ~3B active: code-specialized AND fast on CPU; fewer - active params than Gemma-4-26B-A4B; Apache-2.0. - - 18.6 GB download; needs Qwen sampling (temp 0.7 / top_p 0.8 / top_k 20). + Qwen3-Coder-30B-A3B-Instruct-UD-Q4_K_XL-C64k (RECOMMENDED default for code; ACTIVE for both phases) + + MoE 30B total / ~3.3B active: code-specialized AND fast on CPU; fewer + active params than Gemma-4-26B-A4B; non-thinking; Apache-2.0. + + Locally present (X:/Modelle/Qwen3-Coder-30B-A3B-Instruct-UD-Q4_K_XL.gguf, + 17.7 GB); 64K context — generous but CPU-feasible (256K prefill is unusable on CPU). + - Needs Qwen sampling (temp 0.7 / top_p 0.8 / top_k 20 / repeat 1.05). Use when: this is the go-to for most code summarization on CPU. - Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-C256k (same file, huge window) - + Native 256K context; MoE + GQA keep the KV cache small (~+4.8 GB vs 32K). - - CPU PREFILL of a near-full window can take minutes; only worth it for - very large package roll-ups (Phase 2) or huge files. - Use when: a single input genuinely exceeds the 32K entries. - Qwen2.5-Coder-14B-Instruct-Q4_K_M-C32k + The cited top LOCAL dense code model at the 16 GB tier; big step up from the 7B entry. @@ -1110,36 +1106,27 @@ SPDX-License-Identifier: Apache-2.0 <end_of_turn> - + - Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-C32k - X:/Modelle/Qwen3-Coder-30B-A3B-Instruct-Q4_K_M.gguf - 32768 - 2048 - 0.7 - 8 - 4 - true - 0.0 - 0.8 - 20 - 1.05 - - - - Qwen3-Coder-30B-A3B-Instruct-Q4_K_M-C256k - X:/Modelle/Qwen3-Coder-30B-A3B-Instruct-Q4_K_M.gguf - 262144 - 2048 + Qwen3-Coder-30B-A3B-Instruct-UD-Q4_K_XL-C64k + X:/Modelle/Qwen3-Coder-30B-A3B-Instruct-UD-Q4_K_XL.gguf + 65536 + 1536 0.7 8 4 @@ -1313,7 +1300,7 @@ Source: file-body - Gemma-4-26B-A4B-it-UD-Q4_K_M-C32k + Qwen3-Coder-30B-A3B-Instruct-UD-Q4_K_XL-C64k @@ -1329,7 +1316,7 @@ Source: package-body - Gemma-4-26B-A4B-it-UD-Q4_K_M-C32k + Qwen3-Coder-30B-A3B-Instruct-UD-Q4_K_XL-C64k From 98dc92988c41b80db933bf2ee983450edfac1eb5 Mon Sep 17 00:00:00 2001 From: Claude Date: Thu, 25 Jun 2026 05:46:55 +0000 Subject: [PATCH 2/6] Replace file-body prompt with structured multi-language code indexer Swap the Java-centric prose file-summary prompt for a dense, section-based multi-language indexer prompt (Java/C/C++/OpenCL/SQL) that emits a blockquote lead plus fixed '####' sections (Purpose, Type, Input, Output, Core logic, Public API, Dependencies, Exceptions/Errors). The File/Source %s placeholders are unchanged. Co-Authored-By: Claude Opus 4.8 Claude-Session: https://claude.ai/code/session_017i6A5bMhgCSbiKibQhxwuz --- pom.xml | 63 +++++++++++++++++++++++++++++++++++---------------------- 1 file changed, 39 insertions(+), 24 deletions(-) diff --git a/pom.xml b/pom.xml index 8b061cd..61c60b4 100644 --- a/pom.xml +++ b/pom.xml @@ -1219,31 +1219,46 @@ SPDX-License-Identifier: Apache-2.0 file-body