Skip to content

Commit 6bad344

Browse files
Unify proposer to z-lab across ALL inference/eval entry points (CUDA gate + Mac harnesses default + run examples); training script + orchestration keep kakeya-baseline (how f_theta v5 was historically trained), documented in docs/k3-gpu-beta.md
Co-authored-by: FluffyAIcode <FluffyAIcode@users.noreply.github.com>
1 parent cbbab48 commit 6bad344

4 files changed

Lines changed: 12 additions & 5 deletions

File tree

docs/k3-gpu-beta.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -91,6 +91,13 @@ sliding-layer restored K/V are window-masked during decode. Both incremental
9191
decode and fused spec-decode measure **recall 1.0** with z-lab. (If pure
9292
sliding-layer restoration is ever needed, retrain f_θ on z-lab K/V.)
9393

94+
All **inference/eval** entry points default to z-lab (`k3_e2e_gpu_bench`,
95+
`k3_specdecode_gpu_bench`, `k3_integrated_niah_eval`(+`_mac`),
96+
`k3_dflash_specdecode_eval`(+`_mac`); the gRPC server takes an explicit
97+
`--drafter-id`). The **f_θ training** script (`k3_f_theta_train.py`) and its
98+
orchestration `.sh` keep `models/dflash-kakeya-baseline` because that is how the
99+
shipped v5 checkpoint was historically trained.
100+
94101
## Notes / scope
95102

96103
* Drafting conditions on the restored verifier hidden for committed decode tokens

scripts/research/k3_dflash_specdecode_eval_mac.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -146,7 +146,7 @@ def main() -> int:
146146
help="Local MLX 4-bit verifier directory (default: standard Mac path).",
147147
)
148148
ap.add_argument(
149-
"--drafter-id", default="models/dflash-kakeya-baseline",
149+
"--drafter-id", default="z-lab/gemma-4-26B-A4B-it-DFlash",
150150
help="DFlash drafter source — local path or HF id. Default: the "
151151
"alignment-trained baseline on main (post PR #93 + #99 merge).",
152152
)

scripts/research/k3_integrated_niah_eval.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -48,7 +48,7 @@
4848
HF_TOKEN=hf_xxx PYTHONPATH=.:sdks/python python3 \\
4949
scripts/research/k3_integrated_niah_eval.py \\
5050
--verifier-id google/gemma-4-26B-A4B-it \\
51-
--drafter-id models/dflash-kakeya-baseline \\
51+
--drafter-id z-lab/gemma-4-26B-A4B-it-DFlash \\
5252
--f-theta-dir results/research/f_theta_v1 \\
5353
--n-samples 10 --haystack-min-lines 60 --haystack-max-lines 80 \\
5454
--sink-size 4 --window-size 64 \\
@@ -91,7 +91,7 @@
9191
def parse_args() -> argparse.Namespace:
9292
ap = argparse.ArgumentParser(description=__doc__)
9393
ap.add_argument("--verifier-id", default="google/gemma-4-26B-A4B-it")
94-
ap.add_argument("--drafter-id", default="models/dflash-kakeya-baseline")
94+
ap.add_argument("--drafter-id", default="z-lab/gemma-4-26B-A4B-it-DFlash")
9595
ap.add_argument("--f-theta-dir", required=True,
9696
help="Directory containing f_theta_config.json + f_theta_weights.pt")
9797
ap.add_argument("--n-samples", type=int, default=10)

scripts/research/k3_integrated_niah_eval_mac.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@
1919
2020
PYTHONPATH=.:sdks/python python3 scripts/research/k3_integrated_niah_eval_mac.py \\
2121
--verifier-path models/gemma-4-26B-A4B-it-mlx-4bit \\
22-
--drafter-id models/dflash-kakeya-baseline \\
22+
--drafter-id z-lab/gemma-4-26B-A4B-it-DFlash \\
2323
--f-theta-dir results/research/f_theta_v5_s5_sliding \\
2424
--s5-exact-full-attn \\
2525
--n-samples 10 --haystack-min-lines 238 --haystack-max-lines 322 \\
@@ -55,7 +55,7 @@
5555
def parse_args() -> argparse.Namespace:
5656
ap = argparse.ArgumentParser(description=__doc__)
5757
ap.add_argument("--verifier-path", default="models/gemma-4-26B-A4B-it-mlx-4bit")
58-
ap.add_argument("--drafter-id", default="models/dflash-kakeya-baseline")
58+
ap.add_argument("--drafter-id", default="z-lab/gemma-4-26B-A4B-it-DFlash")
5959
ap.add_argument("--f-theta-dir", required=True)
6060
ap.add_argument("--n-samples", type=int, default=10)
6161
ap.add_argument("--haystack-min-lines", type=int, default=238)

0 commit comments

Comments
 (0)