File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -91,6 +91,13 @@ sliding-layer restored K/V are window-masked during decode. Both incremental
9191decode and fused spec-decode measure ** recall 1.0** with z-lab. (If pure
9292sliding-layer restoration is ever needed, retrain f_θ on z-lab K/V.)
9393
94+ All ** inference/eval** entry points default to z-lab (` k3_e2e_gpu_bench ` ,
95+ ` k3_specdecode_gpu_bench ` , ` k3_integrated_niah_eval ` (+` _mac ` ),
96+ ` k3_dflash_specdecode_eval ` (+` _mac ` ); the gRPC server takes an explicit
97+ ` --drafter-id ` ). The ** f_θ training** script (` k3_f_theta_train.py ` ) and its
98+ orchestration ` .sh ` keep ` models/dflash-kakeya-baseline ` because that is how the
99+ shipped v5 checkpoint was historically trained.
100+
94101## Notes / scope
95102
96103* Drafting conditions on the restored verifier hidden for committed decode tokens
Original file line number Diff line number Diff line change @@ -146,7 +146,7 @@ def main() -> int:
146146 help = "Local MLX 4-bit verifier directory (default: standard Mac path)." ,
147147 )
148148 ap .add_argument (
149- "--drafter-id" , default = "models/dflash-kakeya-baseline " ,
149+ "--drafter-id" , default = "z-lab/gemma-4-26B-A4B-it-DFlash " ,
150150 help = "DFlash drafter source — local path or HF id. Default: the "
151151 "alignment-trained baseline on main (post PR #93 + #99 merge)." ,
152152 )
Original file line number Diff line number Diff line change 4848 HF_TOKEN=hf_xxx PYTHONPATH=.:sdks/python python3 \\
4949 scripts/research/k3_integrated_niah_eval.py \\
5050 --verifier-id google/gemma-4-26B-A4B-it \\
51- --drafter-id models/dflash-kakeya-baseline \\
51+ --drafter-id z-lab/gemma-4-26B-A4B-it-DFlash \\
5252 --f-theta-dir results/research/f_theta_v1 \\
5353 --n-samples 10 --haystack-min-lines 60 --haystack-max-lines 80 \\
5454 --sink-size 4 --window-size 64 \\
9191def parse_args () -> argparse .Namespace :
9292 ap = argparse .ArgumentParser (description = __doc__ )
9393 ap .add_argument ("--verifier-id" , default = "google/gemma-4-26B-A4B-it" )
94- ap .add_argument ("--drafter-id" , default = "models/dflash-kakeya-baseline " )
94+ ap .add_argument ("--drafter-id" , default = "z-lab/gemma-4-26B-A4B-it-DFlash " )
9595 ap .add_argument ("--f-theta-dir" , required = True ,
9696 help = "Directory containing f_theta_config.json + f_theta_weights.pt" )
9797 ap .add_argument ("--n-samples" , type = int , default = 10 )
Original file line number Diff line number Diff line change 1919
2020 PYTHONPATH=.:sdks/python python3 scripts/research/k3_integrated_niah_eval_mac.py \\
2121 --verifier-path models/gemma-4-26B-A4B-it-mlx-4bit \\
22- --drafter-id models/dflash-kakeya-baseline \\
22+ --drafter-id z-lab/gemma-4-26B-A4B-it-DFlash \\
2323 --f-theta-dir results/research/f_theta_v5_s5_sliding \\
2424 --s5-exact-full-attn \\
2525 --n-samples 10 --haystack-min-lines 238 --haystack-max-lines 322 \\
5555def parse_args () -> argparse .Namespace :
5656 ap = argparse .ArgumentParser (description = __doc__ )
5757 ap .add_argument ("--verifier-path" , default = "models/gemma-4-26B-A4B-it-mlx-4bit" )
58- ap .add_argument ("--drafter-id" , default = "models/dflash-kakeya-baseline " )
58+ ap .add_argument ("--drafter-id" , default = "z-lab/gemma-4-26B-A4B-it-DFlash " )
5959 ap .add_argument ("--f-theta-dir" , required = True )
6060 ap .add_argument ("--n-samples" , type = int , default = 10 )
6161 ap .add_argument ("--haystack-min-lines" , type = int , default = 238 )
You can’t perform that action at this time.
0 commit comments