Skip to content

Commit 9064d53

Browse files
fix(mac chat): default --max-new-tokens=2048 as a generous backstop (natural EOS stops first)
Co-authored-by: FluffyAIcode <FluffyAIcode@users.noreply.github.com>
1 parent 3616e33 commit 9064d53

1 file changed

Lines changed: 3 additions & 3 deletions

File tree

scripts/chat_mlx_kakeya.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -95,9 +95,9 @@ def main() -> int:
9595
ap.add_argument("--full-window", type=int, default=8192,
9696
help="Resident window for the full-attention (exact) layers "
9797
"— large = effectively full context (S5 recall carrier).")
98-
ap.add_argument("--max-new-tokens", type=int, default=1024,
99-
help="Generation cap. Long explanations can need 1500+; raise "
100-
"this if answers get cut off ('断掉').")
98+
ap.add_argument("--max-new-tokens", type=int, default=2048,
99+
help="Backstop cap ONLY — generation stops naturally at gemma's "
100+
"<end_of_turn>, so you should not need to tune this.")
101101
ap.add_argument("--repetition-penalty", type=float, default=1.3,
102102
help="Penalize repeated tokens to stop greedy loops (1.0 = off).")
103103
ap.add_argument("--thinking", action="store_true",

0 commit comments

Comments
 (0)