Multi-Token Prediction benchmarks for Gemma 4 on Apple Silicon — LiteRT-LM, transformers, and llama.cpp at batch=1 on a MacBook M4 Pro. ~2× speedup reproducible in one specific runtime.
macos benchmark metal transformers gemma mlx edge-ai on-device-ai apple-silicon llama-cpp speculative-decoding multi-token-prediction litert-lm gemma-4 on-edge-llm
-
Updated
May 7, 2026 - HTML