probe(mac-bridge): vllm-mlx-niah — vLLM-MLX continuous batching on gemma-4 is broken (shared_kv) - #142

probe(mac-bridge): vllm-mlx-niah — vLLM-MLX continuous batching on gemma-4 is broken (shared_kv)#142

FluffyAIcode wants to merge 5 commits into

mainFluffyAIcode/Kakeya-LLM-Inference-engine:mainfrom

AgentMemory/vllm-mlx-bridge-niah-2815FluffyAIcode/Kakeya-LLM-Inference-engine:AgentMemory/vllm-mlx-bridge-niah-2815Copy head branch name to clipboard