long term effort: Serve safetensors models on Metal via MLX (Apple Silicon) - #1009

Draft

michaelneale wants to merge 37 commits into

mainfrom

Commits on Jul 16, 2026

docs: MLX as a Skippy stage engine — deep dive and plan
michaelneale
committed
0a0bf81
spike: prove goose-style solo MLX serving from raw safetensors
michaelneale
committed
d2bf949
spike: real Metal numbers for goose-style solo MLX serving
michaelneale
committed
b63e10c
docs+spike: correct MLX platform framing; prove fork-free is not viable yet
michaelneale
committed
558be44
feat: MLX (Metal) serving engine for tensor models, goose-style
michaelneale
committed
4632c4b
feat(mlx): serve safetensors models to Metal via git-pinned safemlx
michaelneale
committed
8eded3a
wip(mlx): wire MLX engine into mesh-llm serve (safetensors routing)
michaelneale
committed
7448a10

Commits on Jul 17, 2026

feat(mlx): prove partial safetensors stage execution
michaelneale
committed
99a86ec
feat(mlx): serve partial safetensors stages over skippy wire
michaelneale
committed
613ddaa
refactor(skippy): adapt llama runtime to stage engine
michaelneale
committed
7d3852c
feat(mlx): materialize verified safetensors stage slices
michaelneale
committed
93f5d58
fix(mlx): harden staged tensor identity and loading
michaelneale
committed
43d08d1
feat(mlx): load safetensors stages through host control
michaelneale
committed
3adc7a9
feat(mlx): quantize partial stages on load
michaelneale
committed
6e46934
feat(model-hf): stream exact stage tensors sequentially
michaelneale
committed
54de5f4
feat(mlx): derive quantized stages from exact ranges
michaelneale
committed
884395e
feat(mlx): cache derived stages by recipe
michaelneale
committed
e71a926
feat(mlx): prepare quantized stages through host cache
michaelneale
committed
fb731b9
feat(model-hf): plan Nemotron-H tensor ranges
michaelneale
committed
24c4e0d
feat(mlx): derive bounded Nemotron-H expert layers
michaelneale
committed
16447d1
feat(mlx): execute Nemotron-H MoE stages
michaelneale
committed
9a5e9ac
feat(mlx): prove Nemotron stage binary wire
michaelneale
committed
5493b77
test(mlx): prove multi-token Nemotron wire
michaelneale
committed
4a261f6
bench(mlx): instrument activation boundary fence
michaelneale
committed
d381bbd
docs(mlx): record boundary fence evidence
michaelneale
committed
08c6d74
bench(mlx): measure production TCP boundary
michaelneale
committed
6350e3a
docs(mlx): record TCP boundary evidence
michaelneale
committed
3854f27
bench(mlx): support external TCP boundary
michaelneale
committed
27bd588
docs(mlx): record two-host boundary evidence
michaelneale
committed
a6802bf
feat(mlx): prove two-host stage execution
michaelneale
committed
58de032
feat(mlx): integrate safetensors mesh serving
michaelneale
committed
2690a1a
docs(mlx): reconcile integrated serving status
michaelneale
committed
9b1cdcd
build(mlx): make engine publish-chain compatible
michaelneale
committed
96cec9f
fix(mlx): preserve native load on auto quant mismatch
michaelneale
committed
226d004
fix(mlx): fail closed on strict load errors
michaelneale
committed
41c4fbf
fix(mlx): serve standard prequantized checkpoints
michaelneale
committed
c4ad58f
fix(models): ignore bit width in parameter labels
michaelneale
committed
75fb8b2