PyTorch compiler and Rust runtime for multi-CPU/GPU inference, NUMA-aware scheduling, model serving, parameter streaming, and activation spill.
python rust machine-learning deep-learning compiler runtime gpu cuda inference pytorch numa multi-gpu systems-programming rocm model-serving heterogeneous-computing intel-xpu model-inference pytorch-compiler parameter-streaming
-
Updated
Aug 18, 2026 - Python