nixl

Here are 4 public repositories matching this topic...

warply-ai / warply

Open-source Python control plane for LLM inference: launch, route, scale, and observe disaggregated serving on infrastructure you control.

gpu inference kv-cache llm llm-inference skypilot sglang ai-infrastructure nixl disaggregated-inference

Updated Aug 4, 2026
Python

manishklach / seam-orchestrator

Star

A policy layer above transport for KV movement, workload-aware admissibility, and explainable routing in disaggregated inference.

distributed-systems routing orchestration efa kv-cache ucx ai-infrastructure nixl disaggregated-inference gray-failure

Updated Apr 7, 2026
Python

Measuring the KV-transfer tax of disaggregated prefill/decode LLM serving (vLLM + NIXL, 4x A10G): on PCIe-only hardware, disagg loses to plain data-parallel replication — measured, committed, reproducible.

kv-cache inference-benchmark llm-serving vllm llm-inference nixl disaggregated-serving prefill-decode goodput

Updated Jul 13, 2026
Python

andyluo7 / atom-dynamo-integration

Star

ATOM + NVIDIA Dynamo integration and upstream NIXL/MORI transport findings for AMD MI355X

atom amd dynamo mori rocm llm-inference nixl mi355x

Updated Jul 31, 2026
Shell

Improve this page

Add a description, image, and links to the nixl topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the nixl topic, visit your repo's landing page and select "manage topics."

Learn more

Navigation Menu