Skip to content

Session affinity routing#178

Open
szedan-rh wants to merge 1 commit into
llm-d:mainfrom
szedan-rh:session-affinity-routing
Open

Session affinity routing#178
szedan-rh wants to merge 1 commit into
llm-d:mainfrom
szedan-rh:session-affinity-routing

Add session-affinity filter for KV cache locality

8400afa
Select commit
Loading
Failed to load commit list.