server: one preemption path, swap under --preempt-ram and recompute above it - #186

server: one preemption path, swap under --preempt-ram and recompute above it#186

danielhanchen wants to merge 4 commits into

feat/server-side-preemptionunslothai/llama.cpp:feat/server-side-preemptionfrom

feat/server-side-preemption-hybridunslothai/llama.cpp:feat/server-side-preemption-hybridCopy head branch name to clipboard