Skip to content

Add async request queue to llm-server - #250

Merged
stikves merged 2 commits into
apple:mainfrom
stikves:sukru/serve-v2-public
Sep 14, 2026
Merged

stikves merged 2 commits into
apple:mainfrom
stikves:sukru/serve-v2-public

Use Atomic<Bool> for QueuePermit release guard

1b97dcb
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
swift-format
succeeded Sep 14, 2026 in 41s