Relationship with sgl-model-gateway in sglang — which to use?

[ekzhang]

Hi, we're interested in using the OSS model gateway directly — I made a PR in sgl-project/sglang#19797 with a small change to job queue for AddWorker but then realized this repository exists and is getting more recent releases.

Should I send future PRs to this repository? Also should we switch from lmsysorg/sgl-model-gateway images to lightseekorg/smg on Docker Hub?

[ekzhang]

@slin1237

[slin1237]

hello @ekzhang
thanks for reaching out. SMG was originally created by me and @CatherineSue
this project no longer makes sense to be part of SGLang code base due to size of the rust code.
SMG also now supports all serving engine (SGLang, vLLM, and TensorRT-LLM).
SMG is now graduated from SGLang, and currently owned by many parties including SGLang, vLLM, TRT, Oracle, togetherAI etc.
we will eventually remove the code inside of SGLang or pause any new features.
We have not officially made the announcement yet.
I'm surprised that you found us 😁
To answer your question. Yes
You should use this SMG, the code you added, I will port them over. Thank you so much!