will more gpu be supported？

[lysh]

will TP，EP，PP be supported？

[andrewkchan]

Hi @lysh, I originally created this as an exercise in single-batch, single-GPU LLM decode performance engineering. I don't currently plan to support parallelism methods over multiple GPUs anytime soon, but if there is enough interest from others I may create another, similar educational repo for the same.