Though vllm-metax is trying its best to catch up with vllm upstream on every release, there is a lot of jobs that are still strongly needed in our open-source ecosystem.
vllm-metax currently is lacking of need 3 significant parts:
Unit test that ported from vllm's tests folder.
Since vllm-metax is a cuda-alike backend. We need to maintain all the functional tests for
- cuda kernels
- and cores like attention backends and pluggable layers and custom ops.
CI/CD
The old CI/CD was deprecated since v0.10.0. We need to reconstruct them:
- Basic e2e tests on PRs(the most significant)
- Daily e2e tests for vllm's upstream master commits.
- Auto-build for docker images by dockerfiles.
- And other github actions for auto format, issue templates.
Documents
We need docs for:
- The git branch strategy
- Benchmark
- torch profile
- maca profile
Though vllm-metax is trying its best to catch up with vllm upstream on every release, there is a lot of jobs that are still strongly needed in our open-source ecosystem.
vllm-metax currently is lacking of need 3 significant parts:
Unit test that ported from vllm's
testsfolder.Since vllm-metax is a cuda-alike backend. We need to maintain all the functional tests for
CI/CD
The old CI/CD was deprecated since v0.10.0. We need to reconstruct them:
Documents
We need docs for: