Popular repositories Loading

1. -cuda-c-cuda-vllm- -cuda-c-cuda-vllm- Public

   针对从零构建兼容 Llama 与 Qwen 架构的高性能、轻量级 LLM 推理引擎

   C++ 1

2. -qwen-deepseek-moe-c-cuda-pytorch-c-extension- -qwen-deepseek-moe-c-cuda-pytorch-c-extension- Public

   面向qwen/deepseek架构的高性能moe算子库(c++/cuda/pytorch c++ extension)

   Python 1

3. MetaInfer MetaInfer Public

   Forked from HuangPuStar/MetaInfer

   Python

4. MetaInfer-00 MetaInfer-00 Public

   MetaInfer workspace and generated task artifacts

   C++

5. MetaInfer-cpp MetaInfer-cpp Public

   C++ Qwen3 inference runtime with paged KV cache, continuous batching, HIP kernels, and tensor parallelism

   C++