Popular repositories Loading

1. MX-QLLM MX-QLLM Public

   LLM Inference with Microscaling Format

   Python 34 5

2. Attention-Head-Pruning Attention-Head-Pruning Public

   Layer-wise Pruning of Transformer Heads for Efficient Language Modeling

   Python 22 1

3. TSLD TSLD Public

   [NeurIPS 2023] Token-Scaled Logit Distillation for Ternary Weight Generative Language Models

   Python 18 1

4. InfiniPot-V InfiniPot-V Public

   [NeurIPS 25] InfiniPot-V: Memory-Constrained KV Cache Compression for Streaming Video Understanding

   Python 17 1

5. TernGEMM TernGEMM Public

   TernGEMM: General Matrix Multiply Library with Ternary Weights for Fast DNN Inference

   C++ 14 1

6. MapCoder-Lite MapCoder-Lite Public

   [EACL2026 Findings] MapCoder-Lite: Distilling Multi-Agent Coding into a Single Small LLM

   Python 12 1