llm-speedup

Here are 2 public repositories matching this topic...

Lossless inference speedup benchmarking suite for local LLMs using DeepSeek DSpark speculative draft heads.

pytorch streamlit inference-acceleration ollama speculative-decoding deepseek qwen3 dspark deepspec llm-speedup

Accelerate local LLM inference using speculative decoding with a draft model and parallel verification via this Streamlit visualizer.

pytorch streamlit inference-acceleration ollama speculative-decoding deepseek qwen3 dspark deepspec llm-speedup

Add a description, image, and links to the llm-speedup topic page so that developers can more easily learn about it.

To associate your repository with the llm-speedup topic, visit your repo's landing page and select "manage topics."