Lossless inference speedup benchmarking suite for local LLMs using DeepSeek DSpark speculative draft heads.
DeepSeek-V4-Flash + DSpark speculative decoding on a pair of NVIDIA DGX Sparks (vLLM TP=2 over RoCE) — tuned recipe, overlays that halve multi-turn TTFT, contamination-guarded benchmarks, ops runbook
Multi-Ensemble Memory-Elastic Token Prediction — a numpy implementation of DeepSeek's DSpark speculative decoding + the MEMTP elastic-ensemble extension, on AMD Strix Halo (gfx1151).
Accelerate local LLM inference using speculative decoding with a draft model and parallel verification via this Streamlit visualizer.
Add a description, image, and links to the dspark topic page so that developers can more easily learn about it.
To associate your repository with the dspark topic, visit your repo's landing page and select "manage topics."