Skip to content
#

sliding-window-attention

Star

Here are 9 public repositories matching this topic...

Language: All
Filter by language
All 9 Python 7 Jupyter Notebook 1 Rust 1

FonaTech / Project_Chronos

Star 203

⚡ Zero-Stall MoE Inference via Lookahead Prediction & Async DMA Prefetching. Optimized for SSD I/O with Hybrid MLA+Sliding Window Attention.

open-source artificial-intelligence lora high-throughput open-models mixture-of-experts llm generative-ai large-language-model streaming-llm predictive-inference sliding-window-attention io-latency-hiding async-dma ssd-offloading lookahead-routing mla-attention dual-layer-moe
  • Updated Apr 26, 2026
  • Python

RubensZimbres / TPU_Inference

Star 3

Measurement harness for the sliding window attention premium in the vLLM TPU Ragged Paged Attention v3 kernel: per layer decode cost, block size control, throughput, and goodput for Gemma 4 31B on TPU v6e.

google-cloud attention-mechanism gemma pallas gpu-kernels tpu jax inference-optimization tpu-benchmarks tpus tpu-acceleration trillium kernel-optimizers vllm llm-inference paged-attention sliding-window-attention vllm-serve kernel-optimization goodput
  • Updated Jul 29, 2026
  • Python

JohnScheuer / sliding-window-attention-kv-bench

Star 0

Analytical benchmark for sliding window attention KV cache management: quality vs window size tradeoffs, SWA vs eviction comparison, prefix sharing interaction, and operational window recommendations across four attention distributions

performance-engineering benchmark simulation inference systems attention mistral eviction analytical-model kv-cache llm long-context llm-serving machine-learning-infrastructure sliding-window-attention prefix-sharing serving-systems kv-cache-management
  • Updated Jul 26, 2026
  • Python

Improve this page

Add a description, image, and links to the sliding-window-attention topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the sliding-window-attention topic, visit your repo's landing page and select "manage topics."

Learn more