[KDA] Add SM90 fused WY-DqKG backward - #1

Closed

zheyang0825 wants to merge 34 commits into

mainfrom

feat/sm90-wydqkg

Commits on Apr 16, 2026

doc: update README with bigger logo (#53)
icavan
authored
d0cb637
[KDA] Adapt recompute_wu and delta_h for backward (#54)

KevinZeng08
and
gemini-code-assist[bot]
authored
e8a7098

Commits on Apr 18, 2026

perf(kda_decode): optimize GMEM coalescing, V-tile parallelism (#52)

icavan
and
boyu.zbw
authored
a78819f

Commits on Apr 22, 2026

fix(linter): fix linter & updates kda decode perf (#60)
icavan
authored
50dd3f1
feat: BHVK (K-last) state layout for Lightning Attention prefill & decode (#56)

authored
33ec0b3

Commits on Apr 23, 2026

perf(la_decode): boost small-batch (B<=32) by 33% via 8-warp CTA (#59)
icavan
authored
2c8c6fa

Commits on Apr 24, 2026

[KDA] Optimize recompute_wu with better register allocation (#61)
KevinZeng08
authored
fa742a2

Commits on May 6, 2026

fix output_final_state wrapper issue (#63)
yechenzhi
authored
9d8eed6

Commits on May 9, 2026

[KDA] fix internal output_final_state wrapper issue in SM90 (#66)
yechenzhi
authored
a6d9572

Commits on May 13, 2026

[Fix] change to umma pipelines for SM100 KDA (#68)

authored
8289976

Commits on May 14, 2026

[Fix] delta_h race risk (#69)

KevinZeng08
and
boyu.zbw
authored
d4fd474
[KDA] sm90 GVA enhance (#64)

sjmshsh
and
sunnyxyli
authored
437dc21

Commits on May 22, 2026

[Feat] upgrade FLA to v0.5.0 (#72)

KevinZeng08
and
boyu.zbw
authored
e4ea536
[Fix] add cross-proxy fence for recomp_wu kernel (#77)
KevinZeng08
authored
f17c36d

Commits on May 23, 2026

[KDA] sm100 GVA enhance for chunk_intra and recomp_wu (#65)

sjmshsh
and
sunnyxyli
authored
bb39cf9
fix: wire h0_indices into Lightning Attention decode for state-pool indexing (#75)

Emre-Dinc
and
sjmshsh
authored
7960942

Commits on May 24, 2026

Unify the naming convention (#79)
icavan
authored
e871b96

Commits on May 25, 2026

Consolidate duplicated benchmark helper logic into `benchmarks/utils.py`, including shared timing, reporting, and accuracy utilities. (#80)

icavanyu
and
icavan
authored
7564280
[KDA] support GVA for SM100 end-to-end (#73)

KevinZeng08
and
boyu.zbw
authored
4571c7d

Commits on May 26, 2026

[KDA] add backward chunk_wy_dqkg kernel for SM10X (#74)

KevinZeng08
and
boyu.zbw
authored
99d4bbc

Commits on May 29, 2026

[KDA] split unit tests into fast/slow modes
Longxmas
authored
85dbcb7

Commits on Jun 3, 2026

[KDA] Add intra-card CP for chunk_delta_h forward in SM100 (#70)

authored
b6d8b2d

Commits on Jun 10, 2026

Relax dependency minimum versions (#87)
icavan
authored
3006957

Commits on Jun 23, 2026

[CI] Add GitHub workflow for building and releasing fat wheels (#91)

authored
7b1e127
ci: add prek lint workflow (#98)
tongke6
authored
ff1b236

Commits on Jun 25, 2026

ci: align pytorch version requirements in wheel build (#99)
tongke6
authored
6cacc37

Commits on Jul 7, 2026

refactor(kda): reorganize KDA backends into arch-first layout and add lazy imports (#100)

cherhh
and
cheheng.ch
authored
f8d7db2
feat: intracard cp for sm90 (#86)

Hyaloid
and
icavan
authored
ca6f174

Commits on Jul 9, 2026

Commits on Jul 13, 2026

[Feature] Add GVA support for Lightning (#85)

sjmshsh
and
sunnyxyli
authored
9ff1edb

Commits on Jul 20, 2026

[Fix] Wire cudac bindings (#105)

cherhh
and
cheheng.ch
authored
326a307
Add SM90 fused WY-DqKG backward
zheyang0825
committed
568789c