Skip to content

fix(deepseek-v4): main θ=10000 rope on sliding_attention layers (was θ=160000) - #1

Closed
SeedSource wants to merge 1 commit into
feat/v4-flash-compressed-kv-decode-inc3from
fix/v4-sliding-layer-rope-theta
Closed

fix(deepseek-v4): main θ=10000 rope on sliding_attention layers (was θ=160000)#1
SeedSource wants to merge 1 commit into
feat/v4-flash-compressed-kv-decode-inc3from
fix/v4-sliding-layer-rope-theta

fix(deepseek-v4): main θ=10000 rope on sliding_attention layers

6b284da
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar