Skip to content

[Triton] Add Fused GEMM A8W8 + Split + Concat to Deepseek FP8 Model - #831

Draft
farlukas wants to merge 2 commits into
355_wipfrom
farlukas/355_wip_ds_fp8_fuse_kv_proj_cat
Draft

[Triton] Add Fused GEMM A8W8 + Split + Concat to Deepseek FP8 Model#831
farlukas wants to merge 2 commits into
355_wipfrom
farlukas/355_wip_ds_fp8_fuse_kv_proj_cat

Fused kv_b_proj with cat in _compute_prefill_context

4db9794
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar