DeepSeek V4.1: fp64 reference tests for the Engram hash, gather and gate by akol1 · Pull Request #1051 · ashhart/TensorFold

DeepSeek V4.1 Flash: configuration, Engram tables and resident weight staging

akol1

committed

b160bcd

DeepSeek V4.1 Flash: Metal operators with fp64-dot references and the qualification runner

akol1

committed

c53616f

THIRD_PARTY_NOTICES: the native DS4.1 reference follows DeepSeek-V4.1-Flash's MIT inference

akol1

committed

4e68261

DeepSeek V4.1 load: the router gate and bias ride the pack's dtypes

akol1

committed

74b7541

DeepSeek V4.1 load: the Engram gate weights ride f32 or bf16

akol1

committed

86b6eec

DeepSeek V4.1: the kept-dense EXL3 form, for rank-split repacks

akol1

committed

611a130

DeepSeek V4.1 reference: the kept-dense apply

akol1

committed

d20aea6

DeepSeek V4.1: the rebase residue — one counters binding, the state-window kernel's brace

akol1

committed

c349413

mHC fp64 ideal reference: the mix at rounding level, 1-ULP noise attenuated

akol1

committed

6ad76e1

CSA2 reference: FP64-ideal parameterization of the pool, RMS and sparse-head boundaries

akol1

committed

943d93f

csa2: FP64 stage harness, compressor pool + RMS, six adversarial input families

akol1

committed

1cf442a

csa2: FP64 stage harness over the sparse attention kernel, with kernel-faithful key addressing

akol1

committed

630f5d2

csa2: indexer stage harness — FP32/FP64 score comparison and top-k selection agreement

akol1

committed

0be1833

csa2: indexer stage receipts — carry the BF16 einsum/score boundaries in the FP64 ideal, read positions through the view offset

akol1

committed

2e56ff2

csa2: sparse stage reads its own FP32 rounding level before the BF16 output quantum

akol1

committed

79e59ac

csa2: per-stage harnesses for sinks, tile denominators, output mix and RoPE

akol1

committed

bba3e7d

csa2: measure how much score noise the top-k selection absorbs

akol1

committed

5c27e3d

The fp64 harness ports: dedupe the shared math helpers, fix the shard-plan test calls

akol1

committed

2f9e506

The oracle records the indexer's selection margins while it teaches

akol1

committed

ffc7028

The indexer-margin capture at depth: one diagnostic token's selection scratch, verbatim

akol1

committed

6e2a7ce

the operator harnesses through zig fmt

akol1

committed

f5c483e

DeepSeek V4.1: the sparse output accumulates each 64-column tile in compensated FP32 pairs

akol1

committed

8f63e8d

The dense EXL3 apply accumulates its dot as a hi/lo FP32 pair

akol1

committed

8bfdf68

DeepSeek V4.1: the token map ships its table generator and its unit tests

akol1

committed

efed9c1

DeepSeek V4.1: the family's comments on one line each, within the 120-column rule

akol1

committed

ec57308

DeepSeek V4.1 reference: the operator harnesses split at their seams

akol1

committed

43b4ee8

DeepSeek V4.1: the reference and Metal comments on one line each

akol1

committed

28f8dc7

DeepSeek V4.1 reference: fp64 tests for the Engram hash, gather and gate

akol1

committed

a9badee

DeepSeek V4.1 reference: hold the Engram gate to the registered kernel contract

akol1

committed

32dc75a

DeepSeek V4.1 reference: the index tie fixture broadcasts row 0 into every key

akol1

committed

46a2fb3

test(contract): DeepSeek V4.1 sparse attention through the Metal kernel contract

akol1

committed

2485c13

Pass the span metadata the counter recorder now requires

akol1

committed

14db390

Rebase the precision line onto 1.1.2

akol1

committed

e740bf0

Navigation Menu

Repository navigation

DeepSeek V4.1: fp64 reference tests for the Engram hash, gather and gate - #1051

DeepSeek V4.1: fp64 reference tests for the Engram hash, gather and gate#1051
akol1 wants to merge 33 commits into
ashhart:mainfrom
akol1:pr-dsv41-f-engram

Commits on Oct 21, 2026

DeepSeek V4.1 Flash: configuration, Engram tables and resident weight staging

DeepSeek V4.1 Flash: Metal operators with fp64-dot references and the qualification runner

THIRD_PARTY_NOTICES: the native DS4.1 reference follows DeepSeek-V4.1-Flash's MIT inference

DeepSeek V4.1 load: the router gate and bias ride the pack's dtypes

DeepSeek V4.1 load: the Engram gate weights ride f32 or bf16

DeepSeek V4.1: the kept-dense EXL3 form, for rank-split repacks

DeepSeek V4.1 reference: the kept-dense apply

DeepSeek V4.1: the rebase residue — one counters binding, the state-window kernel's brace

mHC fp64 ideal reference: the mix at rounding level, 1-ULP noise attenuated

CSA2 reference: FP64-ideal parameterization of the pool, RMS and sparse-head boundaries

csa2: FP64 stage harness, compressor pool + RMS, six adversarial input families

csa2: FP64 stage harness over the sparse attention kernel, with kernel-faithful key addressing

csa2: indexer stage harness — FP32/FP64 score comparison and top-k selection agreement

csa2: indexer stage receipts — carry the BF16 einsum/score boundaries in the FP64 ideal, read positions through the view offset

csa2: sparse stage reads its own FP32 rounding level before the BF16 output quantum

csa2: per-stage harnesses for sinks, tile denominators, output mix and RoPE

csa2: measure how much score noise the top-k selection absorbs

The fp64 harness ports: dedupe the shared math helpers, fix the shard-plan test calls

The oracle records the indexer's selection margins while it teaches

The indexer-margin capture at depth: one diagnostic token's selection scratch, verbatim

the operator harnesses through zig fmt

DeepSeek V4.1: the sparse output accumulates each 64-column tile in compensated FP32 pairs

The dense EXL3 apply accumulates its dot as a hi/lo FP32 pair

DeepSeek V4.1: the token map ships its table generator and its unit tests

DeepSeek V4.1: the family's comments on one line each, within the 120-column rule

DeepSeek V4.1 reference: the operator harnesses split at their seams

DeepSeek V4.1: the reference and Metal comments on one line each

DeepSeek V4.1 reference: fp64 tests for the Engram hash, gather and gate

DeepSeek V4.1 reference: hold the Engram gate to the registered kernel contract

DeepSeek V4.1 reference: the index tie fixture broadcasts row 0 into every key

test(contract): DeepSeek V4.1 sparse attention through the Metal kernel contract

Pass the span metadata the counter recorder now requires

Rebase the precision line onto 1.1.2