Ww20 pr cpu context pickle#252

Closed

hlin99 wants to merge 27 commits into

devfrom

ww20_PR_cpu_context_pickle

Commits on May 12, 2026

Commits on May 14, 2026

Commits on May 15, 2026

rebase dsv4: propagate vllm_logical_block_size through TransferContext.register() to restore DeepSeek V4 compress_ratio
hlin99
committed
rename to more general names: non_gpu_context & non_cuda_transfer_context
hlin99
committed
add todo note for deepseek v4 on non-cuda path
hlin99
committed
Consolidate MPCacheEngine context state into unified registry
hlin99
committed
use dataclass for payload
hlin99
committed
Auto-disable l1-use-lazy on non-CUDA backends
hlin99
committed
Lift layout hints to the caller layer to avoid redundant computation in transfer-context registration
hlin99
committed

Commits on May 17, 2026

Merge branch 'dev' into ww20_PR_cpu_context_pickle
hlin99
authored

Commits on May 19, 2026