Skip to content

feat(loop): prefix-cache warmup — boost KV cache hit rate from ~58% to 95-99%#2326

Open
HUQIANTAO wants to merge 6 commits into
esengine:v1from
HUQIANTAO:feat/cache-warmup
Open

feat(loop): prefix-cache warmup — boost KV cache hit rate from ~58% to 95-99%#2326
HUQIANTAO wants to merge 6 commits into
esengine:v1from
HUQIANTAO:feat/cache-warmup