Skip to content

feat(benchmarks): make DaseR prefetch opt-in - #97

Merged
GentleCold merged 1 commit into
masterfrom
feat/prefetch-opt-in
Sep 6, 2026
Merged

GentleCold merged 1 commit into
masterfrom
feat/prefetch-opt-in

Conversation

@GentleCold

Copy link
Copy Markdown
Owner

Summary

  • Add --daser-prefetch, defaulting to disabled and enabling two scheduler workers when supplied.
  • Preserve the numeric worker override and record effective prefetch settings in manifests and connector config.
  • Add focused CLI/manifest/payload coverage and documentation.

FAST'25 evidence

  • 200 selected rows, 194 eligible, 6 context-limit skips, 8 in-flight, zero failures in every condition.
  • DaseR prefetch off: p50 TTFT 171.56 ms, wall 139.13 s, external-prefix hit rate 31.21%.
  • DaseR prefetch on (2 workers): p50 TTFT 208.67 ms (+21.6%), wall 139.91 s, hit rate 31.63% (+0.42 percentage points).
  • The predeclared negative-optimization rule is met; default remains off.
  • LMCache reference: p50 TTFT 466.20 ms, wall 145.58 s, MP hit rate 30.19%.

Detailed compact artifacts are stored outside the repository under /data/zwt/daser_bench/prefetch_opt_in_fast25_20260905/results.

Tests: 383 passed, 101 deselected; focused 210 passed; ruff passed.

- Add an explicit DaseR prefetch flag with a default worker limit of two\n- Preserve numeric worker overrides and record effective settings in manifests\n- Cover CLI precedence, legacy manifests, and connector payload propagation\n- Document the opt-in behavior in benchmark and development guides
@GentleCold
GentleCold merged commit d3763b3 into master Sep 6, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant