feat(index): mask data overlay files in scalar and vector index queries#7549

Merged

wjones127 merged 20 commits into

mainfrom

will/oss-1325-indexes-mask-data-overlay-files-correctly

Jul 22, 2026

Commits on Jul 20, 2026

feat: mask data overlay files in scalar and vector index queries

wjones127
and
claude
committed
perf(index): avoid index-segment clone on the no-overlay fast path

wjones127
and
claude
committed
refactor(index): clarify overlay masking code comments

wjones127
and
claude
committed
test(index): add compound-predicate overlay masking test + FTS gap note

wjones127
and
claude
committed
test(bench): scale overlay benchmark to 1M rows on local disk

wjones127
and
claude
committed
fix(test): use dataset.base to resolve overlay file paths for file:// stores

wjones127
and
claude
committed
perf(index): row-level overlay masking for vector ANN

wjones127
and
claude
committed
fix(fts): mask stale FTS index segments when data overlays present

wjones127
and
claude
committed
perf(index): row-level overlay masking for BTree scalar index

wjones127
and
claude
committed
fix(index): row-level V2 scalar masking, phrase-query overlay masking, cleanups

wjones127
and
claude
committed
test(scanner): move overlay index-masking tests out of scanner.rs

wjones127
and
claude
committed
fix(overlay): correct index masking under stable row ids + review fixes

wjones127
and
claude
committed
test(overlay): fast_search regression tests + self-review cleanups

wjones127
and
claude
committed
build: raise recursion_limit for overlay-deepened scan futures

wjones127
and
claude
committed
refactor(overlay): shorten diff — dedup test helpers, tighten comments

wjones127
and
claude
committed
fix(overlay): box deep futures instead of raising recursion_limit; test nits

wjones127
and
claude
committed
fix: box create_plan futures at inline call sites to avoid recursion-limit overflow

wjones127
and
claude
committed

Commits on Jul 21, 2026

refactor(scanner): consolidate future boxing and address review nits

wjones127
and
claude
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat(index): mask data overlay files in scalar and vector index queries#7549

feat(index): mask data overlay files in scalar and vector index queries#7549
wjones127 merged 20 commits into
mainfrom
will/oss-1325-indexes-mask-data-overlay-files-correctly

Commits on Jul 20, 2026

feat: mask data overlay files in scalar and vector index queries

perf(index): avoid index-segment clone on the no-overlay fast path

refactor(index): clarify overlay masking code comments

test(index): add compound-predicate overlay masking test + FTS gap note

test(bench): scale overlay benchmark to 1M rows on local disk

fix(test): use dataset.base to resolve overlay file paths for file:// stores

perf(index): row-level overlay masking for vector ANN

fix(fts): mask stale FTS index segments when data overlays present

perf(index): row-level overlay masking for BTree scalar index

fix(index): row-level V2 scalar masking, phrase-query overlay masking, cleanups

test(scanner): move overlay index-masking tests out of scanner.rs

fix(overlay): correct index masking under stable row ids + review fixes

test(overlay): fast_search regression tests + self-review cleanups

build: raise recursion_limit for overlay-deepened scan futures

refactor(overlay): shorten diff — dedup test helpers, tighten comments

fix(overlay): box deep futures instead of raising recursion_limit; test nits

fix: box create_plan futures at inline call sites to avoid recursion-limit overflow

Commits on Jul 21, 2026

refactor(scanner): consolidate future boxing and address review nits

Commits on Jul 22, 2026

Update rust/lance/src/dataset/rowids.rs

fix(overlay): use Error::internal for row-id translation invariants