Skip to content

Support building the unquantized indexes from an mmapped CSR - #42

Merged
zirui-song-18 merged 2 commits into
opensearch-project:mainfrom
zirui-song-18:mmap-csr-build-unquant
Sep 2, 2026
Merged

zirui-song-18 merged 2 commits into
opensearch-project:mainfrom
zirui-song-18:mmap-csr-build-unquant

Conversation

@zirui-song-18

Copy link
Copy Markdown
Collaborator

Description

read_csr(kMmap) borrows vectors_ without going through add(), so DiskSeismic's num_vectors_ (read by write_index and search) is synced after the base read. Add bit-exact convert -> read_csr(kMmap) -> build -> mmap-reload -> search tests for SeismicIndex and DiskSeismicIndex.

Issues Resolved

List any issues this PR will resolve, e.g. Closes [...].

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Zirui Song <zrsong@amazon.com>
Comment thread nsparse/disk_seismic_index_base.h Outdated
Signed-off-by: Zirui Song <zrsong@amazon.com>
@zirui-song-18
zirui-song-18 merged commit 68912d6 into opensearch-project:main Sep 2, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants