You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
#551 phase 3: build derived indexes into staging before cutover #555
Part of #551 (design in its comment). Depends on phases 1 and 2.
Change
Once every derived index lives inside its dataset directory, the offline paths that produce a staged dataset can build the indexes into staging before promotion:
run_bulk_ingest;
tools/re_embed_all.py, for the shared corpus and per notebook.
ops/cutover.py and tools/notebook_cutover.py then promote chunks and indexes together, and rollback restores both. Nothing in either cutover script needs to know the indexes exist.
Done when
A staged corpus carries its own definitions, theorem names and BM25 index.
A cutover-then-rollback test leaves the live server's indexes exactly as they were before the cutover.
Activity