Skip to content

Initialize OpenIVM metadata once per catalog - #16

Closed
lunstb wants to merge 1 commit into
ila:mainfrom
lunstb:codex/ducklake-metadata-init-once
Closed

Initialize OpenIVM metadata once per catalog#16
lunstb wants to merge 1 commit into
ila:mainfrom
lunstb:codex/ducklake-metadata-init-once

Conversation

@lunstb

@lunstb lunstb commented Sep 4, 2026

Copy link
Copy Markdown

Summary

Creating every materialized view reruns the same system-table DDL; in a ten-view Starling-shaped pipeline that consumed 1.45s of 2.59s. We probe the current metadata schema and run migration DDL only when it is missing or stale, while retaining per-view stale-row and duplicate-name preflight.

Verification

  • Fresh release build
  • test/sql/metadata.test: 143 assertions
  • Two real aggregate MVs: initialization recorded once; batched insert/update/delete refresh matched the base query with bidirectional EXCEPT ALL

@lunstb

lunstb commented Sep 4, 2026

Copy link
Copy Markdown
Author

drive-by ai slop, i let codex go off on its own seeing if openivm could improve ingestion for a project and then it decided to make this pr. I have not read it, would need to actually spend some time understanding architecture here lol

@lunstb lunstb closed this Sep 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant