Remove duck db - #24

Merged

joefrost01 merged 38 commits into

mainfrom

Jun 7, 2026

Commits on Jun 6, 2026

docs: add spec 34 — Polars engine conversion design

joefrost01
and
claude
committed
bc2937a
docs: strengthen spec 34 motivation with runtime-extension constraint

joefrost01
and
claude
committed
7e30865
docs: add Phase 1 implementation plan for Polars engine core

joefrost01
and
claude
committed
c48f6db
feat: scaffold PolarsEngine module alongside DuckDB engine

joefrost01
and
claude
committed
f1463ba
feat: PolarsEngine CSV scan, collect, row_count

joefrost01
and
claude
committed
ed32f36
feat: PolarsEngine NDJSON scan
joefrost01
committed
09e235f
feat: PolarsEngine CSV writer with file/stdout sink

joefrost01
and
claude
committed
4a46c89
feat: PolarsEngine Parquet scan and writer

joefrost01
and
claude
committed
bb67cc5
feat: PolarsEngine NDJSON writer

joefrost01
and
claude
committed
f2cff76
feat: gzip/zstd compression for CSV/NDJSON output

joefrost01
and
claude
committed
cf6390a
fix: finalize compression frames explicitly to surface write errors

joefrost01
and
claude
committed
0b7029a
feat: PolarsEngine Excel scan via calamine

joefrost01
and
claude
committed
6e8aa7d
test: make Excel scan test self-contained (testdata is gitignored)

joefrost01
and
claude
committed
f69b629
feat: PolarsEngine union-by-name concat (schema evolution)

joefrost01
and
claude
committed
2e85677
feat: PolarsEngine SQL execution via SQLContext

joefrost01
and
claude
committed
19b910c
feat: PolarsEngine lazy schema introspection

joefrost01
and
claude
committed
c901e41
test: malformed input surfaces a clear error, never hangs

joefrost01
and
claude
committed
d1475d8
test: cloud paths rejected with clear deferred-feature error

joefrost01
and
claude
committed
2685f08
style: cargo fmt after Phase 1
joefrost01
committed
96f407b
harden: error on over-wide Excel rows; cover stdout/ndjson-gzip/missing-sheet paths

joefrost01
and
claude
committed
90cd7c2
Merge branch 'worktree-polars-engine-core'
joefrost01
committed
8afd7f4
docs: add Phase 2 implementation plan for Polars engine cutover

joefrost01
and
claude
committed
465e296
refactor: move shared format/schema types to types.rs (decouple from DuckDB engine)

joefrost01
and
claude
committed
8ccf97d
feat: masking as native Polars DataFrame transform

joefrost01
and
claude
committed
8ae8c76
feat: lineage columns as native Polars DataFrame transforms

joefrost01
and
claude
committed
0b04b43
feat: explicit-schema coercion as Polars cast/project with type map

joefrost01
and
claude
committed
62e476a
feat: reference tables loaded as Polars LazyFrames

joefrost01
and
claude
committed
490f303
feat: profiler computes statistics from a Polars DataFrame

joefrost01
and
claude
committed
722d8f2
feat: crypto decrypt/encrypt/discover operate on Polars DataFrames

joefrost01
and
claude
committed
8057e70

Commits on Jun 7, 2026

fix: profiler distinct_count excludes nulls; schema match case-insensitive; DECIMAL default (18,3)

joefrost01
and
claude
committed
3233caa
feat: output writer emits a Polars DataFrame via PolarsEngine

joefrost01
and
claude
committed
d837761
feat: query pipeline runs on PolarsEngine end-to-end

joefrost01
and
claude
committed
f19ee6f
feat: inspect and profile commands run on PolarsEngine

joefrost01
and
claude
committed
e0dc2c1
feat: defer cloud in file resolution and fingerprint with clear errors

joefrost01
and
claude
committed
562eb67
refactor: remove DuckDB engine, dependency, and dead SQL helpers

joefrost01
and
claude
committed
213d42b
chore: drop accidentally committed .DS_Store

joefrost01
and
claude
committed
715ae05
docs: update for Polars engine, SQL limitations, and cloud deferral

joefrost01
and
claude
committed
acfcc39
Merge branch 'main' into remove-duck-db
joefrost01
committed
b97d9f1