polars-engine-cutover - #23

Merged

joefrost01 merged 31 commits into

mainfrom

polars-engine-cutover

Jun 7, 2026

Commits on Jun 6, 2026

docs: add spec 34 — Polars engine conversion design

joefrost01
and
claude
committed
bc2937a
docs: strengthen spec 34 motivation with runtime-extension constraint

joefrost01
and
claude
committed
7e30865
docs: add Phase 1 implementation plan for Polars engine core

joefrost01
and
claude
committed
c48f6db
feat: scaffold PolarsEngine module alongside DuckDB engine

joefrost01
and
claude
committed
f1463ba
feat: PolarsEngine CSV scan, collect, row_count

joefrost01
and
claude
committed
ed32f36
feat: PolarsEngine NDJSON scan
joefrost01
committed
09e235f
feat: PolarsEngine CSV writer with file/stdout sink

joefrost01
and
claude
committed
4a46c89
feat: PolarsEngine Parquet scan and writer

joefrost01
and
claude
committed
bb67cc5
feat: PolarsEngine NDJSON writer

joefrost01
and
claude
committed
f2cff76
feat: gzip/zstd compression for CSV/NDJSON output

joefrost01
and
claude
committed
cf6390a
fix: finalize compression frames explicitly to surface write errors

joefrost01
and
claude
committed
0b7029a
feat: PolarsEngine Excel scan via calamine

joefrost01
and
claude
committed
6e8aa7d
test: make Excel scan test self-contained (testdata is gitignored)

joefrost01
and
claude
committed
f69b629
feat: PolarsEngine union-by-name concat (schema evolution)

joefrost01
and
claude
committed
2e85677
feat: PolarsEngine SQL execution via SQLContext

joefrost01
and
claude
committed
19b910c
feat: PolarsEngine lazy schema introspection

joefrost01
and
claude
committed
c901e41
test: malformed input surfaces a clear error, never hangs

joefrost01
and
claude
committed
d1475d8
test: cloud paths rejected with clear deferred-feature error

joefrost01
and
claude
committed
2685f08
style: cargo fmt after Phase 1
joefrost01
committed
96f407b
harden: error on over-wide Excel rows; cover stdout/ndjson-gzip/missing-sheet paths

joefrost01
and
claude
committed
90cd7c2
Merge branch 'worktree-polars-engine-core'
joefrost01
committed
8afd7f4
docs: add Phase 2 implementation plan for Polars engine cutover

joefrost01
and
claude
committed
465e296
refactor: move shared format/schema types to types.rs (decouple from DuckDB engine)

joefrost01
and
claude
committed
8ccf97d
feat: masking as native Polars DataFrame transform

joefrost01
and
claude
committed
8ae8c76
feat: lineage columns as native Polars DataFrame transforms

joefrost01
and
claude
committed
0b04b43
feat: explicit-schema coercion as Polars cast/project with type map

joefrost01
and
claude
committed
62e476a
feat: reference tables loaded as Polars LazyFrames

joefrost01
and
claude
committed
490f303
feat: profiler computes statistics from a Polars DataFrame

joefrost01
and
claude
committed
722d8f2
feat: crypto decrypt/encrypt/discover operate on Polars DataFrames

joefrost01
and
claude
committed
8057e70

Commits on Jun 7, 2026

fix: profiler distinct_count excludes nulls; schema match case-insensitive; DECIMAL default (18,3)

joefrost01
and
claude
committed
3233caa
feat: output writer emits a Polars DataFrame via PolarsEngine

joefrost01
and
claude
committed
d837761

Navigation Menu

Uh oh!

polars-engine-cutover - #23

polars-engine-cutover#23
joefrost01 merged 31 commits into
mainfrom
polars-engine-cutover

Commits on Jun 6, 2026

docs: add spec 34 — Polars engine conversion design

docs: strengthen spec 34 motivation with runtime-extension constraint

docs: add Phase 1 implementation plan for Polars engine core

feat: scaffold PolarsEngine module alongside DuckDB engine

feat: PolarsEngine CSV scan, collect, row_count

feat: PolarsEngine NDJSON scan

feat: PolarsEngine CSV writer with file/stdout sink

feat: PolarsEngine Parquet scan and writer

feat: PolarsEngine NDJSON writer

feat: gzip/zstd compression for CSV/NDJSON output

fix: finalize compression frames explicitly to surface write errors

feat: PolarsEngine Excel scan via calamine

test: make Excel scan test self-contained (testdata is gitignored)

feat: PolarsEngine union-by-name concat (schema evolution)

feat: PolarsEngine SQL execution via SQLContext

feat: PolarsEngine lazy schema introspection

test: malformed input surfaces a clear error, never hangs

test: cloud paths rejected with clear deferred-feature error

style: cargo fmt after Phase 1

harden: error on over-wide Excel rows; cover stdout/ndjson-gzip/missing-sheet paths

Merge branch 'worktree-polars-engine-core'

docs: add Phase 2 implementation plan for Polars engine cutover

refactor: move shared format/schema types to types.rs (decouple from DuckDB engine)

feat: masking as native Polars DataFrame transform

feat: lineage columns as native Polars DataFrame transforms

feat: explicit-schema coercion as Polars cast/project with type map

feat: reference tables loaded as Polars LazyFrames

feat: profiler computes statistics from a Polars DataFrame

feat: crypto decrypt/encrypt/discover operate on Polars DataFrames

Commits on Jun 7, 2026

fix: profiler distinct_count excludes nulls; schema match case-insensitive; DECIMAL default (18,3)

feat: output writer emits a Polars DataFrame via PolarsEngine