Bump blosc2 from 3.0.0b4 to 4.2.0

[dependabot]

Bumps blosc2 from 3.0.0b4 to 4.2.0.

Release notes

Sourced from blosc2's releases.

Release 4.2.0

Changes from 4.1.2 to 4.2.0

CTable: columnar compressed tables

• Introduced blosc2.CTable, a new columnar table container for compressed, typed columns. CTables support dataclass- and schema-based construction, row iteration, column access, table views, head() / tail() / sample(), sorting, selection and compact where expressions.
• Added persistent CTables backed by TreeStore, with support for blosc2.open(), CTable.open(), CTable.load(), CTable.save(), CTable.to_b2d() and CTable.to_b2z(). CTable views can be saved too, and .b2z/.b2d path handling has been tightened.
• Added mutation operations for CTables, including append(), extend(), delete(), compact(), add_column(), drop_column(), rename_column() and related schema validation.
• Added computed columns, including virtual computed columns backed by lazy expressions, materialized computed columns and automatic filling of materialized computed columns during inserts.
• Added CTable indexing support, including persistent indexes, direct expression indexes, ordered index reuse, boolean LazyExpr/NDArray masks in CTable.__getitem__, iter_sorted() and indexing support for .b2z tables.
• Added nullable schema support and null policies for CTable scalar columns, preserving nullable scalar Parquet round-trips.
• Added variable-length CTable column support via ListArray / ObjectArray, including vlstring and vlbytes schema specs, fixed-length string/bytes import support and list/struct Arrow/Parquet round-trips.
• Added Arrow, Parquet and CSV interoperability for CTables, including batch-wise Arrow/Parquet import/export, Arrow schema metadata preservation, CTable.from_arrow_batches() improvements and a new parquet-to-blosc2 CLI utility.
• Added CTable documentation, tutorials, examples and benchmarks covering schema definition, persistence, querying, indexing, mutations, nullable columns, computed columns and variable-length columns.

Indexing and ordering

• Added a new indexing subsystem for NDArrays and CTables, including full, partial/bucket, light/medium and OPSI-style index kinds, out-of-core index builders and sidecar storage.
• Added blosc2.Index as the unified public index handle, plus APIs such as create_index(), compact_index(), iter_sorted(), will_use_index() and related query explanation support.
• Added materialized expression indexes for NDArrays and direct expression indexes for CTables.
• Added persistent query-result caching for indexed lookups, with FIFO pruning and cache accounting.
• Added blosc2.argsort() and refactored indexing APIs around explicit index enums and sorting helpers.
• Improved indexed query performance with Cython accelerators, threaded chunk batching, zero-copy/cached mmap reads, chunk-aware and reduced-order layouts and faster scattered row gathering.
• Reduced memory usage during index creation and lookup by avoiding full sidecar materialization, replacing memmap staging with Blosc2 scratch arrays and adding tmpdir support for full out-of-core indexes.

Persistence, stores and serialization

• Added structured Blosc2 serialization based on b2object carriers, including persisted C2Array, LazyExpr and DSL LazyUDF objects.
• Added blosc2.Ref for serializing external references, plus examples for b2object bundles and persisted expressions/UDFs.
• Added blosc2.load() as a convenience loader.
• Added vlmeta support to LazyArray objects.
• Improved store handling by preserving lazy b2object carriers in DictStore, allowing reopened proxies to refill caches after read-only opens, relaxing DictStore/TreeStore suffix requirements and adding DictStore.to_b2d().
• Accelerated blosc2.open() by trying standard opens first and warning on implicit append mode.

Arrays, computation and containers

• Added ObjectArray for fully general object data and renamed the earlier VLArray work accordingly; added ListArray docstrings and Arrow integration improvements.
• Added schema helpers including numeric specs, blosc2.struct() and blosc2.object() for nested/fully general column declarations.
• Improved fromiter() with direct chunked construction and substantially lower peak memory use.
• Improved asarray() behavior for NDArray inputs when copy-inducing keyword arguments are supplied.
• Added SChunk.reorder_offsets().
• Improved BatchArray defaults and documentation; the default compression level is now tuned for faster lookup/scan behavior.
• Continued matmul/linalg optimization work and shared-thread-pool integration.

CLI, docs and examples

• Added the parquet-to-blosc2 command with options such as --max-rows, --parquet-batch-size, --blosc2-items-per-block and --use-dict.
• Added new CTable, ObjectArray, BatchArray, containers, indexing and serialization tutorials and examples.
• Reorganized and expanded the API reference for CTable, Column, schema specs, Index, save/load helpers and miscellaneous APIs.
• Updated benchmark suites for CTables, indexing, Parquet import/export, BatchArray and NDArray construction/indexing.

... (truncated)

Changelog

Sourced from blosc2's changelog.

Changes from 4.2.0 to 4.2.1

XXX version-specific blurb XXX

Changes from 4.1.2 to 4.2.0

CTable: columnar compressed tables

• Introduced blosc2.CTable, a new columnar table container for compressed, typed columns. CTables support dataclass- and schema-based construction, row iteration, column access, table views, head() / tail() / sample(), sorting, selection and compact where expressions.
• Added persistent CTables backed by TreeStore, with support for blosc2.open(), CTable.open(), CTable.load(), CTable.save(), CTable.to_b2d() and CTable.to_b2z(). CTable views can be saved too, and .b2z/.b2d path handling has been tightened.
• Added mutation operations for CTables, including append(), extend(), delete(), compact(), add_column(), drop_column(), rename_column() and related schema validation.
• Added computed columns, including virtual computed columns backed by lazy expressions, materialized computed columns and automatic filling of materialized computed columns during inserts.
• Added CTable indexing support, including persistent indexes, direct expression indexes, ordered index reuse, boolean LazyExpr/NDArray masks in CTable.__getitem__, iter_sorted() and indexing support for .b2z tables.
• Added nullable schema support and null policies for CTable scalar columns, preserving nullable scalar Parquet round-trips.
• Added variable-length CTable column support via ListArray / ObjectArray, including vlstring and vlbytes schema specs, fixed-length string/bytes import support and list/struct Arrow/Parquet round-trips.
• Added Arrow, Parquet and CSV interoperability for CTables, including batch-wise Arrow/Parquet import/export, Arrow schema metadata preservation, CTable.from_arrow_batches() improvements and a new parquet-to-blosc2 CLI utility.
• Added CTable documentation, tutorials, examples and benchmarks covering schema definition, persistence, querying, indexing, mutations, nullable columns, computed columns and variable-length columns.

Indexing and ordering

• Added a new indexing subsystem for NDArrays and CTables, including full, partial/bucket, light/medium and OPSI-style index kinds, out-of-core index builders and sidecar storage.
• Added blosc2.Index as the unified public index handle, plus APIs such as create_index(), compact_index(), iter_sorted(), will_use_index() and related query explanation support.
• Added materialized expression indexes for NDArrays and direct expression indexes for CTables.
• Added persistent query-result caching for indexed lookups, with FIFO pruning and cache accounting.
• Added blosc2.argsort() and refactored indexing APIs around explicit index enums and sorting helpers.
• Improved indexed query performance with Cython accelerators, threaded chunk batching, zero-copy/cached mmap reads, chunk-aware and reduced-order layouts and faster scattered row gathering.
• Reduced memory usage during index creation and lookup by avoiding full sidecar materialization, replacing memmap staging with Blosc2 scratch arrays and adding tmpdir support for full out-of-core indexes.

Persistence, stores and serialization

• Added structured Blosc2 serialization based on b2object carriers, including persisted C2Array, LazyExpr and DSL LazyUDF objects.
• Added blosc2.Ref for serializing external references, plus examples for b2object bundles and persisted expressions/UDFs.
• Added blosc2.load() as a convenience loader.
• Added vlmeta support to LazyArray objects.
• Improved store handling by preserving lazy b2object carriers in DictStore, allowing reopened proxies to refill caches after read-only opens, relaxing DictStore/TreeStore suffix requirements and adding DictStore.to_b2d().
• Accelerated blosc2.open() by trying standard opens first and warning on implicit append mode.

Arrays, computation and containers

• Added ObjectArray for fully general object data and renamed the earlier VLArray work accordingly; added ListArray docstrings and Arrow integration improvements.
• Added schema helpers including numeric specs, blosc2.struct() and blosc2.object() for nested/fully general column declarations.
• Improved fromiter() with direct chunked construction and substantially lower peak memory use.
• Improved asarray() behavior for NDArray inputs when copy-inducing keyword arguments are supplied.
• Added SChunk.reorder_offsets().
• Improved BatchArray defaults and documentation; the default compression level is now tuned for faster lookup/scan behavior.
• Continued matmul/linalg optimization work and shared-thread-pool integration.

CLI, docs and examples

• Added the parquet-to-blosc2 command with options such as --max-rows, --parquet-batch-size, --blosc2-items-per-block and --use-dict.

... (truncated)

Commits

• 81a9c09 Getting ready for release 4.2.0
• c4d64b0 Add new symbols for specifying min C-Blosc2 version
• ff7e64c New blosc2.load() function
• d59d3bf Docstrings for ListArray methods
• 1e81529 New structure for classes in API reference
• 096aa54 Better structure for miscellanous section in docs
• 6f67aa2 Add small description for main classes
• 9f8ee52 Be explicit about .b2d suffix being recommended for directory-backed stores
• 6393abf A CTable view can be saved via .save() now
• b454eda Enforce .b2z for b2z format and allow a b2d fallback for the rest of extensions
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Labels

The following labels could not be found: ignore-for-release, maintenance. Please create them before Dependabot can add them to a pull request.

Please fix the above issues or remove invalid values from dependabot.yml.

[dependabot]

Superseded by #63.