Releases: iangow/db2pq
Releases · iangow/db2pq
db2pq v0.2.8
Added
- Public destination-PostgreSQL helpers
process_sql()andset_table_comment(). wrds_get_tables()for listing WRDS tables in a schema.pg_update_pq()as the local PostgreSQL analogue ofwrds_update_pq().pq_to_pg()andpq_update_pg()for loading Parquet repository tables into PostgreSQL, with DuckDB and experimental ADBC engine paths.
Changed
set_table_comment()now works as both an internal connection-based helper and a public wrapper that resolves the same destination PostgreSQL defaults used bywrds_update_pg().wrds_update_pg()now handles missing destination tables explicitly and can use SAS-derived metadata for freshness and comment propagation.README.mdis now organized around the main workflow paths: WRDS to Parquet, WRDS to PostgreSQL, local PostgreSQL to Parquet, and Parquet to PostgreSQL.- Documented DuckDB as the stable default engine and ADBC as experimental.
- Improved DuckDB Parquet-to-PostgreSQL loading by creating the destination table schema first and then inserting rows, which benchmarked faster than the previous CTAS path on local tests.
Fixed
pg_update_pq()now explains when source table comments do not contain parseable last-modified metadata and suggestsforce=True.pq_update_pg()now explains when source Parquet files do not contain parseablelast_modifiedmetadata and suggestsforce=True.
db2pq v0.2.4
Changed
- Switched the core PostgreSQL dependency to
psycopg[binary]so fresh installs work without a separate systemlibpqsetup, especially on macOS. - Declared Python 3.9 as the minimum supported version.
- Split
psycopgdependency resolution by Python version:psycopg[binary]>=3.3.3on Python 3.10+ andpsycopg>=3.1,<3.3on Python 3.9.
Pasting the contents of RELEASE_NOTES_0.1.6.md
db2pq v0.1.6
Highlights
- Refined documentation and instructions.
- Continued cleanup and restructuring across core modules.
- Expanded PostgreSQL sync/update capabilities, including early
wrds_update_pg()work. - Internal import and path-handling fixes.
Notable changes
3aa0011Fixes to instructions (plus fix incore.py).6254d4bMore clean-up.3a3f672Removed_utils.py.bbf8ebcAdded rough draft ofwrds_update_pg().4700388Refactor ofcomments.py.b56241dFixed core imports.5778231Better handling of Parquet paths.fb2d88cAdded PostgreSQL default resolution helpers.
Tag
- Tag:
0.1.6 - Commit:
3aa00119b4103539c070d79188914490ea21b3db
Install
pip install --upgrade db2pq==0.1.6