Skip to content

Releases: iangow/db2pq

db2pq v0.2.8

29 Mar 00:04
7d87137

Choose a tag to compare

Added

  • Public destination-PostgreSQL helpers process_sql() and set_table_comment().
  • wrds_get_tables() for listing WRDS tables in a schema.
  • pg_update_pq() as the local PostgreSQL analogue of wrds_update_pq().
  • pq_to_pg() and pq_update_pg() for loading Parquet repository tables into PostgreSQL, with DuckDB and experimental ADBC engine paths.

Changed

  • set_table_comment() now works as both an internal connection-based helper and a public wrapper that resolves the same destination PostgreSQL defaults used by wrds_update_pg().
  • wrds_update_pg() now handles missing destination tables explicitly and can use SAS-derived metadata for freshness and comment propagation.
  • README.md is now organized around the main workflow paths: WRDS to Parquet, WRDS to PostgreSQL, local PostgreSQL to Parquet, and Parquet to PostgreSQL.
  • Documented DuckDB as the stable default engine and ADBC as experimental.
  • Improved DuckDB Parquet-to-PostgreSQL loading by creating the destination table schema first and then inserting rows, which benchmarked faster than the previous CTAS path on local tests.

Fixed

  • pg_update_pq() now explains when source table comments do not contain parseable last-modified metadata and suggests force=True.
  • pq_update_pg() now explains when source Parquet files do not contain parseable last_modified metadata and suggests force=True.

db2pq v0.2.4

18 Mar 16:00
c10366a

Choose a tag to compare

Changed

  • Switched the core PostgreSQL dependency to psycopg[binary] so fresh installs work without a separate system libpq setup, especially on macOS.
  • Declared Python 3.9 as the minimum supported version.
  • Split psycopg dependency resolution by Python version: psycopg[binary]>=3.3.3 on Python 3.10+ and psycopg>=3.1,<3.3 on Python 3.9.

Pasting the contents of RELEASE_NOTES_0.1.6.md

13 Feb 00:06

Choose a tag to compare

db2pq v0.1.6

Highlights

  • Refined documentation and instructions.
  • Continued cleanup and restructuring across core modules.
  • Expanded PostgreSQL sync/update capabilities, including early wrds_update_pg() work.
  • Internal import and path-handling fixes.

Notable changes

  • 3aa0011 Fixes to instructions (plus fix in core.py).
  • 6254d4b More clean-up.
  • 3a3f672 Removed _utils.py.
  • bbf8ebc Added rough draft of wrds_update_pg().
  • 4700388 Refactor of comments.py.
  • b56241d Fixed core imports.
  • 5778231 Better handling of Parquet paths.
  • fb2d88c Added PostgreSQL default resolution helpers.

Tag

  • Tag: 0.1.6
  • Commit: 3aa00119b4103539c070d79188914490ea21b3db

Install

pip install --upgrade db2pq==0.1.6