Skip to content

Releases: GoogleCloudPlatform/DataflowTemplates

Dataflow Templates 2025-12-30-00_RC00

30 Dec 14:46
bbea759

Choose a tag to compare

build(deps): bump org.codehaus.mojo:extra-enforcer-rules (#3165)

Bumps [org.codehaus.mojo:extra-enforcer-rules](https://github.com/mojohaus/extra-enforcer-rules) from 1.10.0 to 1.11.0.
- [Release notes](https://github.com/mojohaus/extra-enforcer-rules/releases)
- [Commits](https://github.com/mojohaus/extra-enforcer-rules/compare/1.10.0...1.11.0)

---
updated-dependencies:
- dependency-name: org.codehaus.mojo:extra-enforcer-rules
  dependency-version: 1.11.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

SKIPPED - Dataflow Templates 2025-12-23-00_RC00

23 Dec 14:26
a16c225

Choose a tag to compare

Increasing maxConnection on MySqlResourceManager For AllDataTypesIT (…

Dataflow Templates 2025-12-16-00_RC00

16 Dec 14:48
bf172e2

Choose a tag to compare

What's Changed

Improvements

Bug fixes

Package Upgrades

  • chore(deps): update Python dependencies by @github-actions[bot] in #3076

New Contributors

Full Changelog: 2025-12-09-00_RC00...2025-12-16-00_RC00

Dataflow Templates 2025-12-09-00_RC00

09 Dec 14:49
301cd41

Choose a tag to compare

What's Changed

Improvements

  • [SpannerToSourceDb] Integration test for CDC processing algorithm for Reverse migration template by @darshan-sj in #3027
  • [SourceDbToSpanner] Fixing severe error file overwrite issue in Bulk migration template by @darshan-sj in #3039
  • upgrade go to 1.24 to fix cicd issue by @derrickaw in #3048
  • Add auto yaml to java generation by @derrickaw in #2984
  • remove old todos for 2.68, gax, httpclient, and json-smart that are not used by @derrickaw in #2887
  • feat: Denylist small worker sizes in reverse replication by @manitgupta in #3044
  • Add support for GCP SchemaRegistry in Kafka Templates by @Dippatel98 in #3066

Bug fixes

  • When Spanner has NULL value for SQL PK column, the error is thrown by change event by @aasthabharill in #3034

Package Upgrades

New Contributors

Full Changelog: 2025-12-02-00_RC00...2025-12-09-00_RC00

Dataflow Templates 2025-12-02-00_RC00

02 Dec 14:59
4894f74

Choose a tag to compare

What's Changed

Improvements

  • Fix JSON/JSONB datatypes in postgres-to-sql template by @yair-harel in #2960
  • Add IcebergResourceManager by @tarun-google in #2985
  • Add support for additional fields in terraform templates for Reverse and Live migration by @aasthabharill in #3005
  • [DatastreamToSpanner] Integration test for CDC processing algorithm for Live migration template by @darshan-sj in #3018

Bug fixes

New Contributors

Full Changelog: 2025-11-11-00_RC00...2025-12-02-00_RC00

Dataflow Templates 2025-11-11-00_RC00

11 Nov 14:33
34afdba

Choose a tag to compare

What's Changed

Package Upgrades

  • chore(deps): update Python dependencies by @github-actions[bot] in #2979

Full Changelog: 2025-11-06-00_RC00...2025-11-11-00_RC00

Dataflow Templates 2025-11-06-00_RC00

06 Nov 23:13
5e1c3cb

Choose a tag to compare

What's Changed

Improvements

  • Delete v2/datastream-to-postgres directory by @dhercher in #2959
  • [SpannerToSourceDb] Improving error classification in Reverse replication template by @darshan-sj in #2964
  • Update to beam 2.69 by @Abacn in #2966

Bug fixes

Package Upgrades

  • chore(deps): update Python dependencies by @github-actions[bot] in #2956

Full Changelog: 2025-10-28-01_RC00...2025-11-06-00_RC00

Dataflow Templates 2025-11-05-00_RC00

06 Nov 03:23
b2fbe03

Choose a tag to compare

fix(build): update surefire report processing to handle time format (…

Dataflow Templates 2025-10-28-01_RC00

29 Oct 02:03
92106f5

Choose a tag to compare

What's Changed

Improvements

  • fix(kafka): handle domain-scoped project IDs in bootstrap server URL by @liferoad in #2908
  • Yaml: Add yaml syntax UT by @derrickaw in #2872
  • [SpannerToSourceDb] Fixing CDC events processing logic for Reverse replication template by @darshan-sj in #2919
  • Apply GCP Application Default authentication when using a Managed Service for Apache Kafka cluster. by @fozzie15 in #2925

Bug fixes

  • Remove special handling for only PK column tables by @manitgupta in #2929
  • [yaml] - move syntax test verification to validate section by @derrickaw in #2936

Package Upgrades

New Contributors

Full Changelog: 2025-10-21-00_RC00...2025-10-28-01_RC00

Dataflow Templates 2025-10-28-00_RC00

28 Oct 14:21
9bf7840

Choose a tag to compare

bump org.apache.commons:commons-configuration to resolve CVE-2024-291…