[BUG] cloudberry test failed

[chipitsine]

Database name

cloudberry

WAL-G Version

master

Describe your problem

wal-g_cloudberry_tests | 20260209:12:09:39:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-Starting gpstop with args: -a -M fast
wal-g_cloudberry_tests | 20260209:12:09:39:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-Gathering information and validating the environment...
wal-g_cloudberry_tests | 20260209:12:09:39:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-Obtaining Cloudberry Coordinator catalog information
wal-g_cloudberry_tests | 20260209:12:09:39:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-Obtaining Segment details from coordinator...
wal-g_cloudberry_tests | 20260209:12:09:39:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-Cloudberry Version: 'postgres (Apache Cloudberry) 2.1.0-incubating build dev'
wal-g_cloudberry_tests | 20260209:12:09:39:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-Commencing Coordinator instance shutdown with mode='fast'
wal-g_cloudberry_tests | 20260209:12:09:39:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-Coordinator segment instance directory=/usr/local/gpdb_src/gpAux/gpdemo/datadirs/qddir/demoDataDir-1
wal-g_cloudberry_tests | 20260209:12:09:40:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-Attempting forceful termination of any leftover coordinator process
wal-g_cloudberry_tests | 20260209:12:09:40:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-Terminating processes for segment /usr/local/gpdb_src/gpAux/gpdemo/datadirs/qddir/demoDataDir-1
wal-g_cloudberry_tests | 20260209:12:09:40:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-No standby coordinator host configured
wal-g_cloudberry_tests | 20260209:12:09:40:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-Targeting dbid [2, 3, 4] for shutdown
wal-g_cloudberry_tests | 20260209:12:09:40:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-Commencing parallel segment instance shutdown, please wait...
wal-g_cloudberry_tests | 20260209:12:09:40:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-0.00% of jobs completed
wal-g_cloudberry_tests | 20260209:12:09:42:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-100.00% of jobs completed
wal-g_cloudberry_tests | 20260209:12:09:42:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-----------------------------------------------------
wal-g_cloudberry_tests | 20260209:12:09:42:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:- Segments stopped successfully = 3
wal-g_cloudberry_tests | 20260209:12:09:42:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:- Segments with errors during stop = 0
wal-g_cloudberry_tests | 20260209:12:09:42:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-----------------------------------------------------
wal-g_cloudberry_tests | 20260209:12:09:42:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-Successfully shutdown 3 of 3 segment instances
wal-g_cloudberry_tests | 20260209:12:09:42:141081 gpstop:0530ff5b9cb9:gpadmin-[INFO]:-Database successfully shutdown with no errors reported
wal-g_cloudberry_tests | + start_cluster
wal-g_cloudberry_tests | + /usr/local/gpdb_src/bin/gpstart -a -t 180
wal-g_cloudberry_tests | 20260209:12:09:42:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Starting gpstart with args: -a -t 180
wal-g_cloudberry_tests | 20260209:12:09:42:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Gathering information and validating the environment...
wal-g_cloudberry_tests | 20260209:12:09:42:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Cloudberry Binary Version: 'postgres (Apache Cloudberry) 2.1.0-incubating build dev'
wal-g_cloudberry_tests | 20260209:12:09:42:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Cloudberry Catalog Version: '302502091'
wal-g_cloudberry_tests | 20260209:12:09:42:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Starting Coordinator instance in admin mode
wal-g_cloudberry_tests | 20260209:12:09:42:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-CoordinatorStart pg_ctl cmd is env GPSESSID=0000000000 GPERA=None $GPHOME/bin/pg_ctl -D /usr/local/gpdb_src/gpAux/gpdemo/datadirs/qddir/demoDataDir-1 -l /usr/local/gpdb_src/gpAux/gpdemo/datadirs/qddir/demoDataDir-1/log/startup.log -w -t 180 -o " -p 7000 -c gp_role=utility " start
wal-g_cloudberry_tests | 20260209:12:09:42:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Obtaining Cloudberry Coordinator catalog information
wal-g_cloudberry_tests | 20260209:12:09:42:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Obtaining Segment details from coordinator...
wal-g_cloudberry_tests | 20260209:12:09:42:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Setting new coordinator era
wal-g_cloudberry_tests | 20260209:12:09:42:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Coordinator Started...
wal-g_cloudberry_tests | 20260209:12:09:42:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Shutting down coordinator
wal-g_cloudberry_tests | 20260209:12:09:46:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Commencing parallel segment instance startup, please wait...
wal-g_cloudberry_tests | 20260209:12:09:47:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Process results...
wal-g_cloudberry_tests | 20260209:12:09:47:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-----------------------------------------------------
wal-g_cloudberry_tests | 20260209:12:09:47:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:- Successful segment starts = 3
wal-g_cloudberry_tests | 20260209:12:09:47:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:- Failed segment starts = 0
wal-g_cloudberry_tests | 20260209:12:09:47:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:- Skipped segment starts (segments are marked down in configuration) = 0
wal-g_cloudberry_tests | 20260209:12:09:47:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-----------------------------------------------------
wal-g_cloudberry_tests | 20260209:12:09:47:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Successfully started 3 of 3 segment instances
wal-g_cloudberry_tests | 20260209:12:09:47:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-----------------------------------------------------
wal-g_cloudberry_tests | 20260209:12:09:47:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Starting Coordinator instance 0530ff5b9cb9 directory /usr/local/gpdb_src/gpAux/gpdemo/datadirs/qddir/demoDataDir-1
wal-g_cloudberry_tests | 20260209:12:09:47:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-CoordinatorStart pg_ctl cmd is env GPSESSID=0000000000 GPERA=040d4fb1c9d26eb1_260209120942 $GPHOME/bin/pg_ctl -D /usr/local/gpdb_src/gpAux/gpdemo/datadirs/qddir/demoDataDir-1 -l /usr/local/gpdb_src/gpAux/gpdemo/datadirs/qddir/demoDataDir-1/log/startup.log -w -t 180 -o " -p 7000 -c gp_role=dispatch " start
wal-g_cloudberry_tests | 20260209:12:09:47:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Command pg_ctl reports Coordinator 0530ff5b9cb9 instance active
wal-g_cloudberry_tests | 20260209:12:09:47:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Connecting to db template1 on host localhost
wal-g_cloudberry_tests | 20260209:12:09:47:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-No standby coordinator configured. skipping...
wal-g_cloudberry_tests | 20260209:12:09:47:141423 gpstart:0530ff5b9cb9:gpadmin-[INFO]:-Database successfully started
wal-g_cloudberry_tests | + wal-g --config=/tmp/configs/tmp_config.json delete everything FORCE --confirm
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:47.367183 Using storages: [default]
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:47.399449 retrieving permanent objects
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:47.425093 Objects in folder:
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:47.425126 will be deleted: segments_005/seg-1/wal_005/000000010000000000000001.lz4, from storage: default
wal-g_cloudberry_tests | + wal-g create-restore-point rp1 --config=/tmp/configs/tmp_config.json
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:48.525895 Greenplum version: PostgreSQL 14.4 (Apache Cloudberry 2.1.0-incubating build dev) on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 9.4.0-1ubuntu120.04.2) 9.4.0, 64-bit compiled on Feb 9 2026 11:14:19
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:48.533323 Creating restore point with name rp1
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:48.541975 Greenplum version: PostgreSQL 14.4 (Apache Cloudberry 2.1.0-incubating build dev) on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 9.4.0-1ubuntu120.04.2) 9.4.0, 64-bit compiled on Feb 9 2026 11:14:19
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:48.542393 Switch xlog on cluster
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:48.845407 Uploading restore point metadata file rp1_restore_point.json
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:48.845899 {"name":"rp1","start_time":"2026-02-09T12:09:48.528809Z","finish_time":"2026-02-09T12:09:48.8454Z","hostname":"0530ff5b9cb9","gp_version":"2.1.0","gp_flavor":"cloudberry","system_identifier":7604836475188813245,"lsn_by_segment":{"-1":"0/8003798","0":"0/495BE20","1":"0/495BF00","2":"0/495BF00"},"storage_name":"","time_line":1}
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:48.851686 Restore point rp1 successfully created
wal-g_cloudberry_tests | + wal-g create-restore-point rp2 --config=/tmp/configs/tmp_config.json
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:50.103398 Greenplum version: PostgreSQL 14.4 (Apache Cloudberry 2.1.0-incubating build dev) on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 9.4.0-1ubuntu120.04.2) 9.4.0, 64-bit compiled on Feb 9 2026 11:14:19
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:50.110885 Creating restore point with name rp2
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:50.639980 Greenplum version: PostgreSQL 14.4 (Apache Cloudberry 2.1.0-incubating build dev) on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 9.4.0-1ubuntu120.04.2) 9.4.0, 64-bit compiled on Feb 9 2026 11:14:19
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:50.640948 Switch xlog on cluster
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:51.295610 Uploading restore point metadata file rp2_restore_point.json
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:51.296395 {"name":"rp2","start_time":"2026-02-09T12:09:50.105598Z","finish_time":"2026-02-09T12:09:51.295603Z","hostname":"0530ff5b9cb9","gp_version":"2.1.0","gp_flavor":"cloudberry","system_identifier":7604836475188813245,"lsn_by_segment":{"-1":"0/C0000F0","0":"0/80000C8","1":"0/80000C8","2":"0/80000C8"},"storage_name":"","time_line":1}
wal-g_cloudberry_tests | INFO: 2026/02/09 12:09:51.299732 Restore point rp2 successfully created
wal-g_cloudberry_tests | + sleep 5
wal-g_cloudberry_tests | + for seg_path in segments_005/seg-1/wal_005/ segments_005/seg0/wal_005/ segments_005/seg1/wal_005/ segments_005/seg2/wal_005/
wal-g_cloudberry_tests | + check_wal_upload segments_005/seg-1/wal_005/
wal-g_cloudberry_tests | + local path=segments_005/seg-1/wal_005/
wal-g_cloudberry_tests | + wal-g st ls segments_005/seg-1/wal_005/ --config=/tmp/configs/tmp_config.json
wal-g_cloudberry_tests | type size last modified name
wal-g_cloudberry_tests | obj 284042 2026-02-09 12:09:55.525 +0000 UTC 000000010000000000000002.lz4
wal-g_cloudberry_tests | + wal-g st ls segments_005/seg-1/wal_005/ --config=/tmp/configs/tmp_config.json
wal-g_cloudberry_tests | + awk '/^obj/ {count++} END {exit !(count >= 2)}'
wal-g_cloudberry_tests | + echo 'Error: WAL files after create-restore-point were not correctly uploaded to S3 for segments_005/seg-1/wal_005/'
wal-g_cloudberry_tests | Error: WAL files after create-restore-point were not correctly uploaded to S3 for segments_005/seg-1/wal_005/
wal-g_cloudberry_tests | + exit 1
Aborting on container exit...

Steps to reproduce

No response

Config and WAL-G logs

No response