Skip to content

feat: add GLUE_SKIP_ARCHIVE env variable for glue sync#134

Merged
javsanbel2 merged 1 commit into
mainfrom
feature/gluesync-skip-archive-default
May 15, 2026
Merged

feat: add GLUE_SKIP_ARCHIVE env variable for glue sync#134
javsanbel2 merged 1 commit into
mainfrom
feature/gluesync-skip-archive-default

Conversation

@javsanbel2
Copy link
Copy Markdown
Contributor

Adds an optional GLUE_SKIP_ARCHIVE environment variable that sets the default value passed as SkipArchive on AWS Glue UpdateTable requests (triggered by Hive ALTER TABLE events).

Resolution precedence (highest first):

  1. Hive table property 'apiary.gluesync.skipArchive'
  2. GLUE_SKIP_ARCHIVE env variable
  3. Built-in default (true)

Accepts 'true' or 'false' (case-insensitive); any other value causes the listener to fail on startup. Unset keeps current behaviour.

AWS Glue UpdatePartition/BatchUpdatePartition APIs do not expose a SkipArchive field, so partition updates are not affected. This is documented in the module README.

📝 Description

🔗 Related Issues

@javsanbel2 javsanbel2 requested a review from a team as a code owner May 14, 2026 12:29
Copy link
Copy Markdown

@mollonado mollonado left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@javsanbel2 javsanbel2 force-pushed the feature/gluesync-skip-archive-default branch from c5af78d to 50afc0b Compare May 14, 2026 15:05
…viour

Adds an optional GLUE_SKIP_ARCHIVE environment variable that sets the
default value passed as SkipArchive on AWS Glue UpdateTable requests
(triggered by Hive ALTER TABLE events).

Resolution precedence (highest first):
  1. Hive table property 'apiary.gluesync.skipArchive'
  2. GLUE_SKIP_ARCHIVE env variable
  3. Built-in default (true)

Accepts 'true' or 'false' (case-insensitive); any other value causes the
listener to fail on startup. Unset keeps current behaviour.

AWS Glue UpdatePartition/BatchUpdatePartition APIs do not expose a
SkipArchive field, so partition updates are not affected. This is
documented in the module README.

Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
@javsanbel2 javsanbel2 force-pushed the feature/gluesync-skip-archive-default branch from 50afc0b to 8dc4887 Compare May 14, 2026 15:06
@javsanbel2 javsanbel2 merged commit 191fa7b into main May 15, 2026
1 check passed
@javsanbel2 javsanbel2 deleted the feature/gluesync-skip-archive-default branch May 15, 2026 09:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants