Skip to content

As an administrator, I want automated daily backups of MWAA metadata to S3Β #199

Description

@jordanpadams

Checked for duplicates

Yes - I have already checked

πŸ§‘β€πŸ”¬ User Persona(s)

System Administrator, Data Engineering

πŸ’ͺ Motivation

...so that I can automatically preserve Airflow configuration (Connections, Variables, DAG history) and quickly recover the system state in case of disaster without manual re-entry.

πŸ“– Additional Details

Implement the mwaa_dr_backup_to_s3 DAG from the AWS MWAA Disaster Recovery tool to automate daily exports of the MWAA metadata database.

Implementation Requirements:

  • Deploy the mwaa-dr package to the MWAA environment
  • Configure the mwaa_dr_backup_to_s3 DAG for daily scheduled execution
  • Ensure the MWAA Execution Role has S3 Write permissions to the backup bucket
  • Configure S3 Lifecycle Policy to retain backups for 14 days
  • Backup should include:
    • Airflow Connections
    • Airflow Variables
    • DAG run history

References


For Internal Dev Team To Complete

Acceptance Criteria

Given the MWAA environment is running with configured DAGs
When the daily backup schedule triggers (or manual trigger)
Then a complete metadata backup is exported to the designated S3 bucket with timestamped path

βš™οΈ Engineering Details

To be filled by engineering team

πŸŽ‰ I&T

To be filled by engineering team

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions