Skip to content

Move backup/restore logic to the Charm #80

Description

@kimwnasptd

Context

Right now the backup and restore guide is telling users to run the following commands to create a dump of the sqlite content of MLMD's PVC:

# CKF 1.8
MLMF_POD="mlmd-0"
MLMD_CONTAINER="mlmd"

kubectl exec -n kubeflow $MLMD_POD -c $MLMD_CONTAINER -- \
    /bin/bash -c "apt update && apt install sqlite3 -y"

This has the following 2 drawbacks:

  1. It will not work in airgap environments
  2. Users need to manually use commands to create the backup and push it to S3

What needs to get done

  1. Include any binaries needed for the backup into the Charm (could be separate task)
  2. Have an action that can make the backup and push it to S3
    1. Will most probably need to have a relation with s3-interface for this

This will also need to take into account if MLMD should block receiving traffic when making the backup or not (scaling down the pebble service).

Definition of Done

  1. Have a spike to confirm we know if MLMD should be up/down when doing the backup
  2. The action can be executed in an airgapped environment
  3. Users don't need to run any manual commands from their machine
  4. The data will go directly from the Charm to S3

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions