Skip to content

feat: Add a write_to_athena method to the WithAthena class, writing dataframes to AWS athena. #17

Description

@miodohelper

Context

It is required that Dynamicio can directly write to AWS Athena.

  • Further details about getting started with dynamicio can be found here

Note: #9 is a pre-requisite for this task.

Task

  • Add a write_to_athena method to the WithAthena class, writing dataframes to AWS athena.

Suggested Approach

Dynamicio already uses the boto3 library to access AWS. You'll want to continue using the boto3 class for authentication, and reading/writing where possible.

Please contact kit.burgess@miodo.io for instructions on how to test your code against a test AWS Athena instance.

Acceptance Criteria

  • The write_to_athena method should write entire dataframes to athena tables.
  • All existing tests pass.
  • New tests written as required.
  • Readme & docs are updated to reflect the new changes.

The Process

Please fork this repo, commit your changes on a branch, then send @miodohelper a PR request when your work is ready for review. Miodo will review the code before sending the PR for a final review by @Christos-Hadjinikolis.

Expected Duration

8hrs

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requesthelp wantedExtra attention is needed

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions