Description
Tasks enable one-and-done batch style inference workloads. We need to add Tasks support as part of the control plane. This work will involve
- Adding a helm chart
- Provisioning secrets using Openbao
- Creating Cassandra keyspace
- Setting up ingress routes
Definition of done
This work will be considered complete when the Tasks API is included in the control plane and has been QA validated.
Description
Tasks enable one-and-done batch style inference workloads. We need to add Tasks support as part of the control plane. This work will involve
Definition of done
This work will be considered complete when the Tasks API is included in the control plane and has been QA validated.