Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
53 commits
Select commit Hold shift + click to select a range
6916d39
Make stack ready to deploy
michaelglenister Aug 28, 2025
d7a9e9e
Make stack ready to deploy
michaelglenister Aug 29, 2025
f13452e
Make stack ready to deploy
michaelglenister Sep 2, 2025
bc46c71
Merge pull request #2 from OpenUpSA/folio
michaelglenister Sep 2, 2025
28f1852
Make ready for deploy
michaelglenister Sep 2, 2025
c32bb30
Increase ES ephemeral storage
michaelglenister Sep 9, 2025
92c4a3e
Increase ephemeral storage
michaelglenister Sep 10, 2025
36195fc
Make ready for deploy
michaelglenister Sep 12, 2025
86b4911
Make ready for prod deploy
michaelglenister Sep 22, 2025
4f7456b
CORS fixes and KC update
michaelglenister Sep 30, 2025
ceeb3c1
Create helm chart for frontend
michaelglenister Sep 30, 2025
23c91b0
Use PhaseTwo Keycloak
michaelglenister Oct 2, 2025
d14bc5a
Set KEYCLOAK_URL
michaelglenister Oct 2, 2025
05b57b5
Set email provider for Keycloak
michaelglenister Oct 8, 2025
d47b624
Add semi-private to project privacy options
michaelglenister Oct 9, 2025
46fd286
Set folio db security context
michaelglenister Oct 10, 2025
62edeae
Update init.sql
michaelglenister Oct 21, 2025
2b7df27
KC cors
michaelglenister Oct 21, 2025
d959573
Add Strimzi
michaelglenister Oct 23, 2025
d2aaa80
Updage kafka deploy
michaelglenister Nov 5, 2025
c69b2b8
Elasticsearch and worker
desafinadude Nov 19, 2025
1a81c49
Merge pull request #15 from OpenUpSA/es-and-worker
desafinadude Nov 19, 2025
ef0d130
fixed score and song references
desafinadude Nov 19, 2025
1382ecf
Merge pull request #16 from OpenUpSA/es-and-worker
desafinadude Nov 19, 2025
937d5dc
Add security context to Elasticsearch deployment for permission fixes
desafinadude Nov 19, 2025
e33e73e
Merge pull request #17 from OpenUpSA/es-and-worker
desafinadude Nov 19, 2025
3cd2be1
es fix
desafinadude Nov 19, 2025
52bc12d
Merge pull request #18 from OpenUpSA/es-and-worker
desafinadude Nov 19, 2025
12921d7
worker branch update
desafinadude Nov 19, 2025
b7d5375
upload size increase
desafinadude Nov 19, 2025
6939f59
new worker chart
desafinadude Nov 19, 2025
179e825
helm chart fix
desafinadude Nov 19, 2025
b913b46
worker update
desafinadude Nov 19, 2025
2071f7b
worker update
desafinadude Nov 19, 2025
24d1022
remove overture environment variables from deployment configuration
desafinadude Nov 19, 2025
bb29022
worker update
desafinadude Nov 19, 2025
7af1278
update image
desafinadude Nov 19, 2025
b391a07
worker update
desafinadude Nov 19, 2025
409ea56
added elastic and minio urls
desafinadude Nov 19, 2025
76288ea
worker update
desafinadude Nov 19, 2025
4f4a71a
frontend deploy fix
desafinadude Nov 20, 2025
9c36696
elastic
desafinadude Nov 21, 2025
e75037b
Fix indentation
michaelglenister Nov 21, 2025
fd37e9d
Add some Folio env config
michaelglenister Nov 24, 2025
98a3081
Frontend apply certificate
michaelglenister Nov 24, 2025
2783293
Add SSL certs
michaelglenister Nov 25, 2025
12cf163
Remove unused charts
michaelglenister Nov 25, 2025
c5f0ae3
Remove docs for unused charts
michaelglenister Nov 25, 2025
e712f72
Adding SSL certs to charts
michaelglenister Nov 25, 2025
d5d14d4
Minio update
michaelglenister Nov 25, 2025
713ea7b
Insatll folio worker
michaelglenister Nov 25, 2025
a55441c
Updates
michaelglenister Nov 27, 2025
1996534
Use secret store for db password
michaelglenister Feb 9, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
65 changes: 15 additions & 50 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -45,15 +45,7 @@ helm install minio ./helm/minio -n agari
kubectl port-forward -n agari service/minio 9000:9000
```

### 3.2 Kafka Message Queue

```bash
helm repo add bitnami https://charts.bitnami.com/bitnami

helm install kafka bitnami/kafka -f helm/kafka/values-bitnami.yaml -n agari
```

### 4. Setup Keycloak
#### 3.2 Setup Keycloak

```bash
# Database
Expand All @@ -67,23 +59,6 @@ Set up the **client** in Keycloak and copy the **secret** to **song**, **score**

use `utils/update-secrets.sh` script to update the secrets in all services

### 5. Deploy Overture Stack

#### 5.1 SONG

```bash
# Database
helm install song-db ./helm/song-db -n agari

# Song
helm install song ./helm/song -n agari
```

#### 5.2 SCORE
```bash
helm install score ./helm/score -n agari
```

#### 5.3 ELASTICSEARCH
```bash
# Elasticsearch
Expand All @@ -95,20 +70,7 @@ curl -X PUT "http://elasticsearch.local/agari-index" \
-d @helm/elasticsearch/configs/agari-index-mapping.json
```

#### 5.4 MAESTRO
```bash
helm install maestro ./helm/maestro -n agari
```
#### 5.5 ARRANGER
```bash
# Set up Arranger configuration
kubectl create configmap arranger-config --from-file=helm/arranger/configs/ -n agari

# Arranger
helm install arranger ./helm/arranger -n agari
```

#### 5.6 FOLIO Projects Service
#### 3.4 FOLIO Projects Service

**Find Folio repo at [https://github.com/OpenUpSA/agari-folio](https://github.com/OpenUpSA/agari-folio)**

Expand All @@ -119,6 +81,9 @@ helm install folio-db ./helm/folio-db -n agari
# Folio
helm install folio ./helm/folio -n agari

# Folio worker
helm install folio-worker ./helm/folio-worker -n agari

```


Expand All @@ -128,23 +93,23 @@ helm install folio ./helm/folio -n agari
For local development, you can use `/etc/hosts` to map the services:

```bash
echo "127.0.0.1 song.local
127.0.0.1 score.local
127.0.0.1 maestro.local
127.0.0.1 arranger.local
127.0.0.1 keycloak.local
echo "127.0.0.1 keycloak.local
127.0.0.1 elasticsearch.local
127.0.0.1 minio-console.local
127.0.0.1 folio.local" | sudo tee -a /etc/hosts
```

## Set SSL cert secret

```
kubectl create secret tls folio-prod-tls-cert --cert=/path/to/tls.crt --key=/path/to/tls.key -n agari-prod
```


## Service Access

Services are available at these URLs:

- **SONG API**: http://song.local/swagger-ui.html
- **Score API**: http://score.local/swagger-ui.html
- **Arranger GraphQL**: http://arranger.local/graphql
- **Keycloak**: http://keycloak.local
- **Elasticsearch**: http://elasticsearch.local
- **MinIO Console**: http://minio-console.local
Expand Down Expand Up @@ -193,15 +158,15 @@ curl -d "client_id=song-api" \
"http://keycloak.local/realms/agari/protocol/openid-connect/token"
```

## Data Flow
## Data Flow - outdated

1. **Submit metadata** → SONG validates and stores in PostgreSQL
2. **Upload files** → Score stores in MinIO object storage
3. **Analysis events** → Kafka message queue
4. **Index data** → Maestro processes and indexes in Elasticsearch
5. **Query data** → Arranger provides GraphQL API

## GraphQL Query Examples
## GraphQL Query Examples - outdated

Visit http://arranger.local/graphql to access the GraphQL playground. Here are example queries you can copy and paste:

Expand Down
6 changes: 0 additions & 6 deletions helm/arranger/Chart.yaml

This file was deleted.

4 changes: 0 additions & 4 deletions helm/arranger/configs/base.json

This file was deleted.

Loading