Skip to content

Switch to Mistral Small 4 as default LLM #168

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
sandragjacinto merged 18 commits into from
May 5, 2026
Merged

Switch to Mistral Small 4 as default LLM #168

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
be8778f
Update environment variables
jmsevin Apr 28, 2026
47e7e2c
Update poetry requirements
jmsevin Apr 28, 2026
4a37a1f
Get Mistral env vars
jmsevin Apr 28, 2026
9b6847c
Replace Azure AI by Mistral AI
jmsevin Apr 28, 2026
0b79575
Remove unused method
jmsevin Apr 28, 2026
3fd3738
Format agent_message to Mistral schema
jmsevin Apr 29, 2026
11c6d5f
Use Mistral as default completion client
jmsevin Apr 29, 2026
8e76b6a
Tests, format and lint
jmsevin Apr 29, 2026
3f64697
Manually add dependency
jmsevin Apr 30, 2026
8308fe9
Change syntax in pyproject.toml
jmsevin Apr 30, 2026
89d2ea6
Fix CI/CD issue with pip version
jmsevin Apr 30, 2026
7b51d53
chore: update MISTRAL_API_KEY and modify lastmodified date in secrets…
lpi-tn Apr 30, 2026
4722dff
Merge branch 'mistral-small-4' of https://github.com/CyberCRI/WeLearn…
jmsevin Apr 30, 2026
ee6cf3d
Add Mistral API model name
jmsevin Apr 30, 2026
621cc28
Add test values for new env vars
jmsevin Apr 30, 2026
d0175f7
Fix errors in unit tests
jmsevin Apr 30, 2026
dca5612
adds history and thread id
sandragjacinto May 5, 2026
385a8a5
adds sops to prod and staging
sandragjacinto May 5, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions .env.example
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,16 +1,18 @@
CLIENT_ORIGINS=https://fake-origin.example.com
CLIENT_ORIGINS_REGEX="^http://fake-localhost:.*"
ENV=development
##### MISTRAL AZURE #####
AZURE_MISTRAL_SWEDEN_API_BASE=https://fake-mistral-sweden.example.com/models
AZURE_MISTRAL_SWEDEN_API_KEY=FAKE_MISTRAL_SWEDEN_API_KEY

##### AZURE #####
AZURE_MISTRAL_API_BASE=https://fake-mistral.example.com/models
AZURE_MISTRAL_API_KEY=FAKE_MISTRAL_API_KEY

AZURE_APIM_API_BASE=https://fake-apim-mistral.example.com/models
AZURE_APIM_API_KEY=FAKE_APIM_API_KEY

##### MISTRAL #####
MISTRAL_API_KEY=FAKE_MISTRAL_API_KEY
MISTRAL_LLM_MODEL_NAME=fake-mistral-llm-model

############ FOR RAG METRICS ###########
AZURE_API_KEY=FAKE_AZURE_API_KEY
AZURE_API_BASE=https://fake-openai.example.com
Expand All @@ -35,8 +37,6 @@ QDRANT_PORT=1234
######## TIKA ##############
TIKA_URL_BASE=https://fake-tika.example.com/

LITELLM_LOG=FAKE_LOG_LEVEL

HASH_SALT="FAKE_HASH_SALT"
HASH_ALGO="FAKE_HASH_ALGO"
AUTH_TOKEN_EXPIRATION=9999
Expand Down
1 change: 1 addition & 0 deletions Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ RUN apt update && apt install -y --no-install-recommends make

COPY --from=requirements-stage ./tmp/requirements.txt ./requirements.txt

RUN pip install --upgrade pip
RUN pip install --no-cache-dir --upgrade -r requirements.txt

COPY . .
Expand Down
7 changes: 4 additions & 3 deletions k8s/welearn-api/secrets.dev.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@ config:
AZURE_MISTRAL_API_KEY: ENC[AES256_GCM,data:FjMSqC6wQM4/1cg5hwM3qAZiKmDEEU0rz6l44XDr0HQ0WLXRYKxDcm/0Ii1khG693fyQJalH7lvf8CRVdD4mnIm3KOaw5Q5MCkqrqoQo2GGm+7ZF,iv:h157m7hUESIOMC81yrnxzG//fInFLfsR8o2zYTsGcUs=,tag:pMOQn7+ijCbvYh1AksjYbQ==,type:str]
AZURE_APIM_API_KEY: ENC[AES256_GCM,data:GKEHlKS5GgzSO+rHYYvrdL0e7WDZDyByD6mYbDmSNZQ=,iv:k/SHzVKSvMr0ibz3O19yQc3Hz4rzFRALxINlNJRLAwk=,tag:9sgSAnfTKEL5SDPyyw2uhA==,type:str]
PG_PASSWORD: ENC[AES256_GCM,data:8GsISVAuJyIh0WUFwb9mpqyWcNT04fnmpH4ru5CA+aw=,iv:oGKLDiadbhRQWVSE5J/4QJbppiTIcHhNr9fFY7XI0jY=,tag:Ksk0uMrB9fmVT8thQODFJA==,type:str]
MISTRAL_API_KEY: ENC[AES256_GCM,data:2om3jEYb/E8bexmXO1LVWMp5fV4WOm51WCiJLiDEF3g=,iv:aYnBjQt3ZmK0DC4VGcqTGFUYRIOKrewkvoZC2Iz1ArY=,tag:eHpoeTdk5QVaKrqUJYueVw==,type:str]
azureSecrets:
azurestorageaccountname: ENC[AES256_GCM,data:vhsGuyM8IYCRua2BQtuYpLI/Dzdx,iv:kPcuAWarV4RXujfwe+9rKe/YWARoeOcFp789WwrI+z8=,tag:Hg8JJmYW0Zuz/2brM/z8yQ==,type:str]
azurestorageaccountkey: ENC[AES256_GCM,data:xssnW7Kk3LGmF9dpeCiiV2Z7vyNo4n0aSMcA3aXJYd7uvx7B1HmmSRnc47y3pBS8Hg0dc+6Lf0AIod/Yr2mMC+Dfoosfj2oiY4P/7FQZNMD2xVuZCebTYA==,iv:wlEwj0M1U/EIgVbqxiT0aLgtcwmVGfuRgTaOdQYs6IU=,tag:pLiJujwzEMZOg1xEM22Ojg==,type:str]
Expand Down Expand Up @@ -63,7 +64,7 @@ sops:
Q1lsakJjbW5rTGRIYUt0M3ArN2xjMW8KyUV4W7zltLlQ3Bdp4U1OgU5hRlWLa5RU
hxOYlyFSCKkn/hXTx2AAwyTVcwVGt/OoUujuRN1A1/pGrO1sDY0uFg==
-----END AGE ENCRYPTED FILE-----
lastmodified: "2025-12-05T11:12:47Z"
mac: ENC[AES256_GCM,data:FL4ZyGT2BoO/xUYY4ZEvQqf1nTuLMbX8wE0tvghsFlnOp7bhINuZBA9Mc5xK5dsy5LkVesVV60CtMXu6yhNJUxGRcyrZHkrQnvUX+0qVh4GqRPxhFRP++e8oOFbsVs+XTwZSpJNN740VV27B5NbsM6lXbWi4DGH1q+aL2qE2EuY=,iv:lVWWYPAwkfNg9dJJtTRvD3mYmLcOnvId6fDsndNE6qc=,tag:T4sAj8BPtVzjABw++ejy7Q==,type:str]
lastmodified: "2026-04-30T13:05:26Z"
mac: ENC[AES256_GCM,data:ZFiWNcr07s7GcnleGpFZWb+YIk1Hv5nut4GFn4o2p5YFd0IvycuFWybk3sw1e4GmPoIJwaXiuSIThUYaZSBbuAzy9u7QZj0tkiVti7otbccsTj+mFOQ4p4iJty1Ms6+S03O4Yd3jWOugJQMbzuMm4OHKkI2rorvaVOdyQjvPK6c=,iv:+WSNB3GrlxU7kOCnAeI1M1JkTQG/ssEXD+QYt2WcwjM=,tag:Gc19gH91iYb6tAj0PKI8Wg==,type:str]
unencrypted_suffix: _unencrypted
version: 3.9.4
version: 3.12.1
10 changes: 8 additions & 2 deletions k8s/welearn-api/secrets.prod.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,10 +4,15 @@ config:
AZURE_MISTRAL_API_KEY: ENC[AES256_GCM,data:gvtwPHReMmaaKcNWUcf63NO6GpAiiyLRimQkuJC1qKlSa/leVe5oLJzY9/3JkY4S9LJvs7JI2MT2AvUgMRd+qPfMHySgosOQPxx0PJAtp6ikfAKb,iv:t9Pb1+XKP5B2VwA9c9fguR/oULpIETFngt0cmqJPb7I=,tag:ABBYMiyjUW/dsUESQB1Uqg==,type:str]
AZURE_APIM_API_KEY: ENC[AES256_GCM,data:ceGyPsjjZ09T3U+zAJdTaqYr3ly5/wW4GYtJxd0noTI=,iv:1chC8dCnBhtqCd8Ex34dlSAO3LT+9IlbI5SQXdXt79U=,tag:2qd1zxwpDnKwFcGVZE8siw==,type:str]
PG_PASSWORD: ENC[AES256_GCM,data:T+LaC4wkSed2ZbuZZA9EnqsZ,iv:7JM9iNYjLQ63kqZ5AtDODkE0BELWRal3wTB4G8W8Kho=,tag:IRUsvN4EowdEhJsSx++7Mg==,type:str]
MISTRAL_API_KEY: ENC[AES256_GCM,data:onBQp43O+S55XnaNKX2wZ9SW65owQR2rNost6Mw8/R8=,iv:rL9K7AD/mpl8lgq7XOu0qtfC/zg2x8MrSIKJW1idkNw=,tag:QDqgOruwTtxZH4IVIGtOIg==,type:str]
azureSecrets:
azurestorageaccountname: ENC[AES256_GCM,data:b0QcVmOiCxTrMqxPi+jI/NFOB4Zo6QA=,iv:IO39BNbdBcsLMYX5BydeQWM5oSIGPz66ldYKkGPmy7Q=,tag:UmkHbz1x90RoZ7Nw2gi02A==,type:str]
azurestorageaccountkey: ENC[AES256_GCM,data:TTK/V7kI3W7UC4P2OoIJiCW+eM78j7+nhPK007sYwlhLRv6Q6dXIYT3jjPyz2r8HJBBnLM5t4leWU+97jDtYYEwIrdGDmEAw8z98vLchU8d+O8Q5CfXlSg==,iv:eETF+0rF/X9GyIGKQujbRM+KeGZvzeCtqYrE7e4VaPQ=,tag:S99K8hY6JEEoPjWMYXINFw==,type:str]
sops:
kms: []
gcp_kms: []
azure_kv: []
hc_vault: []
age:
- recipient: age13da407hamk8c3rdp3nu3q8hqgxsefn902vrxsuphw2ljfmd2k5qqy7mgzx
enc: |
Expand Down Expand Up @@ -63,7 +68,8 @@ sops:
ZjYvVUx5Y2UvblUwemdsYVdDWEN6bXcKd7kv1FAE5d1ROzveRc+1LJHOox3Xy7Ve
vrDdYftAyCYvY5PSC82+/JiV0lqKwEx5+xLradzLB1lOb8F45px4Dw==
-----END AGE ENCRYPTED FILE-----
lastmodified: "2025-12-05T11:12:42Z"
mac: ENC[AES256_GCM,data:sOEfKW8r/ruDBv/6pTJHPyw99TGL+JmFTyV8PbB8ZaeOwoa3zWei+XCvdeS7f35p3neYy/u0qznxI1qhowSxSQt6LtPdwqGezxEb8wkLI1SXwUH5kp4TcU7mDusBduMY5zomH+THviqDo8NlWz86gpElleyYTnnnWntd8oICFFM=,iv:O9+oxLcTVopjq6S+zrNfHN1CrrQ4gUc2Zb9HLCqWAfA=,tag:w5PVJeqB6c7gBu8YgPm0ww==,type:str]
lastmodified: "2026-05-05T14:13:13Z"
mac: ENC[AES256_GCM,data:wi64FB7cDBlS4FWJNkxd+scqswRlBv8zavInSnREoaLRCJ0Mo69n/ge2uB6RNum3qP/VFDrZzLUQ5uFcC1uKlqXUGP78u2srqt3Gljd716xCGI4dPI1sV19CbyMBHEYnYPq1bn/z0J+l+0s4G1+M2Ym9m1m8R0/rlEfIfIbD05E=,iv:Zdjf2CXFo2alz70lnV5GCdM/Uh6SDAqWYh8K1Xu9K6A=,tag:SPWfFeywx7bTWy/FGNgaug==,type:str]
pgp: []
unencrypted_suffix: _unencrypted
version: 3.9.4
10 changes: 8 additions & 2 deletions k8s/welearn-api/secrets.staging.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,10 +4,15 @@ config:
AZURE_MISTRAL_API_KEY: ENC[AES256_GCM,data:f9Ig3O6AisJ/m5Vcot8egHASrHSq3d8vkxp+RGE7KwRqC0lK+KoAkuI90iz1RFc5J9nACGp+pV/8V3OFW3uUTmC8UNWZdrH+Zpk6v7coqsQjb0cy,iv:Qo9s3kLLx3FbWKvoQOX5+DNLT/z9FZrAcvp48x6GOzo=,tag:mQZgcbQEvUWXn2QlnnZoTA==,type:str]
AZURE_APIM_API_KEY: ENC[AES256_GCM,data:0RPZHeVfTsVxcLewO+Ckd39phDJxKJAhbG5jv6Ze8+E=,iv:ca2E1a1kAmuRExX6xl3RYz0IWGGcEOKaa4SXZ7QSISQ=,tag:afdEmP/R4a9iGcJnNLCyCg==,type:str]
PG_PASSWORD: ENC[AES256_GCM,data:2fOIMhUVmR9UzHwFcAb2OroedRFxq/4Gbm+aSiml/90=,iv:6PyPvbY7IYFANkfKKiK86m3xkrtzQspQlIo6+qgaZTc=,tag:hM8LpwMY64u361gnd//yFg==,type:str]
MISTRAL_API_KEY: ENC[AES256_GCM,data:04rlq1Gg1yVQGiJxamsUsbYO4BAvQmGzAk+7Pa5Rd0M=,iv:OxfEwzzBAnoIB/x6aeZWAm1iOHYToqScqVzs6AqhC1U=,tag:2238THbjn2oSk8hVtkVayA==,type:str]
azureSecrets:
azurestorageaccountname: ENC[AES256_GCM,data:cyznEYCgdmOLaK65CiL3iXiRgJW4,iv:Ivqi93DGvm2S9HVLOUCDEnC/qs2OQ4ejbH/yQDIU1dQ=,tag:CymYFXGA6MLvHWa94eIUJg==,type:str]
azurestorageaccountkey: ENC[AES256_GCM,data:bU324wNm44RtxdMQQQ3gO7N0FsKR/S+gj2oL62TnCrRRdJWhl5OurgbBuXq3wtH5zfSJsdr94FRGgttjBePkTkJk9PMssGhCChnKRttxb9od+VuH/EJfYA==,iv:qyom9rLLOCagB+7d9YgzIgtMZfF/yEn5zTVGljfHNYA=,tag:WSd0l0nRx7MMWkqoMOuRtA==,type:str]
sops:
kms: []
gcp_kms: []
azure_kv: []
hc_vault: []
age:
- recipient: age1dvu205sflecfu6uewgwmgs83nkm2c2fzfxs55zfkjs2gmqjya50qmm6lck
enc: |
Expand Down Expand Up @@ -63,7 +68,8 @@ sops:
S2dEMnlFaVhWekxiL2pXd1B3aUxBOVkKQyMWNIM5IsQAB01bq66xCMU6Spgps9h9
nmnWY8LKRAHuw24H1rZLkFEHlUbdRuhqRfkCDWJuxwjKBEA6WsCmwg==
-----END AGE ENCRYPTED FILE-----
lastmodified: "2026-04-16T08:13:53Z"
mac: ENC[AES256_GCM,data:mMaGEJ42OJbjaO1mtnGNTMeTULpNc/+ifHc6OIMdQoMpMKHDBBt5mUWRSSsoHoxFvBepfDOrQww0remh/l4P2nHi5c6ccuu2gJIb7DxMI8U7BT0cfYtqteLIBUecdhJZvDWplGj+udd67acEky8CVksmuDXiwtncqundTgBbgnQ=,iv:eRO3qnpj/I8VEJcWDecKcy4/FOTDSrtEBVDJ0dOpVVo=,tag:EGkypDU/+XSF7vNu3Ac/HA==,type:str]
lastmodified: "2026-05-05T14:13:23Z"
mac: ENC[AES256_GCM,data:qlEtzvYnyU/izsIwfhDliLLFHlNHiYUHqjKUz3BGGAapdhwGnEpIObf9wlyt9glaO2q7d3R1uYcXKZum0qm2QLYK3yU/PDrWl8W1b4aBdpwNMDWCvV6T96oPXepDGMSt85TnhQ6i3TWQ8dV3mVvF3YTLDAwKppUVAniQUVMCP/I=,iv:1pr45Bed7vIj5aZNZwLnt47w5mCuQ8rGmMHrECjDiPk=,tag:3GABUwf0OlBrkDHW9Ll5iA==,type:str]
pgp: []
unencrypted_suffix: _unencrypted
version: 3.11.0
1 change: 1 addition & 0 deletions k8s/welearn-api/values.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,7 @@ config:
AZURE_API_BASE: "https://welearn-openai.openai.azure.com/openai/"
AZURE_API_VERSION: "2024-08-01-preview"
LLM_MODEL_NAME: gpt-oss-120b
MISTRAL_LLM_MODEL_NAME: mistral-small-latest
QDRANT_HOST: "http://qdrant.qdrant"
QDRANT_PORT: "6333"
MODELS_FOLDER_ROOTS: "/models"
Expand Down
Loading
Loading