Skip to content

feat: add env-driven MVP request envelope across predict stack - #20

Merged
BehRoooz merged 5 commits into
mainfrom
prod/cold-start-gpu
Jul 30, 2026
Merged

feat: add env-driven MVP request envelope across predict stack#20
BehRoooz merged 5 commits into
mainfrom
prod/cold-start-gpu

Conversation

@BehRoooz

Copy link
Copy Markdown
Owner

Summary

Limit sequences, AA length, FASTA upload size, and sync predict
timeouts end-to-end (API, nginx, Streamlit, Compose) so cold-start
GPU deploys stay within production MVP bounds.

BehRoooz added 5 commits July 30, 2026 15:25
Cap sequences, AA length, FASTA size, and sync predict timeout via
config instead of hardcoded route defaults, and reject oversize
requests early on job and predict paths.
Read sequence/FASTA/timeout caps from env so the UI rejects bad
uploads before the gateway, and surface those limits in the FASTA help text.
Expose envelope vars in Compose for embedding-api and streamlit-ui,
document them in .env.example, and set predict routes to 2m body /
660s read timeout for cold starts.
Include a longer UniProt record for local MVP envelope and predict smoke checks.
Limit sequences, AA length, FASTA upload size, and sync predict
timeouts end-to-end (API, nginx, Streamlit, Compose) so cold-start
GPU deploys stay within production MVP bounds.
@BehRoooz
BehRoooz merged commit a8e3150 into main Jul 30, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant