feat: add BL_MODEL_GATEWAY_URL env var to override mk3 gateway endpoint#328
Open
mendral-app[bot] wants to merge 1 commit into
Open
feat: add BL_MODEL_GATEWAY_URL env var to override mk3 gateway endpoint#328mendral-app[bot] wants to merge 1 commit into
mendral-app[bot] wants to merge 1 commit into
Conversation
The model gateway at mdl-model-gateway-esb1qo.bl.run is returning 404 (service no longer deployed). This adds a BL_MODEL_GATEWAY_URL environment variable that overrides the API-provided metadata URL for mk3 models, allowing CI and users to point to a working gateway endpoint. Affected packages: @blaxel/core, @blaxel/vercel, @blaxel/langgraph, @blaxel/llamaindex
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Important
Manual Steps Required Before Merging
BL_MODEL_GATEWAY_URLrepository secret/variable to a working model gateway URL (e.g., the redeployed gateway endpoint)mdl-model-gateway-esb1qo.bl.runso the API-provided URL works againSummary
BL_MODEL_GATEWAY_URLenvironment variable support to override the mk3 model gateway URL across all SDK packages (@blaxel/core,@blaxel/vercel,@blaxel/langgraph,@blaxel/llamaindex)mdl-model-gateway-esb1qo.bl.run) is unavailable — currently returning HTTP 404 "Service not found" for 14+ daysContext
The model gateway service has been undeployed/unreachable since May 28, causing all 11 model integration tests to fail. The gateway URL is dynamically fetched from the Blaxel API (
modelData.metadata.url), so it cannot be fixed by changing the model name or endpoint in code alone.This PR adds a
settings.modelGatewayUrlgetter backed byBL_MODEL_GATEWAY_URLthat takes precedence over the API-provided URL when set, giving operators a way to redirect model traffic to a working endpoint without waiting for platform changes.Related insight: https://app.mendral.com/insights/01KSR30RWQH96JY0NDFHMR961F
Note
Created by Mendral. Tag @mendral-app with feedback or questions.