-
Notifications
You must be signed in to change notification settings - Fork 818
feat(agent): add OpenAI service-tier configuration #2719
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -17,6 +17,17 @@ export const BUZZ_AGENT_MAX_CONTEXT_TOKENS = "BUZZ_AGENT_MAX_CONTEXT_TOKENS"; | |
| /** Env var key for the maximum number of LLM/tool rounds per turn. */ | ||
| export const BUZZ_AGENT_MAX_ROUNDS = "BUZZ_AGENT_MAX_ROUNDS"; | ||
|
|
||
| /** Env var key for the OpenAI request processing tier. */ | ||
| export const BUZZ_AGENT_SERVICE_TIER = "BUZZ_AGENT_SERVICE_TIER"; | ||
|
|
||
| /** OpenAI service tiers accepted by buzz-agent. */ | ||
| export const BUZZ_AGENT_SERVICE_TIER_VALUES = [ | ||
| "auto", | ||
| "default", | ||
| "flex", | ||
| "priority", | ||
|
Comment on lines
+23
to
+28
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
This adds the service-tier capability as a frontend-only env key/value table, with rendering gated separately in the component, but the runtime catalog/core never exposes whether the selected harness supports Useful? React with 👍 / 👎.
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Defaults/onboarding catalog integration would be a broader configuration-model change, so we are leaving that for a separate follow-up rather than expanding this PR. |
||
| ] as const; | ||
|
|
||
| /** | ||
| * Ordered set of valid thinking-effort values accepted by buzz-agent. | ||
| * Mirrors `parse_thinking_effort` in `crates/buzz-agent/src/config.rs`. | ||
|
|
||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
OpenAI's API reference lists
scaleas a validservice_tierrequest value alongsideauto,default,flex, andpriority(see https://developers.openai.com/api/reference/resources/chat). With this allowlist, an operator on Scale Tier who setsBUZZ_AGENT_SERVICE_TIER=scalegets a startup config error before any request is made, and the matching desktop selector cannot offer the valid tier either.Useful? React with 👍 / 👎.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The request values are auto, default, flex, and priority. Scale Tier is organization/project capacity, not a per-request selector.
OpenAI uses Scale capacity automatically when the project is Scale-enabled and the request uses auto or omits service_tier. We are therefore leaving scale out of the parser and UI.