Skip to content

Promote model roster: set cascade to mistral-small, gemma, qwen - #44

Merged
morgaesis merged 1 commit into
mainfrom
chore/model-roster-retry
Jul 11, 2026
Merged

morgaesis merged 1 commit into
mainfrom
chore/model-roster-retry

Conversation

@morgaesis

Copy link
Copy Markdown
Contributor

Update the default model cascade to mistralai/mistral-small-3.2-24b-instruct, google/gemma-3-27b-it, and qwen/qwen3-32b in that priority order, now that fixture expansion and cost-reporting prerequisites are merged. Primary model remains deepseek-v4-pro. Tests updated to verify cascade order and token counts.

Update DEFAULT_CASCADE in config.rs to include mistralai/mistral-small-3.2-24b-instruct,
google/gemma-3-27b-it, and qwen/qwen3-32b in that priority order. Keep deepseek-v4-pro
as the primary model. Update README, STARTER_CONFIG, and e2e tests to reflect the new
cascade configuration and expected token counts.

@postil-dev postil-dev Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Expanding the default model cascade from empty to three fallback models quadruples the default number of API calls and sends user source code to additional third-party providers (Mistral, Google, Qwen) without explicit opt-in. This is a consequential behavioral and privacy-boundary change that needs human confirmation before merge.

  • warn warn src/config.rs:126 — Default cascade sends code to three additional third parties without opt-in · confidence 0.90 · kind: humanEscalation

Model: moonshotai/kimi-k2.6

Comment thread src/config.rs
gate_on_error: OnError::Block,
model: DEFAULT_MODEL.to_string(),
cascade: Vec::new(),
cascade: DEFAULT_CASCADE.iter().map(|m| (*m).to_string()).collect(),

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warn Default cascade sends code to three additional third parties without opt-in
warn · confidence 0.90 · kind: humanEscalation

Changing the default cascade from empty to [mistralai/mistral-small-3.2-24b-instruct, google/gemma-3-27b-it, qwen/qwen3-32b] means existing users who have not explicitly configured a cascade will now send their source code to three extra external providers on every run. The updated e2e assertions show the default request count jumping from 2 to 8 and token totals increasing proportionally, confirming a significant rise in latency and cost. Confirm that expanding the default data-sharing boundary to multiple new vendors without a major-version bump or explicit opt-in is intentional and acceptable. If not, keep the default cascade empty and surface the new roster only as an opt-in example in documentation.

@morgaesis
morgaesis merged commit 9f42b69 into main Jul 11, 2026
8 checks passed
@morgaesis
morgaesis deleted the chore/model-roster-retry branch July 11, 2026 01:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant