Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 7 additions & 7 deletions packages/local-host-rs/src/model_catalog_data.json
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
{
"generated_at": 1789284488,
"generated_at": 1789371690,
"source": "https://models.dev/api.json+https://openrouter.ai/api/v1/models",
"models": [
{
Expand Down Expand Up @@ -1514,7 +1514,7 @@
"reasoning": true,
"streaming": true,
"context_tokens": 1310720,
"output_tokens": 235929
"output_tokens": 943718
},
"verification": {
"state": "catalog",
Expand Down Expand Up @@ -2540,7 +2540,7 @@
"reasoning": true,
"streaming": true,
"context_tokens": 1048576,
"output_tokens": 393216
"output_tokens": 384000
},
"verification": {
"state": "catalog",
Expand Down Expand Up @@ -4687,7 +4687,7 @@
"reasoning": true,
"streaming": true,
"context_tokens": 262144,
"output_tokens": 32768
"output_tokens": 182520

Check failure on line 4690 in packages/local-host-rs/src/model_catalog_data.json

View workflow job for this annotation

GitHub Actions / unresolved-review-threads / unresolved-review-threads

unresolved P1 review thread

packages/local-host-rs/src/model_catalog_data.json:4690 https://github.com/evalops/maestro/pull/1127#discussion_r4003345196

Check failure on line 4690 in packages/local-host-rs/src/model_catalog_data.json

View workflow job for this annotation

GitHub Actions / unresolved-review-threads / unresolved-review-threads

unresolved P1 review thread

packages/local-host-rs/src/model_catalog_data.json:4690 https://github.com/evalops/maestro/pull/1127#discussion_r4003345196

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Clamp enlarged output ceilings to the remaining context

When openrouter/nvidia/nemotron-3-ultra-550b-a55b uses the catalog default, this value becomes RequestConfig.max_tokens, but build_config_with_usage only applies clamp_output_to_remaining_context to local models and hosted auto-compaction waits until 85% of the 262,144-token window. The new 182,520 ceiling therefore leaves only 79,624 tokens for the prompt, so longer requests that are still far below the advertised context limit are rejected by OpenRouter for context overflow (or require input truncation); the previous 32,768 value did not create this failure range. The same issue affects the new approximately 943K ceilings for ~z-ai/glm-latest and z-ai/glm-5.3, so catalog-derived hosted budgets should be clamped against the actual request input or kept within the compaction headroom.

Useful? React with 👍 / 👎.

},
"verification": {
"state": "catalog",
Expand Down Expand Up @@ -6356,7 +6356,7 @@
"reasoning": true,
"streaming": true,
"context_tokens": 131072,
"output_tokens": 8192
"output_tokens": 16384
},
"verification": {
"state": "catalog",
Expand Down Expand Up @@ -8142,7 +8142,7 @@
"reasoning": true,
"streaming": true,
"context_tokens": 1048576,
"output_tokens": 182476
"output_tokens": 131072
},
"verification": {
"state": "catalog",
Expand All @@ -8161,7 +8161,7 @@
"reasoning": true,
"streaming": true,
"context_tokens": 1310720,
"output_tokens": 131072
"output_tokens": 943717
},
"verification": {
"state": "catalog",
Expand Down
Loading