Skip to content

feat(site): filter models by config and add devMode query param - #53

Merged
zwpaper merged 6 commits into
mainfrom
feat/dev-mode
May 18, 2026
Merged

feat(site): filter models by config and add devMode query param#53
zwpaper merged 6 commits into
mainfrom
feat/dev-mode

Conversation

@zwpaper

@zwpaper zwpaper commented May 7, 2026

Copy link
Copy Markdown
Member

Summary

  • Added models array to .zealt/config.json to configure which models are shown by default.
  • Updated Leaderboard and Tasks pages to filter out unconfigured models.
  • Added devMode=true query parameter to bypass model filtering.
  • Replaced experimentalArtifacts=true with devMode=true on the Trajectory page.

🤖 Generated with Pochi | Task

- Added `models` array to `.zealt/config.json` to configure which models are shown by default.
- Updated Leaderboard and Tasks pages to filter out unconfigured models.
- Added `devMode=true` query parameter to bypass model filtering.
- Replaced `experimentalArtifacts=true` with `devMode=true` on the Trajectory page.

🤖 Generated with [Pochi](https://getpochi.com) | [Task](https://app.getpochi.com/share/p-1ae444cc9bb2423db44d4d5c713bf052)

Co-Authored-By: Pochi <noreply@getpochi.com>
@github-actions

github-actions Bot commented May 7, 2026

Copy link
Copy Markdown
PR Preview Action v1.8.1
Preview removed because the pull request was closed.
2026-05-18 06:36 UTC

zwpaper and others added 2 commits May 7, 2026 13:52
If the `models` list is empty in `.zealt/config.json`, it now shows all models instead of filtering everything out.

🤖 Generated with [Pochi](https://getpochi.com) | [Task](https://app.getpochi.com/share/p-1ae444cc9bb2423db44d4d5c713bf052)

Co-Authored-By: Pochi <noreply@getpochi.com>
@zwpaper
zwpaper requested review from liangfung and wsxiaoys May 7, 2026 08:23
Comment thread site/app/(home)/components/leaderboard-table.tsx Outdated
Comment thread .zealt/config.json Outdated
"description": "Performance results of AI coding models on Jujutsu tasks, measuring success rate and execution time with high precision.",
"github_repo": "https://github.com/TabbyML/jj-benchmark"
"github_repo": "https://github.com/TabbyML/jj-benchmark",
"models": []

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

as discussed previously, use a blacklist, not whitelist

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

renamed to hidden_models, and will show all models if empty, will hide the model if it's specified in list

@zwpaper
zwpaper requested a review from wsxiaoys May 8, 2026 09:44
Changes the config property from `models` to `pending_models` and updates the filtering logic in the leaderboard and tasks page to exclude models present in the `pending_models` list.

🤖 Generated with [Pochi](https://getpochi.com) | [Task](https://app.getpochi.com/share/p-dbe3cc1bf5b44bc89258cc48d27006f6)

Co-Authored-By: Pochi <noreply@getpochi.com>
@zwpaper
zwpaper merged commit 56e0c33 into main May 18, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants