Skip to content

Actions: ikermoel/open-alternative-jev

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
14 workflow runs
14 workflow runs

Filter by Workflow

⌥ + click/return to exclude

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
tests (latest deps) tests (latest deps) #2: Scheduled
1m 19s main
main
1m 19s
tests (latest deps) tests (latest deps) #1: Scheduled
1m 38s main
main
1m 38s
Option order: position bias measured (4B loses 4 pts reversed, 27B 1.… tests #12: Commit 3689c67 pushed by ikermoel
1m 32s main
main
1m 32s
permutations option: average the answer over option orderings (defaul… tests #11: Commit 110582a pushed by ikermoel
1m 23s main
main
1m 23s
permutations: average over option orderings to cancel position bias tests #10: Pull request #5 opened by ikermoel
1m 34s permutations
permutations
1m 34s
RACE-H by model size: interference falls monotonically with size (37 … tests #9: Commit 4a85df1 pushed by ikermoel
1m 16s main
main
1m 16s
typed-decisions: Qwen3-0.6B FP8 vs BF16 through vLLM (no difference a… tests #8: Commit 274fe48 pushed by ikermoel
1m 17s main
main
1m 17s
README: label every row that is ours as Open Alternative to Jev (pack… tests #7: Commit 150b1a5 pushed by ikermoel
1m 34s main
main
1m 34s
Jev row provenance: measured by the typed-decisions authors via TypeS… tests #6: Commit 192daa7 pushed by ikermoel
1m 17s main
main
1m 17s
README: headline, beats Jev's published typed-decisions score zero-shot tests #5: Commit 492200b pushed by ikermoel
1m 24s main
main
1m 24s
Figures: accuracy vs latency scatter for typed-decisions (RACE-H scat… tests #4: Commit 7825859 pushed by ikermoel
1m 28s main
main
1m 28s
README: typed-decisions table marks zero-shot vs fine-tuned and measu… tests #3: Commit 99e87b0 pushed by ikermoel
1m 20s main
main
1m 20s
typed-decisions: Qwen3.6-27B zero-shot matches published Jev (73.7 vs… tests #2: Commit 2dcfd26 pushed by ikermoel
1m 30s main
main
1m 30s
Add CI: pinned suite on 3.10/3.13, plus a weekly unpinned run (#2) (#3) tests #1: Commit 08d21d7 pushed by ikermoel
1m 27s main
main
1m 27s