Skip to content

Actions: sileod/reasoning-core

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
265 workflow runs
265 workflow runs

Filter by Workflow

⌥ + click/return to exclude

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
gitignore: ignore whole task_diagnostics/ (private rc-eval) Deploy Jekyll site to Pages #60: Commit 3b00e27 pushed by sileod
34s main
main
34s
chore: move task_diagnostics (eval/influence pipeline) to private rc-… Deploy Jekyll site to Pages #59: Commit eb6542b pushed by sileod
46s main
main
46s
mmlu: add TRUE balanced math macro leg (mmlu_math_macro[_cloze]) Deploy Jekyll site to Pages #58: Commit 4c16b3b pushed by sileod
50s main
main
50s
influence: log token-F1 alongside EM for free-gen legs (gsm8k/drop) Deploy Jekyll site to Pages #57: Commit da45567 pushed by sileod
39s main
main
39s
chore: untrack paper_exports — unpublished paper results, keep OFF pu… Deploy Jekyll site to Pages #56: Commit 5935940 pushed by sileod
44s main
main
44s
influence: LOG-LARGE default panel on every collection run Deploy Jekyll site to Pages #55: Commit b461828 pushed by sileod
42s main
main
42s
influence: log per-subject MMLU (6 subjects, cloze+letter) by default… Deploy Jekyll site to Pages #54: Commit 796e073 pushed by sileod
36s main
main
36s
influence: --per-task mode for collection driver (task-level feature … Deploy Jekyll site to Pages #53: Commit 801ac61 pushed by sileod
6m 22s main
main
6m 22s
eval: GSM8K + DROP default legs (answer-NLL + numeric-aware free-gen … Deploy Jekyll site to Pages #52: Commit 999b2e1 pushed by sileod
40s main
main
40s
influence: TOKEN_RATIO mode — match aux (prompt+answer) token dose ac… Deploy Jekyll site to Pages #51: Commit cbdbebc pushed by sileod
44s main
main
44s
eval: per-subject MMLU legs (cloze+normal, gated) + opt-in weights-on… Deploy Jekyll site to Pages #50: Commit 87060b8 pushed by sileod
41s main
main
41s
eval: add bbh_test_open — options-omitted cloze for the held-out BBH-… Deploy Jekyll site to Pages #49: Commit 762baa0 pushed by sileod
50s main
main
50s
eval: add bbh_open leg — options-OMITTED BBH cloze (format-confound-f… Deploy Jekyll site to Pages #48: Commit 0deb59d pushed by sileod
42s main
main
42s
eval: log BBH content-NLL (bbh_cloze_nll / bbh_test_cloze_nll) alongs… Deploy Jekyll site to Pages #47: Commit 23247b8 pushed by sileod
36s main
main
36s
eval: emit cloze BBH-MC under new key bbh_mc_cloze_acc / bbh_test_mc_… Deploy Jekyll site to Pages #46: Commit 4f4a503 pushed by sileod
36s main
main
36s
eval: BBH MC accuracy scores option TEXT (cloze), not the letter label Deploy Jekyll site to Pages #45: Commit 48844f7 pushed by sileod
36s main
main
36s
eval: log BBH dev+test MC max-likelihood accuracy (bbh_mc_acc / bbh_t… Deploy Jekyll site to Pages #44: Commit 0c8b2d0 pushed by sileod
39s main
main
39s
eval: add FOLIO logic-entailment leg (gated EVAL_FOLIO=1) Deploy Jekyll site to Pages #43: Commit 969be9e pushed by sileod
44s main
main
44s
influence: lazy-import litlm in zero_shot_eval so score_native (rewar… Deploy Jekyll site to Pages #42: Commit fac1011 pushed by sileod
35s main
main
35s
influence: fix reward_final=None in COLLECTION mode (pool sat/reward … Deploy Jekyll site to Pages #41: Commit 2c407d8 pushed by sileod
36s main
main
36s
influence: record max_len/packing/drop_overlong in result metadata (p… Deploy Jekyll site to Pages #40: Commit 95342e2 pushed by sileod
39s main
main
39s
influence: make MAX_LEN env-configurable (paper protocol uses 1024) Deploy Jekyll site to Pages #39: Commit 15bfccf pushed by sileod
48s main
main
48s
Add production-compatible influence evaluator Deploy Jekyll site to Pages #38: Commit 5e41cfa pushed by sileod
36s main
main
36s
per_task_influence: filter SFTConfig kwargs to installed trl (version… Deploy Jekyll site to Pages #37: Commit c011d37 pushed by sileod
39s main
main
39s
per_task_influence: rename BBH_SEALED -> BBH_TEST (standard dev/test … Deploy Jekyll site to Pages #36: Commit 6d25546 pushed by sileod
37s main
main
37s