Skip to content

Artifact-evaluation fixes: is_moe, judge comments, LICENSE, GPU params, manifest, checksums, appendix PDFs - #12

Merged
lindsey98 merged 4 commits into
mainfrom
claude/great-hawking-6bl5mj
Aug 6, 2026
Merged

Artifact-evaluation fixes: is_moe, judge comments, LICENSE, GPU params, manifest, checksums, appendix PDFs#12
lindsey98 merged 4 commits into
mainfrom
claude/great-hawking-6bl5mj

Conversation

@lindsey98

Copy link
Copy Markdown
Owner

Carries the CCS AEC review fixes and packaging that landed after PR #10 was merged (PR #10 merged the earlier cb73b5a snapshot).

Review C

  • Correct the training-time judge comments/docs: the curation filter (data_generation/data_curation_drip.py) and PISmith reward auditor (testing/pismith/utils.py, train_sep.py) check data inclusion / witness presence, not whether the injected task was executed. Fixed the misleading "executed" wording in code + data_generation/pismith READMEs. (SEP-eval judge left as-is — it correctly checks execution.)

Review D

  • Remove the undefined is_moe flag that broke DRIP training (train_unified.py); keep the dense LoRA path, drop the unused MoE branch.
  • Add the MIT LICENSE claimed in the appendix.
  • Parameterize hard-coded GPU counts in launchers via $NPROC_PER_NODE / $CUDA_VISIBLE_DEVICES (defaults preserved).
  • datasets/MANIFEST.md: every dataset each training/baseline/eval script consumes, its source (Zenodo), and how to regenerate.
  • CHECKPOINTS.md: pinned revisions + SHA-256 checksums for the four released LoRA adapters, with a verify script.

Review B

  • Document fewer/smaller-GPU training (batch↔grad-accum, single-GPU, 24 GB QLoRA) in the README.

Author-requested

  • Add Artifact_Appendix.pdf and DRIP_Supplementary.pdf with README references.

🤖 Generated with Claude Code


Generated by Claude Code

claude added 4 commits August 6, 2026 02:46
… checksums, fewer-GPU docs

- Launchers: make GPU count overridable via $NPROC_PER_NODE and $CUDA_VISIBLE_DEVICES
  instead of hard-coded --nproc_per_node / export lines; defaults preserved (Review D).
- datasets/MANIFEST.md: manifest of every dataset each training/baseline/eval script
  consumes, with source (Zenodo) and how to regenerate (Review D).
- CHECKPOINTS.md: pinned-revision + SHA-256 checksum manifest and verify script for
  the released LoRA adapters (Review D).
- README: document NPROC_PER_NODE/CUDA_VISIBLE_DEVICES overrides and fewer/smaller-GPU
  training (batch/grad-accum, single-GPU, 24GB QLoRA) (Review B); link manifest+checksums.
@lindsey98
lindsey98 merged commit b96f5e1 into main Aug 6, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants