Skip to content

academy/evren: curriculum v0.2 — adaptive selection, retention, diagn… - #21

Merged
Pentexa merged 1 commit into
mainfrom
academy/evren-curriculum-v02
Nov 7, 2026
Merged

Pentexa merged 1 commit into
mainfrom
academy/evren-curriculum-v02

Conversation

@Pentexa

@Pentexa Pentexa commented Nov 7, 2026

Copy link
Copy Markdown
Owner

…osis

  • selection.py: LearningProgressSelector (pooled family signatures, |Δ success| learning progress, per-atom-class weakness targeting, novelty recovery; deterministic, checkpointable)
  • diversity.py: Jaccard/entropy/coverage/novelty metrics
  • retention.py: frozen-substrate repeated-probe protocol (per-config)
  • diagnosis.py: root-causes the v0.1 null result (eval artifact: one-config-per-seed draws; plus trained-state memory saturation)
  • curriculum_experiment.py: matched-budget 5-condition comparison (uniform/ascending/calibrated/proc_lp/teacher_lp), per-config eval grids, paired bootstrap CIs, zero API calls, state persistence
  • CLI: evren-curriculum, evren-diagnose (warn on hash randomization)
  • configs/academy_v01.toml: [evren.curriculum] section
  • tests: +5 suites (selection/diversity/retention/diagnosis/experiment)
  • docs/EVREN_CURRICULUM_V02.md: protocol + measured results
  • pinned run (PYTHONHASHSEED=0): LP and teacher-source effects exactly +0.0000 on classic transfer; ascending only non-uniform (+0.042); retention flat. Honest negative result: student memory saturation is the binding constraint, not curriculum source.

…osis

- selection.py: LearningProgressSelector (pooled family signatures,
  |Δ success| learning progress, per-atom-class weakness targeting,
  novelty recovery; deterministic, checkpointable)
- diversity.py: Jaccard/entropy/coverage/novelty metrics
- retention.py: frozen-substrate repeated-probe protocol (per-config)
- diagnosis.py: root-causes the v0.1 null result (eval artifact:
  one-config-per-seed draws; plus trained-state memory saturation)
- curriculum_experiment.py: matched-budget 5-condition comparison
  (uniform/ascending/calibrated/proc_lp/teacher_lp), per-config eval
  grids, paired bootstrap CIs, zero API calls, state persistence
- CLI: evren-curriculum, evren-diagnose (warn on hash randomization)
- configs/academy_v01.toml: [evren.curriculum] section
- tests: +5 suites (selection/diversity/retention/diagnosis/experiment)
- docs/EVREN_CURRICULUM_V02.md: protocol + measured results
- pinned run (PYTHONHASHSEED=0): LP and teacher-source effects exactly
  +0.0000 on classic transfer; ascending only non-uniform (+0.042);
  retention flat. Honest negative result: student memory saturation is
  the binding constraint, not curriculum source.
Copilot AI balanced review requested due to automatic review settings November 7, 2026 19:27

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has insufficient remaining quota. Try requesting a review at a lower effort level.

@Pentexa
Pentexa merged commit 41947f3 into main Nov 7, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants