A reusable skill package for Claude Code, Codex, and similar coding/research agents focused on JEPA research workflows.
jepa-research/SKILL.md: JEPA research skill definition (triggering + workflow, 4 modes).metadata/: structured indexes (papers, code, evidence) with 71% long-tail coverage.scripts/: corpus organization, metadata build, evidence validation, and annotation scripts.eval/: 40-prompt benchmark suite with scoring rubric and 5-version comparison history.docs/: roadmap, execution tracker, evidence schema, paper-code linking policy, release workflow.CLAUDE.md: project rules for Claude Code agents working in this repo.
- Full paper PDFs and full third-party codebases should usually stay local.
- For open-source publishing, share metadata + scripts; fetch source artifacts on demand.
.
+-- jepa-research/
| +-- SKILL.md
| +-- references/
| `-- scripts/
+-- metadata/
+-- scripts/
`-- corpus/ # local cache; large files ignored by default
- Put your local paper/code assets under
corpus/(optional for public repo users). - Build a shareable paper catalog:
python scripts/build_paper_catalog.py --input metadata/papers_index.csv --output metadata/paper_catalog.csv- Use the skill:
- Ask the agent about JEPA paper comparison, reproduction, debugging, intro drafting, and citations.
- The skill expects evidence-style answers tied to metadata records.
- The Python scripts in this repo use the standard library only. There is currently no
requirements.txtorpyproject.toml. - Validate on Python
3.11+. This repo was checked successfully with Python3.13.5. - Run commands from the repo root so relative paths resolve correctly.
- The current corpus layout expected by metadata and evidence files is:
corpus/papers/all/corpus/code/archives/
- The optional import script
scripts/organize_jepa_corpus.ps1can ingest raw assets from:JEPA-Papers/JEPA-Papers/awesome-jepa/JEPA-CodeBase/
- After moving the repo to another machine, the recommended sanity check is:
python scripts/build_paper_catalog.py --input metadata/papers_index.csv --output metadata/paper_catalog.csv
python scripts/validate_evidence_index.py --input metadata/evidence_index.csv --check-paths --json eval/results/evidence_index_validation.json
python scripts/check_metadata_completeness.py --input metadata/paper_catalog.csv --json eval/results/metadata_completeness_report.jsonAll 4 modes score 100% on the 40-prompt eval benchmark:
| Mode | Factual | Citation | Key Metric |
|---|---|---|---|
| Research Q&A | 100% | 100% | — |
| Reproduction Plan | 100% | 100% | Executability 100% |
| Debug Triage | 100% | 100% | Debug Hit 100% |
| Writing/Citation | 100% | 100% | — |
| Hallucination rate | 0.0% |
See eval/results/v1_3_0_benchmark_comparison.md for the full 5-version comparison from v1.0.0 to v1.3.0.
This repo is ready to open-source as a metadata-and-workflow package. Third-party paper PDFs and code archives are excluded from Git by .gitignore.
Release gates (all passing for v1.3.0):
- production evidence schema documented ✅
evidence_index.csvwith real data ✅- validation scripts for evidence and metadata completeness ✅
- documented eval workflow that another contributor can rerun ✅
Sanity check after cloning:
python scripts/build_paper_catalog.py --input metadata/papers_index.csv --output metadata/paper_catalog.csv
python scripts/annotate_long_tail.py --input metadata/paper_catalog.csv --output metadata/paper_catalog.csv
python scripts/validate_evidence_index.py --input metadata/evidence_index.csv --check-paths --json eval/results/evidence_index_validation.json
python scripts/check_metadata_completeness.py --input metadata/paper_catalog.csv --json eval/results/metadata_completeness_report.json- Keep
.gitignoredefaults forcorpus/papers/allandcorpus/code/archives✅ - Keep metadata CSVs and templates ✅
- MIT license included ✅
- Users are responsible for third-party paper/code licenses ✅