Skip to content
 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

160 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Open Science Skills — vintage typewriter, globe, and books labeled Open Access, Collaboration, Transparency, Reproducibility, beneath a framed title sign.

Open Science Skills

Claude Code OpenAI Codex version license Claude skills Codex skills updated sources PRs welcome

Open Science Skills is a library of 39 agentic skills for Claude Code, with a parallel 37-skill library for OpenAI Codex, written for computational social scientists and digital humanists. Each skill is meant to work the way the field expects. Identify the data-generating process before proposing an estimator, and design experiments and instruments to a standard. Drafts are held to established reporting norms.

The library follows the research lifecycle. It covers survey design, list experiments, topic modeling, LLM text classification, VLM-based OCR pipelines, manuscript QA, multi-model orchestration, and transparent reporting under APSA, JARS, DA-RT, TOP, and FAIR expectations. Every skill is grounded in published methods sources and based on best practices for writing skills. See SOURCES.md for the bibliography of 150+ works consulted.

This is the toolkit I use in my own research, and it grows as I add sources and skills. The authoring is mine, with editing help from Opus 5, Fable 5, and ChatGPT 5.5/6.

Platform Skills Invoke
Claude Code 39, as the oss plugin /oss:skill-name
OpenAI Codex 37, as the codex/ library $skill-name

The two libraries differ only in invocation and tooling. The Codex side omits presubmit, fable-orchestrate, and opus-orchestrate, and adds 46-orchestrate. See codex/README.md.

Quick start · Skills · How skills trigger · Installation · Sources · Contributing · License


Quick start

Install the plugin from the marketplace, user-wide across all projects, or add --scope project for one project only:

# Step 1: Register the marketplace (one-time)
claude plugin marketplace add scdenney/open-science-skills

# Step 2: Install the plugin
claude plugin install oss@open-science-skills

# Project-only install
claude plugin install oss@open-science-skills --scope project

Then invoke a skill explicitly, for example /oss:conjoint-design, or just describe your task in plain language and let the matching skill load on its own.

On Codex there is no plugin. Install the skills library instead (see Codex).


Skills

Skills are grouped by where they fall in a project. Unless the Platform column says otherwise, a skill runs on both Claude Code (/oss:name) and Codex ($name). One row, 46-orchestrate, belongs to the Codex library only and is not part of the 39-skill plugin.

Project Setup

Skill Platform Command What it does
research-repo Both /oss:research-repo Scaffold a new research project around its source library, or audit an existing one. The sources folder is the spine. From there it builds the references file and the intake tooling, plus the analysis and manuscript folders and a place for reviews.

Workflow & Orchestration

Skill Platform Command What it does
fable-orchestrate Claude Code /oss:fable-orchestrate Run a multi-model workflow with Fable 5 as lead. As the strongest model on the team it keeps the hard reasoning itself. Mechanical work goes to a Sonnet subagent and wide or parallel reasoning to Opus subagents. Calls with a high blast radius that it cannot cheaply verify go to a GPT-5.6 Codex peer for a decorrelated cross-check.
opus-orchestrate Claude Code /oss:opus-orchestrate The same workflow with Opus 5 as lead, at medium reasoning effort by default (raise to high for a reasoning-heavy session). Workflow fan-out comes with the skill's own opt-in, so ultracode is not required. Opus reasons on hard problems itself and delegates only to fan out. The Codex peer is gpt-5.6-sol.
advisor Both /oss:advisor / $advisor Consult an independent second reviewer before committing to an interpretation or calling a task done. Your session is the main seat, on Opus 5 or on Sonnet 5 for cheaper sustained work. The advisor seat is Fable 5, pinned to max reasoning effort. The Codex counterpart always runs Sol/xhigh.
46-orchestrate Codex $46-orchestrate Sol at high effort owns orchestration and sign-off. It routes bounded work to Terra workers and reserves Luna for tightly specified mechanical work.

Ideation

Skill Platform Command What it does
diverge Both /oss:diverge Before implementing, generate three to five distinct approaches labeled by how they differ, then pause for you to choose, instead of defaulting to the first obvious solution.
diverge-codex Both /oss:diverge-codex The same brainstorm-then-select, but Codex (GPT-5.6 Sol at xhigh, from Claude Code) generates the alternatives, so a second model family widens the range.

Research Design

Skill Platform Command What it does
conjoint-design Both /oss:conjoint-design Design conjoint experiments, including the attribute architecture and the statistical power that architecture implies. Covers AMCE and AMIE estimation.
conjoint-diagnostics Both /oss:conjoint-diagnostics Check a conjoint design and its analysis for integrity, measurement error, external validity, and sound interpretation.
conjoint-cleaning Both /oss:conjoint-cleaning Reshape a Qualtrics conjoint export into analysis-ready long format, with choice mapping, translation, pilot detection, and validation.
survey-design Both /oss:survey-design Write survey instruments. Covers question wording, scales, flow, pretesting, respondent burden, and social-desirability mitigation.
cross-national-design Both /oss:cross-national-design Design survey experiments that run across countries, with per-country power and measurement equivalence checks. Includes instrument localization.
list-experiment Both /oss:list-experiment Design and diagnose list experiments (the item count technique), from sensitivity assessment through estimation and placebo checks.

Analysis

Skill Platform Command What it does
topic-modeling Both /oss:topic-modeling Fit structural topic models, choosing the topic count by coherence and exclusivity rather than by eye. Covers covariate specification and what to report.
text-classification Both /oss:text-classification Classify text with LLMs. Covers codebook design, human-in-the-loop workflows, validation, and agreement statistics.
model-council-voting Both /oss:model-council-voting Use a panel of models as independent coders under a consensus rule stated in advance, then read their disagreement with chance-corrected agreement statistics (the kappa and alpha families). Includes checks for correlated errors across jurors.
model-committee Both /oss:model-committee Have GPT-5.6 Sol and Claude Opus 5 deliberate toward one decision. They propose independently, critique each other, revise, and converge under a rule fixed before they start. Opus 5 chairs the tally.
model-committee-sol Both /oss:model-committee-sol The same committee, but the GPT debater is Terra (not Sol) and the chair is GPT-5.6 Sol rather than a member, so a model outside the vote runs the tally and synthesis.
model-committee-fable Both /oss:model-committee-fable The same committee, but Fable 5 chairs it. A lighter and faster chair, and not one of the two models doing the voting.
llm-calibration-logprobs Both /oss:llm-calibration-logprobs Turn token log-probabilities into per-decision confidence, then measure calibration against human labels (ECE and Brier scores, plus reliability diagrams).

Corpus Processing

Skill Platform Command What it does
vlm-ocr-pipeline Both /oss:vlm-ocr-pipeline Build an OCR pipeline on vision-language models. Covers model choice, image handling, prompts, batching, evaluation, and reproducibility.
post-ocr-cleanup Both /oss:post-ocr-cleanup Clean OCR output with LLM and rule-based correction, quality diagnostics, multilingual handling, and provenance tracking.
vlm-ocr-evaluation Both /oss:vlm-ocr-evaluation Compare OCR systems before a bulk run, using stratified ground truth and CER/WER reported per language and per stratum.

Writing & Reporting

Skill Platform Command What it does
hypothesis-building Both /oss:hypothesis-building Turn a research question into falsifiable causal hypotheses using DAGs, counterfactuals, equivalence testing, and a stated smallest effect size of interest.
literature-review Both /oss:literature-review Build or audit a literature review. Produces an evidence map, an assessment of the closest prior work, gap verdicts, and a synthesis plan.
narrative-building Both /oss:narrative-building Draft or audit a paper's introduction so it gets from the "why" to the "if-then," and keep multi-experiment papers coherent.
pre-registration-writing Both /oss:pre-registration-writing Write a pre-analysis plan. Covers structure, registry choice, analysis strategy, and how to document any deviations.
methods-reporting Both /oss:methods-reporting Check a methods section against a 40-item reporting checklist drawn from CONSORT and JARS, plus the DA-RT transparency standards.
paper-tex Both /oss:paper-tex Typeset a draft as house-style LaTeX from Markdown, Word, or other formats. Builds the PDF and prepares it for a specific journal.

Figures & Tables

Skill Platform Command What it does
figures Both /oss:figures Design publication-quality figures. Covers chart choice, scales, color, legend order, self-contained captions, and reproducible code.
tables Both /oss:tables Design publication-quality tables. Covers column order, row grouping, precision and uncertainty, self-contained notes, and reproducible code.

Manuscript QA

Skill Platform Command What it does
fair-check Both /oss:fair-check Audit a finished manuscript against FAIR principles. Checks that data, code, materials, and prompts are available under stated licenses and persistent identifiers, with reuse conditions spelled out.
citation-check Both /oss:citation-check Check citations for in-text and reference parity, then for working DOIs and fabrication risk (via Crossref and OpenAlex). Also checks citation style.
fact-check Both /oss:fact-check Verify that each in-text claim is actually supported by its cited source, reading the source's Markdown in the project's knowledge base. Runs citation-check first.
figure-table-audit Both /oss:figure-table-audit Audit the finished figure and table set for cross-references, text consistency, accessibility, and links to supplementary and replication materials.
replication-package Both /oss:replication-package Scaffold or audit a replication package. Generates the folder structure, README, master script, figure/table crosswalk, codebook, license, and pre-release checklist.

Review & Submission

Skill Platform Command What it does
paper-review-lite Both /oss:paper-review-lite Run a pre-submission self-audit of your own manuscript across argument, numbers, references, writing, figures, and replication.
paper-review-lite-codex Both /oss:paper-review-lite-codex The same audit run across two model families. Claude and Codex (GPT-5.6 Sol at xhigh) review independently, then cross-check each other, and every surviving issue is tagged by confidence.
presubmit Claude Code /oss:presubmit Set up and run the standalone presubmit CLI, a heavier 30-plus-stage adversarial review pipeline driven by the Anthropic API.
journal-review Both /oss:journal-review Draft a senior referee report on someone else's manuscript, using parallel finder agents and a chief-reviewer synthesis to produce a structured report.

How skills trigger

Most skills load on their own. When your prompt matches a skill's description, Claude Code or Codex reads that skill into context and follows it, so you usually don't need to name anything. You can also invoke any skill explicitly, with /oss:skill-name in Claude Code or $skill-name in Codex.

The orchestration and delegated-review skills (fable-orchestrate, opus-orchestrate, 46-orchestrate, advisor, the model-committee family, diverge-codex, and paper-review-lite-codex) run only when invoked explicitly, because they start subagents or call an external model.


Installation

Claude Code

The recommended install is the plugin, shown in Quick start. It registers the marketplace and installs all 39 skills and their slash commands. The command prefix is oss:, for open science skills. The marketplace and the repository are both named open-science-skills.

To try the plugin for one session without installing:

git clone https://github.com/scdenney/open-science-skills.git
cd open-science-skills && claude --plugin-dir ./plugin
Selective install — pick specific skills (auto-trigger only, no slash commands)

Clone the repository and run the interactive installer, which lists the skills and installs your choices to ./.claude/skills/ (current project) by default:

git clone https://github.com/scdenney/open-science-skills.git
cd open-science-skills
bash plugin/scripts/install.sh

Other targets and non-interactive selection:

# Install to user-wide skills directory (all projects)
bash plugin/scripts/install.sh --target ~/.claude/skills

# Install specific skills non-interactively
bash plugin/scripts/install.sh --skill conjoint-design survey-design list-experiment

# Install all skills
bash plugin/scripts/install.sh --all --target ~/.claude/skills

Restart Claude Code after installing.

Manual copy — a single skill by hand (auto-trigger only)

Copy the whole skill folder, since many skills ship reference, asset, or script files their SKILL.md points at (replace your-project with your project's path):

git clone https://github.com/scdenney/open-science-skills.git

# Project-level (current project only) — copy the whole skill folder:
# many skills ship reference/, assets/, or scripts/ files their SKILL.md points at
mkdir -p your-project/.claude/skills
cp -R open-science-skills/plugin/skills/conjoint-design \
   your-project/.claude/skills/

# User-wide (all projects)
mkdir -p ~/.claude/skills
cp -R open-science-skills/plugin/skills/list-experiment ~/.claude/skills/

Manual copy gives auto-trigger only. Slash commands require the plugin.

Codex

Codex discovers skills under .agents/skills (repository) and ~/.agents/skills (user-wide). From the repository root, install all 37 skills user-wide:

mkdir -p "$HOME/.agents/skills"
for skill in "$PWD"/codex/*/; do
  ln -sfn "${skill%/}" "$HOME/.agents/skills/$(basename "$skill")"
done

For selective and repository-scoped install, plus the Codex catalog, see codex/README.md.


Knowledge base and sources

The skills are built from a curated corpus of methods texts rather than the model's built-in knowledge. SOURCES.md is the full bibliography (150+ works). The knowledge_base/ folder holds Markdown conversions of those sources that the skills read directly when a task needs chapter-and-verse support, as fact-check does when it verifies a claim against its citation.


Contributing

Pull requests are welcome. To add a skill:

  1. Write plugin/skills/<name>/SKILL.md, following the skill authoring best practices.
  2. Add plugin/commands/<name>.md (a one-paragraph activation prompt plus $ARGUMENTS, following the existing examples).
  3. Mirror the skill to plugin/.skills/<name>.md, byte-identical.
  4. Add the Codex package at codex/<name>/ (SKILL.md and agents/openai.yaml), unless the skill is intentionally platform-specific.
  5. Add sources to SOURCES.md.
  6. Update the catalogs and badges, then run bash plugin/scripts/check.sh.

License

This project is licensed under Creative Commons Attribution-NonCommercial 4.0 International. The skills are intended for noncommercial scholarly and educational use.

The citation-check, literature-review, figures, tables, and figure-table-audit skills remix workflow ideas from Cheng-I Wu's Academic Research Skills for Claude Code, also licensed CC BY-NC 4.0. The instructions here are rewritten for this repository's open-science and experimental-social-science scope.

The replication-package skill adapts the structural conventions in Yusaku Horiuchi's replication-package-guide (the source for single-entry-point, compact vs. build/analyze layouts, figure/table crosswalk, paper-consistency check, correction workflow, and pre-release checklist). FAIR-principle integration and Claude Code/Codex skill packaging are added on top. Harvard Dataverse and other platform-specific upload mechanics are not included. Cite Horiuchi's guide if you publish a package built with this skill.

About

Agentic skills for Claude Code and Codex, built from published social-science methods sources. Covers experimental design, computational text analysis, manuscript QA, and transparent reporting.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages