Skip to content

Repository files navigation

Codex How To

Turn Codex from a code generator into a verifiable engineering workflow.

Codex How To: from scope through evidence

This engineering-first guide takes a task through scoping, implementation, testing, review, and evidence—with focused workflows for frontend, backend, DevOps, security, and multi-agent orchestration.

Validate License: MIT skills.sh Engineering Loop security Engineering Loop score

Start learning · Try the engineering loop · See measured results · Browse all skills · Fork a tested edition · Contribute

Status: community preview. Content was checked against official Codex documentation on 2026-07-31. Codex changes quickly; verify settings and commands through the links marked Official source.

Choose the smallest workflow that fits

Do not install every skill by default. Start with the minimum guidance that can change the outcome of your task:

Your task Start here Use it when
Learn Codex from first principles Mental model You need the progressive course, sandbox model, prompts, tools, and verification basics
Fix one bounded defect Testing and review The scope and acceptance check are already clear; a lifecycle skill may add more context than value
Deliver a multi-surface feature engineering-loop Implementation, testing, review, and evidence must stay connected through one verified loop
Split a large task safely Orchestration decision matrix Work has genuinely independent ownership surfaces and integration checks
Preserve team know-how Codex Living Wiki Repeated research and decisions should become reviewed, source-grounded repository knowledge

Unsure? Run the five-minute playground before installing anything globally.

Use it, verify it, improve it

  1. Use it: install the flagship loop or run the dependency-free playground.
  2. Verify it: inspect the raw task receipts before trusting an efficiency claim.
  3. Improve it: fork the repository, run the same evaluator on your stack, and contribute a sanitized result.

If the workflow saves you a failed iteration, star the repository to follow new measurements. A fork is most useful when it produces a reproducible task, evaluator, correction, translation, or workflow profile—not just another copy.

Try the engineering loop

Install the flagship skill with the community skills.sh installer:

npx skills add Phelan164/codex-howto --skill engineering-loop -g -a codex -y

Start a new Codex task in a small, version-controlled project:

$engineering-loop Implement this change end to end. Continue through focused
tests, required checks, diff review, and verified fixes. Report the commands
run, evidence produced, and anything that remains unverified.

Expect a baseline, a bounded implementation, focused and required checks, a final diff review, and an evidence handoff—not just generated code. Inspect the skill source before installing it, or use the dependency-free five-minute playground first.

See the engineering loop

flowchart TD
    subgraph Understand["1 · Understand"]
        direction LR
        A["Scope the task"] --> B["Reproduce or baseline"]
    end

    subgraph Build["2 · Change and verify"]
        direction LR
        C["Make a small change"] --> D["Run focused checks"] --> E["Run required checks"]
    end

    subgraph Finish["3 · Review and finish"]
        direction LR
        F["Review findings"] --> G["Record evidence and hand off"]
    end

    B --> C
    E --> F
    F -. "Issue found" .-> C
Loading

Read it top to bottom: understand the task, make and verify one small change, then review and hand off evidence. A verified review finding returns to the change step.

The repository treats generated code as an intermediate result. Completion requires observable behavior, relevant checks, diff review, and an explicit record of anything that remains unverified.

Ad hoc Codex use Repository workflow
Start from a vague request Define goal, context, constraints, and done conditions
Generate a large solution in one pass Reproduce, change minimally, and verify incrementally
Load broad context “just in case” Route to one lifecycle skill and only relevant specialists
Treat passing output as proof Record commands, results, review findings, and residual risk
Add agents because parallelism is available Delegate only independent, bounded work

What the seed measurements show

Skills are not automatically more efficient. In controlled GPT-5.6-sol runs, the best choice changed with task size:

Task Quality result Most token-efficient variant
Small backend boundary fix All three variants passed No repository skill: 390,144 reported tokens
Medium 2048 browser game All three variants passed Lean skill v0.4.0: 380,767 reported tokens

On the game task, the lean engineering-loop used 31.2% fewer reported tokens than v0.2.0 and 54.0% fewer than the no-repository-skill control. On the smaller backend fix, the control remained cheapest. This suggests that lifecycle guidance may be redundant for a bounded fix but useful when a task spans implementation, testing, review, and evidence handoff.

These are two controlled seed tasks, not universal performance claims. Read the backend result, the 2048 result, and the measurement protocol before changing a team workflow.

The interactive benchmark explorer turns the six runs into a task-size toggle, proportional token comparison, run-detail table, method summary, and visible limitations. Its source and rendered evidence are checked in CI so the shareable view remains traceable to the repository measurements. The standalone measurement article explains the setup, results, boundary hypothesis, and replication protocol without requiring a repository click. A complete Vietnamese edition preserves the same measurements and limitations for local publication.

Measure workflows instead of collecting them

Established community projects already provide strong engineering methods. mattpocock/skills emphasizes small, composable workflows for real engineering. obra/superpowers provides a more prescriptive design, planning, TDD, review, and verification lifecycle.

This repository does not vendor or rename those catalogs. It provides comparison profiles and a common measured task receipt so teams can compare no skill, the lean Codex loop, and selected third-party workflows under the same task contract.

The useful question is not “which catalog is best?” It is “which minimum workflow improves acceptance, evidence, or safety enough to justify its context, checkpoints, time, and total tokens for this task class?”

Five-minute engineering demo

Use the dependency-free engineering playground to demonstrate a complete backend defect loop safely:

demo_root="$(mktemp -d)"
cp -R labs/engineering-playground "$demo_root/playground"
mkdir -p "$demo_root/playground/.agents/skills"
cp -R skills/engineering-loop "$demo_root/playground/.agents/skills/"
cd "$demo_root/playground"
git init

Start Codex in that directory and ask:

$engineering-loop Inspect the inventory reservation contract, reproduce one
uncovered input-boundary defect, add the smallest regression test, implement
the fix, run the required checks, and review the final diff. Work only in this
disposable playground.

Watch for four proof points: a failing regression before the fix, a small implementation diff, passing focused checks, and a final evidence report. Then use the measurement protocol to compare no-skill, full-skill, and lean-skill runs without treating one demo as proof. For a larger implementation exercise, use the dependency-free 2048 benchmark and inspect the GPT-5.6-sol seed measurement. To measure a genuinely partitioned large task, compare one agent with bounded backend/frontend ownership in the incident-response orchestration benchmark. The standalone multi-agent decision article explains the ownership rule, smoke evidence, controller contract, invalid claims, and replication protocol in a shareable format. Use PRESENTING.md for a 15-minute talk track, demo checklist, and copy-ready announcement.

Make Codex know-how compound

The Codex Living Wiki turns repeated research into a reviewed, source-grounded knowledge layer:

flowchart LR
    A["Official docs and engineering evidence"] --> B["Living wiki"]
    B --> C["Query with citations"]
    B --> D["Lint drift and provenance"]
    B --> E["Promote through a reviewed PR"]
    E --> F["Module, skill, rule, or check"]
Loading

It adapts Karpathy's LLM Wiki idea for Codex engineering. External source bodies stay out of Git by default, deterministic lint checks mechanical integrity, and factual changes remain human-reviewed.

Try a read-only query:

$maintain-codex-wiki What does this repository know about orchestration
efficiency? Cite wiki pages, separate evidence from recommendation, and do not
modify files.

The wiki starts with Markdown and repository search—no database, embeddings, or MCP service until measured retrieval quality justifies them.

Why this repository exists

Official documentation is the source of truth for product behavior. This repository turns that product surface into a practical, runnable curriculum for software engineers.

You will learn how to:

  • give Codex enough context without flooding the conversation;
  • encode repository conventions in AGENTS.md;
  • turn repeated frontend, backend, DevOps, testing, review, and security work into skills;
  • connect external systems through MCP;
  • choose safe sandbox and approval settings;
  • delegate bounded work to specialized agents;
  • orchestrate parallel work without creating edit conflicts;
  • reduce wasted context, retries, and unnecessary token use;
  • compile evolving Codex know-how into a review-first living wiki;
  • automate stable workflows only after they are reliable interactively.

What is included

  • 14 progressive modules covering safety, prompting, AGENTS.md, skills, MCP, subagents, orchestration, context efficiency, automation, and living knowledge maintenance.
  • 9 installable skills covering the end-to-end engineering loop, frontend, backend, DevOps, testing, code review, security review, and orchestration, plus review-first knowledge maintenance and an explicit router kept as an educational example.
  • A living maintainer wiki with registered provenance, deterministic linting, review gates, and a measured promotion path into the curriculum.
  • Copy-ready examples for project configuration, custom agents, prompts, engineering specifications, dependency-aware tickets, handoffs, hooks, MCP, and local plugins.
  • A dependency-free playground with seeded defects for practicing the full implement–test–review loop safely.

Who this is for

  • Beginners who can open Codex but are unsure how to structure a real task.
  • Working engineers who want repeatable workflows for production repositories.
  • Tech leads who want shared agent instructions and review standards.
  • Platform teams building skills, plugins, MCP integrations, and CI automation.

Choose your route

Goal Start here
Learn safe Codex fundamentals Track A · Safe beginner
Build and review application code Track B · Application engineer
Work with delivery and infrastructure Track C · Platform and DevOps engineer
Coordinate subagents efficiently Track D · Agent orchestrator
Maintain evolving Codex know-how Track E · Knowledge maintainer
Learn by fixing a small project Engineering playground

Learning path

Stage Module Outcome Time
Foundation 00 · Mental model Choose the right Codex surface and task shape 25 min
Foundation 01 · Sandbox and approvals Set safe autonomy boundaries before the first write 45 min
Foundation 02 · CLI and surfaces Install, authenticate, navigate, and inspect safely 35 min
Foundation 03 · Prompts and plans Write scoped prompts with observable completion criteria 40 min
Foundation 04 · AGENTS.md Make repository guidance durable and local 45 min
Engineering 05 · Engineering skills Build and install reusable engineering workflows 60 min
Engineering 06 · MCP and tools Add live data and actions without bloating instructions 45 min
Engineering 07 · Testing and review Close the implementation–verification–review loop 55 min
Scale 08 · Subagents Delegate narrow, independent work 50 min
Scale 09 · Orchestration Coordinate parallel agents with clear ownership 70 min
Scale 10 · Context and token efficiency Reduce context pollution and expensive retries 50 min
Scale 11 · Automation, plugins, and hooks Package and automate stable workflows 60 min
Operations 12 · Troubleshooting Diagnose failures by layer instead of guessing 35 min
Operations 13 · Living Codex wiki Compile, verify, and promote evolving know-how 55 min

Full path: roughly 10–11 hours. Start with modules 00–03, then follow the shortest track that matches your work.

Five-minute safe start

  1. Install Codex using the official quickstart.

  2. Open a small, version-controlled repository.

  3. Ask Codex:

    Goal: explain how this repository is built and tested.
    Context: inspect the root configuration and contributor docs.
    Constraints: read only; do not install dependencies or change files.
    Done when: return the exact build, test, lint, and type-check commands,
    and cite the files that define them.
    
  4. Review the result.

  5. Generate a starter AGENTS.md with /init, then replace generic text with verified commands.

Engineering skill catalog

Start with the model, the task contract, and repository guidance. Add one focused skill only when it improves a measured engineering outcome or supplies non-generic workflow, safety, policy, or tool knowledge. Use the model-adaptive skill guide and three-way ablation protocol before standardizing a skill for a team.

This repository includes nine installable starter skills:

Skill Purpose
engineering-loop Drive a change through baseline, implementation, testing, review, and evidence
build-frontend Implement accessible UI changes with visual and behavioral verification
build-backend Change APIs, services, persistence, and contracts safely
operate-devops Modify delivery and infrastructure with rollback-aware validation
review-code Find consequential defects, regressions, and missing tests
test-software Design risk-based tests and implement the highest-value coverage
review-security Trace trust boundaries and report exploitable security risks
orchestrate-engineering Coordinate bounded agents while protecting context and avoiding edit conflicts
maintain-codex-wiki Query, capture, ingest, archive, lint, and promote review-first Codex knowledge

The quick start installs engineering-loop. Install the Living Wiki maintainer through the same open agent skills ecosystem:

npx skills add Phelan164/codex-howto --skill maintain-codex-wiki -g -a codex -y

The flagship skills also have independently scanned SkillStore pages: Engineering Loop and Maintain Codex Wiki.

List all nine skills without installing:

npx skills add Phelan164/codex-howto --list

Alternatively, inspect and copy a skill into .agents/skills/ for one project or ~/.agents/skills/ for personal reuse:

mkdir -p .agents/skills
cp -R /path/to/codex-howto/skills/review-code .agents/skills/

Inspect every skill before installing it, then start a new Codex task and invoke it explicitly:

$review-code Review this branch against main. Lead with consequential findings
and list checks you could not run.

The explicit-only choose-engineering-flow router remains an educational example, not a recommended runtime dependency. Clear skill descriptions should normally let Codex select the relevant workflow without spending another turn on routing. The orchestrator remains explicit-only because accidental activation adds coordination overhead. maintain-codex-wiki is also explicit-only because capture, ingest, archive, and promotion can change shared factual guidance.

For a complete local develop–test–review cycle, install engineering-loop and start with:

$engineering-loop Implement this change end to end. Continue through focused
tests, required checks, diff review, and verified fixes. Stop on missing
authority or an ambiguous test environment.

The orchestration rule

Use one agent by default. Add agents only when the work has independent, bounded parts.

flowchart TD
    A["New task"] --> B{"Can one agent finish it clearly?"}
    B -- Yes --> C["Use one agent"]
    B -- No --> D{"Are parts independent?"}
    D -- No --> E["Plan sequential stages"]
    D -- Yes --> F{"Mostly read-heavy?"}
    F -- Yes --> G["Delegate in parallel"]
    F -- No --> H["Assign exclusive file ownership or run sequentially"]
    G --> I["Return concise evidence summaries"]
    H --> I
    I --> J["Main agent integrates and verifies"]
Loading

Parallel agents often improve elapsed time and protect the main thread from noisy logs, but they normally use more total tokens. The efficiency target is fewer failed loops and cleaner context, not the maximum number of agents.

Repository map

codex-howto/
├── .github/                 # Validation workflow and PR template
├── .codex-plugin/           # Plugin manifest over the existing skill catalog
├── modules/                 # Progressive tutorials and labs
├── skills/                  # Installable engineering skills
├── knowledge/               # Review-first maintainer evidence wiki
├── labs/
│   └── engineering-playground/ # Self-contained practice project
├── examples/
│   ├── agents/              # Project-scoped custom agent definitions
│   ├── config/              # Conservative Codex configuration
│   ├── prompts/             # Copy-ready task and orchestration prompts
│   └── AGENTS.md            # Starter repository guidance
├── resources/               # Checklists and comparison material
└── scripts/validate_repo.py # Offline structural validation

See CATALOG.md for the complete index and LEARNING-ROADMAP.md for suggested tracks.

For a dependency-free end-to-end exercise, copy the engineering playground to a disposable directory and practice backend, frontend, DevOps, testing, review, security, and orchestration workflows against its seeded defects.

Source policy

  • Product behavior and configuration claims must link to official OpenAI documentation.
  • Community examples must be labeled as community material.
  • Version-sensitive examples should include a verification date.
  • Secrets, production credentials, and destructive defaults are never included.
  • Marketing claims such as “10x productivity” are intentionally avoided.

Inspiration and related work

The progressive-module idea was inspired by luongnv89/claude-howto. This repository is an original Codex-focused curriculum and does not copy its tutorial text or templates.

The skill-system refinements were inspired by the original mattpocock/skills repository. Its invocation, routing, debugging, and review ideas were adapted to Codex without copying its skills.

The workflow-calibration profiles also study obra/superpowers, particularly its design gates, worktree isolation, verification discipline, staged review, and skill-behavior testing. codex-howto links to both MIT-licensed upstream projects rather than vendoring their catalogs.

Bounded autonomous-loop controls were informed by affaan-m/everything-claude-code, especially its plan-build-judge, evaluation, context-budget, and cost-tracking workflows. The Codex adaptation remains optional and is measured as a focused component rather than importing the full harness.

The living-wiki pattern was inspired by Karpathy's LLM Wiki idea. The review-first Codex adaptation also studies Astro-Han/karpathy-llm-wiki, lucasastorian/llmwiki, and atomicstrata/llm-wiki-compiler. External source bodies are not copied into this repository by default.

Useful related community projects:

The authoritative upstream implementation is openai/codex.

Contributing

Contributions are welcome. Start with CONTRIBUTING.md. New tutorials should include a concrete outcome, a safe exercise, a verification step, and official sources.

If the guide is useful, choose the action that creates the most value:

Use the community guide for responsible participation and the launch kit for audience-specific presentation material.

License and trademarks

Released under the MIT License. “OpenAI” and “Codex” are trademarks of their respective owners. This is an independent community project and is not endorsed by OpenAI or Anthropic.

About

Engineering-first OpenAI Codex guide: 14 modules, 9 installable skills, reproducible benchmarks, testing, review, orchestration, and a Living Wiki.

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

2 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages