diff --git a/PROGRAM_STATUS.md b/PROGRAM_STATUS.md index 1b6bba1..82c0461 100644 --- a/PROGRAM_STATUS.md +++ b/PROGRAM_STATUS.md @@ -4,15 +4,15 @@ **Coverage: 19/19 expected repositories; duplicates: 0.** -Last verified: `2026-08-25T05:14:23Z`. HEADs are the verified default-branch revisions, not an assumption about later changes. +Last verified: `2026-08-25T05:55:58Z`. HEADs are the verified default-branch revisions, not an assumption about later changes. ## Portfolio totals | Lifecycle stage | Count | |---|---:| -| `THEORY` | 13 | -| `SPECIFIED` | 1 | -| `PROTOTYPED` | 5 | +| `THEORY` | 12 | +| `SPECIFIED` | 0 | +| `PROTOTYPED` | 7 | | `VERIFIED` | 0 | | `BENCHMARK_READY` | 0 | | `EXPERIMENTED` | 0 | @@ -30,7 +30,7 @@ Program state totals: active 4; waiting 15; complete 0. | 2 | [semantic-edit-protocol](https://github.com/opsle/semantic-edit-protocol) | concept | `29caad5c0382` | `THEORY` | [none; placeholder source directory only](https://github.com/opsle/semantic-edit-protocol/blob/29caad5c03827cde17aabd71c38bc25899413a33/THEORY.md); placeholder only; no automated tests | No executable semantic operation, validator, tests, or benchmark fixtures. | Specify one JavaScript symbol-replacement operation with preconditions, rollback behavior, and conformance cases. | `agent-resource-claims`, `agent-trajectory-profiler` | waiting | | 3 | [durable-supervisor](https://github.com/opsle/durable-supervisor) | concept | `555ebedb992a` | `THEORY` | [none; placeholder source directory only](https://github.com/opsle/durable-supervisor/blob/555ebedb992ac74236bb7da8230b4d6b0489830b/THEORY.md); placeholder only; no automated tests | Portable ledger, scheduler, and wakeup fixtures do not yet exist. | After ledger and wakeup fixtures exist, specify the minimum reconstruction envelope and failure behavior. | `agent-state-ledger`, `agent-scheduler-runtime`, `event-driven-agent-wakeup`, `decision-evidence-protocol` | waiting | | 4 | [event-driven-agent-wakeup](https://github.com/opsle/event-driven-agent-wakeup) | concept | `a6209860c215` | `PROTOTYPED` | [dependency-free JavaScript state-machine prototype](https://github.com/opsle/event-driven-agent-wakeup/blob/a6209860c2151450cc28ed648bc8c2631c8db7ef/src/runtime.js); 2 of 2 automated tests passed locally at the verified HEAD | Current prototype is in-memory and has no restart or durable-store harness. | Add a deterministic persisted-event fixture covering restart, duplicate delivery, wrong-wait, and timeout cases. | `agent-state-ledger` | waiting | -| 5 | [context-firewall](https://github.com/opsle/context-firewall) | concept | `e865644e86a3` | `THEORY` | [none; placeholder source directory only](https://github.com/opsle/context-firewall/blob/e865644e86a3f820a120548e91284c048e515671/THEORY.md); placeholder only; no automated tests | No executable reducer, conformance suite, frozen fixtures, or correctness oracle. | Implement a dependency-free test-output reducer and synthetic conformance fixtures for EXP-001 without provider use. | `decision-evidence-protocol`, `agent-trajectory-profiler` | active | +| 5 | [context-firewall](https://github.com/opsle/context-firewall) | concept | `dd34bd9f6813` | `PROTOTYPED` | [dependency-free deterministic JavaScript TAP-subset reducer, CLI, evidence receipts, payload ceilings, and synthetic conformance corpus](https://github.com/opsle/context-firewall/blob/dd34bd9f681314761f1ca87f339648bf611811f3/src/reducer.js); 33 of 33 automated tests and 30 of 30 synthetic conformance fixtures passed locally at the verified HEAD; PR #1 CI passed | Decision Evidence Protocol does not yet validate packet-v1 receipts, Agent Trajectory Profiler lacks raw/reduced payload fixtures, and EXP-001 task fixtures, correctness oracle, harness, exact model configuration, and randomized/blinded allocation remain unfrozen. | After downstream receipt validation exists, freeze content-addressed EXP-001 reducer packets and a correctness oracle without launching a provider run. | `decision-evidence-protocol`, `agent-trajectory-profiler` | active | | 6 | [decision-evidence-protocol](https://github.com/opsle/decision-evidence-protocol) | concept | `7050f83406a7` | `PROTOTYPED` | [dependency-free JavaScript envelope validator prototype](https://github.com/opsle/decision-evidence-protocol/blob/7050f83406a709da84e4b4770556319f767bbeaf/src/validate.js); 2 of 2 automated tests passed locally at the verified HEAD | Validator covers only a minimal envelope and has no cross-tool fixture suite. | Add reducer receipt and escalation conformance cases required by EXP-001. | — | active | | 7 | [agent-state-ledger](https://github.com/opsle/agent-state-ledger) | concept | `acab03b1ff71` | `THEORY` | [none; placeholder source directory only](https://github.com/opsle/agent-state-ledger/blob/acab03b1ff7168222552050e21e7553b07d00e7c/THEORY.md); placeholder only; no automated tests | No portable schema, implementation, projection oracle, or replay fixtures. | Specify a minimal append-only event schema and deterministic projection with contradiction fixtures. | — | waiting | | 8 | [agent-scheduler-runtime](https://github.com/opsle/agent-scheduler-runtime) | concept | `d97cd3c218b2` | `THEORY` | [none; placeholder source directory only](https://github.com/opsle/agent-scheduler-runtime/blob/d97cd3c218b20e0b2b0e09873f6a3d15c396b3a0/THEORY.md); placeholder only; no automated tests | Ledger and claim interfaces are not portable or executable in these repositories. | After ledger schema exists, specify deterministic readiness and lease transitions with a fake-clock harness. | `agent-resource-claims`, `agent-state-ledger` | waiting | @@ -42,21 +42,21 @@ Program state totals: active 4; waiting 15; complete 0. | 14 | [controlled-agent-acceptance](https://github.com/opsle/controlled-agent-acceptance) | concept | `2d652adf56e5` | `THEORY` | [none; placeholder source directory only](https://github.com/opsle/controlled-agent-acceptance/blob/2d652adf56e53953327d09b1ba9c4a9c3445f052/THEORY.md); placeholder only; no automated tests | Authorization, routing, scheduling, and handoff contracts are not yet executable together. | Wait for prerequisite contracts, then specify an offline one-shot manifest state machine before any provider run. | `agent-execution-authorization`, `agent-routing-policy`, `agent-scheduler-runtime`, `verifiable-agent-handoff` | waiting | | 15 | [agent-recovery-policy](https://github.com/opsle/agent-recovery-policy) | concept | `1b733a111e26` | `THEORY` | [none; placeholder source directory only](https://github.com/opsle/agent-recovery-policy/blob/1b733a111e26e0a409fee3b96f627048531daefe/THEORY.md); placeholder only; no automated tests | No shared failure schema, attempt ledger, route evaluator, or comparative fixture set. | After decision evidence and route schemas stabilize, define same-failure convergence on synthetic failures. | `agent-routing-policy`, `agent-state-ledger`, `decision-evidence-protocol` | waiting | | 16 | [ephemeral-agent-workers](https://github.com/opsle/ephemeral-agent-workers) | concept | `ad96fcfdfac0` | `THEORY` | [none; placeholder source directory only](https://github.com/opsle/ephemeral-agent-workers/blob/ad96fcfdfac06d340b5e96d369634980cee78ef4/THEORY.md); placeholder only; no automated tests | Portable authority, claim, and handoff contracts are not ready; no safe synthetic containment harness exists. | Wait for prerequisite contracts, then define a fake worker adapter and destruction receipt without infrastructure changes. | `agent-execution-authorization`, `agent-resource-claims`, `verifiable-agent-handoff` | waiting | -| 17 | [research](https://github.com/opsle/research) | program infrastructure | `20a48bbad179` | `SPECIFIED` | [public program material present; machine registry and validator are introduced by this bootstrap branch, not the verified default-branch HEAD](https://github.com/opsle/research/blob/20a48bbad1794c726e2f02bf5da7415d5e7674f8/METHODOLOGY.md); no registry validator at the verified default-branch HEAD | Program-control bootstrap must be reviewed and merged before the default branch becomes authoritative. | Review and merge the program-control bootstrap after CI passes. | — | active | +| 17 | [research](https://github.com/opsle/research) | program infrastructure | `f1652bf58d30` | `PROTOTYPED` | [authoritative 19-repository machine registry, experiment ledger, deterministic status renderer, validator, mutation tests, operating rules, and integrity CI on main](https://github.com/opsle/research/blob/f1652bf58d30947f7401855fe2a9a189fafe9a33/program/registry.json); 9 of 9 registry/renderer tests, including 7 mutation/failure cases, passed locally at the verified control revision; PR #1 integrity CI passed | Verified remote HEAD reconciliation is not yet mechanically fetched, and the program has no canonical measured concept experiment. | Record the next exact EXP-001 prerequisite revision when Decision Evidence Protocol accepts Context Firewall packet-v1 receipts; keep EXP-001 planned. | — | active | | 18 | [site](https://github.com/opsle/site) | program infrastructure | `28ad65be4750` | `PROTOTYPED` | [React/Vinext source implementation with content routes](https://github.com/opsle/site/blob/28ad65be4750dc849976fbf5c9eae9501c6bbb25/README.md); automated build/render tests present; not rerun because this reconciliation kept other repositories read-only | Wait for validated registry data and measured research; deployment requires separate authorization. | After registry merge, add a read-only registry ingestion design without deploying the site. | `research` | waiting | | 19 | [.github](https://github.com/opsle/.github) | program infrastructure | `01c38e726db7` | `THEORY` | [documentation-only organization profile](https://github.com/opsle/.github/blob/01c38e726db7c3e45059d25fccce55e071e35938/profile/README.md); not applicable to current single Markdown profile; consistency is unverified | No mechanical registry consistency check exists in this repository. | After registry merge, design a read-only consistency check for organization-profile repository links. | `research` | waiting | ## Highest-priority workstream -EXP-001 prerequisites: Context Firewall reducer plus Decision Evidence receipts and Trajectory Profiler payload fixtures. +EXP-001 prerequisites: validate Context Firewall receipts in Decision Evidence Protocol, then add Trajectory Profiler payload fixtures before freezing the experiment harness. `EXP-001` — **PLANNED** — How much context can an AI coding agent safely not see? -Blockers: No executable Context Firewall reducer or conformance suite exists. Fixture identities, correctness oracle, harness, and exact configurations are not frozen. +Blockers: Decision Evidence Protocol has not validated Context Firewall packet-v1 receipts and escalation semantics. Agent Trajectory Profiler lacks raw/reduced payload and escalation fixtures for EXP-001. Experimental fixture identities, correctness oracle, baseline/arm harness, exact model/provider configurations, and randomized/blinded task allocation are not frozen. ## Exact recommended next execution -Implement a dependency-free Context Firewall test-output reducer and synthetic conformance fixtures that emit Decision Evidence Protocol-compatible receipts and Agent Trajectory Profiler-compatible payload measurements; do not run a model/provider experiment. +Extend the dependency-free Decision Evidence Protocol validator with Context Firewall packet-v1 receipt, suppression, measurement, and NEEDS_RAW_EVIDENCE conformance cases at exact revisions; do not run a model/provider experiment. ## Mechanical source of truth diff --git a/program/PRIORITY.md b/program/PRIORITY.md index e46b4ad..b79c0bc 100644 --- a/program/PRIORITY.md +++ b/program/PRIORITY.md @@ -5,10 +5,10 @@ checklist. ## Workstream 1: EXP-001 prerequisites and experiment -1. Extend the Decision Evidence Protocol validator for deterministic reducer - receipts and explicit raw-output escalation. -2. Implement the smallest Context Firewall reducer and conformance fixtures for - synthetic test output. +1. Context Firewall's deterministic test-output reducer and synthetic + conformance corpus are now prototyped at an exact revision. +2. Extend the Decision Evidence Protocol validator for packet-v1 receipts, + suppression accounting, measurements, and explicit raw-output escalation. 3. Extend Agent Trajectory Profiler fixtures to measure visible payload, gross payload, escalation, and correctness-gated comparison. 4. Freeze the EXP-001 fixture set and harness, then run baseline and reduction @@ -50,7 +50,7 @@ conversation-local. ## Exact next execution -Implement a dependency-free Context Firewall reducer plus synthetic conformance -fixtures, emitting Decision Evidence Protocol-compatible receipts and Agent -Trajectory Profiler-compatible payload measurements. Do not run a model/provider -experiment in that execution. +Extend the dependency-free Decision Evidence Protocol validator with Context +Firewall packet-v1 receipt, suppression, measurement, and NEEDS_RAW_EVIDENCE +conformance cases at exact revisions. Do not run a model/provider experiment in +that execution. diff --git a/program/experiments.json b/program/experiments.json index 3e698ab..6d57122 100644 --- a/program/experiments.json +++ b/program/experiments.json @@ -1,6 +1,6 @@ { "schema_version": 1, - "last_verified_at": "2026-08-25T05:14:23Z", + "last_verified_at": "2026-08-25T05:55:58Z", "experiments": [ { "id": "EXP-001", @@ -48,17 +48,31 @@ "missing telemetry", "interrupted run" ], - "dataset_fixture_identity": "UNVERIFIED: task-stratified synthetic coding fixtures and immutable hashes have not yet been created.", + "dataset_fixture_identity": "UNVERIFIED: task-stratified experimental coding fixtures and immutable hashes have not yet been created. Context Firewall's 30 synthetic conformance fixtures are implementation evidence only, not the EXP-001 dataset.", "model_provider_configuration": "UNVERIFIED: no model, provider, version, reasoning effort, or sampling configuration has been selected.", "run_identities": [], "result_artifacts": [], + "prerequisite_progress": [ + { + "repository": "context-firewall", + "head_sha": "dd34bd9f681314761f1ca87f339648bf611811f3", + "status": "COMPLETED", + "evidence": [ + "https://github.com/opsle/context-firewall/blob/dd34bd9f681314761f1ca87f339648bf611811f3/src/reducer.js", + "https://github.com/opsle/context-firewall/blob/dd34bd9f681314761f1ca87f339648bf611811f3/tests/reducer.test.js", + "https://github.com/opsle/context-firewall/blob/dd34bd9f681314761f1ca87f339648bf611811f3/fixtures/corpus.js" + ], + "limitations": "Prototype conformance does not establish model correctness, benchmark readiness, or a safe context-reduction frontier." + } + ], "replication_status": "NOT_STARTED", "verdict": "PENDING", "blockers": [ - "No executable Context Firewall reducer or conformance suite exists.", - "Fixture identities, correctness oracle, harness, and exact configurations are not frozen." + "Decision Evidence Protocol has not validated Context Firewall packet-v1 receipts and escalation semantics.", + "Agent Trajectory Profiler lacks raw/reduced payload and escalation fixtures for EXP-001.", + "Experimental fixture identities, correctness oracle, baseline/arm harness, exact model/provider configurations, and randomized/blinded task allocation are not frozen." ], - "next_task": "Implement the dependency-free reducer and synthetic conformance fixtures without launching a model/provider run." + "next_task": "Extend Decision Evidence Protocol with Context Firewall packet-v1 receipt and NEEDS_RAW_EVIDENCE conformance cases without launching a model/provider run." }, { "id": "LEGACY-001", diff --git a/program/registry.json b/program/registry.json index 29086b6..dc1e276 100644 --- a/program/registry.json +++ b/program/registry.json @@ -4,9 +4,9 @@ "authoritative_repository_count": 19, "lifecycle_model": "program/LIFECYCLE.md", "experiment_registry": "program/experiments.json", - "current_highest_priority_workstream": "EXP-001 prerequisites: Context Firewall reducer plus Decision Evidence receipts and Trajectory Profiler payload fixtures.", - "recommended_next_execution": "Implement a dependency-free Context Firewall test-output reducer and synthetic conformance fixtures that emit Decision Evidence Protocol-compatible receipts and Agent Trajectory Profiler-compatible payload measurements; do not run a model/provider experiment.", - "last_verified_at": "2026-08-25T05:14:23Z", + "current_highest_priority_workstream": "EXP-001 prerequisites: validate Context Firewall receipts in Decision Evidence Protocol, then add Trajectory Profiler payload fixtures before freezing the experiment harness.", + "recommended_next_execution": "Extend the dependency-free Decision Evidence Protocol validator with Context Firewall packet-v1 receipt, suppression, measurement, and NEEDS_RAW_EVIDENCE conformance cases at exact revisions; do not run a model/provider experiment.", + "last_verified_at": "2026-08-25T05:55:58Z", "repositories": [ { "name": "agent-trajectory-profiler", @@ -132,31 +132,31 @@ "name": "context-firewall", "github_url": "https://github.com/opsle/context-firewall", "default_branch": "main", - "last_verified_head_sha": "e865644e86a3f820a120548e91284c048e515671", + "last_verified_head_sha": "dd34bd9f681314761f1ca87f339648bf611811f3", "project_type": "concept", "purpose": "Reduce operational payload deterministically while preserving provenance and safe raw-evidence escalation.", - "lifecycle_stage": "THEORY", - "implementation_status": "none; placeholder source directory only", + "lifecycle_stage": "PROTOTYPED", + "implementation_status": "dependency-free deterministic JavaScript TAP-subset reducer, CLI, evidence receipts, payload ceilings, and synthetic conformance corpus", "implementation_requirement": "An executable reducer and conformance suite are sufficient; a full agent runtime is not required.", - "specification_status": "experimental theory contract; reducer and escalation rules remain incomplete", - "test_status": "placeholder only; no automated tests", - "benchmark_status": "prose plan only; EXP-001 harness and fixtures do not exist", - "measured_experiment_status": "EXP-001 planned; no runs", - "reproducibility_status": "not available", - "documentation_status": "public theory, preliminary specification, architecture, and benchmark plan present", + "specification_status": "experimental prototype contract for packet v1 and deterministic TAP-subset policy v1", + "test_status": "33 of 33 automated tests and 30 of 30 synthetic conformance fixtures passed locally at the verified HEAD; PR #1 CI passed", + "benchmark_status": "30 synthetic conformance fixtures only; no frozen EXP-001 task fixtures, correctness oracle, baseline/arm harness, or model run", + "measured_experiment_status": "EXP-001 remains planned; zero model/provider experiment runs", + "reproducibility_status": "prototype tests and conformance are reproducible locally and in CI; model correctness and safe reduction frontier are untested", + "documentation_status": "public theory, packet/input contract, parser limits, retention/suppression policy, escalation, ceilings, CLI, conformance, and EXP-001 boundary documented", "site_publication_status": "GitHub documentation only; no evidence-backed site publication", - "known_limitations": ["Safe reduction frontier, reducer conformance, escalation policy, and adversarial omission behavior are unknown."], + "known_limitations": ["The parser is a strict flat TAP-compatible subset, small inputs can expand because of receipt overhead, caller raw references are not externally verified, and no evidence yet establishes model correctness or a safe reduction frontier."], "dependencies": ["decision-evidence-protocol", "agent-trajectory-profiler"], "dependents": [], "active_experiment_ids": ["EXP-001"], - "blockers": ["No executable reducer, conformance suite, frozen fixtures, or correctness oracle."], - "next_task": "Implement a dependency-free test-output reducer and synthetic conformance fixtures for EXP-001 without provider use.", - "evidence": ["https://github.com/opsle/context-firewall/blob/e865644e86a3f820a120548e91284c048e515671/THEORY.md", "https://github.com/opsle/context-firewall/blob/e865644e86a3f820a120548e91284c048e515671/BENCHMARK.md"], + "blockers": ["Decision Evidence Protocol does not yet validate packet-v1 receipts, Agent Trajectory Profiler lacks raw/reduced payload fixtures, and EXP-001 task fixtures, correctness oracle, harness, exact model configuration, and randomized/blinded allocation remain unfrozen."], + "next_task": "After downstream receipt validation exists, freeze content-addressed EXP-001 reducer packets and a correctness oracle without launching a provider run.", + "evidence": ["https://github.com/opsle/context-firewall/blob/dd34bd9f681314761f1ca87f339648bf611811f3/src/reducer.js", "https://github.com/opsle/context-firewall/blob/dd34bd9f681314761f1ca87f339648bf611811f3/tests/reducer.test.js", "https://github.com/opsle/context-firewall/blob/dd34bd9f681314761f1ca87f339648bf611811f3/fixtures/corpus.js", "https://github.com/opsle/context-firewall/pull/1"], "completion_criteria": ["Publish reducer policy and executable conformance validator.", "Run correctness-gated measured context-reduction experiments.", "Replicate the safe frontier and publish omission failure modes."], "completion_evidence": [], "completion_status": "INCOMPLETE", "program_state": "active", - "last_verified_at": "2026-08-25T05:14:23Z" + "last_verified_at": "2026-08-25T05:55:58Z" }, { "name": "decision-evidence-protocol", @@ -492,31 +492,31 @@ "name": "research", "github_url": "https://github.com/opsle/research", "default_branch": "main", - "last_verified_head_sha": "20a48bbad1794c726e2f02bf5da7415d5e7674f8", + "last_verified_head_sha": "f1652bf58d30947f7401855fe2a9a189fafe9a33", "project_type": "program infrastructure", "purpose": "Own public research methodology, portfolio reconciliation, experiment records, and the authoritative program ledger.", - "lifecycle_stage": "SPECIFIED", - "implementation_status": "public program material present; machine registry and validator are introduced by this bootstrap branch, not the verified default-branch HEAD", + "lifecycle_stage": "PROTOTYPED", + "implementation_status": "authoritative 19-repository machine registry, experiment ledger, deterministic status renderer, validator, mutation tests, operating rules, and integrity CI on main", "implementation_requirement": "Program infrastructure requires a validated registry, generated dashboard, experiment ledger, operating rules, and CI.", - "specification_status": "methodology, maturity, architecture, extraction, migration, and publication plans present", - "test_status": "no registry validator at the verified default-branch HEAD", + "specification_status": "canonical lifecycle, operating, priority, registry ownership, experiment, and generated-status controls are present on main", + "test_status": "9 of 9 registry/renderer tests, including 7 mutation/failure cases, passed locally at the verified control revision; PR #1 integrity CI passed", "benchmark_status": "cross-project methodology and prose plans only", "measured_experiment_status": "one legacy integration observation; no canonical measured concept experiment", - "reproducibility_status": "legacy observation is not independently replicated", - "documentation_status": "public program documentation present", + "reproducibility_status": "program registry validation and status generation are reproducible locally and in CI; the legacy observation remains unreplicated", + "documentation_status": "public program documentation plus authoritative machine controls and generated portfolio status present", "site_publication_status": "GitHub research hub only", - "known_limitations": ["Default branch predates this program-control bootstrap and has no authoritative machine ledger or integrity CI."], + "known_limitations": ["Default-branch HEAD verification remains operator-driven, site content is not registry-derived, and no canonical concept experiment has run."], "dependencies": [], "dependents": [".github", "site"], "active_experiment_ids": ["LEGACY-001"], - "blockers": ["Program-control bootstrap must be reviewed and merged before the default branch becomes authoritative."], - "next_task": "Review and merge the program-control bootstrap after CI passes.", - "evidence": ["https://github.com/opsle/research/blob/20a48bbad1794c726e2f02bf5da7415d5e7674f8/METHODOLOGY.md", "https://github.com/opsle/research/blob/20a48bbad1794c726e2f02bf5da7415d5e7674f8/OPSLE_EXTRACTION_MAP.md"], + "blockers": ["Verified remote HEAD reconciliation is not yet mechanically fetched, and the program has no canonical measured concept experiment."], + "next_task": "Record the next exact EXP-001 prerequisite revision when Decision Evidence Protocol accepts Context Firewall packet-v1 receipts; keep EXP-001 planned.", + "evidence": ["https://github.com/opsle/research/blob/f1652bf58d30947f7401855fe2a9a189fafe9a33/program/registry.json", "https://github.com/opsle/research/blob/f1652bf58d30947f7401855fe2a9a189fafe9a33/tools/validate_program.py", "https://github.com/opsle/research/blob/f1652bf58d30947f7401855fe2a9a189fafe9a33/tests/test_validate_program.py", "https://github.com/opsle/research/pull/1"], "completion_criteria": ["Keep the 19-repository ledger and dashboard mechanically consistent.", "Retain immutable experiment evidence and lifecycle promotion proof.", "Publish program documentation without stale or unsupported claims."], "completion_evidence": [], "completion_status": "INCOMPLETE", "program_state": "active", - "last_verified_at": "2026-08-25T05:14:23Z" + "last_verified_at": "2026-08-25T05:55:58Z" }, { "name": "site",