Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

134 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

LLM Errata

validate

A vendor-neutral proposal for making corrections follow AI memory after it has been copied.

An imported memory is a dependency, not a copy. When its source changes, the importer should quarantine its known descendants, rebuild them from valid inputs, and report anything it could not verify.

If an AI accepts a memory, it should also accept responsibility for its future errata.

Publication status

Field Value
Author Thomas Rainer Willner
Version 0.4.1
Status Public concept proposal / Request for Comment
Published 2026-08-07
Latest release v0.4.1 — integrity and conformance hardening release
Research reviewed through 2026-08-01
License Attributed specification implementations permitted; reference code remains personal-use. See LICENSE.

This is an independent proposal. It does not represent the position of the author's employer or any organization referenced in this repository.

The problem

AI memory is beginning to move between assistants, agents, applications, and vendors. Portability is useful, but every import creates another copy that may outlive the truth from which it originated.

Suppose a personal assistant records that Alice is vegetarian. Alice exports that memory to a travel planner and a work-event assistant. Each importer produces local summaries, embeddings, profiles, and caches. Months later, Alice says the preference has ended. Updating the original assistant does not necessarily update any of those descendants.

Existing work covers important parts of the lifecycle:

  • portable and cross-runtime memory formats;
  • signed corrections and incremental synchronization;
  • local lineage, deletion, and regeneration;
  • cross-recipient notifications and acknowledgments;
  • provenance, revocation, and cryptographic receipts.

The missing obligation is what an importer must do after it receives the update.

The proposal

LLM Errata defines a conformance pattern with five verbs:

observe → quarantine → rebuild → test → attest
  1. Observe: authenticate a correction, supersession, or erasure for an imported memory root.
  2. Quarantine: block that root and its known local descendants before further recall.
  3. Rebuild: retire invalid artifacts and reconstruct mixed artifacts from still-valid inputs.
  4. Test: run the repair triad across the declared stores and behavioral scope.
  5. Attest: return an authenticated, coverage-truthful receipt bound to the erratum and the importer's pre-repair and post-repair state. Its signature authenticates the bytes; separate coverage rules determine whether the signed claim is honest.

An importer that cannot inspect a relevant cache or derived store reports unknown. It does not silently turn incomplete coverage into success.

An empty enumeration is not a clean result by itself. The adapter must also establish that its root-specific lineage authority is complete; otherwise the store remains unknown. A receipt also speaks only for the signed feed view that one importer accepted. Detecting different views delivered to different importers requires an external witness or append-only transparency mechanism.

A durable quarantine checkpoint records the adapter's own phase-specific coverage rather than assuming every enumerable store is verified. Final repair cannot erase an earlier partial, unknown, or failed checkpoint. Independent adapters own their lineage inputs behind the published interface; they do not have to mirror store internals into the reference ledger.

The repair triad

Every repair is evaluated against three postconditions:

Check Required result
Negative The retired proposition does not reappear in the declared tests.
Positive The replacement is active where it should be.
Preservation Unrelated retained memory still works.

Erasure has no positive replacement but still requires negative and preservation checks. These tests provide scoped evidence, not mathematical proof that a model can never express the retired proposition again.

Correct, supersede, and erase are different

  • Correction: the earlier proposition was wrong.
  • Supersession: the earlier proposition was true and later stopped being true.
  • Erasure: the proposition must no longer be retained or used, whether or not it was true.

This distinction prevents false history from being preserved, valid history from being rewritten, and secrets from surviving as audit evidence.

Why this could affect millions

OpenAI reported more than 800 million weekly ChatGPT users by December 2025. A separate OpenAI/NBER consumer-use study found that practical guidance, information seeking, and writing dominate ordinary use. In a 2026 survey of 6,000 digital workers, Glean reported that, among its respondents who use AI, 77% used multiple AI tools weekly and 33% used four or more.

Those datasets do not measure the same population, and they do not establish how many users already export memory. They do establish the scale of persistent AI use and multi-tool fragmentation. Even a small affected fraction would represent millions of users.

What is—and is not—claimed as new

This repository does not claim to invent portable memory, correction feeds, provenance graphs, dependency-aware deletion, regeneration, revocation, behavioral testing, or signed receipts.

The narrow research conclusion is:

No exact public implementation found in the reviewed sources required all four together: post-export update delivery; importer-side quarantine and repair of the known descendant closure; negative, positive, and preservation tests; and an authenticated, coverage-truthful callback bound to the erratum and pre/post state.

This is a novel synthesis with an apparently unimplemented conformance gap. It is not a claim of patentability, a “world first,” or freedom to operate. EngramSpec is the strongest AI-memory transport collision. The individual vCon Lifecycle using SCITT draft is the strongest formal standards/control-plane collision. Shomei and Inspeximus are the closest local governance and correction collisions.

See PRIOR_ART.md for the feature-level comparison and RESEARCH.md for the reproducible public decision record.

Repository map

File Purpose
prototype/ Runnable demo and CLI. Three stores, one supersession, a receipt that refuses to go green.
spec/ The wire schema for errata and receipts, with conformance vectors.
IDEA.md Complete, copy-pasteable idea file and architecture.
RESEARCH.md Research scope, search protocol, rejected candidates, limits, and falsifiers.
PRIOR_ART.md Feature-collision matrix and source-by-source comparison.
THREAT_MODEL.md What the design defends against, what it does not, and what it can only make visible.
HARD_PROBLEMS.md Screen of the three problems the proposal declares out of scope, with verdicts.
SOURCES.md Pinned source record: versions, commits, access dates, and the sources that remain unpinned.
ROADMAP.md Smallest credible implementation, acceptance gates, and standards path.
AGENTS.md Model-agnostic rules for coding and research agents working in this repository.
CONTRIBUTING.md How to challenge the novelty boundary, correct evidence, or propose an implementation.
CODE_OF_CONDUCT.md How disagreement about evidence is expected to be handled.
SECURITY.md Security-reporting scope and private-reporting guidance.
CITATION.cff Citation metadata.
CHANGELOG.md Public version history, including claims that were narrowed or retired.
PUBLISHING.md Exact repository settings, review gates, release text, and announcement wording.
REVIEW_REQUEST.md Required record for independent conformance and security/distributed-systems review.
INDEPENDENT_IMPLEMENTATION.md Call and evidence requirements for independently authored adapters.
PHASE3_SYSTEMS.md Nominations for future authorized three-system synthetic-data experiment.
docs/PUBLICATION_STRATEGY.md Evidence-bounded publication channels and canonical announcement copy.
docs/PUBLICATION_LOG.md Public GitHub calls, blocked external-channel attempts, and readiness boundary.
docs/READINESS_EVIDENCE_SCHEMAS.md Exact commit-bound G3-G5 external evidence records and qualification boundaries.

Verifying this repository

Everything is Python standard library only. There is nothing to install.

make check    # structure/metadata, bounded claim, readiness-evidence honesty, and self-tests
make links    # liveness of every cited external URL (needs network)

make check runs four validation components because they answer different questions:

Command Question Failure means
make lint Are repository structure and metadata well formed? A file, link, encoding, fence, or metadata field is wrong.
make claim Does the documentation still state the bounded claim? An anchor sentence, the quarantine-before-repair ordering, or the novelty boundary has been altered.
make readiness Is the recorded readiness evidence structurally honest and synchronized with the human matrix? The ledger is malformed, evidence is insufficient for a recorded status, or the matrix contradicts the ledger.
make test Do those checkers reject what they claim to reject? A checker has stopped catching a fault it is supposed to catch.

make publication proves offline manifest consistency and local Git binding only. It prints remote GitHub state as unverified; a live publication or latest feedback claim additionally requires the repository-wide freshness receipt described in PUBLISHING.md.

The self-tests exist because a check that has never failed has not been shown to work. The self-tests build corpora that misstate the proposal — an inverted quarantine ordering, an asserted world first — and require the guard to reject each one.

Readiness-check exit 0 validates structural honesty of the recorded evidence. It does not mean PROD_READY; consult the ledger and human matrix for the current verdict.

scripts/claim_guard.py distinguishes failed (exit 1) from inconclusive (exit 2, meaning a guarded file was missing or unreadable, so the claim was never evaluated). Inconclusive is not a pass. make reports its own exit 2 for any failed recipe, so make claim prints which of the two occurred; a script that needs to branch on the distinction should call the guard directly.

Run it

make demo        # the narrated three-store scenario
make cli-demo    # the same lifecycle through the errata command line

Standard library only, no network, no API key. It exits 2 on purpose: both inspectable stores are repaired, all three probes pass, and the aggregate is still partial because one required store cannot show its own state.

That refusal is the point. Remove the opaque store and the same repair reports verified — there is a test asserting exactly that, so the non-green result cannot be read as a bug. See prototype/README.md.

Current maturity

Version 0.4.1 is an experimental conformance proposal and tested reference implementation, not a production protocol or proof of interoperability. It hardens immutable review/release binding, append-only publication history, readiness matrix equality, gate-specific external-evidence independence, full-width state roots, snapshot limitation disclosure, licence scope, and byte-preserving conformance-corpus digests. G4 validator reports must bind the same erratum and exact receipts from both adapters; G5 reports must record the complete declared three-system experiment rather than generic system passes. Phase 1 and the internal Phase 2 conformance surface retain conflict-disclosed external remediation for split-view limitations, empty-enumeration truthfulness, phase-specific checkpoint coverage, complete adapter call-surface documentation, and removal of hidden reference-ledger coupling. G2 remains BLOCKED: interested-party findings and internal remediation do not replace a complete independent review of the current surface. G4 also remains BLOCKED: one externally authored adapter candidate exists, but two independent implementations and a separately produced third-party validator result are not established.

Current production-readiness verdict: NOT_PROD_READY. ROADMAP.md defines implementation and kill criteria. PRODUCTION_READINESS.md records the human evidence matrix and continuous enforcement boundaries.

Experimental release readiness is separate from production readiness. Version 0.4.1 is published so implementers can evaluate and extend a materially better baseline while G2–G6 remain an explicit backlog. External challenge is welcome whenever users or reviewers encounter the project, but no release claims those gates passed merely because a reviewer did not appear.

Review requests

The most useful contributions are:

  1. a public system or specification that already implements the complete four-part conjunction;
  2. a correction to a documented feature in the prior-art matrix;
  3. an attack that breaks quarantine, lineage, receipt integrity, privacy, or coverage honesty;
  4. a smaller design that achieves the same user outcome;
  5. a concrete adapter or conformance test.

Please use the evidence requirements in CONTRIBUTING.md, REVIEW_REQUEST.md, and INDEPENDENT_IMPLEMENTATION.md. A convincing prior-art collision should narrow or retire the claim rather than be argued away.

Authorship and research disclosure

The concept was developed under Thomas Rainer Willner's direction using AI-assisted research, candidate generation and rejection, drafting, prior-art comparison, fact-checking, and adversarial review. Thomas Rainer Willner is the publishing author and accepts responsibility for the final claims after completing the human review checklist in PUBLISHING.md.

The public research record exposes the decision criteria and evidence trail. It does not claim to reproduce private model reasoning or hidden chain-of-thought.

License

Copyright © 2026 Thomas Rainer Willner.

Commercial and non-commercial independent implementations are permitted under an irrevocable, worldwide, royalty-free specification grant. Every product or service implementing a material part of LLM Errata must credit LLM Errata and Thomas Willner, with the repository URL, in an ordinarily accessible About, Legal, documentation, acknowledgements, or NOTICE location.

Reference code under prototype/, scripts/, and tests/ remains licensed only for personal, non-commercial evaluation and study unless separately licensed. The specification grant permits clean-room implementation; it does not permit copying reference code. Attribution does not imply endorsement, certification, audit, or support.

Version 0.2.0 and earlier were published under the Apache License 2.0. That grant is irrevocable for those releases and is not withdrawn here.

Third-party files under spec/vendor/ keep their own licences.

About

A vendor-neutral conformance proposal for repairing derived AI memory after post-export correction, supersession, or erasure.

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Used by

Contributors

Languages