Skip to content

Sharpen the README and package metadata (scope, related work, M3b status) - #1

Merged
DanielMoj merged 1 commit into
mainfrom
texts-2026-11-06
Nov 6, 2026
Merged

DanielMoj merged 1 commit into
mainfrom
texts-2026-11-06

Conversation

@DanielMoj

Copy link
Copy Markdown
Owner

Text-only changes; no code, tests or data are touched.

README

  • Opening sentence: "the kind of evidence ... before the output of an LLM step is relied on"; the decision stays with the organization that runs the pipeline.
  • New section Related work: generalizability-theory decompositions of LLM outputs (Messing, 2026; Żatuchin, 2026) and Inspect AI's standard errors and Krippendorff's alpha, and what llmsa adds on top (pre-specified verdict, designed robustness screening, control charts, report tied to context of use and risk).
  • New section Scope and limits: research software without warranty, not a medical device or IVD, a report documents one study and certifies nothing.
  • Validation status after M3b: robustness screening verified (Plackett and Burman 1946 with NIST and FrF2; Lenth 1989 examples II and IV with unrepx and DoE.base; false-alarm rate by simulation with MCSE, Lenth's limits conservative at about 2 to 3 % per effect). Agreement, bias and linearity: validation in progress. Mutation score of R/robustness.R (96.6 % of 317) added.
  • Website link, lifecycle badge, an install line without vignettes, data collection of the application study reported as complete, "language model" named in the development section.
  • US spelling in the prose to match Language: en-US; official titles (ICH, EU regulations) keep their spelling.
  • Three references added.

DESCRIPTION

  • URL lists the pkgdown site first (BL-121); tools:::.check_package_description() reports nothing.
  • Description names Krippendorff's alpha and cites the methods with DOIs taken from the README references.

NEWS — the half-normal plot entry names Daniel (1959) instead of "Daniel's".

inst/CITATION — version read from DESCRIPTION, ORCID added; the printed citation for 0.1.0 is identical to the old file (checked with utils::readCitationFile()).

Merge note. The local main of the harness is ahead of GitHub while M3a runs. Merge this branch into the local main when the run has stopped (not during a model phase), then push main as usual. Merging here on GitHub first would make the next push from the harness clone fail the pre-push check, as on 5 November.


Generated by Claude Code

…rk, M3b status)

README
- Opening: "the kind of evidence ... before the output of an LLM step is
  relied on"; the decision stays with the organization running the pipeline.
- New sections "Related work" (generalizability-theory decompositions,
  Inspect AI) and "Scope and limits" (research software, not a medical
  device, a report documents one study and certifies nothing).
- Validation status after M3b: robustness screening verified (Plackett and
  Burman 1946 with NIST and FrF2, Lenth 1989 examples II and IV, false-alarm
  rate by simulation); agreement, bias and linearity in progress; mutation
  score of R/robustness.R.
- Website link, lifecycle badge, install line without vignettes, status of
  the application study, language models named in the development section.
- US spelling throughout the prose (Language: en-US); official titles keep
  their spelling.
- References: Messing (2026), UK AI Security Institute (2026), Zatuchin (2026).

DESCRIPTION
- URL lists the pkgdown site first (BL-121).
- Description names Krippendorff's alpha and cites the methods with DOIs.

NEWS
- Half-normal plot entry names Daniel (1959) instead of "Daniel's".

inst/CITATION
- Version read from DESCRIPTION; ORCID added. Output for 0.1.0 unchanged.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01HzgnGxL7FYy2kGa7J5RRPL
@DanielMoj
DanielMoj merged commit 32acbee into main Nov 6, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants