Skip to content

feat(M92): Test Suite Generation from Divergent Samples #198

@hlin99

Description

@hlin99

M92: Test Suite Generation from Divergent Samples

Generate reusable test datasets from divergent samples in batch reports.

  • xpyd-acc generate-suite --report <path> --output <path> extracts divergent samples into JSONL
  • Filters: --classification, --min-logprob-gap, --max-samples, --include-expected
  • Output compatible with batch-compare --dataset for CI regression testing
  • Enables workflow: batch-compare → generate-suite → commit suite → rerun on every deploy

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions