Skip to content

fix(ai-service): grounding verifier rejects quotes that span a table cell border #50

Closed

Description

@Fluory

Beobachtet

Eval case t03-table-eml-plaintext (#24 / PR #41): the model quotes a table row across a cell border, e.g. 60 | Stk.. The grounding verifier does not confirm the unit from that quote, so a correct value ends up not found.

Erwartet

A quote whose text matches the cited segment once cell separators (|, tabs, repeated spaces) are normalised is confirmed – as long as the value itself is in the quote and in the cited segment. "Found needs proof" (ADR-0001 D8) must stay strict: no fuzzy matching beyond separator normalisation.

Reproduktion

  1. uv run --project services/ai --directory services/ai python -m requestflow_ai.evals --replay
  2. See line_items.unit / line_items.quantity for case t03: the value is not grounded.

Akzeptanzkriterien

  • Fehler behoben, Regressionstest existiert (unit test in the verifier tests with a cross-cell quote).
  • Negative test: a quote that only matches after dropping real characters (not separators) is still rejected.
  • Eval replay: t03 grounded; no key field drops; baseline updated deliberately.

Security/Privacy betroffen?

KI/RAG: the verifier is the proof gate for found – change needs the eval gate and a review against D8.

Activity

  1. added
    bugSomething is broken
    aiLLM, prompts, evals
    on Sep 23, 2026
  2. added
    readyDefinition of Ready met – may be claimed
    on Sep 24, 2026
  3. self-assigned this
    on Sep 24, 2026
  4. Fluory commented on Sep 24, 2026

    @Fluory
    OwnerAuthor

    Claimed by @Fluory (Claude Code session) on branch claude/fix-verifier-cell-border-50. Draft PR follows.


    Generated by Claude Code

  5. added 3 commits that reference this issue on Sep 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

aiLLM, prompts, evalsbugSomething is brokenreadyDefinition of Ready met – may be claimed

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions