Skip to content

[spec] Counting model left to commercial agreement // suggestion to support business teams #15

Description

@B-Szymbo

Specification section

4.3.2 Event lifecycle -> Grounding // 6.4 Grounding data // 10.1 Counting semantics

What you observed

6.4: “The boundary is drawn at the generation context rather than at earlier processing stages, the point most directly tied to content influence on the output.

The boundary is consistent; the resulting grounding count is not. An agent that loads fifty results into a long context and one that places three re-ranked chunks produce very different grounding counts for the same answer. The counting model is therefore left to commercial agreement (section 10) rather than fixed by the format.”

This approach is technically consistent for engineers, but it does present a business inconsistency. A model utilizing an expansive, unoptimized context window versus a model using an advanced, aggressive semantic re-ranker will generate significantly different event counts for utilizing the value from the exact same content.

Why it matters

Negotiating subtle interpretations of counting semantics will likely be challenging for publisher-side business leads during licensing negotiations. There is information asymmetry:, especially prior to an executed agreement that would, ideally, have some audit rights.

Presumably, this will get easier in the future, as noted in the README.md’s “Open questions in v0.1”:

“Input from platform engineering teams building real implementations will sharpen this definition.”

This is not where many publishers are today.

Proposed direction (optional)

Suggestion to look at the IAB Tech Lab’s CoMP release.

Shortly after their release of the 1.0 spec ( CoMP ), CoMP issued the "Bot and Crawler Management Guidance" document to support non-technical audiences in decision-making ( Guidance ).

Recommendation: Compile and release a centralized, “living and breathing” playbook for non-technical/business teams in publisher organizations.

This supporting playbook should include:

(A) standardized definitions that all non-technical / business teams of SPUR members can use during negotiations, and;

(B) a structured list of considerations to assist non-technical leaders in strategic decision-making.

Ideally, this “considerations” checklist would include suggestions for default counting metrics to protect smaller publishers who lack the engineering resources to audit backend tracking systems.

Your perspective

Content owner / publisher

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    guidanceAnswered by non-normative guidance rather than a spec change

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions