Skip to content

[BUG]: The numbers produced by this tool appear to be meaningless? #61

Description

@mpgussert

What happened?

I ran the tool and saw the output

What do any of the evaluation metrics mean, quantitatively? For example, what is "Lift"? What is "Quality"? etc... How are these numbers explicitly calculated? What tests are run to get the data need to calculate these numbers? What are their units? How were they validated? How do we know these numbers aren't just hallucinated?

thanks!
Gus

Reproduction steps

run the tool.

SkillEvaluator version or commit

latest

Environment

not applicable

Before submitting

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions