What happened?
I ran the tool and saw the output
What do any of the evaluation metrics mean, quantitatively? For example, what is "Lift"? What is "Quality"? etc... How are these numbers explicitly calculated? What tests are run to get the data need to calculate these numbers? What are their units? How were they validated? How do we know these numbers aren't just hallucinated?
thanks!
Gus
Reproduction steps
run the tool.
SkillEvaluator version or commit
latest
Environment
not applicable
Before submitting
What happened?
I ran the tool and saw the output
What do any of the evaluation metrics mean, quantitatively? For example, what is "Lift"? What is "Quality"? etc... How are these numbers explicitly calculated? What tests are run to get the data need to calculate these numbers? What are their units? How were they validated? How do we know these numbers aren't just hallucinated?
thanks!
Gus
Reproduction steps
run the tool.
SkillEvaluator version or commit
latest
Environment
not applicable
Before submitting