Hi, I found a likely GT/source mismatch in traditional sports_3.
Sample
Question: Who is the hero of United States when beating Serbia in Paris Olympics?
Ground Truth: Kevin Durant
area: news
subfield: traditional sports
timestamp: 2024-08-09
Issue
There were two USA vs Serbia games in the Paris Olympics:
-
July 28, 2024 — Group Stage
-
August 8, 2024 — Semifinal
The current sample has timestamp 2024-08-09, which points to the August 8 semifinal news context. If the source is ESPN gameId=401694864, the answer should be Stephen Curry, not Kevin Durant.
Kevin Durant only matches the July 28 group-stage game, not the August 8 semifinal.
Suggested Fix
Either change the GT to:
or, if the intended answer is Kevin Durant, change the source/timestamp to match the July 28 group-stage game.
Hi, I found a likely GT/source mismatch in
traditional sports_3.Sample
Issue
There were two USA vs Serbia games in the Paris Olympics:
July 28, 2024 — Group Stage
August 8, 2024 — Semifinal
The current sample has timestamp
2024-08-09, which points to the August 8 semifinal news context. If the source is ESPNgameId=401694864, the answer should be Stephen Curry, not Kevin Durant.Kevin Durant only matches the July 28 group-stage game, not the August 8 semifinal.
Suggested Fix
Either change the GT to:
or, if the intended answer is Kevin Durant, change the source/timestamp to match the July 28 group-stage game.