EgoLifeQA Benchmark

[pritamqu]

Hey - I am planning to evaluate on your benchmark
Could you please confirm if the EgoLifeQA benchmark is public yet? This link seems to have just one participant's data! Any plan for release the rest?
https://huggingface.co/datasets/lmms-lab/EgoLife/tree/main/EgoLifeQA

Great work, thanks!

[peterwilson3912]

Second! Very nice work! Looking forward to see the whole benchmark. There is a paper EgoGraph: Temporal Knowledge Graph for Egocentric Video Understanding already claimed their results on EgoLifeQA benchmark. They mentioned that

they didn't mention it is a subset of the dataset. they claimed that

Extensive experiments on the EgoLifeQA and EgoR1-bench benchmarks demonstrate that EgoGraph achieves state-of-the-art performance on long-term video question answering, validating its effectiveness as a new paradigm for ultra-long egocentric video understanding.

May I ask is it possible to have the dataset in some other way? Like contact author and get a google drive link something. Thank you so much for your help!

[lezhangleonard]

Would be appreciate if the full evaluation data is released

[cyshello]

Same here! Would be appreciate if the full EgolifeQA benchmark is released