About the three attributes in BLIP-VQA(Color,Texture and Shap)

[HarlayZhang]

Thank you for your great contributions.

But I have encountered some minor problems. As a beginner, when I was reading a large number of papers, I found that many papers used the following evaluation metrics.

What I don't understand is why BLIP-VQA has three attributes when I run your code cd T2I-CompBench bash When BLIPvqa_eval/test.sh was used, only one result appeared.

I would like to ask if this is normal. How should I understand it? Can it help me? thank you

[Karine-Huang]

Hello,
Thanks for your interest in our work and sorry about the late reply.
BLIP-VQA assigns three attribute scores for these three categories: color, shape, and texture.
To get 3 attribute results, you need:
(1) Using "color_val.txt", "shape_val.txt", and "texture_val.txt" in this dataset to generate images for each category.
(2) Then use "BLIPvqa_eval/test.sh" to get score for each category.
You will get 3 attribute results separately.