Skip to content

Confusion about the eval implementation #7

@OPilgrim

Description

@OPilgrim

Hi, Barry Menglong Yao,

First of all, thank you for a great job!

But I have a question when I look at the code. After running the 'python main.py --mode=preprocess_for_verification' instruction in 'eval.sh', I found that the 'img_evidences' in 'Corpus2_for_verification.csv' is completely empty. This phenomenon is caused by the code in 'verification_preprocess.py':

image

I am confused about this, could you please explain why proof is used instead of img in this position, and why only text evidences is used instead of picture evidences when eval is used?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions