Baseline Results

[fym0503]

Hi, Thanks for your great work and dataset. Could you please share how you get the baseline (roberta) results ? It is not in the open source code and I don't know how to replicate the results. And Roberta (encoder only) arch is diffrent from T5(encoder-decoder).

[Slash0BZ]

Sorry I missed this issue. The Roberta results come from an off-the-shelf standard NLI setting (premise, hypothesis, entailment-label). I believe you can reuse the example structure provided by Huggingface on entailment for that purpose. We did not attempt to alter it much since it was just a baseline.