Running list of assets for BLOOMZ that always output a single class (~tested with 30-50 samples)
assets/benchmark_v1/sentiment_emotion_others/StanceUnifiedFC_BLOOMZ_ZeroShot: "disagree"
assets/benchmark_v1/factuality_disinformation_harmful_content/Subjectivity_BLOOMZ_ZeroShot.py: "OBJ"
assets/benchmark_v1/demography/gender/GenderArapTweet_BLOOMZ_ZeroShot.py: "Female"
Sample code to print label prediction to see easily
jq '"\(.label) \(.filtered_output)"' results/benchmark_v1_run1/factuality_disinformation_harmful_content/Subjectivity_BLOOMZ_ZeroShot/summary.jsonl
Running list of assets for BLOOMZ that always output a single class (~tested with 30-50 samples)
assets/benchmark_v1/sentiment_emotion_others/StanceUnifiedFC_BLOOMZ_ZeroShot: "disagree"assets/benchmark_v1/factuality_disinformation_harmful_content/Subjectivity_BLOOMZ_ZeroShot.py: "OBJ"assets/benchmark_v1/demography/gender/GenderArapTweet_BLOOMZ_ZeroShot.py: "Female"Sample code to print
label predictionto see easilyjq '"\(.label) \(.filtered_output)"' results/benchmark_v1_run1/factuality_disinformation_harmful_content/Subjectivity_BLOOMZ_ZeroShot/summary.jsonl