Skip to content

BLOOM assets that seem to output the same class #113

@fdalvi

Description

@fdalvi

Running list of assets for BLOOMZ that always output a single class (~tested with 30-50 samples)

assets/benchmark_v1/sentiment_emotion_others/StanceUnifiedFC_BLOOMZ_ZeroShot: "disagree"
assets/benchmark_v1/factuality_disinformation_harmful_content/Subjectivity_BLOOMZ_ZeroShot.py: "OBJ"
assets/benchmark_v1/demography/gender/GenderArapTweet_BLOOMZ_ZeroShot.py: "Female"

Sample code to print label prediction to see easily

jq '"\(.label) \(.filtered_output)"' results/benchmark_v1_run1/factuality_disinformation_harmful_content/Subjectivity_BLOOMZ_ZeroShot/summary.jsonl

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions