Skip to content

Remove tests which check that model output contains the right keys #312

Description

@r-ash

These fail and need to be updated in multiple places whenever we change the model config. See #310 (comment) for a discussion.

I wonder if instead we could

  1. Add some "common" tests which run each of the language implementations, and run every model variant exported by each language. This would extend the existing "model-output-equality.yaml" GitHub action
  2. Add a test in here which reads the config and checks that all "outputs" are exported from the model. That way we won't ever have to manually update it

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions