Skip to content

Is there a way to get GenerateResponse full json when calling sagemaker endpoints #32

@nth-attempt

Description

@nth-attempt

The schema here (https://huggingface.github.io/text-generation-inference/#/Text%20Generation%20Inference/generate) shows the response contains details and generated_text. Currently, the output response from the sagemaker endpoints only return generated_text. Is there a way to get the full output json in the response to a sagemaker endpoint request?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions