Skip to content
This repository was archived by the owner on Sep 26, 2025. It is now read-only.
This repository was archived by the owner on Sep 26, 2025. It is now read-only.

Implement tokenization/truncation endpoint #38

Description

@Oleksii-Klimov

Tokenization: for a given chat completion request return size in tokens.
Truncation: for a given chat chat completion prompt return message ids that remain in the history.
Corresponding endpoints should be added to the DIAL Core.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

  • Status
    No status

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions