Skip to content

Expose used token information after compaction #1012

@DonJayamanne

Description

@DonJayamanne

Today we get the used token information after messages,
& the SDK also exposes an API to compact conversations.
However once conversation is compacted, we do not get any details of the current (post compaction) token usage.

Suggestion is to expose this information so we know how much context window is available after compaction

Metadata

Metadata

Assignees

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions