Skip to content

implement dynamic chunking #2

@abrizu

Description

@abrizu

Need advanced chunking methods: Chunk size is dynamic depending on the content, and can overload the model if the chunk size is too large.
Use semantic chunking to chunk the data into smaller pieces based on semantic meaning.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions