v1.5.0

[chonknick]

✨ Highlights

• This version removes support for Py3.9, and adds support for Py3.13.
• Added a RowTokenizer to chunk tables based on row values, thanks to @chonk-lain.
• Parameter hints now pass through from their original object to the pipelines, thanks to @akx!
• Multiple bug fixes and patches!

What's Changed

• Fix broken pricing link by @shreyash-chonkie in Fix broken pricing link #389
• Feat: Add Pipeline to the cloud client + Add Docs Pages by @chonknick in Feat: Add Pipeline to the cloud client + Add Docs Pages #390
• Fix: Add update flow if the pipeline already exists on the run() by @chonknick in Fix: Add update flow if the pipeline already exists on the run() #391
• fix(slumber): preserve spaces in chunk concatenation by @kiendoantrung in fix(slumber): preserve spaces in chunk concatenation #381
• chore: update geminie geinie default parameters by @chonk-lain in chore: update geminie geinie default parameters #393
• Add support for custom Chonkie tokenizer instances by @chonknick in Add support for custom Chonkie tokenizer instances #396
• Feat: Add ByteTokenizer by @chonknick in Feat: Add ByteTokenizer #397
• Docs: Add byte-level tokenizer to documentation by @chonknick in Docs: Add byte-level tokenizer to documentation #398
• Fix: Add ability to wrap AutoTokenizer in another AutoTokenizer instance by @chonknick in Fix: Add ability to wrap AutoTokenizer in another AutoTokenizer instance #399
• Fix: Deprecate Py3.9 and add support for Py3.13! by @chonknick in Fix: Deprecate Py3.9 and add support for Py3.13! #320
• feat: add row based table chunker by @chonk-lain in feat: add row based table chunker #392
• Feat: Add Catsu embeddings support to Chonkie by @chonknick in Feat: Add Catsu embeddings support to Chonkie #402
• Fix: Pass-through original object type through pipeline registration functions by @akx in Fix: Pass-through original object type through pipeline registration functions #394

New Contributors

• @akx made their first contribution in Fix: Pass-through original object type through pipeline registration functions #394

Full Changelog: v1.4.2...v1.5.0

---

This discussion was created from the release v1.5.0.