Skip to content

unicode: add custom splitter for k2-horizon pre-tokenizer - #3

Closed
mohitsoni48 wants to merge 1 commit into
ifm-ai:model/K2Horizonfrom
mohitsoni48:fix/k2-horizon-tokenizer-regex
Closed

unicode: add custom splitter for k2-horizon pre-tokenizer#3
mohitsoni48 wants to merge 1 commit into
ifm-ai:model/K2Horizonfrom
mohitsoni48:fix/k2-horizon-tokenizer-regex

Commits

  1. Commits on Sep 15, 2026