Skip to content

Fix CI failure with tokenizers 0.23.2 - #286

Merged
Anush008 merged 2 commits into
dependabot/cargo/tokenizers-0.23.2from
copilot/fix-github-actions-job-failure
Sep 7, 2026
Merged

Fix CI failure with tokenizers 0.23.2#286
Anush008 merged 2 commits into
dependabot/cargo/tokenizers-0.23.2from
copilot/fix-github-actions-job-failure

Handle tokenizers special token errors

feddf7c
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Analyze (actions)
succeeded Sep 7, 2026 in 33s