Repository navigation
Chatterui MTP Support #590
Unanswered
doctormajid7-ux
asked this question in
Q&A
Replies: 1 comment 1 reply
|
The underlying engine does have MTP support for models which have it built in, I just havent gotten around to implementing it on the frontend. |
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Hi, quick question: does ChatterUI currently support llama.cpp MTP (multi-token prediction / speculative decoding)? If yes, is it enabled automatically when using compatible models, or does it require manual flags in the settings or launch parameters?
All reactions