Hello there
I see you support Ollama and OpenWebUI.
From transparency and simplicity point of view, I would love to be able to utilize plain llama.cpp, as it's the most transparent way of utilizing LLM for me. Ollama is a bit obscure to me (it's just a UI for llama.cpp) and OpenWebUI has loads of features, which reduces transparency as well.
Llama.cpp on the other hands is bare bones, which serves exactly what's necessary and is OAI compliant.
I would assume therefore, that it should be rather simple to add, together with and without an API key.
https://github.com/ggml-org/llama.cpp
Please consider and if I could be of any help, just let me know. However, I'm no programmer, rather a scripter ;)
Cheers
Hello there
I see you support Ollama and OpenWebUI.
From transparency and simplicity point of view, I would love to be able to utilize plain llama.cpp, as it's the most transparent way of utilizing LLM for me. Ollama is a bit obscure to me (it's just a UI for llama.cpp) and OpenWebUI has loads of features, which reduces transparency as well.
Llama.cpp on the other hands is bare bones, which serves exactly what's necessary and is OAI compliant.
I would assume therefore, that it should be rather simple to add, together with and without an API key.
https://github.com/ggml-org/llama.cpp
Please consider and if I could be of any help, just let me know. However, I'm no programmer, rather a scripter ;)
Cheers