[Feature] Support self hosted (Ollama/Openai compatible)

[roadkingvrod]

would be nice not to need to pay for ai when many of us host our own.

[kahwoo]

local_ai_support.patch like this?