Use as backend for chat-style UI

[raine]

Could this be used as a backend also for a chat-style UI such as the one CopilotChat.nvim provides?

It allows you to interact with an LLM by asking questions about selected parts of code in the open buffer, and to easily apply suggestions as diffs to avoid manual copy-pasting between the chat and editor, as one might do when using ChatGPT in the browser. The issue with CopilotChat.nvim in particular though is that it's not backend agnostic, and only supports GitHub's Copilot.

Maybe this could be something for llm.nvim as well.

Quick demo of how it looks like:

copilotnvim.mov

[McPatate]

This is a big feature I want to add to llm-*! Haven't had the time yet though. Shouldn't be too hard to add it to llm-ls, I'm wondering what the config should look like though. Should we use the same model or a different one, etc.

I think the bigger bulk of the work is on the IDE client side.