Increasing the context length

[mcandru]

Currently, I have implemented a 15 message history. I have found that for longer conversations, particularly around a piece of long context e.g. an academic paper, it will lose the context of the paper pretty quickly after follow-up messages.

Some options are:

1. Just increase this limit, at the extra cost
2. Figure out a way to persist long context in the conversation
3. Increase the limit, and implement some kind of prompt caching to try and reduce costs/time
4. Add an @symbol, something like @full_context that will overwrite the 15 message limit if you need it
5. Add a user controllable /context_length command that allows you to set the limit, or unlimited context for a particular conversation

I kind of like (4) and (5) in the spirit of the tool, because sometimes you really don't need the full conversation context for what you're doing, but sometimes you do.