Objective
I think that user profile info is not currently used by the app for anything. Ideally it should be used to improve responses.
Maybe for smaller LLMs this could be accomplished by having the orchestrator consider whether any profile info is relevant to the current query and add it to context if so. For the largest models the entire user profile info could simply be added to every query it is potentially relevant for.
Initial Implementation Requirements
Other Considerations
- We may want to change the user profile info which is gathered.
Objective
I think that user profile info is not currently used by the app for anything. Ideally it should be used to improve responses.
Maybe for smaller LLMs this could be accomplished by having the orchestrator consider whether any profile info is relevant to the current query and add it to context if so. For the largest models the entire user profile info could simply be added to every query it is potentially relevant for.
Initial Implementation Requirements
Other Considerations