Name and Version
ai-dial-rag
What is the problem this feature will solve?
I am aware that there is no 'hard' threshold to the file size we can chat with using RAG. The only threshold is the attachment file size limit of 500MB. However, since RAG uses high memory due to the fact that it performs semantic and keyword searches using embedded models.
What is the feature you are proposing to solve the problem?
To avoid performance issues during peak/business hours, is it possible to have a parameter allowing us to adjust or set the maximum file size limit that users can chat with?
What alternatives have you considered?
No response
Name and Version
ai-dial-rag
What is the problem this feature will solve?
I am aware that there is no 'hard' threshold to the file size we can chat with using RAG. The only threshold is the attachment file size limit of 500MB. However, since RAG uses high memory due to the fact that it performs semantic and keyword searches using embedded models.
What is the feature you are proposing to solve the problem?
To avoid performance issues during peak/business hours, is it possible to have a parameter allowing us to adjust or set the maximum file size limit that users can chat with?
What alternatives have you considered?
No response