Getting "I am not sure" in First Response

[kenleung-PW]

Hi,

End users of the Information Assistant in my organization occasionally reported that they got the "I am not sure" response after asking their first question in their browser sessions. After the first question, user asked the same question in the same session, and got a more appropriate and expected response.

Here is some info about my Information Assistant setup:

• Chat mode: "Work Only"
• Models: GPT-4o (2024-05-13) and text-embedding-ada-002 (version 2)
• Retrieve this many documents from search: 5
• Conversation Type: Balanced
• Secure Mode deployment

Questions

1. Is there a technical reason why this happened more frequently with the first question?
2. Is there any configurations in Information Assistant that can reduce the likelihood of this experience?
3. Do you have any suggestions on what we can add/edit to the system message in chatreadretrieveread.py to improve this?

Thank you.

[lon-tierney]

Thank you for sharing this issue you are seeing. Have you checked your logs to see if there are any errors happening?

Can you also please share the version you've deployed and any additional information about your deployment, such as if you've modified anything from the ask-shipped configuration (scaling, VM SKU, etc.)?