Research Planner/User Prompt Refinement Agent #27
moritz-baumgart
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Currently, a vague user prompt can lead to garbage results or to the agent using unsensible practices.
It sometimes even leads to complete failures, e.g., when no specific evaluation setup with train/val/test ratios is specified, the agent sometimes skips validation completely, which leads to failures in RecBole, because validation is required there.
We should add some kind of feedback loop before the current pipeline to enable the agent to elicit missing details from the user and to improve the starting user prompt.
Beta Was this translation helpful? Give feedback.
All reactions