Add Question tool#2980
Conversation
| Use when you need information from the user that you cannot determine on your own, and proceeding without it would risk doing the wrong thing or producing an incorrect result: | ||
| - The task is ambiguous and multiple valid interpretations exist | ||
| - A key decision depends on user preference (e.g. naming, style, approach) | ||
| - You are about to make a hard-to-reverse change and need confirmation of intent | ||
|
|
||
| Do not use for questions you can answer yourself by reading the codebase, documentation, or applying reasonable defaults. |
There was a problem hiding this comment.
None of these concerns is unique to this tool. General guidance on seeking user feedback should be left to the people training the LLM and to the user. As a user, I wouldn't want my expectations of the degree of autonomy in various situations to be overridden by this tool.
In essence, this tool is just a preferred UI for asking blocking questions, right? Approximately this?
<when_to_use>
When ending your turn of the conversation with a question,
pose it with this tool rather than as plain text.
</when_to_use>
There was a problem hiding this comment.
Depends on the model. I’m testing on a very weak model that needs guidance. But let’s try without overprompting. Agreed, we’ll probably only benefit from that on stronger models.
I took your text exactly as-is.
There was a problem hiding this comment.
I'm honored. To be clear, I haven't tested it.
|
Would it be difficult to number the multiple-choice options and accept a single-key answer, for example |
|
when I checked the code it looked like the wiring was already in place for that |
Thanks for checking. I don't see numbers in the screenshot; maybe it's old. |
Yes, that was already there, but the options themselves weren’t numbered in the UI. I added that, plus a hint at the bottom. |
vadiminshakov
force-pushed
the
feature/question
branch
from
ce3f5fc to
a00db6f
Compare
|
Isn't this a duplicate of #2579 ? For a "status update": in last chat with @meowgorithm I agreed that it would be better to make it offer 3 "modes" of asking question and that it would be integrated into the Text Area (instead of a full window overlay). I have just been incredibly busy at work and haven't had a chance to resume work. |
|
can you support multiple selection? like checkboxes |
added allow_multiple with checkboxes |
vadiminshakov
force-pushed
the
feature/question
branch
from
f300bb4 to
2099264
Compare
|
|
||
| <when_to_use> | ||
| When ending your turn of the conversation with a question, | ||
| pose it with this tool rather than as plain text. |
There was a problem hiding this comment.
Use this tool when you need to ask the user questions during execution.
This allows you to:
1. Gather user preferences or requirements.
2. Clarify ambiguous instructions.
3. Get decisions on implementation choices as you work.
4. Offer choices to the user about what direction to take.
| <usage_notes> | ||
| - question: The question to ask the user. Keep it concise and specific. | ||
| - options: An optional list of 1–4 suggested answers. The user may select one or type a custom answer instead. | ||
| - allow_multiple: Set to true when the user may select multiple provided options and/or add a custom free-text answer. |
There was a problem hiding this comment.
- If you recommend a specific option, make that the first option in the list and add "(Recommended)" at the end of the label.
There was a problem hiding this comment.
Good point, added
…mprove error handling
…ons and responses
… multiple selections
vadiminshakov
force-pushed
the
feature/question
branch
from
0170c2f to
fc081ff
Compare
|
the behavior of the cursor when the answer is long is weird, out of place |
Minor issue: the input field shifts relative to the cursor when the response is very long. I can fix it if there’s any interest from the maintainers, but it seems like they don’t really like this feature |
but I'm interested :) I have a fork with all these changes integrated |
|
apparently @taciturnaxolotl is working on this now |
|
@dcu yes: we're converging the thoughts around this and other PRs in #3069 (and @vadiminshakov, thanks for the good work in this one). Let's keep this open for the moment but focus our efforts there. We should be able to get the feature in pretty quickly at this point. |
7 participants
CONTRIBUTING.md.Add question tool. Now the dance with the model will be more coordinated.