Add Monitor conversations page for debounced scoring#2371
Open
anastasiaguspan wants to merge 6 commits intomainfrom
Open
Add Monitor conversations page for debounced scoring#2371anastasiaguspan wants to merge 6 commits intomainfrom
anastasiaguspan wants to merge 6 commits intomainfrom
Conversation
New how-to guide covering debounced scoring for grouped calls in multi-turn conversations and audio threads. Documents the Aggregation field, Aggregation method, and Timeout settings. Made-with: Cursor
anastasiaguspan
requested review from
mscavezze-cw
and removed request for
mscavezze-cw
Contributor
|
Preview deployment for your docs. Learn more about Mintlify Previews.
|
anastasiaguspan
force-pushed
the
monitor-conv-docs-1924
branch
from
4865b7c to
b6e26f7
Compare
Contributor
📚 Mintlify Preview Links✨ Added (1 total)📄 Pages (1)
📝 Changed (1 total)⚙️ Other (1)
🤖 Generated automatically when Mintlify deployment succeeds |
Contributor
🔗 Link Checker Results✅ All links are valid! No broken links were detected. Checked against: https://wb-21fd5541-monitor-conv-docs-1924.mintlify.app |
Capitalize Calls to match Weave terminology, remove cross-reference from monitors.mdx, and soften wording in timeout section. Made-with: Cursor
anastasiaguspan
force-pushed
the
monitor-conv-docs-1924
branch
from
b6e26f7 to
ca7e9d7
Compare
dbrian57
approved these changes
Mar 27, 2026
Contributor
dbrian57
left a comment
dbrian57
left a comment
There was a problem hiding this comment.
Minor nits inline. Looks good otherwise!
|
|
||
| For example, if your application uses OpenAI's Realtime APIs, each trace contains multiple `realtime.response` Calls. Debounced scoring waits for the conversation to go idle, then scores the relevant Calls as a group. | ||
|
|
||
| For general monitor setup, see [Set up monitors](/weave/guides/evaluation/monitors). |
Contributor
There was a problem hiding this comment.
Should we explicitly mention how debounced scoring differs from monitors in here somewhere? The doc doesn't mention monitoring at all up until this point, and it feels like we're randomly introducing a new concept here.
Co-authored-by: Dan Brian <daniel.brian@gmail.com>
Co-authored-by: Dan Brian <daniel.brian@gmail.com>
Co-authored-by: Dan Brian <daniel.brian@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Add a new page documenting debounced scoring for monitoring multi-turn conversations and audio threads in Weave. The page covers:
Also adds the new page to the nav in
docs.jsonunder "Monitor and collect feedback," after "Set up monitors."Testing
mint broken-links)Related issues
Made with Cursor