Skip to content

docs(mcp): add full tool reference organized by category#107

Open
Yash1hi wants to merge 8 commits intomainfrom
add-sdk-tracing-docs
Open

docs(mcp): add full tool reference organized by category#107
Yash1hi wants to merge 8 commits intomainfrom
add-sdk-tracing-docs

Conversation

@Yash1hi
Copy link
Contributor

@Yash1hi Yash1hi commented Mar 17, 2026

Summary

  • Replaces the placeholder "Available Tools" blurb with a complete tool reference
  • Tools sourced directly from the live Scorecard MCP server
  • Organized into 10 collapsible accordion sections: Projects, Testsets, Testcases, Metrics, Runs, Records, Scores, Systems, Annotations, Docs
  • Each section contains a table with tool name and description
  • Notes that create_metrics/update_metrics support all 9 combos of eval type × output type

Test plan

  • Verify accordions render and expand correctly
  • Confirm tool names and descriptions match the live MCP server

- Merge simulation questions into Getting Started section
- Add coming soon tags for multi-turn conversations and enterprise environments
- Update Metrics references to Critic Agent Metrics
- Add Claude Agent SDK as first framework integration
- Condense from 8 to 5 questions with more bolding on key points
Updated the "Viewing simulation results" section to point users to the
Record's details page directly, replacing references to Scorecard Run.
Merge main's improved eval description and new agent improvement
accordion while preserving branch's Record terminology and Claude
Agent SDK framework integration.
Add new features/sdk-tracing.mdx page documenting how to combine
runAndEvaluate() with OpenTelemetry traces via otelLinkId. Includes
tested code examples for Claude Agent SDK (TypeScript + Python) and
SDK wrappers (Python with manual otel_link_id).

Also adds "Where to go next" links at the end of SDK quickstart and
tracing quickstart pointing to each other and the new page.
Rewrites the MCP docs to be more concise and actionable, adds a
dedicated Claude Code setup section, and includes a screenshot
showing the ~45 available MCP server tools.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant