Skip to content

Fetch datasets from traces #10

@markpeterfejes

Description

@markpeterfejes

Feature Request: Generate datasets from execution traces

Description

Add CLI functionality to create datasets by extracting data from execution traces in the Orq platform.

Features

  • Query traces by various filters
  • Extract inputs/outputs from traces
  • Transform trace data into dataset format
  • Automatic labeling and annotation

Example Commands

orq datasets from-traces --filter "tag:production" --last 7d
orq datasets from-traces --deployment-id abc123 --sample 1000
orq datasets from-traces --query "error:true" --output errors-dataset.json

Use Cases

  • Create evaluation datasets from production data
  • Build test sets from real user interactions
  • Generate training data from successful executions

Package

@orq-ai/cli

This feature is part of the CLI roadmap.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions