Skip to content

Phase 4: Pipeline orchestrator with state transfer - #7

Merged
lonestarx1 merged 1 commit into
mainfrom
phase4
Feb 16, 2026
Merged

lonestarx1 merged 1 commit into
mainfrom
phase4

Conversation

@lonestarx1

Copy link
Copy Markdown
Owner

Summary

  • Pipeline (Linear) orchestrator — Sequential chain of agent stages with state ownership transfer, retry policies, error handling, input transforms, output validation, and progress reporting
  • Website documentation — Three new doc sections (Pipeline, Pipeline Stages, Retry & Error Handling) with pipeline trace span tree
  • Research Pipeline example — Three-stage research → analyze → summarize pipeline with retry and progress callbacks

What's Included

Go packages (pkg/orchestrator/pipeline/)

File Description
doc.go Package documentation
pipeline.go Pipeline, Stage, Config, Result, RetryPolicy, ErrorAction, ProgressFunc
pipeline_test.go 25 tests covering all features

Key Features

  • State ownership transfer — Integrates with memory/transfer package; previous stages lose access after handoff
  • Retry policies — Configurable max attempts and delay per stage
  • Error actions — Abort (stop pipeline) or Skip (continue with previous output)
  • Input transforms — Transform previous stage output before passing to agent
  • Output validation — Validate stage output before proceeding
  • Progress reporting — Callback after each stage completes
  • Timeouts & budgets — Per-stage and pipeline-level
  • Full tracing — pipeline.run and pipeline.stage spans with attributes

Test plan

  • go test -race ./... — all packages pass (25 new pipeline tests)
  • npm run build in website/ — static export succeeds
  • CI pipeline passes

Add pipeline (linear) orchestration pattern:
- Sequential stage execution with state ownership transfer via
  memory/transfer package
- Stage-level retry policies with configurable max attempts and delay
- Error actions: Abort (default) and Skip for non-critical stages
- Input transforms and output validation per stage
- Per-stage and pipeline-level timeouts and cost budgets
- Progress reporting via callback function
- Full tracing with pipeline.run and pipeline.stage spans
- 25 tests covering execution, state transfer, retry, error handling,
  timeouts, cost budgets, tracing, and progress reporting

Update website docs with Pipeline, Pipeline Stages, and Retry sections.
Add research pipeline example. Update README.
@vercel

vercel Bot commented Feb 16, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
gogrid Ready Ready Preview, Comment Feb 16, 2026 9:34am

@lonestarx1 lonestarx1 self-assigned this Feb 16, 2026
@lonestarx1
lonestarx1 merged commit b57eafc into main Feb 16, 2026
5 checks passed

This branch was successfully deployed

1 active deployment
Preview — af1649ff Deployed Feb 16, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant