[goosewobbler]

Description

• Every LLM provider now streams its response, and llm.options.timeout is an idle timeout: a request fails only when nothing arrives for that long, so a long response that keeps streaming is never cut off. Before, the timeout capped the whole response, so a large chunk with PR context hit it on all three retries (about 6.5 minutes on chore: release v0.42.0 #614's run) and came back ungrouped.
• Ollama parses the NDJSON stream. An error object mid-stream, or a stream that ends without done, fails retryably.
• OpenAI, openai-compatible and Anthropic stream through their SDKs, and fail retryably when the stream ends without a finish or stop reason.
• One place for it: BaseLLMProvider.withIdleTimeout runs each request under the idle timer, turns an abort into the timeout error (whatever the SDK then threw), and wraps other errors as <provider> error: …. The OpenAI, Anthropic and openai-compatible prefixes change from … API error: to that form.
• Retries are unchanged: a timeout now means a stall, and a stall is what retries are for.
• Live test: entries now carry PR bodies at the 2 KB cap (the first chunk is about 66 KB of entries), and calls run at the production timeout. A stall fails the live test instead of being skipped as an outage.
• The timeout description in the schema and docs is updated, and the troubleshooting entry is rewritten.

Related Issue(s)

None; seen in #614's notes run.

Type of Change

• feat — New feature
• fix — Bug fix
• docs — Documentation change
• refactor — Code refactoring
• test — Adding or updating tests
• chore — Maintenance, dependencies, tooling
• Breaking change — Requires major version bump

Scope

• @releasekit/version
• @releasekit/notes
• @releasekit/publish
• @releasekit/release
• @releasekit/config
• @releasekit/core
• CI / workflows
• Root / monorepo

Checklist

• Lint passes (pnpm lint)
• Tests pass (pnpm test)
• Typecheck passes (pnpm typecheck)
• Documentation updated (if applicable)
• Breaking changes noted in description

Testing Notes

• base.spec.ts tests the timer once: a request that keeps resetting never times out; a quiet one aborts as a retryable timeout with the abort as its cause; an abort wins over whatever the request then throws; other errors are wrapped with their cause; the timer is cleared; and bad timeouts (0, sub-millisecond, NaN, past the timer ceiling) are clamped. Making reset a no-op, dropping the clamp, or letting an LLMError win over the abort each fails it.
• Each provider tests that a slow but steady stream doesn't time out (its wiring of reset) and its own missing finish marker. Ollama also covers NDJSON split across reads, including multi-byte characters, and an error object mid-stream.
• The live test needs OLLAMA_API_KEY, so it runs in CI's Live Tests job on this PR. It passed on the earlier commits.
• The notes (486) and config unit suites, typecheck, schema:check and docs:check pass.

🤖 Generated with Claude Code

Confidence Score: 5/5

The PR appears safe to merge; no new actionable issues remain.

Summary

All four LLM providers now stream responses and use an idle timeout instead of a total request deadline.

• LLM providers stream complete answers and time out only when they stall.

Diagram

%%{init: {'theme': 'neutral'}}%%
flowchart LR
  A[Start provider request] --> B[Start idle timer]
  B --> C{Response activity}
  C -->|Data arrives| D[Reset idle timer]
  D --> C
  C -->|Response completes| E[Return result and clear timer]
  C -->|Timer expires| F[Abort request]
  F --> G[Return retryable timeout and clear timer]

Loading

_{Reviews (3) · Last reviewed commit: "refactor(notes): share the idle timeout ..." · Reviewed by Greptile}

[github-actions]

Standing release PR: #614 · v0.42.0 queued (4 packages) · open 82d 22h 42m · ✅ ready to merge

Release Preview — v0.41.2 → v0.41.3

Note: Labels on this PR are advisory in standing-pr mode. Bumps come from conventional commits in the standing PR; override by editing labels on the standing PR itself. Add release:immediate to bypass the standing PR and release this PR directly.

These changes will be added to the release PR (#614) when merged:

Changelog

monorepo 0.41.2 → 0.41.3

Changed

• share the idle timeout and error handling in the base provider (notes)

Fixed

• give a cut-off Ollama stream a cause (notes)
• stream LLM responses and time out only on a stall (notes)

All packages → 0.41.3 (sync versioning)

• @releasekit/version
• @releasekit/notes
• @releasekit/publish
• @releasekit/release

After merge — predicted release

No version escalation — this PR's changes will be included in the queued release without affecting the projected versions.

Package	Standing PR	This PR	After merge
monorepo	0.42.0	0.41.3	0.42.0

---

Updated automatically by ReleaseKit