Skip to content

[codex] Keep Vertex streams open during idle periods#2

Merged
prasadus92 merged 1 commit into
mainfrom
codex/vertex-streaming-timeouts
May 9, 2026
Merged

[codex] Keep Vertex streams open during idle periods#2
prasadus92 merged 1 commit into
mainfrom
codex/vertex-streaming-timeouts

Conversation

@prasadus92
Copy link
Copy Markdown
Owner

Summary

Fixes the local Vertex proxy streaming path so long Vertex responses do not get cut off during idle periods.

Changes:

  • adds a separate no-read-timeout HTTPX timeout for streaming requests
  • returns structured SSE error events for upstream stream failures
  • drains upstream HTTP error bodies instead of raising inside the generator
  • documents the incomplete-chunked-read troubleshooting path
  • adds regression coverage for streaming read timeouts

Why

Hermes saw RemoteProtocolError / incomplete chunked reads when the proxy hit an upstream httpx.ReadTimeout mid-stream. That closed the response abruptly and made the client see a broken chunked response instead of a clean model error.

Validation

  • .venv/bin/pytest -q -> 20 passed
  • .venv/bin/ruff check .
  • git diff --check
  • curl -fsS http://127.0.0.1:8787/health -> healthy against project luminik-459117

Operational note

The local launchd service was restarted and is currently healthy on 127.0.0.1:8787.

@prasadus92 prasadus92 marked this pull request as ready for review May 9, 2026 12:09
@prasadus92 prasadus92 merged commit 6ca8d37 into main May 9, 2026
2 checks passed
@prasadus92 prasadus92 deleted the codex/vertex-streaming-timeouts branch May 9, 2026 12:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant