Skip to content
This repository was archived by the owner on May 10, 2026. It is now read-only.

test(e2e): add SDK-based proxy compatibility tests#141

Open
if414013 wants to merge 1 commit into
mainfrom
feat/sdk-e2e-proxy-tests
Open

test(e2e): add SDK-based proxy compatibility tests#141
if414013 wants to merge 1 commit into
mainfrom
feat/sdk-e2e-proxy-tests

Conversation

@if414013
Copy link
Copy Markdown
Owner

Summary

  • Add 8 new E2E test spec files using official OpenAI and Anthropic TypeScript SDKs to validate proxy protocol compatibility
  • Add sdk-clients.ts helper with factory functions for both SDK clients
  • Add openai and @anthropic-ai/sdk as dev dependencies

Test Coverage (8 spec files, 35 tests)

Spec File Tests Protocol
sdk-openai-chat 5 OpenAI non-streaming
sdk-openai-streaming 4 OpenAI SSE streaming
sdk-anthropic-chat 5 Anthropic non-streaming
sdk-anthropic-streaming 3 Anthropic SSE streaming
sdk-models 5 Model listing + alias resolution
sdk-error-handling 6 Auth errors, bad requests, invalid models
sdk-tool-use 4 Tool call acceptance + round-trip (both SDKs)
sdk-extended-thinking 3 reasoning_effort + thinking parameter acceptance

Test plan

  • Run cd e2e-tests && npm test against a live gateway with valid API key
  • Verify SDK clients connect and authenticate correctly
  • Confirm streaming tests collect events with correct invariants
  • Verify tool-use round-trip tests handle non-deterministic model behavior gracefully (skip if model doesn't call tool)

🤖 Generated with Claude Code

Add 35 Playwright tests using official OpenAI and Anthropic TypeScript
SDKs to validate proxy protocol compatibility. Tests cover non-streaming,
streaming, model alias resolution, error handling, tool acceptance, and
thinking parameter acceptance.

Co-Authored-By: Claude <noreply@anthropic.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant