Skip to content

ci: multi-transport SQL E2E (subprocess, http, unix) - #2

Merged
rustyconover merged 1 commit into
mainfrom
multi-transport-sql-ci
Jun 24, 2026
Merged

ci: multi-transport SQL E2E (subprocess, http, unix)#2
rustyconover merged 1 commit into
mainfrom
multi-transport-sql-ci

Conversation

@rustyconover

Copy link
Copy Markdown
Contributor

Parameterizes ci/run-integration.sh by TRANSPORT and expands the integration job into an os x transport matrix so the same test/sql/*.test suite runs over all three transports the vgi extension supports (subprocess, http, unix).

The bm25_search() and supported_languages() table functions pass over http unchanged (the Rust SDK drains producers fully in the init response — no externalized-cursor fix needed). Verified locally: all three GREEN (42/46/42 assertions).

🤖 Generated with Claude Code

Parameterize ci/run-integration.sh by TRANSPORT and expand the integration
job into an os x transport matrix. The same test/sql/*.test suite now runs
over all three transports the vgi extension supports, by varying only the
LOCATION the .test files ATTACH (VGI_TANTIVY_WORKER):

  subprocess  the stdio worker binary DuckDB spawns (current behavior)
  http        tantivy-worker --http (auto port, advertises PORT:<n>)
  unix        tantivy-worker --unix <sock> (advertises UNIX:<sock>)

For the http leg the script starts the worker out-of-band, discovers the
port from stdout, and the awk preprocessor injects a signed
INSTALL/LOAD httpfs after each LOAD vgi;. A fail-on-skip guard rejects the
silent auto-skip the sqllogictest runner applies to "HTTP"-containing
errors. Cleanup trap preserves the run's exit code.

No worker code changes: the bm25_search() and supported_languages() table
functions drain fully within the HTTP init response (the Rust SDK serves
producers with producer_batch_limit 0), so they run over HTTP unchanged —
no externalized-cursor fix required.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@rustyconover
rustyconover force-pushed the multi-transport-sql-ci branch from 9250efe to 8cee727 Compare June 24, 2026 01:11
@rustyconover
rustyconover merged commit eb408b3 into main Jun 24, 2026
8 checks passed
@rustyconover
rustyconover deleted the multi-transport-sql-ci branch June 24, 2026 01:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant