Add a gRPC wire beside the websocket for inference sessions - #728

Open

v-positronic wants to merge 48 commits into

mainfrom

Commits on Sep 10, 2026

Add a gRPC wire beside the websocket for inference sessions
v-positronic
committed
cd048df
Open the endpoint-description line on its subject
v-positronic
committed
c2487b3
Tighten two comments the writing gate named
v-positronic
committed
deba93f
Bracket an IPv6 host in the address the gRPC wire binds
v-positronic
committed
b73a933
Pin the frame ceiling for both wires, and close a connection the handshake refuses
v-positronic
committed
4ab68e4
Carry a gRPC session through a TLS edge and a front's idle close
v-positronic
committed
be5921e
Add a wire-only stub server for measuring a session's transport
v-positronic
committed
6155128
Serve both wires from a Nebius endpoint, and say what its front does
v-positronic
committed
f6028f2
Say the front's contract once, where the README already holds it
v-positronic
committed
58292e4
Put the subject first in two sentences about the TLS edge
v-positronic
committed
a5aa9aa
Read a TLS edge no client can use as permanent, and expose the port asked for
v-positronic
committed
859fecd
State the ping defaults without counting them first
v-positronic
committed
9904200
Say why the websocket is not shaped, rather than closing on the sound of it
v-positronic
committed
267a3a9
Leave the front's idle close to the README, and name the constant's job
v-positronic
committed
cc26f7d
Refuse a closed gRPC session, and drop the credentials alias
v-positronic
committed
4e9fa75
State the session-param constraint without weighing the alternative
v-positronic
committed
bb1d888
Refuse a send into an ended stream, and pin the websocket's own ceiling
v-positronic
committed
b4bc5da
Name the subject first in two comments about an ended session
v-positronic
committed
f871822
Keep the connect refusal probe inside one attempt's budget
v-positronic
committed
3b24ad7
Type the URL scheme a session opens on
v-positronic
committed
d93e06a
Name the websocket port once in the serve script
v-positronic
committed
931109a
Name a remote session for what it is, not for one wire it can take
v-positronic
committed
3c26716
Name the compress-images metadata key once in its test
v-positronic
committed
030eba2
Cover the close report on both wires, and place two helpers above their callers
v-positronic
committed
deffec0
Hold a test server's websocket port from the draw to the serve
v-positronic
committed
f710044
Keep a short open timeout usable, and bind the gRPC test wire on any free port
v-positronic
committed
4907e2e
Say the port rule without listing the TLS schemes
v-positronic
committed
569d4dc
Say which port the serve script fixes and which the caller names
v-positronic
committed
eb26d62
List the gRPC schemes where the eval docs name what a policy URL takes
v-positronic
committed
0b9ab74
Name the session protocol rather than one of its wires in the eval docs
v-positronic
committed
c84de5c

Commits on Sep 11, 2026

Commits on Sep 12, 2026

Move the websocket wire into its own module
v-positronic
committed
811c04c
Cut the comments and docs of the wires to what holds
v-positronic
committed
da23946
Cut two client comments to two lines and give `serve.sh` a usage block
v-positronic
committed
816cdc0
State the README's protocol claims as facts
v-positronic
committed
c01b1d3
Rename `UNUSABLE_EDGE_DETAILS` and cut the inherited docstrings to what holds
v-positronic
committed
1a9a9d1
State where the served model's values are named
v-positronic
committed
c9e66e2
Raise a wire-neutral refusal from each wire's dial
v-positronic
committed
9738f0c
Report a lost peer when a status ends a started gRPC session
v-positronic
committed
0f3f5b4
Log an unexpected error delivery failure at ERROR
v-positronic
committed
b884a13
Serve both wires in the offboard docs
v-positronic
committed
735741f
Refuse to serve with no wire
v-positronic
committed
86dbe97
Say that an endpoint serves two wires
v-positronic
committed
6586b98