Skip to content

Support per-node RDMA ports and reject ambiguous fabric discovery - #66

Merged
data-angel merged 1 commit into
mainfrom
fix/per-node-fabric-20261013
Oct 13, 2026
Merged

data-angel merged 1 commit into
mainfrom
fix/per-node-fabric-20261013

Conversation

@data-angel

Copy link
Copy Markdown
Contributor

Distributed launches now use explicit per-node RDMA devices and socket interfaces. Ambiguous discovery fails before any model or container changes; explicit rail lists remain exact, including asymmetric device names.

Validation: focused regression tests and static checks passed. Both existing port-1 rails between the second Spark pair passed bounded RDMA transfers; updated SparkGLM and SparkQwen launchers accepted the explicit rails and rejected ambiguous discovery and the backchannel. Existing first-pair containers were unchanged.

The Atlas GLM recipe consumes cluster.nodes[nodeId].fabricHca; NVIDIA Sync refresh preserves explicit node overrides.

@data-angel
data-angel merged commit 3ad7ce7 into main Oct 13, 2026
2 checks passed
@data-angel
data-angel deleted the fix/per-node-fabric-20261013 branch October 13, 2026 07:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant