You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
My 2 spark is connect on interface enp1s0f1np1 but it try to use enp1s0f0np0 which is not in use, after look in the start.sh it set to use rocep1s0f0 "FABRIC_HCA=${FABRIC_HCA:-rocep1s0f0}", maybe a notification should be add to inform user to change the parameter if needed
Thanks for the report, @HKMist. You were right: start.sh assumed the cable was on the first port.
Fixed in #45. start.sh now finds the fabric port on each Spark by itself:
it looks for RoCE ports whose link is up and that have an IPv4 address;
it picks the pair on the same subnet, which is the cable between your two Sparks;
it prints the choice before starting. For your setup, expect something like:
== fabric: rocep1s0f1 (enp1s0f1np1, <address>) here, rocep1s0f1 (enp1s0f1np1, <address>) on <worker>; set FABRIC_HCA in .env to choose another port
To get it, run git pull and then ./start.sh. The image is unchanged, so nothing new is downloaded or built.
If you had already set FABRIC_HCA=rocep1s0f1 in .env to work around it, that still works and still overrides the detection. If the detection picks the wrong port, please let us know here.
Activity
data-angel commentedon Oct 12, 2026
Thanks for the report, @HKMist. You were right:
start.shassumed the cable was on the first port.Fixed in #45.
start.shnow finds the fabric port on each Spark by itself:To get it, run
git pulland then./start.sh. The image is unchanged, so nothing new is downloaded or built.If you had already set
FABRIC_HCA=rocep1s0f1in.envto work around it, that still works and still overrides the detection. If the detection picks the wrong port, please let us know here.