Skip to content

Need a notification on using start.sh #44

Closed

Description

@HKMist

My 2 spark is connect on interface enp1s0f1np1 but it try to use enp1s0f0np0 which is not in use, after look in the start.sh it set to use rocep1s0f0 "FABRIC_HCA=${FABRIC_HCA:-rocep1s0f0}", maybe a notification should be add to inform user to change the parameter if needed

Activity

  1. data-angel commented on Oct 12, 2026

    @data-angel
    Contributor

    Thanks for the report, @HKMist. You were right: start.sh assumed the cable was on the first port.

    Fixed in #45. start.sh now finds the fabric port on each Spark by itself:

    • it looks for RoCE ports whose link is up and that have an IPv4 address;
    • it picks the pair on the same subnet, which is the cable between your two Sparks;
    • it prints the choice before starting. For your setup, expect something like:
    == fabric: rocep1s0f1 (enp1s0f1np1, <address>) here, rocep1s0f1 (enp1s0f1np1, <address>) on <worker>; set FABRIC_HCA in .env to choose another port
    

    To get it, run git pull and then ./start.sh. The image is unchanged, so nothing new is downloaded or built.

    If you had already set FABRIC_HCA=rocep1s0f1 in .env to work around it, that still works and still overrides the detection. If the detection picks the wrong port, please let us know here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions