Skip to content

DOCA Update for Slurm Custom Image #107

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
youngjeong46 wants to merge 1 commit into
base: main
Choose a base branch
from
Open

DOCA Update for Slurm Custom Image #107

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion slurm-custom-image/group_vars/all.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +1 @@
linux_arch: "{{ {'x86_64': 'amd64', 'aarch64': 'arm64'}[ansible_architecture] | default(ansible_architecture) }}"
linux_arch: "{{ {'x86_64': 'amd64', 'aarch64': 'arm64'}[ansible_facts['architecture']] | default(ansible_facts['architecture']) }}"
8 changes: 1 addition & 7 deletions slurm-custom-image/roles/ompi/tasks/main.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,17 +4,11 @@
state: directory
mode: '755'

- name: Set HPC-X variables based on architecture
ansible.builtin.set_fact:
hpcx_version: "{{ (ansible_architecture == 'x86_64') | ternary(hpcx_version_mlnx, hpcx_version_doca) }}"
ofed_distro: "{{ (ansible_architecture == 'x86_64') | ternary(ofed_distro_mlnx, ofed_distro_doca) }}"
cuda_version: "{{ (ansible_architecture == 'x86_64') | ternary(cuda_version_mlnx, cuda_version_doca) }}"

- name: Download HPCX archive
vars:
distribution_with_version: "{{ (ansible_facts['distribution'] | lower) + ansible_facts['distribution_version'] }}"
ansible.builtin.get_url:
url: https://content.mellanox.com/hpc/hpc-x/{{ hpcx_version }}/hpcx-{{ hpcx_version }}-gcc-{{ ofed_distro }}-{{ distribution_with_version }}-{{ cuda_version }}-{{ ansible_architecture }}.tbz
url: https://content.mellanox.com/hpc/hpc-x/{{ hpcx_version }}_{{ cuda_version }}/hpcx-{{ hpcx_version }}-gcc-{{ ofed_distro }}-{{ distribution_with_version }}-{{ cuda_version }}-{{ ansible_facts['architecture'] }}.tbz
dest: /opt/hpcx.tbz
mode: '755'

Expand Down
12 changes: 3 additions & 9 deletions slurm-custom-image/roles/ompi/vars/main.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,9 +1,3 @@
## Mellanox
hpcx_version_mlnx: v2.20
ofed_distro_mlnx: mlnx_ofed
cuda_version_mlnx: cuda12

## DOCA
hpcx_version_doca: v2.21.3
ofed_distro_doca: doca_ofed
cuda_version_doca: cuda12
hpcx_version: v2.25.1
ofed_distro: doca_ofed
cuda_version: cuda13
Loading