Skip to content

Upgrading cyclecloud-slurm cluster definitions #537

Description

@felixschurk

Hei,
once more, I have some issues when trying to update a cluster to use the latest cyclecloud-slurm definition.
My workflow is as follow (as I did not find better documentation).

I upload the files into my cyclecloud locker using first:

cyclecloud project fetch https://github.com/Azure/cyclecloud-slurm/releases/4.0.9/ ~/tmp
cd ~/tmp
cyclecloud project upload

so the project with the corresponding binaries is online in the locker. I verified that and can see it.

As a next step I would like to create a new cluster definition, hence I download the slurm.txt from the tag and try to import into a new cluster using

cyclecloud import_cluster dev -c Slurm -f slurm.txt -p params.json

where params.json are files from the current cluster.

Starting the cluster then fails with some error regarding the health agent.

root@slurm-test-v408-scheduler:/opt/cycle/jetpack/run/commands# ./slurm_configure_fwd4iqc0.sh Executing cluster-init script: /mnt/cluster-init/slurm/scheduler/scripts/00-install.sh, output written to /opt/cycle/jetpack/logs/cluster-init/slurm/scheduler/scripts/00-install.sh.out Found Python at /usr/bin/python3.11 Verified /usr/bin/python3.11 is >= 3.11 (found 3.11.0rc1) An error occured during installation. See log file /var/log/azure-slurm-install.log for details. 2026-07-07 15:19:02,931 ERROR: An error occured during installation. Traceback (most recent call last): File "/opt/cycle/jetpack/system/bootstrap/azure-slurm-install/install.py", line 1178, in <module> main() File "/opt/cycle/jetpack/system/bootstrap/azure-slurm-install/install.py", line 1156, in main complete_install(settings) File "/opt/cycle/jetpack/system/bootstrap/azure-slurm-install/install.py", line 484, in complete_install _complete_install_primary(s) File "/opt/cycle/jetpack/system/bootstrap/azure-slurm-install/install.py", line 527, in _complete_install_primary ilib.copy_file("/etc/healthagent/prolog.sh.example", prolog_program, owner="root", group="root", mode=755) File "/opt/cycle/jetpack/system/bootstrap/azure-slurm-install/installlib.py", line 148, in copy_file shutil.copyfile(src=source, dst=dest) File "/usr/lib/python3.11/shutil.py", line 256, in copyfile with open(src, 'rb') as fsrc: ^^^^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/etc/healthagent/prolog.sh.example'

So I am really wondering where my problem is here or if there is a file missing in the upload?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions