Synchronize with submitit Slurmexecutor python arg addition#2830
Open
berombau wants to merge 3 commits into
Open
Synchronize with submitit Slurmexecutor python arg addition#2830berombau wants to merge 3 commits into
berombau wants to merge 3 commits into
Conversation
|
This would be an amazing addition. I cannot use the Submitit plugin without it on our cluster. |
lauritsf
approved these changes
Dec 16, 2024
lauritsf
left a comment
There was a problem hiding this comment.
This contribution is of high value to people working on larger HPC clusters, where the preferred approach is to use singularity containers.
The naming and default match the existing init keys.
Collaborator
|
Thanks, I will fix this. |
omry
requested changes
Jun 10, 2026
omry
left a comment
Collaborator
There was a problem hiding this comment.
Thanks for the PR. This looks like a useful addition, but it needs a bit more before I can take it:
- Add tests covering the new
hydra.launcher.python/slurm_pythonbehavior. - Add a plugin news fragment for
hydra-submitit-launcher.
Please also make sure the implementation handles the Submitit version requirement cleanly, since Hydra currently allows older Submitit versions that may not support this constructor argument.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Motivation
Synchronizing with now merged submitit change (facebookincubator/submitit#1729) that allows to pass in a "python" variable to SlurmExecutor.
Have you read the Contributing Guidelines on pull requests?
Yes
Test Plan
This minimal added optional variable works for my setup.
Related Issues and PRs
The previous PR #2654 does the same, but the PR was closed before it could be merged.