Skip to content

Add ray to SageMaker Distribution v4.3#1254

Merged
TRNWWZ merged 1 commit into
aws:mainfrom
HariniNarayanan:add-ray-package
Jul 7, 2026
Merged

Add ray to SageMaker Distribution v4.3#1254
TRNWWZ merged 1 commit into
aws:mainfrom
HariniNarayanan:add-ray-package

Conversation

@HariniNarayanan

@HariniNarayanan HariniNarayanan commented Jul 7, 2026

Copy link
Copy Markdown

What

Add ray (ray-default) as an explicit top-level dependency of SageMaker Distribution v4.3, for both CPU and GPU images.

Today ray is only present transitively (pulled in by autogluon). This promotes it to a first-class, version-tracked package so it stays in the image on its own.

How

  • Add conda-forge::ray-default[version='>=2.53.0,<3.0.0'] to cpu.additional_packages_env.in and gpu.additional_packages_env.in under build_artifacts/v4/v4.3/v4.3.0/.
  • Add test/test_artifacts/v4/ray.test.Dockerfile (imports ray and runs ray.init(local_mode=True)), registered in the CPU and GPU lists in test/test_dockerfile_based_harness.py.

The floor is pinned to >=2.53.0 because autogluon 1.5.0 (already in the image) requires ray-default <2.54, so 2.53.0 is the current compatible version; anything higher fails to solve. <3.0.0 caps at the next major.

Per CONTRIBUTING.md step 8, only the additional_packages_env.in files and test files are included; env.in/env.out/Dockerfile are regenerated by maintainers/CI.

Testing

Built both images locally end-to-end via python ./src/main.py build --target-patch-version=4.3.0:

  • CPU image built successfully (4.3.0-cpu); env.out resolves ray-default-2.53.0.
  • GPU image built successfully (4.3.0-gpu).

The environment solves cleanly with ray-default promoted to a top-level dependency, co-existing with autogluon at the compatible 2.53.0.

@HariniNarayanan HariniNarayanan requested a review from a team as a code owner July 7, 2026 17:56
Add ray (ray-default) as an explicit top-level dependency for the cpu
and gpu environments in v4.3. ray is currently present only transitively
(via autogluon); this promotes it to a first-class, version-tracked
package. Pinned >=2.53.0,<3.0.0 to stay within autogluon's supported ray
range (autogluon 1.5.0 caps ray-default < 2.54) while allowing minor/
patch upgrades.

Also adds a test Dockerfile validating ray import + local-mode init,
registered in test_dockerfile_based_harness.py for both cpu and gpu.
@TRNWWZ TRNWWZ merged commit b17d3a5 into aws:main Jul 7, 2026
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants