Skip to content

Make rapidsmpf py_executor thread pool size configurable#21446

Merged
rapids-bot[bot] merged 1 commit intorapidsai:mainfrom
TomAugspurger:tom/cudf-polars-py-executor
Feb 13, 2026
Merged

Make rapidsmpf py_executor thread pool size configurable#21446
rapids-bot[bot] merged 1 commit intorapidsai:mainfrom
TomAugspurger:tom/cudf-polars-py-executor

Conversation

@TomAugspurger
Copy link
Copy Markdown
Contributor

Description

This adds a new configuration option to control the size of the ThreadPoolExecutor used as rapidsmpf's py_executor.

This pairs with rapidsai/rapidsmpf#858, which starts using the user-provided py_executor for asyncio.to_thread calls.

This adds a new configuration option to control the number of threads
passed to the ThreadPoolExecutor used as rapidsmpf's `py_executor`.

This pairs with rapidsai/rapidsmpf#858,
which starts using the user-provided `py_executor` for
`asyncio.to_thread` calls.
@copy-pr-bot
Copy link
Copy Markdown

copy-pr-bot bot commented Feb 13, 2026

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@github-actions github-actions bot added Python Affects Python cuDF API. cudf-polars Issues specific to cudf-polars labels Feb 13, 2026
@GPUtester GPUtester moved this to In Progress in cuDF Python Feb 13, 2026
@TomAugspurger TomAugspurger added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Feb 13, 2026
@TomAugspurger TomAugspurger marked this pull request as ready for review February 13, 2026 20:24
@TomAugspurger TomAugspurger requested a review from a team as a code owner February 13, 2026 20:24
Comment thread python/cudf_polars/cudf_polars/experimental/rapidsmpf/core.py
@TomAugspurger
Copy link
Copy Markdown
Contributor Author

/merge

Copy link
Copy Markdown
Member

@pentschev pentschev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks Tom.

@rapids-bot rapids-bot bot merged commit e618030 into rapidsai:main Feb 13, 2026
110 checks passed
@github-project-automation github-project-automation bot moved this from In Progress to Done in cuDF Python Feb 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cudf-polars Issues specific to cudf-polars improvement Improvement / enhancement to an existing function non-breaking Non-breaking change Python Affects Python cuDF API.

Projects

Archived in project

Development

Successfully merging this pull request may close these issues.

4 participants