Skip to content

[AMORO-4086] Add OptimizerGroupKeeper to automatically maintain optim…#4087

Open
davedwwang wants to merge 1 commit intoapache:masterfrom
davedwwang:feature_4086
Open

[AMORO-4086] Add OptimizerGroupKeeper to automatically maintain optim…#4087
davedwwang wants to merge 1 commit intoapache:masterfrom
davedwwang:feature_4086

Conversation

@davedwwang
Copy link
Contributor

Why are the changes needed?

Currently, when users configure optimizer resources through the dashboard, there is no automatic mechanism to ensure the resource group always meets the minimum parallelism requirement. Users must manually monitor and create optimizers when resources fall below the expected level, which is inconvenient for production environments where automatic resource management is expected.

Close #4086.

Brief change log

  • OptimizerGroupKeepingTask - Delayed task for tracking resource group keeping status
  • OptimizerGroupKeeper - Background thread extending AbstractKeeper for monitoring and maintaining optimizer resources
  • AbstractKeeper - Refactored common base class for both OptimizerKeeper and OptimizerGroupKeeper

How was this patch tested?

  • [ x] Add some test cases that check the changes thoroughly including negative and positive cases if possible

  • Add screenshots for manual tests if appropriate

  • [x ] Run test locally before making a pull request

Documentation

  • Does this pull request introduce a new feature? yes
  • If yes, how is the feature documented? docs

@github-actions github-actions bot added type:docs Improvements or additions to documentation module:ams-server Ams server module module:common labels Feb 14, 2026
…izer resources based on min-parallelism configuration
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

module:ams-server Ams server module module:common type:docs Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature]: Add OptimizerGroupKeeper to automatically maintain optimizer resources based on min-parallelism configuration

1 participant