[Feature]: Add OptimizerGroupKeeper to automatically maintain optimizer resources based on min-parallelism configuration

[davedwwang]

Description

Add OptimizerGroupKeeper to automatically maintain optimizer resources based on min-parallelism configuration

Use case/motivation

Currently, when users configure optimizer resources through the dashboard, there is no automatic mechanism to ensure the resource group always meets the minimum parallelism requirement. Users must manually monitor and create optimizers when resources fall below the expected level, which is inconvenient for production environments where automatic resource management is expected.

Describe the solution

Introduce OptimizerGroupKeeper, a background thread within DefaultOptimizingService that continuously monitors and automatically maintains optimizer resources for each resource group based on the min-parallelism configuration.

Subtasks

No response

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct