Skip to content

[Console] Deduplicate Flink/Spark HTTP watcher polling per application #4386

Description

@shangeyao

Problem

FlinkAppHttpWatcher and SparkAppHttpWatcher schedule polling every 1 second and submit a new executor task for each app on every tick, even when the previous poll has not finished. This causes redundant REST calls and thread pool pressure.

Proposed solution

  • Track in-flight watch tasks per application with AtomicBoolean single-flight guard
  • Skip scheduling when a watch is already running
  • Clean up in-flight markers when an app is removed from the watch list

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions