Skip to content

Stabilize nightly cluster stop/resume integration test timing#1281

Draft
essiembre with Copilot wants to merge 2 commits into
mainfrom
copilot/fix-integration-test-suite-failure-again
Draft

Stabilize nightly cluster stop/resume integration test timing#1281
essiembre with Copilot wants to merge 2 commits into
mainfrom
copilot/fix-integration-test-suite-failure-again

Conversation

Copilot AI commented Jun 29, 2026

Copy link
Copy Markdown
Contributor

The nightly integration suite was failing intermittently in ClusterScenarioIT.stopResumeCompletes because the stop signal could occur after the first run had effectively completed, causing resume assertions to compare against a new crawl session. This change tightens the scenario so stop/resume is exercised during true partial progress.

  • Failure mode addressed

    • stopResumeCompletes expected session continuity on resume, but occasionally observed a new crawlSessionId when first run progressed too far before stop.
  • Targeted test hardening

    • Increased first-run mock fetch delay in this scenario (100ms250ms) to widen the interruption window.
    • Tightened partial-progress gate before issuing stop:
      • from “some progress but not complete”
      • to “some progress and still below half of total refs”
  • Scope

    • Single-file test-only change in:
      • crawler/core/src/test/java/com/norconex/crawler/core/cluster/ClusterScenarioIT.java
baseConfig(numOfRefs, 250).accept(cfg);

return imported > 0
        && imported < (numOfRefs / 2);

Copilot AI changed the title [WIP] Fix failing GitHub Actions job Integration Test Suite (Nightly) Stabilize nightly cluster stop/resume integration test timing Jun 29, 2026
Copilot AI requested a review from essiembre June 29, 2026 20:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants