Skip to content

Comments

chore(python): increase python timeout#6368

Draft
VianneyRuhlmann wants to merge 3 commits intomainfrom
vianney/enable-resource-renaming-test
Draft

chore(python): increase python timeout#6368
VianneyRuhlmann wants to merge 3 commits intomainfrom
vianney/enable-resource-renaming-test

Conversation

@VianneyRuhlmann
Copy link
Contributor

Motivation

The issue from APMSP-2359 has been fixed and the tests can be re-enabled. However due to stats being flushed every 10 seconds the test run in isolation is showing some flakiness.

Changes

  • Remove the bug decorator on ressource renaming stats test
  • Increase python library timeout to 10 seconds to wait for stats to be properly flushed

Workflow

  1. ⚠️ Create your PR as draft ⚠️
  2. Work on you PR until the CI passes
  3. Mark it as ready for review
    • Test logic is modified? -> Get a review from RFC owner.
    • Framework is modified, or non obvious usage of it -> get a review from R&P team

🚀 Once your PR is reviewed and the CI green, you can merge it!

🛟 #apm-shared-testing 🛟

Reviewer checklist

  • Anything but tests/ or manifests/ is modified ? I have the approval from R&P team
  • A docker base image is modified?
    • the relevant build-XXX-image label is present
  • A scenario is added, removed or renamed?

@github-actions
Copy link
Contributor

github-actions bot commented Feb 23, 2026

CODEOWNERS have been resolved as:

manifests/python.yml                                                    @DataDog/apm-python @DataDog/asm-python
utils/_context/_scenarios/endtoend.py                                   @DataDog/system-tests-core

@datadog-datadog-prod-us1-2
Copy link

datadog-datadog-prod-us1-2 bot commented Feb 23, 2026

⚠️ Tests

Fix all issues with BitsAI or with Cursor

⚠️ Warnings

❄️ 49 New flaky tests detected

tests.appsec.rasp.test_lfi.Test_Lfi_UrlQuery.test_lfi_get[vertx4] from system_tests_suite (Datadog) (Fix with Cursor)
AssertionError: assert 500 == 403
 +  where 500 = HttpResponse(status_code:500, headers:{'content-length': '21'}, text:Internal Server Error).status_code
 +    where HttpResponse(status_code:500, headers:{'content-length': '21'}, text:Internal Server Error) = <tests.appsec.rasp.test_lfi.Test_Lfi_UrlQuery object at 0x7f0dd06c5d90>.r

self = <tests.appsec.rasp.test_lfi.Test_Lfi_UrlQuery object at 0x7f0dd06c5d90>

    def test_lfi_get(self):
>       assert self.r.status_code == 403
E       AssertionError: assert 500 == 403
E        +  where 500 = HttpResponse(status_code:500, headers:{'content-length': '21'}, text:Internal Server Error).status_code
...
tests.debugger.test_debugger_pii.Test_Debugger_PII_Redaction_Excluded_Identifiers.test_pii_redaction_excluded_identifiers[poc] from system_tests_suite (Datadog) (Fix with Cursor)
KeyError: 'log170aa-acda-4453-9111-1478a600line'

self = <tests.debugger.test_debugger_pii.Test_Debugger_PII_Redaction_Excluded_Identifiers object at 0x7f343862d370>

    def test_pii_redaction_excluded_identifiers(self):
        excluded_identifiers = ["_2fa", "cookie", "sessionid"]
>       self._assert(excluded_identifiers, line_probe=True)

tests/debugger/test_debugger_pii.py:248: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
...
tests.test_profiling.Test_Profile.test_agent[apache-mod-7.1] from system_tests_suite (Datadog) (Fix with Cursor)
ValueError: No data has been observed on /api/v2/profile

self = <tests.test_profiling.Test_Profile object at 0x7f8f9ce9af90>

    def test_agent(self):
        """All profiling agent payload have recording-start and recording-end fields"""
>       interfaces.agent.validate_all(self._validate_data, path_filters="/api/v2/profile")

tests/test_profiling.py:46: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
...
View all

ℹ️ Info

🧪 All tests passed

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 46825ab | Docs | Datadog PR Page | Was this helpful? Give us feedback!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant