Skip to content

Add multi device perf monitoring and commenting PR report#3

Merged
akayiz merged 13 commits intomainfrom
gh-action-dev
Apr 16, 2026
Merged

Add multi device perf monitoring and commenting PR report#3
akayiz merged 13 commits intomainfrom
gh-action-dev

Conversation

@Dimitry-bit
Copy link
Copy Markdown

@Dimitry-bit Dimitry-bit commented Mar 25, 2026

No description provided.

@Dimitry-bit Dimitry-bit reopened this Mar 25, 2026
@Dimitry-bit Dimitry-bit reopened this Mar 25, 2026
@Dimitry-bit Dimitry-bit reopened this Mar 25, 2026
@Dimitry-bit Dimitry-bit reopened this Mar 25, 2026
@Dimitry-bit Dimitry-bit reopened this Mar 25, 2026
@Dimitry-bit Dimitry-bit reopened this Mar 25, 2026
@Dimitry-bit Dimitry-bit reopened this Mar 25, 2026
@github-actions
Copy link
Copy Markdown

github-actions bot commented Mar 25, 2026 •
edited by akayiz
Loading

Startup Benchmark

IMPROVEMENT ✅

  • Device (emu64xa):
    • Brand: google
    • Model: sdk_gphone64_x86_64
    • Cores: 2 @ 2000Hz
    • Memory: 3922MB
    • Type: Emulated

Metric 'Time to Initial Display' (TID):

  • Baseline Runs (ms): [1737.048, 1630.309, 1874.445, 1761.079, 2113.461, 1585.441, 1574.009, 1386.908, 1319.067, 1657.717]
  • Candidate Runs (ms): [1629.603, 1016.497, 991.257, 960.678, 910.227, 993.956, 1034.383, 1021.935, 983.202, 1028.479]
  • Change: [-6.19%, -37.65%, -47.12%, -45.45%, -56.93%, -37.31%, -34.28%, -26.32%, -25.46%, -37.96%]
  • Median: [1644.013, 1005.226] (-638.787 ~ -38.86%)
  • Method 'Mann-Whitney U-Test': IMPROVEMENT, p=0.000, threshold=0.01
  • Method 'Step Fit': NOT_SIGNIFICANT, fit=13.175, threshold=25.0

@Dimitry-bit Dimitry-bit reopened this Apr 13, 2026
@Dimitry-bit Dimitry-bit reopened this Apr 13, 2026
@Dimitry-bit Dimitry-bit force-pushed the gh-action-dev branch 2 times, most recently from a55d728 to ff41bb8 Compare April 13, 2026 08:58
@Dimitry-bit Dimitry-bit reopened this Apr 13, 2026
@Dimitry-bit Dimitry-bit reopened this Apr 13, 2026
@github-actions
Copy link
Copy Markdown

github-actions bot commented Apr 13, 2026

📊 Android Performance Analysis Report

🚀 Summary

MacroBenchmark Metric Status
StartupPrecompiledWithBaselineProfile App Launch Time ⚪ Insignificant

⌛ Benchmarks

  • StartupPrecompiledWithBaselineProfile

    Name: startupPrecompiledWithBaselineProfile
    Class: com.google.samples.apps.nowinandroid.startup.StartupBenchmark

    • Extra Execution Metadata
      Device Runtime (sec) Repeat Iterations Warmup Iterations
      emu64xa 37 - 36 2 - 2 0 - 0
      emu64xa_01 41 - 20 2 - 2 0 - 0
    • App Launch Time
      • Time to Initial Display (TID)

        Mann-Whitney U-Test (threshold = 0.010)

        Device Median Change (%) Statistic Status
        emu64xa 1267 ms vs 1252 ms -15 (-1%) =+0.333 ⚪ Insignificant
        emu64xa_01 1982 ms vs 1752 ms -229 (-12%) =+0.333 ⚪ Insignificant
        emu64xa 1860 ms vs 1449 ms -410 (-22%) =+0.167 ⚪ Insignificant

        Step Fit (threshold = 25.000)

        Device Median Change (%) Statistic Status
        emu64xa 1267 ms vs 1252 ms -15 (-1%) =+0.189 ⚪ Insignificant
        emu64xa_01 1982 ms vs 1752 ms -229 (-12%) =+3.739 ⚪ Insignificant
        emu64xa 1860 ms vs 1449 ms -410 (-22%) =+3.673 ⚪ Insignificant
        • 🗃️ Raw Runs
          • 📱 emu64xa
            Run Baseline Candidate Change
            0 1431 ms 1079 ms -25%
            1 1104 ms 1424 ms +29%
          • 📱 emu64xa_01
            Run Baseline Candidate Change
            0 2133 ms 1839 ms -14%
            1 1831 ms 1666 ms -9%
      • Time to Full Display (TFD)

        Mann-Whitney U-Test (threshold = 0.010)

        Device Median Change (%) Statistic Status
        emu64xa 2138 ms vs 1607 ms -531 (-25%) =+0.333 ⚪ Insignificant
        emu64xa_01 3230 ms vs 2378 ms -852 (-26%) =+0.167 ⚪ Insignificant
        emu64xa 2324 ms vs 1943 ms -380 (-16%) =+0.167 ⚪ Insignificant

        Step Fit (threshold = 25.000)

        Device Median Change (%) Statistic Status
        emu64xa 2138 ms vs 1607 ms -531 (-25%) =+2.697 ⚪ Insignificant
        emu64xa_01 3230 ms vs 2378 ms -852 (-26%) =+4.193 ⚪ Insignificant
        emu64xa 2324 ms vs 1943 ms -380 (-16%) =+9.910 ⚪ Insignificant
        • 🗃️ Raw Runs
          • 📱 emu64xa
            Run Baseline Candidate Change
            0 1666 ms 1310 ms -21%
            1 2610 ms 1903 ms -27%
          • 📱 emu64xa_01
            Run Baseline Candidate Change
            0 2673 ms 2518 ms -6%
            1 3788 ms 2239 ms -41%

📱 Device Specifications

Device Brand CPU Memory SDK
emu64xa google 2 @ 2000 Hz 2 MB 34 (REL)
emu64xa_01 google 2 @ 2000 Hz 3 MB 34 (REL)

@Dimitry-bit Dimitry-bit reopened this Apr 13, 2026
@github-actions
Copy link
Copy Markdown

github-actions bot commented Apr 13, 2026

📊 Android Performance Analysis Report

🚀 Summary

MacroBenchmark Metric Status
StartupPrecompiledWithBaselineProfile App Launch Time ⚪ Insignificant

⌛ Benchmarks

  • StartupPrecompiledWithBaselineProfile

    Name: startupPrecompiledWithBaselineProfile
    Class: com.google.samples.apps.nowinandroid.startup.StartupBenchmark

    • Extra Execution Metadata
      Device Runtime (sec) Repeat Iterations Warmup Iterations
      emu64xa 38 - 36 2 - 2 0 - 0
      emu64xa_01 40 - 20 2 - 2 0 - 0
      emu64xa_02 40 - 20 2 - 2 0 - 0
    • App Launch Time
      • Time to Initial Display (TID)

        Mann-Whitney U-Test (threshold = 0.010)

        Device Median Change (%) Statistic Status
        emu64xa 1424 ms vs 1391 ms -32 (-2%) =+0.667 ⚪ Insignificant
        emu64xa_01 1751 ms vs 1787 ms 36 (+2%) =+0.667 ⚪ Insignificant
        emu64xa_02 1860 ms vs 1634 ms -225 (-12%) =+0.167 ⚪ Insignificant

        Step Fit (threshold = 25.000)

        Device Median Change (%) Statistic Status
        emu64xa 1424 ms vs 1391 ms -32 (-2%) =+0.317 ⚪ Insignificant
        emu64xa_01 1751 ms vs 1787 ms 36 (+2%) =-0.379 ⚪ Insignificant
        emu64xa_02 1860 ms vs 1634 ms -225 (-12%) =+4.131 ⚪ Insignificant
        • 🗃️ Raw Runs
          • 📱 emu64xa
            Run Baseline Candidate Change
            0 1701 ms 1292 ms -24%
            1 1147 ms 1491 ms +30%
          • 📱 emu64xa_01
            Run Baseline Candidate Change
            0 2020 ms 1785 ms -12%
            1 1481 ms 1789 ms +21%
          • 📱 emu64xa_02
            Run Baseline Candidate Change
            0 1984 ms 1726 ms -13%
            1 1735 ms 1542 ms -11%
      • Time to Full Display (TFD)

        Mann-Whitney U-Test (threshold = 0.010)

        Device Median Change (%) Statistic Status
        emu64xa 2089 ms vs 1737 ms -352 (-17%) =+0.333 ⚪ Insignificant
        emu64xa_01 2932 ms vs 2403 ms -528 (-18%) =+0.167 ⚪ Insignificant
        emu64xa_02 2714 ms vs 2079 ms -634 (-23%) =+0.333 ⚪ Insignificant

        Step Fit (threshold = 25.000)

        Device Median Change (%) Statistic Status
        emu64xa 2089 ms vs 1737 ms -352 (-17%) =+2.814 ⚪ Insignificant
        emu64xa_01 2932 ms vs 2403 ms -528 (-18%) =+3.547 ⚪ Insignificant
        emu64xa_02 2714 ms vs 2079 ms -634 (-23%) =+3.364 ⚪ Insignificant
        • 🗃️ Raw Runs
          • 📱 emu64xa
            Run Baseline Candidate Change
            0 1846 ms 1480 ms -20%
            1 2333 ms 1994 ms -15%
          • 📱 emu64xa_01
            Run Baseline Candidate Change
            0 2515 ms 2466 ms -2%
            1 3349 ms 2340 ms -30%
          • 📱 emu64xa_02
            Run Baseline Candidate Change
            0 2196 ms 2207 ms +1%
            1 3232 ms 1951 ms -40%

📱 Device Specifications

Device Brand CPU Memory SDK
emu64xa google 2 @ 2000 Hz 2 GB 34 (REL)
emu64xa_01 google 2 @ 2000 Hz 3 GB 34 (REL)
emu64xa_02 google 2 @ 2000 Hz 2 GB 34 (REL)

@Dimitry-bit Dimitry-bit reopened this Apr 13, 2026
@Dimitry-bit Dimitry-bit reopened this Apr 13, 2026
@Dimitry-bit Dimitry-bit reopened this Apr 13, 2026
@github-actions
Copy link
Copy Markdown

github-actions bot commented Apr 13, 2026

📊 Android Performance Analysis Report

🔎 Summary

MacroBenchmark Metric Status
StartupPrecompiledWithBaselineProfile App Launch Time ⚪ Insignificant

⌛ Benchmarks

  • StartupPrecompiledWithBaselineProfile

    Name: startupPrecompiledWithBaselineProfile
    Class: com.google.samples.apps.nowinandroid.startup.StartupBenchmark

    • Extra Execution Metadata
      Device Runtime (sec) Repeat Iterations Warmup Iterations
      Nexus_4 37 - 36 2 - 2 0 - 0
      Nexus_6 26 - 41 2 - 2 0 - 0
      Pixel 41 - 37 2 - 2 0 - 0
    • App Launch Time
      • Time to Initial Display (TID)

        Mann-Whitney U-Test (threshold = 0.010)

        Device Median Change (%) Statistic Status
        Nexus_4 1681 ms vs 1178 ms -503 (-30%) p=+0.667 ⚪ Insignificant
        Nexus_6 2132 ms vs 2074 ms -58 (-3%) p=+0.333 ⚪ Insignificant
        Pixel 1911 ms vs 1301 ms -609 (-32%) p=+0.167 ⚪ Insignificant

        Step Fit (threshold = 25.000)

        Device Median Change (%) Statistic Status
        Nexus_4 1681 ms vs 1178 ms -503 (-30%) fit=+2.487 ⚪ Insignificant
        Nexus_6 2132 ms vs 2074 ms -58 (-3%) fit=+1.025 ⚪ Insignificant
        Pixel 1911 ms vs 1301 ms -609 (-32%) fit=+10.218 ⚪ Insignificant
        • 🗃️ Raw Runs
          • 📱 Nexus_4
            Run Baseline Candidate Change
            0 2252 ms 1230 ms -45%
            1 1111 ms 1125 ms +1%
          • 📱 Nexus_6
            Run Baseline Candidate Change
            0 2261 ms 2170 ms -4%
            1 2003 ms 1978 ms -1%
          • 📱 Pixel
            Run Baseline Candidate Change
            0 2055 ms 1390 ms -32%
            1 1768 ms 1213 ms -31%
      • Time to Full Display (TFD)

        Mann-Whitney U-Test (threshold = 0.010)

        Device Median Change (%) Statistic Status
        Nexus_4 2500 ms vs 1855 ms -644 (-26%) p=+0.167 ⚪ Insignificant
        Nexus_6 2752 ms vs 2798 ms 46 (+2%) p=+0.667 ⚪ Insignificant
        Pixel 2796 ms vs 2152 ms -643 (-23%) p=+0.333 ⚪ Insignificant

        Step Fit (threshold = 25.000)

        Device Median Change (%) Statistic Status
        Nexus_4 2500 ms vs 1855 ms -644 (-26%) fit=+3.797 ⚪ Insignificant
        Nexus_6 2752 ms vs 2798 ms 46 (+2%) fit=-0.693 ⚪ Insignificant
        Pixel 2796 ms vs 2152 ms -643 (-23%) fit=+2.624 ⚪ Insignificant
        • 🗃️ Raw Runs
          • 📱 Nexus_4
            Run Baseline Candidate Change
            0 2623 ms 1391 ms -47%
            1 2377 ms 2319 ms -2%
          • 📱 Nexus_6
            Run Baseline Candidate Change
            0 2930 ms 2734 ms -7%
            1 2573 ms 2862 ms +11%
          • 📱 Pixel
            Run Baseline Candidate Change
            0 2314 ms 1652 ms -29%
            1 3277 ms 2652 ms -19%

📱 Device Specifications

Device Brand CPU Memory SDK
Nexus_4 google 2-cores @ 2000 Hz 2 GB 34 (REL)
Nexus_6 google 2-cores @ 2000 Hz 3 GB 34 (REL)
Pixel google 2-cores @ 2000 Hz 2 GB 34 (REL)

@perfpulse
Copy link
Copy Markdown

perfpulse bot commented Apr 13, 2026

📊 Android Performance Analysis Report

🔎 Summary

MacroBenchmark Metric Status
StartupPrecompiledWithBaselineProfile App Launch Time ⚪ Insignificant

⌛ Benchmarks

  • StartupPrecompiledWithBaselineProfile

    Name: startupPrecompiledWithBaselineProfile
    Class: com.google.samples.apps.nowinandroid.startup.StartupBenchmark

    • Extra Execution Metadata
      Device Runtime (sec) Repeat Iterations Warmup Iterations
      Nexus_4 39 - 19 2 - 2 0 - 0
      Nexus_6 40 - 20 2 - 2 0 - 0
      Pixel 38 - 38 2 - 2 0 - 0
    • App Launch Time
      • Time to Initial Display (TID)

        Mann-Whitney U-Test (threshold = 0.010)

        Device Median Change (%) Statistic Status
        Nexus_4 1525 ms vs 1312 ms -212 (-14%) p=+0.333 ⚪ Insignificant
        Nexus_6 1837 ms vs 1651 ms -186 (-10%) p=+0.333 ⚪ Insignificant
        Pixel 1551 ms vs 1448 ms -102 (-7%) p=+0.333 ⚪ Insignificant

        Step Fit (threshold = 25.000)

        Device Median Change (%) Statistic Status
        Nexus_4 1525 ms vs 1312 ms -212 (-14%) fit=+2.833 ⚪ Insignificant
        Nexus_6 1837 ms vs 1651 ms -186 (-10%) fit=+2.303 ⚪ Insignificant
        Pixel 1551 ms vs 1448 ms -102 (-7%) fit=+2.390 ⚪ Insignificant
        • 🗃️ Raw Runs
          • 📱 Nexus_4
            Run Baseline Candidate Change
            0 1730 ms 1368 ms -21%
            1 1320 ms 1257 ms -5%
          • 📱 Nexus_6
            Run Baseline Candidate Change
            0 2037 ms 1762 ms -13%
            1 1637 ms 1539 ms -6%
          • 📱 Pixel
            Run Baseline Candidate Change
            0 1657 ms 1506 ms -9%
            1 1444 ms 1390 ms -4%
      • Time to Full Display (TFD)

        Mann-Whitney U-Test (threshold = 0.010)

        Device Median Change (%) Statistic Status
        Nexus_4 2275 ms vs 1690 ms -585 (-26%) p=+0.167 ⚪ Insignificant
        Nexus_6 3021 ms vs 2243 ms -778 (-26%) p=+0.333 ⚪ Insignificant
        Pixel 2528 ms vs 2421 ms -106 (-4%) p=+0.333 ⚪ Insignificant

        Step Fit (threshold = 25.000)

        Device Median Change (%) Statistic Status
        Nexus_4 2275 ms vs 1690 ms -585 (-26%) fit=+5.495 ⚪ Insignificant
        Nexus_6 3021 ms vs 2243 ms -778 (-26%) fit=+3.538 ⚪ Insignificant
        Pixel 2528 ms vs 2421 ms -106 (-4%) fit=+0.395 ⚪ Insignificant
        • 🗃️ Raw Runs
          • 📱 Nexus_4
            Run Baseline Candidate Change
            0 1981 ms 1755 ms -11%
            1 2569 ms 1624 ms -37%
          • 📱 Nexus_6
            Run Baseline Candidate Change
            0 2438 ms 2461 ms +1%
            1 3604 ms 2024 ms -44%
          • 📱 Pixel
            Run Baseline Candidate Change
            0 2006 ms 1861 ms -7%
            1 3049 ms 2980 ms -2%

📱 Device Specifications

Device Brand CPU Memory SDK
Nexus_4 google 2-cores @ 2000 Hz 2 GB 34 (REL)
Nexus_6 google 2-cores @ 2000 Hz 3 GB 34 (REL)
Pixel google 2-cores @ 2000 Hz 2 GB 34 (REL)

@akayiz akayiz closed this Apr 15, 2026
@akayiz akayiz reopened this Apr 15, 2026
@akayiz akayiz changed the title Please Please Worky Add multi device perf monitoring and commenting PR report Apr 15, 2026
@akayiz akayiz closed this Apr 15, 2026
@perfpulse
Copy link
Copy Markdown

perfpulse bot commented Apr 15, 2026 •
edited by Dimitry-bit
Loading

📊 Android Performance Analysis Report

🔎 Summary

MacroBenchmark Metric Status
StartupPrecompiledWithBaseline App Launch Time ⚪ Insignificant

⌛ Benchmarks

  • StartupPrecompiledWithBaselineProfile

    Name: startupPrecompiledWithBaselineProfile
    Class: com.google.samples.apps.nowinandroid.startup.StartupBenchmark

    • Extra Execution Metadata
      Device Runtime (sec) Repeat Iterations Warmup Iterations
      Nexus_6 40 - 19 2 - 2 0 - 0
      Pixel 38 - 18 2 - 2 0 - 0
    • App Launch Time
      • Time to Initial Display (TID)

        Mann-Whitney U-Test (threshold = 0.010)

        Device Median Change (%) Statistic Status
        Nexus_6 1780 ms vs 1557 ms -222 (-13%) p=+0.167 ⚪ Insignificant
        Pixel 1378 ms vs 1322 ms -56 (-4%) p=+0.333 ⚪ Insignificant

        Step Fit (threshold = 25.000)

        Device Median Change (%) Statistic Status
        Nexus_6 1780 ms vs 1557 ms -222 (-13%) fit=+5.774 ⚪ Insignificant
        Pixel 1378 ms vs 1322 ms -56 (-4%) fit=+1.580 ⚪ Insignificant
        • 🗃️ Raw Runs
          • 📱 Nexus_6
            Run Baseline Candidate Change
            0 1699 ms 1483 ms -13%
            1 1861 ms 1631 ms -12%
          • 📱 Pixel
            Run Baseline Candidate Change
            0 1448 ms 1395 ms -4%
            1 1308 ms 1249 ms -5%
      • Time to Full Display (TFD)

        Mann-Whitney U-Test (threshold = 0.010)

        Device Median Change (%) Statistic Status
        Nexus_6 2744 ms vs 2038 ms -705 (-26%) p=+0.167 ⚪ Insignificant
        Pixel 2272 ms vs 1748 ms -523 (-23%) p=+0.167 ⚪ Insignificant

        Step Fit (threshold = 25.000)

        Device Median Change (%) Statistic Status
        Nexus_6 2744 ms vs 2038 ms -705 (-26%) fit=+4.797 ⚪ Insignificant
        Pixel 2272 ms vs 1748 ms -523 (-23%) fit=+3.411 ⚪ Insignificant
        • 🗃️ Raw Runs
          • 📱 Nexus_6
            Run Baseline Candidate Change
            0 2330 ms 1996 ms -14%
            1 3158 ms 2081 ms -34%
          • 📱 Pixel
            Run Baseline Candidate Change
            0 1849 ms 1845 ms -0%
            1 2695 ms 1652 ms -39%

📱 Device Specifications

Device Brand CPU Memory SDK
Nexus_6 google 2-cores @ 2000 Hz 3 GB 34 (REL)
Pixel google 2-cores @ 2000 Hz 2 GB 34 (REL)

@akayiz akayiz reopened this Apr 16, 2026
@akayiz akayiz merged commit 9c9127e into main Apr 16, 2026
0 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@Dimitry-bit @akayiz @CodingPanda166