Skip to content

🍒 9952 - exclude check-big-regression when merging backport PRs #9966

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: release/v1.55.x
Choose a base branch
from
Open

🍒 9952 - exclude check-big-regression when merging backport PRs #9966

wants to merge 1 commit into from

Conversation

@amarziali
Copy link
Contributor

@amarziali amarziali commented Nov 14, 2025

Backport #9952 to release/v1.55.x
@amarziali amarziali requested a review from a team as a code owner November 14, 2025 09:29
@amarziali amarziali added type: enhancement Enhancements and improvements comp: testing Testing tag: no release notes Changes to exclude from release notes labels Nov 14, 2025
@amarziali amarziali requested review from erikayasuda and removed request for a team November 14, 2025 09:29
@amarziali amarziali enabled auto-merge (squash) November 14, 2025 09:29
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Nov 14, 2025 •
edited by datadog-official bot
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.70% (-0.02%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 293e728 | Docs | Datadog PR Page | Was this helpful? Give us feedback!
@pr-commenter
Copy link

pr-commenter bot commented Nov 14, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/backport-pr-9952
git_commit_date 1763111453 1763112572
git_commit_sha 8ceb94d 293e728
release_version 1.56.0-SNAPSHOT~8ceb94de51 1.56.0-SNAPSHOT~293e728451
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763114449 1763114449
ci_job_id 1234717051 1234717051
ci_pipeline_id 82382884 82382884
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-hd7dql3p 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-hd7dql3p 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 12 performance improvements and 11 performance regressions! Performance is the same for 31 metrics, 11 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start better
[-87.547ms; -49.683ms] or [-7.073%; -4.014%]		 1.169s 1.238s
scenario:startup:insecure-bank:iast:Debugger better
[-54.252ms; -53.296ms] or [-90.496%; -88.901%]		 6.176ms 59.950ms
scenario:startup:insecure-bank:iast:Telemetry worse
[+0.709ms; +1.295ms] or [+9.313%; +16.998%]		 8.619ms 7.617ms
scenario:startup:insecure-bank:iast:Flare Poller worse
[+662.483µs; +880.058µs] or [+19.241%; +25.560%]		 4.214ms 3.443ms
scenario:startup:insecure-bank:tracing:Agent.start better
[-85.228ms; -50.940ms] or [-7.719%; -4.613%]		 1.036s 1.104s
scenario:startup:insecure-bank:tracing:Debugger better
[-57.806ms; -56.670ms] or [-90.762%; -88.978%]		 6.452ms 63.690ms
scenario:startup:insecure-bank:tracing:Remote Config worse
[+29.671µs; +77.730µs] or [+4.703%; +12.322%]		 684.539µs 630.838µs
scenario:startup:petclinic:appsec:Agent.start better
[-85.737ms; -74.840ms] or [-6.696%; -5.845%]		 1.200s 1.280s
scenario:startup:petclinic:appsec:Debugger better
[-56.565ms; -54.614ms] or [-92.007%; -88.834%]		 5.889ms 61.479ms
scenario:startup:petclinic:iast:Agent.start better
[-80.098ms; -70.462ms] or [-6.470%; -5.691%]		 1.163s 1.238s
scenario:startup:petclinic:iast:Debugger better
[-54.979ms; -54.205ms] or [-90.531%; -89.256%]		 6.138ms 60.730ms
scenario:startup:petclinic:iast:Remote Config worse
[+35.956µs; +63.096µs] or [+6.541%; +11.478%]		 599.257µs 549.732µs
scenario:startup:petclinic:iast:Telemetry worse
[+587.340µs; +854.484µs] or [+7.729%; +11.244%]		 8.320ms 7.599ms
scenario:startup:petclinic:iast:Flare Poller worse
[+744.339µs; +879.107µs] or [+21.589%; +25.497%]		 4.260ms 3.448ms
scenario:startup:petclinic:profiling:Agent.start better
[-66.707ms; -25.355ms] or [-5.422%; -2.061%]		 1.184s 1.230s
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+12.457ms; +16.115ms] or [+12.913%; +16.705%]		 110.750ms 96.464ms
scenario:startup:petclinic:profiling:Debugger better
[-51.583ms; -47.367ms] or [-82.575%; -75.826%]		 12.993ms 62.468ms
scenario:startup:petclinic:profiling:Remote Config worse
[+28.944µs; +67.632µs] or [+4.528%; +10.581%]		 687.498µs 639.210µs
scenario:startup:petclinic:profiling:Flare Poller worse
[+406.094µs; +644.987µs] or [+10.955%; +17.399%]		 4.233ms 3.707ms
scenario:startup:petclinic:profiling:Profiling worse
[+12.558ms; +16.192ms] or [+12.940%; +16.685%]		 111.422ms 97.047ms
scenario:startup:petclinic:tracing:Agent.start better
[-70.261ms; -61.848ms] or [-6.396%; -5.631%]		 1.032s 1.098s
scenario:startup:petclinic:tracing:Debugger better
[-58.153ms; -57.216ms] or [-90.660%; -89.200%]		 6.459ms 64.143ms
scenario:startup:petclinic:tracing:Remote Config worse
[+20.197µs; +61.395µs] or [+3.165%; +9.622%]		 678.873µs 638.077µs
Startup time reports for insecure-bank 
gantt title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~293e728451, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section tracing Agent [baseline] (1.104 s) : 0, 1104162 Total [baseline] (8.83 s) : 0, 8829616 Agent [candidate] (1.036 s) : 0, 1036078 Total [candidate] (8.661 s) : 0, 8661265 section iast Agent [baseline] (1.238 s) : 0, 1237783 Total [baseline] (9.553 s) : 0, 9552990 Agent [candidate] (1.169 s) : 0, 1169168 Total [candidate] (9.372 s) : 0, 9372430
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.104 s -
Agent iast 1.238 s 133.621 ms (12.1%)
Total tracing 8.83 s -
Total iast 9.553 s 723.374 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.036 s -
Agent iast 1.169 s 133.091 ms (12.8%)
Total tracing 8.661 s -
Total iast 9.372 s 711.165 ms (8.2%) 
gantt title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~293e728451, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section tracing crashtracking [baseline] (1.467 ms) : 0, 1467 crashtracking [candidate] (1.48 ms) : 0, 1480 BytebuddyAgent [baseline] (710.843 ms) : 0, 710843 BytebuddyAgent [candidate] (706.882 ms) : 0, 706882 GlobalTracer [baseline] (248.604 ms) : 0, 248604 GlobalTracer [candidate] (246.407 ms) : 0, 246407 AppSec [baseline] (32.355 ms) : 0, 32355 AppSec [candidate] (32.498 ms) : 0, 32498 Debugger [baseline] (63.69 ms) : 0, 63690 Debugger [candidate] (6.452 ms) : 0, 6452 Remote Config [baseline] (630.838 µs) : 0, 631 Remote Config [candidate] (684.539 µs) : 0, 685 Telemetry [baseline] (8.098 ms) : 0, 8098 Telemetry [candidate] (13.689 ms) : 0, 13689 Flare Poller [baseline] (3.648 ms) : 0, 3648 Flare Poller [candidate] (6.716 ms) : 0, 6716 section iast crashtracking [baseline] (1.48 ms) : 0, 1480 crashtracking [candidate] (1.467 ms) : 0, 1467 BytebuddyAgent [baseline] (829.862 ms) : 0, 829862 BytebuddyAgent [candidate] (829.704 ms) : 0, 829704 GlobalTracer [baseline] (238.139 ms) : 0, 238139 GlobalTracer [candidate] (234.807 ms) : 0, 234807 IAST [baseline] (27.559 ms) : 0, 27559 IAST [candidate] (31.248 ms) : 0, 31248 AppSec [baseline] (34.394 ms) : 0, 34394 AppSec [candidate] (30.904 ms) : 0, 30904 Debugger [baseline] (59.95 ms) : 0, 59950 Debugger [candidate] (6.176 ms) : 0, 6176 Remote Config [baseline] (562.982 µs) : 0, 563 Remote Config [candidate] (602.769 µs) : 0, 603 Telemetry [baseline] (7.617 ms) : 0, 7617 Telemetry [candidate] (8.619 ms) : 0, 8619 Flare Poller [baseline] (3.443 ms) : 0, 3443 Flare Poller [candidate] (4.214 ms) : 0, 4214
Loading
Startup time reports for petclinic 
gantt title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~293e728451, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section tracing Agent [baseline] (1.098 s) : 0, 1098434 Total [baseline] (10.813 s) : 0, 10812558 Agent [candidate] (1.032 s) : 0, 1032380 Total [candidate] (10.846 s) : 0, 10845546 section appsec Agent [baseline] (1.28 s) : 0, 1280333 Total [baseline] (11.153 s) : 0, 11153481 Agent [candidate] (1.2 s) : 0, 1200044 Total [candidate] (10.865 s) : 0, 10865157 section iast Agent [baseline] (1.238 s) : 0, 1238059 Total [baseline] (11.241 s) : 0, 11241176 Agent [candidate] (1.163 s) : 0, 1162779 Total [candidate] (11.087 s) : 0, 11086697 section profiling Agent [baseline] (1.23 s) : 0, 1230303 Total [baseline] (11.083 s) : 0, 11082987 Agent [candidate] (1.184 s) : 0, 1184272 Total [candidate] (10.956 s) : 0, 10955622
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.098 s -
Agent appsec 1.28 s 181.898 ms (16.6%)
Agent iast 1.238 s 139.625 ms (12.7%)
Agent profiling 1.23 s 131.869 ms (12.0%)
Total tracing 10.813 s -
Total appsec 11.153 s 340.923 ms (3.2%)
Total iast 11.241 s 428.618 ms (4.0%)
Total profiling 11.083 s 270.429 ms (2.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.032 s -
Agent appsec 1.2 s 167.664 ms (16.2%)
Agent iast 1.163 s 130.399 ms (12.6%)
Agent profiling 1.184 s 151.892 ms (14.7%)
Total tracing 10.846 s -
Total appsec 10.865 s 19.611 ms (0.2%)
Total iast 11.087 s 241.151 ms (2.2%)
Total profiling 10.956 s 110.076 ms (1.0%) 
gantt title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~293e728451, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section tracing crashtracking [baseline] (1.45 ms) : 0, 1450 crashtracking [candidate] (1.471 ms) : 0, 1471 BytebuddyAgent [baseline] (705.427 ms) : 0, 705427 BytebuddyAgent [candidate] (704.255 ms) : 0, 704255 GlobalTracer [baseline] (248.115 ms) : 0, 248115 GlobalTracer [candidate] (245.023 ms) : 0, 245023 AppSec [baseline] (32.136 ms) : 0, 32136 AppSec [candidate] (32.441 ms) : 0, 32441 Debugger [baseline] (64.143 ms) : 0, 64143 Debugger [candidate] (6.459 ms) : 0, 6459 Remote Config [baseline] (638.077 µs) : 0, 638 Remote Config [candidate] (678.873 µs) : 0, 679 Telemetry [baseline] (8.088 ms) : 0, 8088 Telemetry [candidate] (14.409 ms) : 0, 14409 Flare Poller [baseline] (3.616 ms) : 0, 3616 Flare Poller [candidate] (6.426 ms) : 0, 6426 section appsec crashtracking [baseline] (1.452 ms) : 0, 1452 crashtracking [candidate] (1.468 ms) : 0, 1468 BytebuddyAgent [baseline] (729.372 ms) : 0, 729372 BytebuddyAgent [candidate] (723.989 ms) : 0, 723989 GlobalTracer [baseline] (241.063 ms) : 0, 241063 GlobalTracer [candidate] (235.617 ms) : 0, 235617 IAST [baseline] (25.179 ms) : 0, 25179 IAST [candidate] (25.045 ms) : 0, 25045 AppSec [baseline] (174.115 ms) : 0, 174115 AppSec [candidate] (174.059 ms) : 0, 174059 Debugger [baseline] (61.479 ms) : 0, 61479 Debugger [candidate] (5.889 ms) : 0, 5889 Remote Config [baseline] (682.981 µs) : 0, 683 Remote Config [candidate] (634.619 µs) : 0, 635 Telemetry [baseline] (8.294 ms) : 0, 8294 Telemetry [candidate] (8.38 ms) : 0, 8380 Flare Poller [baseline] (3.929 ms) : 0, 3929 Flare Poller [candidate] (3.868 ms) : 0, 3868 section iast crashtracking [baseline] (1.451 ms) : 0, 1451 crashtracking [candidate] (1.478 ms) : 0, 1478 BytebuddyAgent [baseline] (829.528 ms) : 0, 829528 BytebuddyAgent [candidate] (824.605 ms) : 0, 824605 GlobalTracer [baseline] (238.356 ms) : 0, 238356 GlobalTracer [candidate] (234.252 ms) : 0, 234252 IAST [baseline] (30.123 ms) : 0, 30123 IAST [candidate] (32.773 ms) : 0, 32773 AppSec [baseline] (31.52 ms) : 0, 31520 AppSec [candidate] (29.042 ms) : 0, 29042 Debugger [baseline] (60.73 ms) : 0, 60730 Debugger [candidate] (6.138 ms) : 0, 6138 Remote Config [baseline] (549.732 µs) : 0, 550 Remote Config [candidate] (599.257 µs) : 0, 599 Telemetry [baseline] (7.599 ms) : 0, 7599 Telemetry [candidate] (8.32 ms) : 0, 8320 Flare Poller [baseline] (3.448 ms) : 0, 3448 Flare Poller [candidate] (4.26 ms) : 0, 4260 section profiling crashtracking [baseline] (1.447 ms) : 0, 1447 crashtracking [candidate] (1.492 ms) : 0, 1492 BytebuddyAgent [baseline] (733.196 ms) : 0, 733196 BytebuddyAgent [candidate] (733.652 ms) : 0, 733652 GlobalTracer [baseline] (222.369 ms) : 0, 222369 GlobalTracer [candidate] (222.123 ms) : 0, 222123 AppSec [baseline] (32.184 ms) : 0, 32184 AppSec [candidate] (32.655 ms) : 0, 32655 Debugger [baseline] (62.468 ms) : 0, 62468 Debugger [candidate] (12.993 ms) : 0, 12993 Remote Config [baseline] (639.21 µs) : 0, 639 Remote Config [candidate] (687.498 µs) : 0, 687 Telemetry [baseline] (7.944 ms) : 0, 7944 Telemetry [candidate] (9.734 ms) : 0, 9734 Flare Poller [baseline] (3.707 ms) : 0, 3707 Flare Poller [candidate] (4.233 ms) : 0, 4233 ProfilingAgent [baseline] (96.464 ms) : 0, 96464 ProfilingAgent [candidate] (110.75 ms) : 0, 110750 Profiling [baseline] (97.047 ms) : 0, 97047 Profiling [candidate] (111.422 ms) : 0, 111422
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/backport-pr-9952
git_commit_date 1763111453 1763112572
git_commit_sha 8ceb94d 293e728
release_version 1.56.0-SNAPSHOT~8ceb94de51 1.56.0-SNAPSHOT~293e728451
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763118861 1763118861
ci_job_id 1234893745 1234893745
ci_pipeline_id 82382884 82382884
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-qgeqi9cj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-qgeqi9cj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 6 performance regressions! Performance is the same for 10 metrics, 19 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:code_origins:high_load worse
[+1.316ms; +1.808ms] or [+7.535%; +10.349%]		 worse
[+0.916ms; +2.050ms] or [+3.149%; +7.044%]		 unstable
[-43.737op/s; +7.549op/s] or [-16.818%; +2.903%]		 19.030ms 30.580ms 241.969op/s 17.468ms 29.097ms 260.062op/s
scenario:load:petclinic:iast:high_load worse
[+425.663µs; +1199.478µs] or [+2.436%; +6.864%]		 same
[-39.343µs; +1383.035µs] or [-0.137%; +4.813%]		 unstable
[-36.833op/s; +16.708op/s] or [-14.069%; +6.382%]		 18.287ms 29.404ms 251.750op/s 17.474ms 28.733ms 261.812op/s
scenario:load:petclinic:appsec:high_load worse
[+0.560ms; +1.810ms] or [+3.061%; +9.901%]		 unsure
[+0.381ms; +2.167ms] or [+1.284%; +7.296%]		 unstable
[-36.852op/s; +13.477op/s] or [-14.713%; +5.381%]		 19.469ms 30.972ms 238.781op/s 18.284ms 29.698ms 250.469op/s
scenario:load:petclinic:profiling:high_load worse
[+0.523ms; +1.600ms] or [+2.897%; +8.854%]		 same
[-511.215µs; +1296.418µs] or [-1.726%; +4.376%]		 unstable
[-36.908op/s; +15.595op/s] or [-14.561%; +6.153%]		 19.129ms 30.018ms 242.812op/s 18.067ms 29.625ms 253.469op/s
scenario:load:petclinic:no_agent:high_load worse
[+0.667ms; +2.253ms] or [+3.911%; +13.209%]		 unstable
[-0.333ms; +3.205ms] or [-1.150%; +11.058%]		 unstable
[-48.424op/s; +7.799op/s] or [-18.233%; +2.937%]		 18.520ms 30.419ms 245.281op/s 17.060ms 28.983ms 265.594op/s
scenario:load:petclinic:tracing:high_load same
[-552.228µs; +149.803µs] or [-3.179%; +0.862%]		 better
[-1.609ms; -0.617ms] or [-5.565%; -2.134%]		 unstable
[-21.739op/s; +32.614op/s] or [-8.256%; +12.386%]		 17.173ms 27.793ms 268.750op/s 17.374ms 28.906ms 263.312op/s
Request duration reports for insecure-bank 
gantt title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~293e728451, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section baseline no_agent (1.208 ms) : 1197, 1219 . : milestone, 1208, iast (3.373 ms) : 3310, 3435 . : milestone, 3373, iast_FULL (5.796 ms) : 5739, 5853 . : milestone, 5796, iast_GLOBAL (3.634 ms) : 3545, 3722 . : milestone, 3634, profiling (2.009 ms) : 1991, 2028 . : milestone, 2009, tracing (1.792 ms) : 1777, 1806 . : milestone, 1792, section candidate no_agent (1.268 ms) : 1254, 1281 . : milestone, 1268, iast (3.307 ms) : 3261, 3353 . : milestone, 3307, iast_FULL (5.862 ms) : 5804, 5920 . : milestone, 5862, iast_GLOBAL (3.604 ms) : 3546, 3662 . : milestone, 3604, profiling (2.121 ms) : 2102, 2140 . : milestone, 2121, tracing (1.787 ms) : 1770, 1805 . : milestone, 1787,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.208 ms [1.197 ms, 1.219 ms] -
iast 3.373 ms [3.31 ms, 3.435 ms] 2.165 ms (179.2%)
iast_FULL 5.796 ms [5.739 ms, 5.853 ms] 4.588 ms (379.8%)
iast_GLOBAL 3.634 ms [3.545 ms, 3.722 ms] 2.426 ms (200.8%)
profiling 2.009 ms [1.991 ms, 2.028 ms] 801.46 µs (66.3%)
tracing 1.792 ms [1.777 ms, 1.806 ms] 583.57 µs (48.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.268 ms [1.254 ms, 1.281 ms] -
iast 3.307 ms [3.261 ms, 3.353 ms] 2.04 ms (160.9%)
iast_FULL 5.862 ms [5.804 ms, 5.92 ms] 4.594 ms (362.4%)
iast_GLOBAL 3.604 ms [3.546 ms, 3.662 ms] 2.336 ms (184.3%)
profiling 2.121 ms [2.102 ms, 2.14 ms] 853.44 µs (67.3%)
tracing 1.787 ms [1.77 ms, 1.805 ms] 519.467 µs (41.0%)
Request duration reports for petclinic 
gantt title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~293e728451, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section baseline no_agent (17.568 ms) : 17390, 17747 . : milestone, 17568, appsec (18.634 ms) : 18446, 18822 . : milestone, 18634, code_origins (17.942 ms) : 17761, 18122 . : milestone, 17942, iast (17.82 ms) : 17642, 17998 . : milestone, 17820, profiling (18.41 ms) : 18225, 18594 . : milestone, 18410, tracing (17.722 ms) : 17545, 17899 . : milestone, 17722, section candidate no_agent (19.028 ms) : 18836, 19221 . : milestone, 19028, appsec (19.552 ms) : 19348, 19756 . : milestone, 19552, code_origins (19.295 ms) : 19101, 19489 . : milestone, 19295, iast (18.54 ms) : 18356, 18724 . : milestone, 18540, profiling (19.223 ms) : 19030, 19415 . : milestone, 19223, tracing (17.361 ms) : 17194, 17528 . : milestone, 17361,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.568 ms [17.39 ms, 17.747 ms] -
appsec 18.634 ms [18.446 ms, 18.822 ms] 1.066 ms (6.1%)
code_origins 17.942 ms [17.761 ms, 18.122 ms] 373.164 µs (2.1%)
iast 17.82 ms [17.642 ms, 17.998 ms] 251.432 µs (1.4%)
profiling 18.41 ms [18.225 ms, 18.594 ms] 841.189 µs (4.8%)
tracing 17.722 ms [17.545 ms, 17.899 ms] 153.236 µs (0.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.028 ms [18.836 ms, 19.221 ms] -
appsec 19.552 ms [19.348 ms, 19.756 ms] 523.867 µs (2.8%)
code_origins 19.295 ms [19.101 ms, 19.489 ms] 266.79 µs (1.4%)
iast 18.54 ms [18.356 ms, 18.724 ms] -488.093 µs (-2.6%)
profiling 19.223 ms [19.03 ms, 19.415 ms] 194.386 µs (1.0%)
tracing 17.361 ms [17.194 ms, 17.528 ms] -1.668 ms (-8.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/backport-pr-9952
git_commit_date 1763111453 1763112572
git_commit_sha 8ceb94d 293e728
release_version 1.56.0-SNAPSHOT~8ceb94de51 1.56.0-SNAPSHOT~293e728451
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1763114699 1763114699
ci_job_id 1234717053 1234717053
ci_pipeline_id 82382884 82382884
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-ee8vs9zi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-ee8vs9zi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~293e728451, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section baseline no_agent (14.814 s) : 14814000, 14814000 . : milestone, 14814000, appsec (14.691 s) : 14691000, 14691000 . : milestone, 14691000, iast (18.455 s) : 18455000, 18455000 . : milestone, 18455000, iast_GLOBAL (17.758 s) : 17758000, 17758000 . : milestone, 17758000, profiling (14.847 s) : 14847000, 14847000 . : milestone, 14847000, tracing (14.751 s) : 14751000, 14751000 . : milestone, 14751000, section candidate no_agent (15.248 s) : 15248000, 15248000 . : milestone, 15248000, appsec (14.94 s) : 14940000, 14940000 . : milestone, 14940000, iast (18.746 s) : 18746000, 18746000 . : milestone, 18746000, iast_GLOBAL (17.741 s) : 17741000, 17741000 . : milestone, 17741000, profiling (15.483 s) : 15483000, 15483000 . : milestone, 15483000, tracing (15.245 s) : 15245000, 15245000 . : milestone, 15245000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.814 s [14.814 s, 14.814 s] -
appsec 14.691 s [14.691 s, 14.691 s] -123.0 ms (-0.8%)
iast 18.455 s [18.455 s, 18.455 s] 3.641 s (24.6%)
iast_GLOBAL 17.758 s [17.758 s, 17.758 s] 2.944 s (19.9%)
profiling 14.847 s [14.847 s, 14.847 s] 33.0 ms (0.2%)
tracing 14.751 s [14.751 s, 14.751 s] -63.0 ms (-0.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.248 s [15.248 s, 15.248 s] -
appsec 14.94 s [14.94 s, 14.94 s] -308.0 ms (-2.0%)
iast 18.746 s [18.746 s, 18.746 s] 3.498 s (22.9%)
iast_GLOBAL 17.741 s [17.741 s, 17.741 s] 2.493 s (16.3%)
profiling 15.483 s [15.483 s, 15.483 s] 235.0 ms (1.5%)
tracing 15.245 s [15.245 s, 15.245 s] -3.0 ms (-0.0%)
Execution time for tomcat 
gantt title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~293e728451, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section baseline no_agent (1.485 ms) : 1474, 1497 . : milestone, 1485, appsec (2.47 ms) : 2418, 2522 . : milestone, 2470, iast (2.231 ms) : 2167, 2295 . : milestone, 2231, iast_GLOBAL (2.269 ms) : 2205, 2333 . : milestone, 2269, profiling (2.098 ms) : 2044, 2151 . : milestone, 2098, tracing (2.045 ms) : 1995, 2095 . : milestone, 2045, section candidate no_agent (1.481 ms) : 1469, 1493 . : milestone, 1481, appsec (2.472 ms) : 2421, 2523 . : milestone, 2472, iast (2.224 ms) : 2159, 2288 . : milestone, 2224, iast_GLOBAL (2.265 ms) : 2201, 2330 . : milestone, 2265, profiling (2.079 ms) : 2026, 2132 . : milestone, 2079, tracing (2.038 ms) : 1988, 2088 . : milestone, 2038,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.485 ms [1.474 ms, 1.497 ms] -
appsec 2.47 ms [2.418 ms, 2.522 ms] 984.748 µs (66.3%)
iast 2.231 ms [2.167 ms, 2.295 ms] 745.911 µs (50.2%)
iast_GLOBAL 2.269 ms [2.205 ms, 2.333 ms] 783.466 µs (52.7%)
profiling 2.098 ms [2.044 ms, 2.151 ms] 612.546 µs (41.2%)
tracing 2.045 ms [1.995 ms, 2.095 ms] 559.928 µs (37.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.469 ms, 1.493 ms] -
appsec 2.472 ms [2.421 ms, 2.523 ms] 990.64 µs (66.9%)
iast 2.224 ms [2.159 ms, 2.288 ms] 742.675 µs (50.1%)
iast_GLOBAL 2.265 ms [2.201 ms, 2.33 ms] 784.351 µs (53.0%)
profiling 2.079 ms [2.026 ms, 2.132 ms] 598.364 µs (40.4%)
tracing 2.038 ms [1.988 ms, 2.088 ms] 556.86 µs (37.6%)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

4 participants

@amarziali @bric3 @PerfectSlayer