Skip to content

Conversation

@mhlidd
Copy link
Contributor

@mhlidd mhlidd commented Nov 12, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@mhlidd mhlidd added the tag: do not merge Do not merge changes label Nov 12, 2025
@datadog-official
Copy link

datadog-official bot commented Nov 13, 2025

🎯 Code Coverage
Patch Coverage: 100.00%
Total Coverage: 59.51% (-0.07%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: ce9b02c | Docs | Datadog PR Page | Was this helpful? Give us feedback!
@pr-commenter
Copy link

pr-commenter bot commented Nov 13, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/testing_ci
git_commit_date 1763072899 1763097299
git_commit_sha 7a4d8d0 ce9b02c
release_version 1.56.0-SNAPSHOT~7a4d8d030d 1.56.0-SNAPSHOT~ce9b02c4cf
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763099104 1763099104
ci_job_id 1234535086 1234535086
ci_pipeline_id 82370223 82370223
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-kkjwnxe6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-kkjwnxe6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 56 metrics, 8 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:appsec:Flare Poller worse
[+134.871µs; +393.744µs] or [+3.409%; +9.953%]
4.220ms 3.956ms
Startup time reports for insecure-bank
gantt title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~ce9b02c4cf, baseline=1.56.0-SNAPSHOT~7a4d8d030d dateFormat X axisFormat %s section tracing Agent [baseline] (1.106 s) : 0, 1105913 Total [baseline] (8.828 s) : 0, 8828243 Agent [candidate] (1.103 s) : 0, 1103362 Total [candidate] (8.809 s) : 0, 8809325 section iast Agent [baseline] (1.239 s) : 0, 1239328 Total [baseline] (9.577 s) : 0, 9576897 Agent [candidate] (1.236 s) : 0, 1235970 Total [candidate] (9.466 s) : 0, 9465891 
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.106 s -
Agent iast 1.239 s 133.416 ms (12.1%)
Total tracing 8.828 s -
Total iast 9.577 s 748.654 ms (8.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.103 s -
Agent iast 1.236 s 132.608 ms (12.0%)
Total tracing 8.809 s -
Total iast 9.466 s 656.566 ms (7.5%)
gantt title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~ce9b02c4cf, baseline=1.56.0-SNAPSHOT~7a4d8d030d dateFormat X axisFormat %s section tracing crashtracking [baseline] (1.451 ms) : 0, 1451 crashtracking [candidate] (1.478 ms) : 0, 1478 BytebuddyAgent [baseline] (710.716 ms) : 0, 710716 BytebuddyAgent [candidate] (711.678 ms) : 0, 711678 GlobalTracer [baseline] (249.723 ms) : 0, 249723 GlobalTracer [candidate] (248.446 ms) : 0, 248446 AppSec [baseline] (32.63 ms) : 0, 32630 AppSec [candidate] (32.285 ms) : 0, 32285 Debugger [baseline] (63.998 ms) : 0, 63998 Debugger [candidate] (62.665 ms) : 0, 62665 Remote Config [baseline] (649.43 µs) : 0, 649 Remote Config [candidate] (629.994 µs) : 0, 630 Telemetry [baseline] (8.394 ms) : 0, 8394 Telemetry [candidate] (8.227 ms) : 0, 8227 Flare Poller [baseline] (3.69 ms) : 0, 3690 Flare Poller [candidate] (3.674 ms) : 0, 3674 section iast crashtracking [baseline] (1.452 ms) : 0, 1452 crashtracking [candidate] (1.479 ms) : 0, 1479 BytebuddyAgent [baseline] (831.163 ms) : 0, 831163 BytebuddyAgent [candidate] (831.022 ms) : 0, 831022 GlobalTracer [baseline] (238.676 ms) : 0, 238676 GlobalTracer [candidate] (236.759 ms) : 0, 236759 IAST [baseline] (27.468 ms) : 0, 27468 IAST [candidate] (30.414 ms) : 0, 30414 AppSec [baseline] (33.92 ms) : 0, 33920 AppSec [candidate] (30.398 ms) : 0, 30398 Debugger [baseline] (60.191 ms) : 0, 60191 Debugger [candidate] (59.979 ms) : 0, 59979 Remote Config [baseline] (543.753 µs) : 0, 544 Remote Config [candidate] (538.74 µs) : 0, 539 Telemetry [baseline] (7.67 ms) : 0, 7670 Telemetry [candidate] (7.596 ms) : 0, 7596 Flare Poller [baseline] (3.48 ms) : 0, 3480 Flare Poller [candidate] (3.521 ms) : 0, 3521 
Loading
Startup time reports for petclinic
gantt title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~ce9b02c4cf, baseline=1.56.0-SNAPSHOT~7a4d8d030d dateFormat X axisFormat %s section tracing Agent [baseline] (1.099 s) : 0, 1099060 Total [baseline] (10.785 s) : 0, 10784947 Agent [candidate] (1.114 s) : 0, 1113901 Total [candidate] (10.713 s) : 0, 10713277 section appsec Agent [baseline] (1.277 s) : 0, 1277046 Total [baseline] (10.985 s) : 0, 10984801 Agent [candidate] (1.283 s) : 0, 1283106 Total [candidate] (11.019 s) : 0, 11018615 section iast Agent [baseline] (1.236 s) : 0, 1235673 Total [baseline] (11.197 s) : 0, 11197209 Agent [candidate] (1.25 s) : 0, 1249827 Total [candidate] (11.256 s) : 0, 11255543 section profiling Agent [baseline] (1.234 s) : 0, 1233926 Total [baseline] (11.017 s) : 0, 11017411 Agent [candidate] (1.231 s) : 0, 1230888 Total [candidate] (10.983 s) : 0, 10983271 
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.099 s -
Agent appsec 1.277 s 177.986 ms (16.2%)
Agent iast 1.236 s 136.613 ms (12.4%)
Agent profiling 1.234 s 134.866 ms (12.3%)
Total tracing 10.785 s -
Total appsec 10.985 s 199.854 ms (1.9%)
Total iast 11.197 s 412.262 ms (3.8%)
Total profiling 11.017 s 232.464 ms (2.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.114 s -
Agent appsec 1.283 s 169.205 ms (15.2%)
Agent iast 1.25 s 135.926 ms (12.2%)
Agent profiling 1.231 s 116.988 ms (10.5%)
Total tracing 10.713 s -
Total appsec 11.019 s 305.338 ms (2.9%)
Total iast 11.256 s 542.266 ms (5.1%)
Total profiling 10.983 s 269.994 ms (2.5%)
gantt title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~ce9b02c4cf, baseline=1.56.0-SNAPSHOT~7a4d8d030d dateFormat X axisFormat %s section tracing crashtracking [baseline] (1.453 ms) : 0, 1453 crashtracking [candidate] (1.508 ms) : 0, 1508 BytebuddyAgent [baseline] (705.654 ms) : 0, 705654 BytebuddyAgent [candidate] (717.747 ms) : 0, 717747 GlobalTracer [baseline] (248.359 ms) : 0, 248359 GlobalTracer [candidate] (250.545 ms) : 0, 250545 AppSec [baseline] (32.231 ms) : 0, 32231 AppSec [candidate] (32.827 ms) : 0, 32827 Debugger [baseline] (64.219 ms) : 0, 64219 Debugger [candidate] (64.176 ms) : 0, 64176 Remote Config [baseline] (636.168 µs) : 0, 636 Remote Config [candidate] (641.218 µs) : 0, 641 Telemetry [baseline] (8.199 ms) : 0, 8199 Telemetry [candidate] (8.302 ms) : 0, 8302 Flare Poller [baseline] (3.676 ms) : 0, 3676 Flare Poller [candidate] (3.723 ms) : 0, 3723 section appsec crashtracking [baseline] (1.456 ms) : 0, 1456 crashtracking [candidate] (1.482 ms) : 0, 1482 BytebuddyAgent [baseline] (728.671 ms) : 0, 728671 BytebuddyAgent [candidate] (733.369 ms) : 0, 733369 GlobalTracer [baseline] (239.977 ms) : 0, 239977 GlobalTracer [candidate] (240.534 ms) : 0, 240534 IAST [baseline] (24.717 ms) : 0, 24717 IAST [candidate] (24.251 ms) : 0, 24251 AppSec [baseline] (173.784 ms) : 0, 173784 AppSec [candidate] (174.718 ms) : 0, 174718 Debugger [baseline] (60.792 ms) : 0, 60792 Debugger [candidate] (60.96 ms) : 0, 60960 Remote Config [baseline] (712.713 µs) : 0, 713 Remote Config [candidate] (710.023 µs) : 0, 710 Telemetry [baseline] (8.258 ms) : 0, 8258 Telemetry [candidate] (8.429 ms) : 0, 8429 Flare Poller [baseline] (3.956 ms) : 0, 3956 Flare Poller [candidate] (4.22 ms) : 0, 4220 section iast crashtracking [baseline] (1.451 ms) : 0, 1451 crashtracking [candidate] (1.491 ms) : 0, 1491 BytebuddyAgent [baseline] (827.987 ms) : 0, 827987 BytebuddyAgent [candidate] (840.426 ms) : 0, 840426 GlobalTracer [baseline] (237.067 ms) : 0, 237067 GlobalTracer [candidate] (238.808 ms) : 0, 238808 IAST [baseline] (30.942 ms) : 0, 30942 IAST [candidate] (29.228 ms) : 0, 29228 AppSec [baseline] (30.471 ms) : 0, 30471 AppSec [candidate] (32.367 ms) : 0, 32367 Debugger [baseline] (61.217 ms) : 0, 61217 Debugger [candidate] (61.328 ms) : 0, 61328 Remote Config [baseline] (569.193 µs) : 0, 569 Remote Config [candidate] (546.088 µs) : 0, 546 Telemetry [baseline] (7.731 ms) : 0, 7731 Telemetry [candidate] (7.631 ms) : 0, 7631 Flare Poller [baseline] (3.537 ms) : 0, 3537 Flare Poller [candidate] (3.574 ms) : 0, 3574 section profiling crashtracking [baseline] (1.454 ms) : 0, 1454 crashtracking [candidate] (1.509 ms) : 0, 1509 BytebuddyAgent [baseline] (734.609 ms) : 0, 734609 BytebuddyAgent [candidate] (731.792 ms) : 0, 731792 GlobalTracer [baseline] (223.151 ms) : 0, 223151 GlobalTracer [candidate] (221.409 ms) : 0, 221409 AppSec [baseline] (33.272 ms) : 0, 33272 AppSec [candidate] (32.006 ms) : 0, 32006 Debugger [baseline] (62.232 ms) : 0, 62232 Debugger [candidate] (63.272 ms) : 0, 63272 Remote Config [baseline] (648.723 µs) : 0, 649 Remote Config [candidate] (668.172 µs) : 0, 668 Telemetry [baseline] (7.934 ms) : 0, 7934 Telemetry [candidate] (8.152 ms) : 0, 8152 Flare Poller [baseline] (3.786 ms) : 0, 3786 Flare Poller [candidate] (3.86 ms) : 0, 3860 ProfilingAgent [baseline] (97.02 ms) : 0, 97020 ProfilingAgent [candidate] (96.754 ms) : 0, 96754 Profiling [baseline] (97.602 ms) : 0, 97602 Profiling [candidate] (97.329 ms) : 0, 97329 
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/testing_ci
git_commit_date 1763072899 1763097299
git_commit_sha 7a4d8d0 ce9b02c
release_version 1.56.0-SNAPSHOT~7a4d8d030d 1.56.0-SNAPSHOT~ce9b02c4cf
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763099570 1763099570
ci_job_id 1234535087 1234535087
ci_pipeline_id 82370223 82370223
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-13wz6jhm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-13wz6jhm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 19 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:profiling:high_load worse
[+0.373ms; +1.756ms] or [+2.035%; +9.570%]
unsure
[+0.234ms; +2.569ms] or [+0.786%; +8.637%]
unstable
[-33.480op/s; +13.480op/s] or [-13.424%; +5.405%]
19.417ms 31.143ms 239.406op/s 18.353ms 29.741ms 249.406op/s
Request duration reports for petclinic
gantt title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~ce9b02c4cf, baseline=1.56.0-SNAPSHOT~7a4d8d030d dateFormat X axisFormat %s section baseline no_agent (18.43 ms) : 18238, 18623 . : milestone, 18430, appsec (18.779 ms) : 18590, 18968 . : milestone, 18779, code_origins (17.883 ms) : 17704, 18061 . : milestone, 17883, iast (17.586 ms) : 17416, 17756 . : milestone, 17586, profiling (18.711 ms) : 18526, 18896 . : milestone, 18711, tracing (17.765 ms) : 17588, 17942 . : milestone, 17765, section candidate no_agent (17.226 ms) : 17052, 17400 . : milestone, 17226, appsec (18.897 ms) : 18707, 19087 . : milestone, 18897, code_origins (17.593 ms) : 17419, 17767 . : milestone, 17593, iast (17.676 ms) : 17499, 17852 . : milestone, 17676, profiling (19.498 ms) : 19298, 19698 . : milestone, 19498, tracing (17.721 ms) : 17544, 17898 . : milestone, 17721, 
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.43 ms [18.238 ms, 18.623 ms] -
appsec 18.779 ms [18.59 ms, 18.968 ms] 348.417 µs (1.9%)
code_origins 17.883 ms [17.704 ms, 18.061 ms] -547.923 µs (-3.0%)
iast 17.586 ms [17.416 ms, 17.756 ms] -844.504 µs (-4.6%)
profiling 18.711 ms [18.526 ms, 18.896 ms] 280.586 µs (1.5%)
tracing 17.765 ms [17.588 ms, 17.942 ms] -665.228 µs (-3.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.226 ms [17.052 ms, 17.4 ms] -
appsec 18.897 ms [18.707 ms, 19.087 ms] 1.671 ms (9.7%)
code_origins 17.593 ms [17.419 ms, 17.767 ms] 367.062 µs (2.1%)
iast 17.676 ms [17.499 ms, 17.852 ms] 450.006 µs (2.6%)
profiling 19.498 ms [19.298 ms, 19.698 ms] 2.272 ms (13.2%)
tracing 17.721 ms [17.544 ms, 17.898 ms] 495.347 µs (2.9%)
Request duration reports for insecure-bank
gantt title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~ce9b02c4cf, baseline=1.56.0-SNAPSHOT~7a4d8d030d dateFormat X axisFormat %s section baseline no_agent (1.191 ms) : 1180, 1203 . : milestone, 1191, iast (3.252 ms) : 3213, 3292 . : milestone, 3252, iast_FULL (5.865 ms) : 5785, 5945 . : milestone, 5865, iast_GLOBAL (3.607 ms) : 3548, 3666 . : milestone, 3607, profiling (2.034 ms) : 2016, 2052 . : milestone, 2034, tracing (1.856 ms) : 1840, 1873 . : milestone, 1856, section candidate no_agent (1.184 ms) : 1173, 1196 . : milestone, 1184, iast (3.301 ms) : 3250, 3353 . : milestone, 3301, iast_FULL (5.925 ms) : 5866, 5985 . : milestone, 5925, iast_GLOBAL (3.652 ms) : 3598, 3705 . : milestone, 3652, profiling (1.912 ms) : 1897, 1928 . : milestone, 1912, tracing (1.797 ms) : 1782, 1812 . : milestone, 1797, 
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.191 ms [1.18 ms, 1.203 ms] -
iast 3.252 ms [3.213 ms, 3.292 ms] 2.061 ms (173.0%)
iast_FULL 5.865 ms [5.785 ms, 5.945 ms] 4.674 ms (392.3%)
iast_GLOBAL 3.607 ms [3.548 ms, 3.666 ms] 2.415 ms (202.8%)
profiling 2.034 ms [2.016 ms, 2.052 ms] 842.581 µs (70.7%)
tracing 1.856 ms [1.84 ms, 1.873 ms] 665.007 µs (55.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.184 ms [1.173 ms, 1.196 ms] -
iast 3.301 ms [3.25 ms, 3.353 ms] 2.117 ms (178.7%)
iast_FULL 5.925 ms [5.866 ms, 5.985 ms] 4.741 ms (400.3%)
iast_GLOBAL 3.652 ms [3.598 ms, 3.705 ms] 2.467 ms (208.3%)
profiling 1.912 ms [1.897 ms, 1.928 ms] 727.852 µs (61.5%)
tracing 1.797 ms [1.782 ms, 1.812 ms] 612.538 µs (51.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/testing_ci
git_commit_date 1763072899 1763097299
git_commit_sha 7a4d8d0 ce9b02c
release_version 1.56.0-SNAPSHOT~7a4d8d030d 1.56.0-SNAPSHOT~ce9b02c4cf
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1763099260 1763099260
ci_job_id 1234535088 1234535088
ci_pipeline_id 82370223 82370223
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-hb1qwkmu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-hb1qwkmu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~ce9b02c4cf, baseline=1.56.0-SNAPSHOT~7a4d8d030d dateFormat X axisFormat %s section baseline no_agent (1.478 ms) : 1466, 1489 . : milestone, 1478, appsec (3.688 ms) : 3468, 3908 . : milestone, 3688, iast (2.22 ms) : 2156, 2283 . : milestone, 2220, iast_GLOBAL (2.248 ms) : 2184, 2312 . : milestone, 2248, profiling (2.08 ms) : 2027, 2133 . : milestone, 2080, tracing (2.026 ms) : 1977, 2076 . : milestone, 2026, section candidate no_agent (1.477 ms) : 1465, 1488 . : milestone, 1477, appsec (3.719 ms) : 3499, 3939 . : milestone, 3719, iast (2.221 ms) : 2157, 2285 . : milestone, 2221, iast_GLOBAL (2.245 ms) : 2181, 2309 . : milestone, 2245, profiling (2.053 ms) : 2001, 2105 . : milestone, 2053, tracing (2.034 ms) : 1984, 2084 . : milestone, 2034, 
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.489 ms] -
appsec 3.688 ms [3.468 ms, 3.908 ms] 2.21 ms (149.5%)
iast 2.22 ms [2.156 ms, 2.283 ms] 741.826 µs (50.2%)
iast_GLOBAL 2.248 ms [2.184 ms, 2.312 ms] 770.13 µs (52.1%)
profiling 2.08 ms [2.027 ms, 2.133 ms] 602.328 µs (40.8%)
tracing 2.026 ms [1.977 ms, 2.076 ms] 548.159 µs (37.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 3.719 ms [3.499 ms, 3.939 ms] 2.243 ms (151.9%)
iast 2.221 ms [2.157 ms, 2.285 ms] 744.37 µs (50.4%)
iast_GLOBAL 2.245 ms [2.181 ms, 2.309 ms] 768.797 µs (52.1%)
profiling 2.053 ms [2.001 ms, 2.105 ms] 576.492 µs (39.0%)
tracing 2.034 ms [1.984 ms, 2.084 ms] 557.816 µs (37.8%)
Execution time for biojava
gantt title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~ce9b02c4cf, baseline=1.56.0-SNAPSHOT~7a4d8d030d dateFormat X axisFormat %s section baseline no_agent (14.959 s) : 14959000, 14959000 . : milestone, 14959000, appsec (15.098 s) : 15098000, 15098000 . : milestone, 15098000, iast (18.569 s) : 18569000, 18569000 . : milestone, 18569000, iast_GLOBAL (18.021 s) : 18021000, 18021000 . : milestone, 18021000, profiling (14.812 s) : 14812000, 14812000 . : milestone, 14812000, tracing (14.584 s) : 14584000, 14584000 . : milestone, 14584000, section candidate no_agent (14.921 s) : 14921000, 14921000 . : milestone, 14921000, appsec (14.724 s) : 14724000, 14724000 . : milestone, 14724000, iast (18.385 s) : 18385000, 18385000 . : milestone, 18385000, iast_GLOBAL (17.844 s) : 17844000, 17844000 . : milestone, 17844000, profiling (15.311 s) : 15311000, 15311000 . : milestone, 15311000, tracing (14.639 s) : 14639000, 14639000 . : milestone, 14639000, 
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.959 s [14.959 s, 14.959 s] -
appsec 15.098 s [15.098 s, 15.098 s] 139.0 ms (0.9%)
iast 18.569 s [18.569 s, 18.569 s] 3.61 s (24.1%)
iast_GLOBAL 18.021 s [18.021 s, 18.021 s] 3.062 s (20.5%)
profiling 14.812 s [14.812 s, 14.812 s] -147.0 ms (-1.0%)
tracing 14.584 s [14.584 s, 14.584 s] -375.0 ms (-2.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.921 s [14.921 s, 14.921 s] -
appsec 14.724 s [14.724 s, 14.724 s] -197.0 ms (-1.3%)
iast 18.385 s [18.385 s, 18.385 s] 3.464 s (23.2%)
iast_GLOBAL 17.844 s [17.844 s, 17.844 s] 2.923 s (19.6%)
profiling 15.311 s [15.311 s, 15.311 s] 390.0 ms (2.6%)
tracing 14.639 s [14.639 s, 14.639 s] -282.0 ms (-1.9%)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: do not merge Do not merge changes

2 participants