Skip to content

Conversation

mobuchowski
Copy link
Contributor

What Does This Do

Points to updated system tests to make #8541 pass.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@mobuchowski mobuchowski requested a review from a team as a code owner April 2, 2025 08:13
@mobuchowski mobuchowski requested a review from amarziali April 2, 2025 08:13
Copy link
Contributor

github-actions bot commented Apr 2, 2025

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@mobuchowski mobuchowski added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Apr 2, 2025
@pr-commenter
Copy link

pr-commenter bot commented Apr 2, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mobuchowski/update-system-tests
git_commit_date 1743592817 1743597109
git_commit_sha 32046a3 35a9c7a
release_version 1.48.0-SNAPSHOT~32046a39ed 1.48.0-SNAPSHOT~35a9c7a0f0
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1743600316 1743600316
ci_job_id 876906122 876906122
ci_pipeline_id 60791274 60791274
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-m1cw8fbu-project-304-concurrent-2-snjn49pl 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-m1cw8fbu-project-304-concurrent-2-snjn49pl 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 69 metrics, 2 unstable metrics.

Startup time reports for petclinic
gantt title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~35a9c7a0f0, baseline=1.48.0-SNAPSHOT~32046a39ed dateFormat X axisFormat %s section tracing Agent [baseline] (1.053 s) : 0, 1053213 Total [baseline] (10.507 s) : 0, 10507357 Agent [candidate] (1.051 s) : 0, 1050650 Total [candidate] (10.494 s) : 0, 10493634 section appsec Agent [baseline] (1.192 s) : 0, 1192121 Total [baseline] (10.796 s) : 0, 10795829 Agent [candidate] (1.201 s) : 0, 1200862 Total [candidate] (10.816 s) : 0, 10815512 section iast Agent [baseline] (1.181 s) : 0, 1181227 Total [baseline] (11.062 s) : 0, 11062147 Agent [candidate] (1.187 s) : 0, 1187119 Total [candidate] (11.077 s) : 0, 11077028 section profiling Agent [baseline] (1.278 s) : 0, 1277551 Total [baseline] (10.925 s) : 0, 10924871 Agent [candidate] (1.276 s) : 0, 1275858 Total [candidate] (10.86 s) : 0, 10860150 
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent appsec 1.192 s 138.908 ms (13.2%)
Agent iast 1.181 s 128.013 ms (12.2%)
Agent profiling 1.278 s 224.338 ms (21.3%)
Total tracing 10.507 s -
Total appsec 10.796 s 288.472 ms (2.7%)
Total iast 11.062 s 554.791 ms (5.3%)
Total profiling 10.925 s 417.515 ms (4.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent appsec 1.201 s 150.212 ms (14.3%)
Agent iast 1.187 s 136.469 ms (13.0%)
Agent profiling 1.276 s 225.208 ms (21.4%)
Total tracing 10.494 s -
Total appsec 10.816 s 321.878 ms (3.1%)
Total iast 11.077 s 583.394 ms (5.6%)
Total profiling 10.86 s 366.516 ms (3.5%)
gantt title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~35a9c7a0f0, baseline=1.48.0-SNAPSHOT~32046a39ed dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (717.745 ms) : 0, 717745 BytebuddyAgent [candidate] (717.99 ms) : 0, 717990 GlobalTracer [baseline] (239.116 ms) : 0, 239116 GlobalTracer [candidate] (239.303 ms) : 0, 239303 AppSec [baseline] (54.356 ms) : 0, 54356 AppSec [candidate] (54.182 ms) : 0, 54182 Debugger [baseline] (4.401 ms) : 0, 4401 Debugger [candidate] (4.422 ms) : 0, 4422 Remote Config [baseline] (689.48 µs) : 0, 689 Remote Config [candidate] (683.023 µs) : 0, 683 Telemetry [baseline] (16.497 ms) : 0, 16497 Telemetry [candidate] (13.436 ms) : 0, 13436 section appsec BytebuddyAgent [baseline] (736.596 ms) : 0, 736596 BytebuddyAgent [candidate] (742.346 ms) : 0, 742346 GlobalTracer [baseline] (235.449 ms) : 0, 235449 GlobalTracer [candidate] (237.156 ms) : 0, 237156 IAST [baseline] (21.547 ms) : 0, 21547 IAST [candidate] (21.834 ms) : 0, 21834 AppSec [baseline] (175.736 ms) : 0, 175736 AppSec [candidate] (176.646 ms) : 0, 176646 Debugger [baseline] (4.275 ms) : 0, 4275 Debugger [candidate] (4.311 ms) : 0, 4311 Remote Config [baseline] (645.966 µs) : 0, 646 Remote Config [candidate] (657.348 µs) : 0, 657 Telemetry [baseline] (8.218 ms) : 0, 8218 Telemetry [candidate] (8.245 ms) : 0, 8245 section iast BytebuddyAgent [baseline] (838.736 ms) : 0, 838736 BytebuddyAgent [candidate] (843.606 ms) : 0, 843606 GlobalTracer [baseline] (230.009 ms) : 0, 230009 GlobalTracer [candidate] (230.665 ms) : 0, 230665 IAST [baseline] (22.645 ms) : 0, 22645 IAST [candidate] (22.765 ms) : 0, 22765 AppSec [baseline] (55.891 ms) : 0, 55891 AppSec [candidate] (55.955 ms) : 0, 55955 Debugger [baseline] (4.145 ms) : 0, 4145 Debugger [candidate] (4.164 ms) : 0, 4164 Remote Config [baseline] (615.382 µs) : 0, 615 Remote Config [candidate] (618.616 µs) : 0, 619 Telemetry [baseline] (8.776 ms) : 0, 8776 Telemetry [candidate] (8.837 ms) : 0, 8837 section profiling BytebuddyAgent [baseline] (710.468 ms) : 0, 710468 BytebuddyAgent [candidate] (710.395 ms) : 0, 710395 GlobalTracer [baseline] (350.286 ms) : 0, 350286 GlobalTracer [candidate] (349.472 ms) : 0, 349472 AppSec [baseline] (54.216 ms) : 0, 54216 AppSec [candidate] (53.447 ms) : 0, 53447 Debugger [baseline] (4.265 ms) : 0, 4265 Debugger [candidate] (4.251 ms) : 0, 4251 Remote Config [baseline] (703.738 µs) : 0, 704 Remote Config [candidate] (708.04 µs) : 0, 708 Telemetry [baseline] (9.058 ms) : 0, 9058 Telemetry [candidate] (8.955 ms) : 0, 8955 ProfilingAgent [baseline] (102.876 ms) : 0, 102876 ProfilingAgent [candidate] (102.837 ms) : 0, 102837 Profiling [baseline] (102.902 ms) : 0, 102902 Profiling [candidate] (102.861 ms) : 0, 102861 
Loading
Startup time reports for insecure-bank
gantt title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~35a9c7a0f0, baseline=1.48.0-SNAPSHOT~32046a39ed dateFormat X axisFormat %s section tracing Agent [baseline] (1.058 s) : 0, 1057565 Total [baseline] (8.694 s) : 0, 8694429 Agent [candidate] (1.058 s) : 0, 1057915 Total [candidate] (8.67 s) : 0, 8669719 section iast Agent [baseline] (1.18 s) : 0, 1180170 Total [baseline] (9.286 s) : 0, 9286136 Agent [candidate] (1.18 s) : 0, 1180482 Total [candidate] (9.263 s) : 0, 9262781 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.183 s) : 0, 1183471 Total [baseline] (9.291 s) : 0, 9291327 Agent [candidate] (1.19 s) : 0, 1189807 Total [candidate] (9.26 s) : 0, 9259999 section iast_TELEMETRY_OFF Agent [baseline] (1.185 s) : 0, 1184634 Total [baseline] (9.283 s) : 0, 9282861 Agent [candidate] (1.183 s) : 0, 1183241 Total [candidate] (9.297 s) : 0, 9296599 
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent iast 1.18 s 122.605 ms (11.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.183 s 125.906 ms (11.9%)
Agent iast_TELEMETRY_OFF 1.185 s 127.068 ms (12.0%)
Total tracing 8.694 s -
Total iast 9.286 s 591.706 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.291 s 596.898 ms (6.9%)
Total iast_TELEMETRY_OFF 9.283 s 588.431 ms (6.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent iast 1.18 s 122.567 ms (11.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.19 s 131.892 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.183 s 125.326 ms (11.8%)
Total tracing 8.67 s -
Total iast 9.263 s 593.063 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.26 s 590.28 ms (6.8%)
Total iast_TELEMETRY_OFF 9.297 s 626.88 ms (7.2%)
gantt title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~35a9c7a0f0, baseline=1.48.0-SNAPSHOT~32046a39ed dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (723.748 ms) : 0, 723748 BytebuddyAgent [candidate] (723.392 ms) : 0, 723392 GlobalTracer [baseline] (239.541 ms) : 0, 239541 GlobalTracer [candidate] (240.893 ms) : 0, 240893 AppSec [baseline] (55.586 ms) : 0, 55586 AppSec [candidate] (56.217 ms) : 0, 56217 Debugger [baseline] (4.451 ms) : 0, 4451 Debugger [candidate] (4.487 ms) : 0, 4487 Remote Config [baseline] (691.983 µs) : 0, 692 Remote Config [candidate] (701.816 µs) : 0, 702 Telemetry [baseline] (12.952 ms) : 0, 12952 Telemetry [candidate] (11.582 ms) : 0, 11582 section iast BytebuddyAgent [baseline] (837.434 ms) : 0, 837434 BytebuddyAgent [candidate] (838.601 ms) : 0, 838601 GlobalTracer [baseline] (229.604 ms) : 0, 229604 GlobalTracer [candidate] (229.544 ms) : 0, 229544 IAST [baseline] (22.758 ms) : 0, 22758 IAST [candidate] (22.73 ms) : 0, 22730 AppSec [baseline] (56.337 ms) : 0, 56337 AppSec [candidate] (55.685 ms) : 0, 55685 Debugger [baseline] (4.18 ms) : 0, 4180 Debugger [candidate] (4.128 ms) : 0, 4128 Remote Config [baseline] (627.744 µs) : 0, 628 Remote Config [candidate] (615.968 µs) : 0, 616 Telemetry [baseline] (8.827 ms) : 0, 8827 Telemetry [candidate] (8.704 ms) : 0, 8704 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (840.079 ms) : 0, 840079 BytebuddyAgent [candidate] (844.857 ms) : 0, 844857 GlobalTracer [baseline] (230.443 ms) : 0, 230443 GlobalTracer [candidate] (230.908 ms) : 0, 230908 IAST [baseline] (22.976 ms) : 0, 22976 IAST [candidate] (23.054 ms) : 0, 23054 AppSec [baseline] (55.847 ms) : 0, 55847 AppSec [candidate] (56.558 ms) : 0, 56558 Debugger [baseline] (4.172 ms) : 0, 4172 Debugger [candidate] (4.221 ms) : 0, 4221 Remote Config [baseline] (617.586 µs) : 0, 618 Remote Config [candidate] (631.37 µs) : 0, 631 Telemetry [baseline] (8.806 ms) : 0, 8806 Telemetry [candidate] (8.921 ms) : 0, 8921 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (841.224 ms) : 0, 841224 BytebuddyAgent [candidate] (840.039 ms) : 0, 840039 GlobalTracer [baseline] (230.535 ms) : 0, 230535 GlobalTracer [candidate] (230.453 ms) : 0, 230453 IAST [baseline] (22.378 ms) : 0, 22378 IAST [candidate] (22.497 ms) : 0, 22497 AppSec [baseline] (56.289 ms) : 0, 56289 AppSec [candidate] (56.246 ms) : 0, 56246 Debugger [baseline] (4.228 ms) : 0, 4228 Debugger [candidate] (4.174 ms) : 0, 4174 Remote Config [baseline] (631.423 µs) : 0, 631 Remote Config [candidate] (616.427 µs) : 0, 616 Telemetry [baseline] (8.82 ms) : 0, 8820 Telemetry [candidate] (8.667 ms) : 0, 8667 
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-04-02T12:53:04 2025-04-02T13:00:50
git_branch master mobuchowski/update-system-tests
git_commit_date 1743592817 1743597109
git_commit_sha 32046a3 35a9c7a
release_version 1.48.0-SNAPSHOT~32046a39ed 1.48.0-SNAPSHOT~35a9c7a0f0
start_time 2025-04-02T12:52:50 2025-04-02T13:00:36
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1743599251 1743599251
ci_job_id 876906124 876906124
ci_pipeline_id 60791274 60791274
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-f8yuutny-project-304-concurrent-1-i6zxx8b0 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-f8yuutny-project-304-concurrent-1-i6zxx8b0 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for petclinic
gantt title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~35a9c7a0f0, baseline=1.48.0-SNAPSHOT~32046a39ed dateFormat X axisFormat %s section baseline no_agent (1.379 ms) : 1359, 1398 . : milestone, 1379, appsec (1.733 ms) : 1709, 1757 . : milestone, 1733, appsec_no_iast (1.734 ms) : 1709, 1760 . : milestone, 1734, code_origins (1.703 ms) : 1676, 1731 . : milestone, 1703, iast (1.524 ms) : 1500, 1549 . : milestone, 1524, profiling (1.542 ms) : 1519, 1564 . : milestone, 1542, tracing (1.508 ms) : 1484, 1533 . : milestone, 1508, section candidate no_agent (1.375 ms) : 1355, 1395 . : milestone, 1375, appsec (1.755 ms) : 1731, 1779 . : milestone, 1755, appsec_no_iast (1.76 ms) : 1737, 1783 . : milestone, 1760, code_origins (1.693 ms) : 1667, 1720 . : milestone, 1693, iast (1.553 ms) : 1529, 1577 . : milestone, 1553, profiling (1.564 ms) : 1540, 1588 . : milestone, 1564, tracing (1.497 ms) : 1473, 1521 . : milestone, 1497, 
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.379 ms [1.359 ms, 1.398 ms] -
appsec 1.733 ms [1.709 ms, 1.757 ms] 354.758 µs (25.7%)
appsec_no_iast 1.734 ms [1.709 ms, 1.76 ms] 355.834 µs (25.8%)
code_origins 1.703 ms [1.676 ms, 1.731 ms] 324.803 µs (23.6%)
iast 1.524 ms [1.5 ms, 1.549 ms] 145.735 µs (10.6%)
profiling 1.542 ms [1.519 ms, 1.564 ms] 162.966 µs (11.8%)
tracing 1.508 ms [1.484 ms, 1.533 ms] 129.865 µs (9.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.375 ms [1.355 ms, 1.395 ms] -
appsec 1.755 ms [1.731 ms, 1.779 ms] 379.835 µs (27.6%)
appsec_no_iast 1.76 ms [1.737 ms, 1.783 ms] 384.566 µs (28.0%)
code_origins 1.693 ms [1.667 ms, 1.72 ms] 318.205 µs (23.1%)
iast 1.553 ms [1.529 ms, 1.577 ms] 177.793 µs (12.9%)
profiling 1.564 ms [1.54 ms, 1.588 ms] 188.886 µs (13.7%)
tracing 1.497 ms [1.473 ms, 1.521 ms] 121.375 µs (8.8%)
Request duration reports for insecure-bank
gantt title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~35a9c7a0f0, baseline=1.48.0-SNAPSHOT~32046a39ed dateFormat X axisFormat %s section baseline no_agent (382.704 µs) : 362, 403 . : milestone, 383, iast (516.105 µs) : 494, 538 . : milestone, 516, iast_FULL (740.449 µs) : 718, 763 . : milestone, 740, iast_GLOBAL (565.735 µs) : 543, 588 . : milestone, 566, iast_HARDCODED_SECRET_DISABLED (520.79 µs) : 499, 543 . : milestone, 521, iast_INACTIVE (468.867 µs) : 448, 490 . : milestone, 469, iast_TELEMETRY_OFF (508.714 µs) : 487, 531 . : milestone, 509, tracing (469.892 µs) : 448, 491 . : milestone, 470, section candidate no_agent (386.583 µs) : 367, 407 . : milestone, 387, iast (519.159 µs) : 497, 541 . : milestone, 519, iast_FULL (738.314 µs) : 716, 760 . : milestone, 738, iast_GLOBAL (564.337 µs) : 543, 586 . : milestone, 564, iast_HARDCODED_SECRET_DISABLED (520.108 µs) : 498, 542 . : milestone, 520, iast_INACTIVE (474.892 µs) : 453, 497 . : milestone, 475, iast_TELEMETRY_OFF (511.034 µs) : 489, 534 . : milestone, 511, tracing (462.351 µs) : 441, 484 . : milestone, 462, 
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 382.704 µs [362.249 µs, 403.158 µs] -
iast 516.105 µs [494.24 µs, 537.97 µs] 133.401 µs (34.9%)
iast_FULL 740.449 µs [718.02 µs, 762.879 µs] 357.745 µs (93.5%)
iast_GLOBAL 565.735 µs [543.376 µs, 588.094 µs] 183.031 µs (47.8%)
iast_HARDCODED_SECRET_DISABLED 520.79 µs [498.829 µs, 542.752 µs] 138.087 µs (36.1%)
iast_INACTIVE 468.867 µs [447.623 µs, 490.111 µs] 86.163 µs (22.5%)
iast_TELEMETRY_OFF 508.714 µs [486.768 µs, 530.66 µs] 126.01 µs (32.9%)
tracing 469.892 µs [448.364 µs, 491.42 µs] 87.188 µs (22.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 386.583 µs [366.636 µs, 406.53 µs] -
iast 519.159 µs [496.901 µs, 541.416 µs] 132.576 µs (34.3%)
iast_FULL 738.314 µs [716.3 µs, 760.327 µs] 351.731 µs (91.0%)
iast_GLOBAL 564.337 µs [542.503 µs, 586.171 µs] 177.754 µs (46.0%)
iast_HARDCODED_SECRET_DISABLED 520.108 µs [498.387 µs, 541.829 µs] 133.526 µs (34.5%)
iast_INACTIVE 474.892 µs [452.653 µs, 497.13 µs] 88.309 µs (22.8%)
iast_TELEMETRY_OFF 511.034 µs [488.56 µs, 533.508 µs] 124.451 µs (32.2%)
tracing 462.351 µs [440.549 µs, 484.152 µs] 75.768 µs (19.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mobuchowski/update-system-tests
git_commit_date 1743592817 1743597109
git_commit_sha 32046a3 35a9c7a
release_version 1.48.0-SNAPSHOT~32046a39ed 1.48.0-SNAPSHOT~35a9c7a0f0
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1743599732 1743599732
ci_job_id 876906127 876906127
ci_pipeline_id 60791274 60791274
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-m1cw8fbu-project-304-concurrent-3-j111oe4i 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-m1cw8fbu-project-304-concurrent-3-j111oe4i 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~35a9c7a0f0, baseline=1.48.0-SNAPSHOT~32046a39ed dateFormat X axisFormat %s section baseline no_agent (1.466 ms) : 1455, 1478 . : milestone, 1466, appsec (2.373 ms) : 2326, 2420 . : milestone, 2373, iast (2.153 ms) : 2094, 2213 . : milestone, 2153, iast_GLOBAL (2.205 ms) : 2145, 2266 . : milestone, 2205, profiling (2.006 ms) : 1958, 2053 . : milestone, 2006, tracing (1.981 ms) : 1935, 2027 . : milestone, 1981, section candidate no_agent (1.467 ms) : 1456, 1478 . : milestone, 1467, appsec (2.376 ms) : 2329, 2424 . : milestone, 2376, iast (2.161 ms) : 2101, 2221 . : milestone, 2161, iast_GLOBAL (2.2 ms) : 2140, 2260 . : milestone, 2200, profiling (1.994 ms) : 1947, 2042 . : milestone, 1994, tracing (1.995 ms) : 1948, 2041 . : milestone, 1995, 
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.466 ms [1.455 ms, 1.478 ms] -
appsec 2.373 ms [2.326 ms, 2.42 ms] 906.718 µs (61.8%)
iast 2.153 ms [2.094 ms, 2.213 ms] 687.172 µs (46.9%)
iast_GLOBAL 2.205 ms [2.145 ms, 2.266 ms] 739.051 µs (50.4%)
profiling 2.006 ms [1.958 ms, 2.053 ms] 539.252 µs (36.8%)
tracing 1.981 ms [1.935 ms, 2.027 ms] 514.966 µs (35.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.456 ms, 1.478 ms] -
appsec 2.376 ms [2.329 ms, 2.424 ms] 909.134 µs (62.0%)
iast 2.161 ms [2.101 ms, 2.221 ms] 694.06 µs (47.3%)
iast_GLOBAL 2.2 ms [2.14 ms, 2.26 ms] 733.07 µs (50.0%)
profiling 1.994 ms [1.947 ms, 2.042 ms] 527.36 µs (35.9%)
tracing 1.995 ms [1.948 ms, 2.041 ms] 527.729 µs (36.0%)
Execution time for biojava
gantt title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~35a9c7a0f0, baseline=1.48.0-SNAPSHOT~32046a39ed dateFormat X axisFormat %s section baseline no_agent (15.326 s) : 15326000, 15326000 . : milestone, 15326000, appsec (14.747 s) : 14747000, 14747000 . : milestone, 14747000, iast (18.623 s) : 18623000, 18623000 . : milestone, 18623000, iast_GLOBAL (18.201 s) : 18201000, 18201000 . : milestone, 18201000, profiling (15.301 s) : 15301000, 15301000 . : milestone, 15301000, tracing (14.735 s) : 14735000, 14735000 . : milestone, 14735000, section candidate no_agent (15.45 s) : 15450000, 15450000 . : milestone, 15450000, appsec (14.997 s) : 14997000, 14997000 . : milestone, 14997000, iast (19.101 s) : 19101000, 19101000 . : milestone, 19101000, iast_GLOBAL (18.158 s) : 18158000, 18158000 . : milestone, 18158000, profiling (14.886 s) : 14886000, 14886000 . : milestone, 14886000, tracing (15.053 s) : 15053000, 15053000 . : milestone, 15053000, 
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.326 s [15.326 s, 15.326 s] -
appsec 14.747 s [14.747 s, 14.747 s] -579.0 ms (-3.8%)
iast 18.623 s [18.623 s, 18.623 s] 3.297 s (21.5%)
iast_GLOBAL 18.201 s [18.201 s, 18.201 s] 2.875 s (18.8%)
profiling 15.301 s [15.301 s, 15.301 s] -25.0 ms (-0.2%)
tracing 14.735 s [14.735 s, 14.735 s] -591.0 ms (-3.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.45 s [15.45 s, 15.45 s] -
appsec 14.997 s [14.997 s, 14.997 s] -453.0 ms (-2.9%)
iast 19.101 s [19.101 s, 19.101 s] 3.651 s (23.6%)
iast_GLOBAL 18.158 s [18.158 s, 18.158 s] 2.708 s (17.5%)
profiling 14.886 s [14.886 s, 14.886 s] -564.0 ms (-3.7%)
tracing 15.053 s [15.053 s, 15.053 s] -397.0 ms (-2.6%)
@mobuchowski mobuchowski changed the title Update system-tests to c8c4db362291ae5cb5173dc3765c79be9e18ed35 Update system-tests to 63dc98fd3bbf07dfe9aa35f14aeee38024312eb4 Apr 2, 2025
@mobuchowski mobuchowski closed this Apr 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes

2 participants