Skip to content

Update system-tests to 5aee0ed598fd984344cf0da0048b27bdb2eb4da1 #8537

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Mar 11, 2025
Merged

Update system-tests to 5aee0ed598fd984344cf0da0048b27bdb2eb4da1 #8537

merged 1 commit into from
Mar 11, 2025

Conversation

mhlidd
Copy link
Contributor

@mhlidd mhlidd commented Mar 11, 2025

What Does This Do

Help fix CI system-tests failures that were recently fixed.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]
@pr-commenter
Copy link

pr-commenter bot commented Mar 11, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/update_system_tests_hash
git_commit_date 1741707364 1741714757
git_commit_sha f8c6b49 9577564
release_version 1.48.0-SNAPSHOT~f8c6b49f18 1.48.0-SNAPSHOT~9577564f7f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741717270 1741717270
ci_job_id 842955516 842955516
ci_pipeline_id 58465015 58465015
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-2wkmbgws-project-304-concurrent-0-2t1i830n 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-2wkmbgws-project-304-concurrent-0-2t1i830n 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 3 unstable metrics.

Startup time reports for insecure-bank 
gantt title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18 dateFormat X axisFormat %s section tracing Agent [baseline] (1.045 s) : 0, 1044833 Total [baseline] (8.711 s) : 0, 8710651 Agent [candidate] (1.043 s) : 0, 1042606 Total [candidate] (8.685 s) : 0, 8685421 section iast Agent [baseline] (1.172 s) : 0, 1172072 Total [baseline] (9.25 s) : 0, 9249589 Agent [candidate] (1.188 s) : 0, 1187707 Total [candidate] (9.275 s) : 0, 9274916 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.173 s) : 0, 1173493 Total [baseline] (9.228 s) : 0, 9227541 Agent [candidate] (1.175 s) : 0, 1174795 Total [candidate] (9.239 s) : 0, 9238916 section iast_TELEMETRY_OFF Agent [baseline] (1.179 s) : 0, 1178819 Total [baseline] (9.269 s) : 0, 9268518 Agent [candidate] (1.169 s) : 0, 1168912 Total [candidate] (9.272 s) : 0, 9271895
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent iast 1.172 s 127.24 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.173 s 128.66 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.179 s 133.987 ms (12.8%)
Total tracing 8.711 s -
Total iast 9.25 s 538.938 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.228 s 516.89 ms (5.9%)
Total iast_TELEMETRY_OFF 9.269 s 557.867 ms (6.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.043 s -
Agent iast 1.188 s 145.101 ms (13.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.175 s 132.188 ms (12.7%)
Agent iast_TELEMETRY_OFF 1.169 s 126.306 ms (12.1%)
Total tracing 8.685 s -
Total iast 9.275 s 589.495 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.239 s 553.495 ms (6.4%)
Total iast_TELEMETRY_OFF 9.272 s 586.474 ms (6.8%) 
gantt title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (720.124 ms) : 0, 720124 BytebuddyAgent [candidate] (718.841 ms) : 0, 718841 GlobalTracer [baseline] (239.963 ms) : 0, 239963 GlobalTracer [candidate] (239.546 ms) : 0, 239546 AppSec [baseline] (55.268 ms) : 0, 55268 AppSec [candidate] (55.055 ms) : 0, 55055 Remote Config [baseline] (686.077 µs) : 0, 686 Remote Config [candidate] (682.442 µs) : 0, 682 Telemetry [baseline] (13.842 ms) : 0, 13842 Telemetry [candidate] (13.494 ms) : 0, 13494 section iast BytebuddyAgent [baseline] (837.852 ms) : 0, 837852 BytebuddyAgent [candidate] (850.532 ms) : 0, 850532 GlobalTracer [baseline] (230.535 ms) : 0, 230535 GlobalTracer [candidate] (232.686 ms) : 0, 232686 IAST [baseline] (22.788 ms) : 0, 22788 IAST [candidate] (23.23 ms) : 0, 23230 AppSec [baseline] (56.676 ms) : 0, 56676 AppSec [candidate] (56.736 ms) : 0, 56736 Remote Config [baseline] (617.601 µs) : 0, 618 Remote Config [candidate] (622.703 µs) : 0, 623 Telemetry [baseline] (8.677 ms) : 0, 8677 Telemetry [candidate] (8.78 ms) : 0, 8780 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (839.054 ms) : 0, 839054 BytebuddyAgent [candidate] (839.294 ms) : 0, 839294 GlobalTracer [baseline] (230.465 ms) : 0, 230465 GlobalTracer [candidate] (231.317 ms) : 0, 231317 IAST [baseline] (23.03 ms) : 0, 23030 IAST [candidate] (22.845 ms) : 0, 22845 AppSec [baseline] (56.732 ms) : 0, 56732 AppSec [candidate] (57.098 ms) : 0, 57098 Remote Config [baseline] (605.193 µs) : 0, 605 Remote Config [candidate] (593.47 µs) : 0, 593 Telemetry [baseline] (8.697 ms) : 0, 8697 Telemetry [candidate] (8.711 ms) : 0, 8711 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (841.171 ms) : 0, 841171 BytebuddyAgent [candidate] (835.022 ms) : 0, 835022 GlobalTracer [baseline] (232.413 ms) : 0, 232413 GlobalTracer [candidate] (230.389 ms) : 0, 230389 IAST [baseline] (22.913 ms) : 0, 22913 IAST [candidate] (22.402 ms) : 0, 22402 AppSec [baseline] (57.802 ms) : 0, 57802 AppSec [candidate] (56.939 ms) : 0, 56939 Remote Config [baseline] (629.875 µs) : 0, 630 Remote Config [candidate] (602.936 µs) : 0, 603 Telemetry [baseline] (8.879 ms) : 0, 8879 Telemetry [candidate] (8.63 ms) : 0, 8630
Loading
Startup time reports for petclinic 
gantt title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18 dateFormat X axisFormat %s section tracing Agent [baseline] (1.04 s) : 0, 1039536 Total [baseline] (10.468 s) : 0, 10468350 Agent [candidate] (1.046 s) : 0, 1045703 Total [candidate] (10.574 s) : 0, 10573938 section appsec Agent [baseline] (1.191 s) : 0, 1190716 Total [baseline] (10.766 s) : 0, 10765854 Agent [candidate] (1.183 s) : 0, 1182949 Total [candidate] (10.765 s) : 0, 10764577 section iast Agent [baseline] (1.182 s) : 0, 1181701 Total [baseline] (11.144 s) : 0, 11143815 Agent [candidate] (1.171 s) : 0, 1171324 Total [candidate] (10.995 s) : 0, 10995272 section profiling Agent [baseline] (1.269 s) : 0, 1268661 Total [baseline] (10.899 s) : 0, 10899446 Agent [candidate] (1.269 s) : 0, 1269204 Total [candidate] (10.854 s) : 0, 10853624
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent appsec 1.191 s 151.18 ms (14.5%)
Agent iast 1.182 s 142.166 ms (13.7%)
Agent profiling 1.269 s 229.125 ms (22.0%)
Total tracing 10.468 s -
Total appsec 10.766 s 297.504 ms (2.8%)
Total iast 11.144 s 675.465 ms (6.5%)
Total profiling 10.899 s 431.096 ms (4.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent appsec 1.183 s 137.246 ms (13.1%)
Agent iast 1.171 s 125.621 ms (12.0%)
Agent profiling 1.269 s 223.501 ms (21.4%)
Total tracing 10.574 s -
Total appsec 10.765 s 190.639 ms (1.8%)
Total iast 10.995 s 421.334 ms (4.0%)
Total profiling 10.854 s 279.686 ms (2.6%) 
gantt title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (717.587 ms) : 0, 717587 BytebuddyAgent [candidate] (719.755 ms) : 0, 719755 GlobalTracer [baseline] (239.526 ms) : 0, 239526 GlobalTracer [candidate] (240.514 ms) : 0, 240514 AppSec [baseline] (55.405 ms) : 0, 55405 AppSec [candidate] (55.539 ms) : 0, 55539 Remote Config [baseline] (682.392 µs) : 0, 682 Remote Config [candidate] (699.95 µs) : 0, 700 Telemetry [baseline] (11.477 ms) : 0, 11477 Telemetry [candidate] (14.288 ms) : 0, 14288 section appsec BytebuddyAgent [baseline] (741.731 ms) : 0, 741731 BytebuddyAgent [candidate] (735.954 ms) : 0, 735954 GlobalTracer [baseline] (237.158 ms) : 0, 237158 GlobalTracer [candidate] (236.088 ms) : 0, 236088 IAST [baseline] (21.774 ms) : 0, 21774 IAST [candidate] (21.56 ms) : 0, 21560 AppSec [baseline] (175.985 ms) : 0, 175985 AppSec [candidate] (175.976 ms) : 0, 175976 Remote Config [baseline] (661.795 µs) : 0, 662 Remote Config [candidate] (655.523 µs) : 0, 656 Telemetry [baseline] (9.314 ms) : 0, 9314 Telemetry [candidate] (8.631 ms) : 0, 8631 section iast BytebuddyAgent [baseline] (845.197 ms) : 0, 845197 BytebuddyAgent [candidate] (837.578 ms) : 0, 837578 GlobalTracer [baseline] (232.277 ms) : 0, 232277 GlobalTracer [candidate] (230.718 ms) : 0, 230718 IAST [baseline] (23.011 ms) : 0, 23011 IAST [candidate] (22.547 ms) : 0, 22547 AppSec [baseline] (56.861 ms) : 0, 56861 AppSec [candidate] (56.377 ms) : 0, 56377 Remote Config [baseline] (614.754 µs) : 0, 615 Remote Config [candidate] (599.914 µs) : 0, 600 Telemetry [baseline] (8.816 ms) : 0, 8816 Telemetry [candidate] (8.649 ms) : 0, 8649 section profiling BytebuddyAgent [baseline] (715.064 ms) : 0, 715064 BytebuddyAgent [candidate] (715.253 ms) : 0, 715253 GlobalTracer [baseline] (350.634 ms) : 0, 350634 GlobalTracer [candidate] (352.441 ms) : 0, 352441 AppSec [baseline] (55.544 ms) : 0, 55544 AppSec [candidate] (54.373 ms) : 0, 54373 Remote Config [baseline] (681.747 µs) : 0, 682 Remote Config [candidate] (678.369 µs) : 0, 678 Telemetry [baseline] (9.012 ms) : 0, 9012 Telemetry [candidate] (9.066 ms) : 0, 9066 ProfilingAgent [baseline] (97.06 ms) : 0, 97060 ProfilingAgent [candidate] (96.733 ms) : 0, 96733 Profiling [baseline] (97.084 ms) : 0, 97084 Profiling [candidate] (96.759 ms) : 0, 96759
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-11T17:51:29 2025-03-11T17:59:15
git_branch master mhlidd/update_system_tests_hash
git_commit_date 1741707364 1741714757
git_commit_sha f8c6b49 9577564
release_version 1.48.0-SNAPSHOT~f8c6b49f18 1.48.0-SNAPSHOT~9577564f7f
start_time 2025-03-11T17:51:15 2025-03-11T17:59:01
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741716353 1741716353
ci_job_id 842955517 842955517
ci_pipeline_id 58465015 58465015
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-2wkmbgws-project-304-concurrent-1-cr6e89qm 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-2wkmbgws-project-304-concurrent-1-cr6e89qm 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for petclinic 
gantt title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18 dateFormat X axisFormat %s section baseline no_agent (1.358 ms) : 1339, 1377 . : milestone, 1358, appsec (1.742 ms) : 1718, 1766 . : milestone, 1742, appsec_no_iast (1.738 ms) : 1712, 1763 . : milestone, 1738, code_origins (1.696 ms) : 1669, 1723 . : milestone, 1696, iast (1.518 ms) : 1494, 1542 . : milestone, 1518, profiling (1.537 ms) : 1512, 1562 . : milestone, 1537, tracing (1.514 ms) : 1489, 1538 . : milestone, 1514, section candidate no_agent (1.354 ms) : 1334, 1375 . : milestone, 1354, appsec (1.746 ms) : 1723, 1770 . : milestone, 1746, appsec_no_iast (1.775 ms) : 1750, 1799 . : milestone, 1775, code_origins (1.676 ms) : 1648, 1703 . : milestone, 1676, iast (1.52 ms) : 1495, 1545 . : milestone, 1520, profiling (1.531 ms) : 1508, 1554 . : milestone, 1531, tracing (1.484 ms) : 1459, 1510 . : milestone, 1484,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.358 ms [1.339 ms, 1.377 ms] -
appsec 1.742 ms [1.718 ms, 1.766 ms] 383.798 µs (28.3%)
appsec_no_iast 1.738 ms [1.712 ms, 1.763 ms] 379.235 µs (27.9%)
code_origins 1.696 ms [1.669 ms, 1.723 ms] 337.721 µs (24.9%)
iast 1.518 ms [1.494 ms, 1.542 ms] 159.947 µs (11.8%)
profiling 1.537 ms [1.512 ms, 1.562 ms] 178.754 µs (13.2%)
tracing 1.514 ms [1.489 ms, 1.538 ms] 155.485 µs (11.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.354 ms [1.334 ms, 1.375 ms] -
appsec 1.746 ms [1.723 ms, 1.77 ms] 392.11 µs (29.0%)
appsec_no_iast 1.775 ms [1.75 ms, 1.799 ms] 420.433 µs (31.0%)
code_origins 1.676 ms [1.648 ms, 1.703 ms] 321.52 µs (23.7%)
iast 1.52 ms [1.495 ms, 1.545 ms] 165.7 µs (12.2%)
profiling 1.531 ms [1.508 ms, 1.554 ms] 177.003 µs (13.1%)
tracing 1.484 ms [1.459 ms, 1.51 ms] 130.274 µs (9.6%)
Request duration reports for insecure-bank 
gantt title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18 dateFormat X axisFormat %s section baseline no_agent (394.825 µs) : 375, 415 . : milestone, 395, iast (513.516 µs) : 492, 535 . : milestone, 514, iast_FULL (734.871 µs) : 712, 757 . : milestone, 735, iast_GLOBAL (563.189 µs) : 541, 585 . : milestone, 563, iast_HARDCODED_SECRET_DISABLED (517.232 µs) : 496, 539 . : milestone, 517, iast_INACTIVE (465.488 µs) : 444, 487 . : milestone, 465, iast_TELEMETRY_OFF (503.309 µs) : 481, 525 . : milestone, 503, tracing (467.033 µs) : 445, 489 . : milestone, 467, section candidate no_agent (389.532 µs) : 370, 409 . : milestone, 390, iast (512.121 µs) : 490, 534 . : milestone, 512, iast_FULL (729.336 µs) : 707, 751 . : milestone, 729, iast_GLOBAL (568.028 µs) : 545, 591 . : milestone, 568, iast_HARDCODED_SECRET_DISABLED (518.012 µs) : 496, 540 . : milestone, 518, iast_INACTIVE (469.555 µs) : 447, 492 . : milestone, 470, iast_TELEMETRY_OFF (511.854 µs) : 489, 535 . : milestone, 512, tracing (466.229 µs) : 444, 488 . : milestone, 466,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 394.825 µs [374.82 µs, 414.831 µs] -
iast 513.516 µs [491.576 µs, 535.457 µs] 118.691 µs (30.1%)
iast_FULL 734.871 µs [712.465 µs, 757.276 µs] 340.045 µs (86.1%)
iast_GLOBAL 563.189 µs [541.342 µs, 585.035 µs] 168.363 µs (42.6%)
iast_HARDCODED_SECRET_DISABLED 517.232 µs [495.717 µs, 538.748 µs] 122.407 µs (31.0%)
iast_INACTIVE 465.488 µs [444.271 µs, 486.704 µs] 70.662 µs (17.9%)
iast_TELEMETRY_OFF 503.309 µs [481.397 µs, 525.221 µs] 108.484 µs (27.5%)
tracing 467.033 µs [445.138 µs, 488.927 µs] 72.207 µs (18.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 389.532 µs [369.817 µs, 409.247 µs] -
iast 512.121 µs [490.352 µs, 533.889 µs] 122.589 µs (31.5%)
iast_FULL 729.336 µs [707.389 µs, 751.283 µs] 339.804 µs (87.2%)
iast_GLOBAL 568.028 µs [545.12 µs, 590.935 µs] 178.496 µs (45.8%)
iast_HARDCODED_SECRET_DISABLED 518.012 µs [496.04 µs, 539.985 µs] 128.481 µs (33.0%)
iast_INACTIVE 469.555 µs [446.721 µs, 492.389 µs] 80.023 µs (20.5%)
iast_TELEMETRY_OFF 511.854 µs [489.193 µs, 534.516 µs] 122.323 µs (31.4%)
tracing 466.229 µs [444.32 µs, 488.138 µs] 76.697 µs (19.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/update_system_tests_hash
git_commit_date 1741707364 1741714757
git_commit_sha f8c6b49 9577564
release_version 1.48.0-SNAPSHOT~f8c6b49f18 1.48.0-SNAPSHOT~9577564f7f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1741716885 1741716885
ci_job_id 842955518 842955518
ci_pipeline_id 58465015 58465015
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-2wkmbgws-project-304-concurrent-2-psmz22n4 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-2wkmbgws-project-304-concurrent-2-psmz22n4 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18 dateFormat X axisFormat %s section baseline no_agent (15.57 s) : 15570000, 15570000 . : milestone, 15570000, appsec (15.017 s) : 15017000, 15017000 . : milestone, 15017000, iast (19.091 s) : 19091000, 19091000 . : milestone, 19091000, iast_GLOBAL (17.626 s) : 17626000, 17626000 . : milestone, 17626000, profiling (15.173 s) : 15173000, 15173000 . : milestone, 15173000, tracing (15.082 s) : 15082000, 15082000 . : milestone, 15082000, section candidate no_agent (15.209 s) : 15209000, 15209000 . : milestone, 15209000, appsec (14.977 s) : 14977000, 14977000 . : milestone, 14977000, iast (18.475 s) : 18475000, 18475000 . : milestone, 18475000, iast_GLOBAL (17.68 s) : 17680000, 17680000 . : milestone, 17680000, profiling (15.192 s) : 15192000, 15192000 . : milestone, 15192000, tracing (14.908 s) : 14908000, 14908000 . : milestone, 14908000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.57 s [15.57 s, 15.57 s] -
appsec 15.017 s [15.017 s, 15.017 s] -553.0 ms (-3.6%)
iast 19.091 s [19.091 s, 19.091 s] 3.521 s (22.6%)
iast_GLOBAL 17.626 s [17.626 s, 17.626 s] 2.056 s (13.2%)
profiling 15.173 s [15.173 s, 15.173 s] -397.0 ms (-2.5%)
tracing 15.082 s [15.082 s, 15.082 s] -488.0 ms (-3.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.209 s [15.209 s, 15.209 s] -
appsec 14.977 s [14.977 s, 14.977 s] -232.0 ms (-1.5%)
iast 18.475 s [18.475 s, 18.475 s] 3.266 s (21.5%)
iast_GLOBAL 17.68 s [17.68 s, 17.68 s] 2.471 s (16.2%)
profiling 15.192 s [15.192 s, 15.192 s] -17.0 ms (-0.1%)
tracing 14.908 s [14.908 s, 14.908 s] -301.0 ms (-2.0%)
Execution time for tomcat 
gantt title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18 dateFormat X axisFormat %s section baseline no_agent (1.471 ms) : 1459, 1482 . : milestone, 1471, appsec (2.341 ms) : 2296, 2387 . : milestone, 2341, iast (2.124 ms) : 2067, 2181 . : milestone, 2124, iast_GLOBAL (2.162 ms) : 2105, 2219 . : milestone, 2162, profiling (1.989 ms) : 1943, 2035 . : milestone, 1989, tracing (1.959 ms) : 1916, 2003 . : milestone, 1959, section candidate no_agent (1.47 ms) : 1458, 1481 . : milestone, 1470, appsec (2.351 ms) : 2306, 2397 . : milestone, 2351, iast (2.126 ms) : 2069, 2183 . : milestone, 2126, iast_GLOBAL (2.168 ms) : 2111, 2226 . : milestone, 2168, profiling (1.976 ms) : 1930, 2021 . : milestone, 1976, tracing (1.954 ms) : 1910, 1998 . : milestone, 1954,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 2.341 ms [2.296 ms, 2.387 ms] 870.417 µs (59.2%)
iast 2.124 ms [2.067 ms, 2.181 ms] 653.259 µs (44.4%)
iast_GLOBAL 2.162 ms [2.105 ms, 2.219 ms] 690.959 µs (47.0%)
profiling 1.989 ms [1.943 ms, 2.035 ms] 518.159 µs (35.2%)
tracing 1.959 ms [1.916 ms, 2.003 ms] 488.524 µs (33.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.458 ms, 1.481 ms] -
appsec 2.351 ms [2.306 ms, 2.397 ms] 881.53 µs (60.0%)
iast 2.126 ms [2.069 ms, 2.183 ms] 655.816 µs (44.6%)
iast_GLOBAL 2.168 ms [2.111 ms, 2.226 ms] 698.383 µs (47.5%)
profiling 1.976 ms [1.93 ms, 2.021 ms] 505.743 µs (34.4%)
tracing 1.954 ms [1.91 ms, 1.998 ms] 483.811 µs (32.9%)
@mhlidd mhlidd marked this pull request as ready for review March 11, 2025 19:05
@mhlidd mhlidd requested a review from a team as a code owner March 11, 2025 19:05
@github-actions GitHub Actions
Copy link
Contributor

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.
@mhlidd mhlidd added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Mar 11, 2025
@mhlidd mhlidd merged commit 3c27cfc into master Mar 11, 2025
223 of 224 checks passed
@mhlidd mhlidd deleted the mhlidd/update_system_tests_hash branch March 11, 2025 19:07
@github-actions github-actions bot added this to the 1.48.0 milestone Mar 11, 2025
mtoffl01 pushed a commit that referenced this pull request Mar 24, 2025
@mhlidd @mtoffl01
Update system-tests to 5aee0ed598fd984344cf0da0048b27bdb2eb4da1 (#8537)
9a4458a
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes

2 participants

@mhlidd @nayeem-kamal