Skip to content

Conversation

robertomonteromiguel
Copy link
Contributor

What Does This Do

Integrate the latest changes on one-pipeline.
Configure and run the system-tests pipeline (only for ssi tests)

Motivation

Simplify the pipeline to run the system-tests ssi tests

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@robertomonteromiguel robertomonteromiguel marked this pull request as ready for review March 14, 2025 08:15
@robertomonteromiguel robertomonteromiguel requested a review from a team as a code owner March 14, 2025 08:15
Copy link
Contributor

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@pr-commenter
Copy link

pr-commenter bot commented Mar 14, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master robertomonteromkguel/ssi_tests_onepipeline
git_commit_date 1741898004 1741938443
git_commit_sha 56d8cd8 58b0538
release_version 1.48.0-SNAPSHOT~56d8cd82bc 1.48.0-SNAPSHOT~58b0538e11
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741941001 1741941001
ci_job_id 847886325 847886325
ci_pipeline_id 58811458 58811458
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-moshnsiy-project-304-concurrent-0-0c1oxy9n 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-moshnsiy-project-304-concurrent-0-0c1oxy9n 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 4 unstable metrics.

Startup time reports for petclinic
gantt title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~58b0538e11, baseline=1.48.0-SNAPSHOT~56d8cd82bc dateFormat X axisFormat %s section tracing Agent [baseline] (1.039 s) : 0, 1039373 Total [baseline] (10.498 s) : 0, 10497728 Agent [candidate] (1.046 s) : 0, 1046171 Total [candidate] (10.428 s) : 0, 10428294 section appsec Agent [baseline] (1.185 s) : 0, 1184922 Total [baseline] (10.692 s) : 0, 10692339 Agent [candidate] (1.185 s) : 0, 1184576 Total [candidate] (10.755 s) : 0, 10754671 section iast Agent [baseline] (1.18 s) : 0, 1179562 Total [baseline] (10.964 s) : 0, 10963670 Agent [candidate] (1.172 s) : 0, 1171723 Total [candidate] (10.965 s) : 0, 10965083 section profiling Agent [baseline] (1.267 s) : 0, 1266634 Total [baseline] (10.857 s) : 0, 10857475 Agent [candidate] (1.26 s) : 0, 1259786 Total [candidate] (10.831 s) : 0, 10831009 
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.039 s -
Agent appsec 1.185 s 145.549 ms (14.0%)
Agent iast 1.18 s 140.189 ms (13.5%)
Agent profiling 1.267 s 227.261 ms (21.9%)
Total tracing 10.498 s -
Total appsec 10.692 s 194.611 ms (1.9%)
Total iast 10.964 s 465.943 ms (4.4%)
Total profiling 10.857 s 359.747 ms (3.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent appsec 1.185 s 138.405 ms (13.2%)
Agent iast 1.172 s 125.552 ms (12.0%)
Agent profiling 1.26 s 213.615 ms (20.4%)
Total tracing 10.428 s -
Total appsec 10.755 s 326.377 ms (3.1%)
Total iast 10.965 s 536.788 ms (5.1%)
Total profiling 10.831 s 402.715 ms (3.9%)
gantt title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~58b0538e11, baseline=1.48.0-SNAPSHOT~56d8cd82bc dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (717.826 ms) : 0, 717826 BytebuddyAgent [candidate] (722.467 ms) : 0, 722467 GlobalTracer [baseline] (239.082 ms) : 0, 239082 GlobalTracer [candidate] (240.563 ms) : 0, 240563 AppSec [baseline] (54.429 ms) : 0, 54429 AppSec [candidate] (54.85 ms) : 0, 54850 Remote Config [baseline] (683.365 µs) : 0, 683 Remote Config [candidate] (698.857 µs) : 0, 699 Telemetry [baseline] (12.168 ms) : 0, 12168 Telemetry [candidate] (12.342 ms) : 0, 12342 section appsec BytebuddyAgent [baseline] (737.49 ms) : 0, 737490 BytebuddyAgent [candidate] (737.12 ms) : 0, 737120 GlobalTracer [baseline] (236.531 ms) : 0, 236531 GlobalTracer [candidate] (236.721 ms) : 0, 236721 AppSec [baseline] (175.983 ms) : 0, 175983 AppSec [candidate] (175.766 ms) : 0, 175766 Remote Config [baseline] (667.067 µs) : 0, 667 Remote Config [candidate] (682.478 µs) : 0, 682 Telemetry [baseline] (8.266 ms) : 0, 8266 Telemetry [candidate] (8.309 ms) : 0, 8309 IAST [baseline] (21.451 ms) : 0, 21451 IAST [candidate] (21.523 ms) : 0, 21523 section iast BytebuddyAgent [baseline] (843.497 ms) : 0, 843497 BytebuddyAgent [candidate] (837.559 ms) : 0, 837559 GlobalTracer [baseline] (231.903 ms) : 0, 231903 GlobalTracer [candidate] (230.779 ms) : 0, 230779 AppSec [baseline] (56.554 ms) : 0, 56554 AppSec [candidate] (56.244 ms) : 0, 56244 Remote Config [baseline] (616.225 µs) : 0, 616 Remote Config [candidate] (608.157 µs) : 0, 608 Telemetry [baseline] (8.736 ms) : 0, 8736 Telemetry [candidate] (8.643 ms) : 0, 8643 IAST [baseline] (22.984 ms) : 0, 22984 IAST [candidate] (22.706 ms) : 0, 22706 section profiling ProfilingAgent [baseline] (97.203 ms) : 0, 97203 ProfilingAgent [candidate] (96.425 ms) : 0, 96425 BytebuddyAgent [baseline] (713.195 ms) : 0, 713195 BytebuddyAgent [candidate] (709.024 ms) : 0, 709024 GlobalTracer [baseline] (350.904 ms) : 0, 350904 GlobalTracer [candidate] (350.56 ms) : 0, 350560 AppSec [baseline] (54.742 ms) : 0, 54742 AppSec [candidate] (53.268 ms) : 0, 53268 Remote Config [baseline] (682.449 µs) : 0, 682 Remote Config [candidate] (665.336 µs) : 0, 665 Telemetry [baseline] (8.98 ms) : 0, 8980 Telemetry [candidate] (9.039 ms) : 0, 9039 Profiling [baseline] (97.227 ms) : 0, 97227 Profiling [candidate] (96.451 ms) : 0, 96451 
Loading
Startup time reports for insecure-bank
gantt title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~58b0538e11, baseline=1.48.0-SNAPSHOT~56d8cd82bc dateFormat X axisFormat %s section tracing Agent [baseline] (1.042 s) : 0, 1041864 Total [baseline] (8.674 s) : 0, 8674149 Agent [candidate] (1.042 s) : 0, 1041985 Total [candidate] (8.676 s) : 0, 8675573 section iast Agent [baseline] (1.177 s) : 0, 1177068 Total [baseline] (9.228 s) : 0, 9228082 Agent [candidate] (1.17 s) : 0, 1169543 Total [candidate] (9.226 s) : 0, 9226463 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.178 s) : 0, 1177879 Total [baseline] (9.191 s) : 0, 9190795 Agent [candidate] (1.174 s) : 0, 1173824 Total [candidate] (9.197 s) : 0, 9196666 section iast_TELEMETRY_OFF Agent [baseline] (1.174 s) : 0, 1173630 Total [baseline] (9.248 s) : 0, 9248246 Agent [candidate] (1.165 s) : 0, 1165337 Total [candidate] (9.22 s) : 0, 9219999 
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.042 s -
Agent iast 1.177 s 135.204 ms (13.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.178 s 136.015 ms (13.1%)
Agent iast_TELEMETRY_OFF 1.174 s 131.766 ms (12.6%)
Total tracing 8.674 s -
Total iast 9.228 s 553.934 ms (6.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.191 s 516.646 ms (6.0%)
Total iast_TELEMETRY_OFF 9.248 s 574.097 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.042 s -
Agent iast 1.17 s 127.558 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.174 s 131.839 ms (12.7%)
Agent iast_TELEMETRY_OFF 1.165 s 123.353 ms (11.8%)
Total tracing 8.676 s -
Total iast 9.226 s 550.89 ms (6.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.197 s 521.092 ms (6.0%)
Total iast_TELEMETRY_OFF 9.22 s 544.425 ms (6.3%)
gantt title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~58b0538e11, baseline=1.48.0-SNAPSHOT~56d8cd82bc dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (718.9 ms) : 0, 718900 BytebuddyAgent [candidate] (718.721 ms) : 0, 718721 GlobalTracer [baseline] (240.142 ms) : 0, 240142 GlobalTracer [candidate] (240.346 ms) : 0, 240346 AppSec [baseline] (54.56 ms) : 0, 54560 AppSec [candidate] (54.688 ms) : 0, 54688 Remote Config [baseline] (698.716 µs) : 0, 699 Remote Config [candidate] (715.843 µs) : 0, 716 Telemetry [baseline] (12.355 ms) : 0, 12355 Telemetry [candidate] (12.31 ms) : 0, 12310 section iast BytebuddyAgent [baseline] (842.794 ms) : 0, 842794 BytebuddyAgent [candidate] (835.908 ms) : 0, 835908 GlobalTracer [baseline] (230.826 ms) : 0, 230826 GlobalTracer [candidate] (230.174 ms) : 0, 230174 IAST [baseline] (23.611 ms) : 0, 23611 IAST [candidate] (23.426 ms) : 0, 23426 AppSec [baseline] (55.286 ms) : 0, 55286 AppSec [candidate] (55.515 ms) : 0, 55515 Remote Config [baseline] (595.739 µs) : 0, 596 Remote Config [candidate] (606.325 µs) : 0, 606 Telemetry [baseline] (8.602 ms) : 0, 8602 Telemetry [candidate] (8.751 ms) : 0, 8751 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (842.422 ms) : 0, 842422 BytebuddyAgent [candidate] (839.276 ms) : 0, 839276 GlobalTracer [baseline] (231.234 ms) : 0, 231234 GlobalTracer [candidate] (231.14 ms) : 0, 231140 IAST [baseline] (23.118 ms) : 0, 23118 IAST [candidate] (22.827 ms) : 0, 22827 AppSec [baseline] (56.436 ms) : 0, 56436 AppSec [candidate] (55.993 ms) : 0, 55993 Remote Config [baseline] (615.012 µs) : 0, 615 Remote Config [candidate] (612.511 µs) : 0, 613 Telemetry [baseline] (8.789 ms) : 0, 8789 Telemetry [candidate] (8.678 ms) : 0, 8678 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (839.02 ms) : 0, 839020 BytebuddyAgent [candidate] (832.516 ms) : 0, 832516 GlobalTracer [baseline] (231.06 ms) : 0, 231060 GlobalTracer [candidate] (229.986 ms) : 0, 229986 IAST [baseline] (22.684 ms) : 0, 22684 IAST [candidate] (22.334 ms) : 0, 22334 AppSec [baseline] (56.141 ms) : 0, 56141 AppSec [candidate] (55.906 ms) : 0, 55906 Remote Config [baseline] (617.299 µs) : 0, 617 Remote Config [candidate] (613.059 µs) : 0, 613 Telemetry [baseline] (8.796 ms) : 0, 8796 Telemetry [candidate] (8.639 ms) : 0, 8639 
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-14T08:00:24 2025-03-14T08:08:11
git_branch master robertomonteromkguel/ssi_tests_onepipeline
git_commit_date 1741898004 1741938443
git_commit_sha 56d8cd8 58b0538
release_version 1.48.0-SNAPSHOT~56d8cd82bc 1.48.0-SNAPSHOT~58b0538e11
start_time 2025-03-14T08:00:10 2025-03-14T08:07:57
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741940091 1741940091
ci_job_id 847886326 847886326
ci_pipeline_id 58811458 58811458
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-dgzduy7c-project-304-concurrent-0-v4daeekp 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-dgzduy7c-project-304-concurrent-0-v4daeekp 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for insecure-bank
gantt title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~58b0538e11, baseline=1.48.0-SNAPSHOT~56d8cd82bc dateFormat X axisFormat %s section baseline no_agent (392.22 µs) : 372, 412 . : milestone, 392, iast (516.467 µs) : 495, 538 . : milestone, 516, iast_FULL (737.354 µs) : 715, 760 . : milestone, 737, iast_GLOBAL (564.626 µs) : 542, 587 . : milestone, 565, iast_HARDCODED_SECRET_DISABLED (522.147 µs) : 500, 544 . : milestone, 522, iast_INACTIVE (468.76 µs) : 448, 490 . : milestone, 469, iast_TELEMETRY_OFF (505.534 µs) : 483, 528 . : milestone, 506, tracing (463.089 µs) : 443, 484 . : milestone, 463, section candidate no_agent (381.81 µs) : 362, 402 . : milestone, 382, iast (517.185 µs) : 495, 539 . : milestone, 517, iast_FULL (733.248 µs) : 711, 755 . : milestone, 733, iast_GLOBAL (568.383 µs) : 546, 591 . : milestone, 568, iast_HARDCODED_SECRET_DISABLED (517.187 µs) : 496, 539 . : milestone, 517, iast_INACTIVE (469.547 µs) : 447, 492 . : milestone, 470, iast_TELEMETRY_OFF (508.894 µs) : 487, 531 . : milestone, 509, tracing (459.871 µs) : 439, 481 . : milestone, 460, 
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 392.22 µs [372.041 µs, 412.398 µs] -
iast 516.467 µs [494.827 µs, 538.108 µs] 124.248 µs (31.7%)
iast_FULL 737.354 µs [715.195 µs, 759.512 µs] 345.134 µs (88.0%)
iast_GLOBAL 564.626 µs [542.475 µs, 586.777 µs] 172.406 µs (44.0%)
iast_HARDCODED_SECRET_DISABLED 522.147 µs [500.184 µs, 544.109 µs] 129.927 µs (33.1%)
iast_INACTIVE 468.76 µs [447.579 µs, 489.942 µs] 76.541 µs (19.5%)
iast_TELEMETRY_OFF 505.534 µs [482.666 µs, 528.402 µs] 113.315 µs (28.9%)
tracing 463.089 µs [442.517 µs, 483.662 µs] 70.87 µs (18.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 381.81 µs [361.902 µs, 401.718 µs] -
iast 517.185 µs [495.282 µs, 539.088 µs] 135.375 µs (35.5%)
iast_FULL 733.248 µs [711.417 µs, 755.08 µs] 351.438 µs (92.0%)
iast_GLOBAL 568.383 µs [545.631 µs, 591.135 µs] 186.573 µs (48.9%)
iast_HARDCODED_SECRET_DISABLED 517.187 µs [495.563 µs, 538.81 µs] 135.376 µs (35.5%)
iast_INACTIVE 469.547 µs [447.5 µs, 491.594 µs] 87.737 µs (23.0%)
iast_TELEMETRY_OFF 508.894 µs [486.989 µs, 530.799 µs] 127.084 µs (33.3%)
tracing 459.871 µs [438.566 µs, 481.177 µs] 78.061 µs (20.4%)
Request duration reports for petclinic
gantt title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~58b0538e11, baseline=1.48.0-SNAPSHOT~56d8cd82bc dateFormat X axisFormat %s section baseline no_agent (1.369 ms) : 1350, 1388 . : milestone, 1369, appsec (1.756 ms) : 1733, 1778 . : milestone, 1756, appsec_no_iast (1.769 ms) : 1745, 1794 . : milestone, 1769, code_origins (1.683 ms) : 1655, 1710 . : milestone, 1683, iast (1.522 ms) : 1497, 1546 . : milestone, 1522, profiling (1.55 ms) : 1524, 1575 . : milestone, 1550, tracing (1.503 ms) : 1479, 1527 . : milestone, 1503, section candidate no_agent (1.358 ms) : 1339, 1377 . : milestone, 1358, appsec (1.735 ms) : 1711, 1759 . : milestone, 1735, appsec_no_iast (1.749 ms) : 1725, 1773 . : milestone, 1749, code_origins (1.706 ms) : 1679, 1732 . : milestone, 1706, iast (1.524 ms) : 1499, 1548 . : milestone, 1524, profiling (1.546 ms) : 1522, 1570 . : milestone, 1546, tracing (1.503 ms) : 1479, 1528 . : milestone, 1503, 
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.369 ms [1.35 ms, 1.388 ms] -
appsec 1.756 ms [1.733 ms, 1.778 ms] 386.617 µs (28.2%)
appsec_no_iast 1.769 ms [1.745 ms, 1.794 ms] 400.288 µs (29.2%)
code_origins 1.683 ms [1.655 ms, 1.71 ms] 313.818 µs (22.9%)
iast 1.522 ms [1.497 ms, 1.546 ms] 152.822 µs (11.2%)
profiling 1.55 ms [1.524 ms, 1.575 ms] 180.585 µs (13.2%)
tracing 1.503 ms [1.479 ms, 1.527 ms] 134.076 µs (9.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.358 ms [1.339 ms, 1.377 ms] -
appsec 1.735 ms [1.711 ms, 1.759 ms] 376.845 µs (27.7%)
appsec_no_iast 1.749 ms [1.725 ms, 1.773 ms] 391.012 µs (28.8%)
code_origins 1.706 ms [1.679 ms, 1.732 ms] 347.28 µs (25.6%)
iast 1.524 ms [1.499 ms, 1.548 ms] 165.592 µs (12.2%)
profiling 1.546 ms [1.522 ms, 1.57 ms] 187.9 µs (13.8%)
tracing 1.503 ms [1.479 ms, 1.528 ms] 145.018 µs (10.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master robertomonteromkguel/ssi_tests_onepipeline
git_commit_date 1741898004 1741938443
git_commit_sha 56d8cd8 58b0538
release_version 1.48.0-SNAPSHOT~56d8cd82bc 1.48.0-SNAPSHOT~58b0538e11
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1741940572 1741940572
ci_job_id 847886327 847886327
ci_pipeline_id 58811458 58811458
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-gzhmqs6t-project-304-concurrent-0-du34otb1 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-gzhmqs6t-project-304-concurrent-0-du34otb1 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~58b0538e11, baseline=1.48.0-SNAPSHOT~56d8cd82bc dateFormat X axisFormat %s section baseline no_agent (14.916 s) : 14916000, 14916000 . : milestone, 14916000, appsec (15.239 s) : 15239000, 15239000 . : milestone, 15239000, iast (18.854 s) : 18854000, 18854000 . : milestone, 18854000, iast_GLOBAL (17.927 s) : 17927000, 17927000 . : milestone, 17927000, profiling (15.659 s) : 15659000, 15659000 . : milestone, 15659000, tracing (14.789 s) : 14789000, 14789000 . : milestone, 14789000, section candidate no_agent (15.398 s) : 15398000, 15398000 . : milestone, 15398000, appsec (15.089 s) : 15089000, 15089000 . : milestone, 15089000, iast (18.896 s) : 18896000, 18896000 . : milestone, 18896000, iast_GLOBAL (18.112 s) : 18112000, 18112000 . : milestone, 18112000, profiling (15.716 s) : 15716000, 15716000 . : milestone, 15716000, tracing (14.99 s) : 14990000, 14990000 . : milestone, 14990000, 
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.916 s [14.916 s, 14.916 s] -
appsec 15.239 s [15.239 s, 15.239 s] 323.0 ms (2.2%)
iast 18.854 s [18.854 s, 18.854 s] 3.938 s (26.4%)
iast_GLOBAL 17.927 s [17.927 s, 17.927 s] 3.011 s (20.2%)
profiling 15.659 s [15.659 s, 15.659 s] 743.0 ms (5.0%)
tracing 14.789 s [14.789 s, 14.789 s] -127.0 ms (-0.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.398 s [15.398 s, 15.398 s] -
appsec 15.089 s [15.089 s, 15.089 s] -309.0 ms (-2.0%)
iast 18.896 s [18.896 s, 18.896 s] 3.498 s (22.7%)
iast_GLOBAL 18.112 s [18.112 s, 18.112 s] 2.714 s (17.6%)
profiling 15.716 s [15.716 s, 15.716 s] 318.0 ms (2.1%)
tracing 14.99 s [14.99 s, 14.99 s] -408.0 ms (-2.6%)
Execution time for tomcat
gantt title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~58b0538e11, baseline=1.48.0-SNAPSHOT~56d8cd82bc dateFormat X axisFormat %s section baseline no_agent (1.473 ms) : 1462, 1485 . : milestone, 1473, appsec (2.348 ms) : 2304, 2392 . : milestone, 2348, iast (2.117 ms) : 2061, 2173 . : milestone, 2117, iast_GLOBAL (2.168 ms) : 2112, 2225 . : milestone, 2168, profiling (1.967 ms) : 1924, 2011 . : milestone, 1967, tracing (1.955 ms) : 1912, 1998 . : milestone, 1955, section candidate no_agent (1.476 ms) : 1464, 1487 . : milestone, 1476, appsec (2.35 ms) : 2306, 2394 . : milestone, 2350, iast (2.126 ms) : 2070, 2183 . : milestone, 2126, iast_GLOBAL (2.173 ms) : 2117, 2230 . : milestone, 2173, profiling (1.975 ms) : 1931, 2020 . : milestone, 1975, tracing (1.949 ms) : 1907, 1992 . : milestone, 1949, 
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 2.348 ms [2.304 ms, 2.392 ms] 874.906 µs (59.4%)
iast 2.117 ms [2.061 ms, 2.173 ms] 643.702 µs (43.7%)
iast_GLOBAL 2.168 ms [2.112 ms, 2.225 ms] 695.19 µs (47.2%)
profiling 1.967 ms [1.924 ms, 2.011 ms] 494.247 µs (33.5%)
tracing 1.955 ms [1.912 ms, 1.998 ms] 481.465 µs (32.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 2.35 ms [2.306 ms, 2.394 ms] 874.503 µs (59.3%)
iast 2.126 ms [2.07 ms, 2.183 ms] 650.681 µs (44.1%)
iast_GLOBAL 2.173 ms [2.117 ms, 2.23 ms] 697.651 µs (47.3%)
profiling 1.975 ms [1.931 ms, 2.02 ms] 499.8 µs (33.9%)
tracing 1.949 ms [1.907 ms, 1.992 ms] 473.544 µs (32.1%)
@robertomonteromiguel robertomonteromiguel merged commit 8b041eb into master Mar 14, 2025
266 of 268 checks passed
@robertomonteromiguel robertomonteromiguel deleted the robertomonteromkguel/ssi_tests_onepipeline branch March 14, 2025 12:08
@github-actions github-actions bot added this to the 1.48.0 milestone Mar 14, 2025
mtoffl01 pushed a commit that referenced this pull request Mar 24, 2025
svc-squareup-copybara pushed a commit to cashapp/misk that referenced this pull request Apr 11, 2025
| Package | Type | Package file | Manager | Update | Change | |---|---|---|---|---|---| | org.flywaydb.flyway | plugin | misk/gradle/libs.versions.toml | gradle | minor | `11.6.0` -> `11.7.0` | | [com.squareup.okio:okio-fakefilesystem](https://github.com/square/okio) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `3.10.2` -> `3.11.0` | | [com.squareup.okio:okio](https://github.com/square/okio) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `3.10.2` -> `3.11.0` | | [com.autonomousapps.dependency-analysis](https://github.com/autonomousapps/dependency-analysis-android-gradle-plugin) | plugin | misk/gradle/libs.versions.toml | gradle | minor | `2.15.0` -> `2.16.0` | | [com.datadoghq:dd-trace-api](https://github.com/datadog/dd-trace-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `1.47.3` -> `1.48.1` | | [com.datadoghq:dd-trace-ot](https://github.com/datadog/dd-trace-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `1.47.3` -> `1.48.1` | | [software.amazon.awssdk:sdk-core](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.18` -> `2.31.20` | | [software.amazon.awssdk:sqs](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.18` -> `2.31.20` | | [software.amazon.awssdk:dynamodb-enhanced](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.18` -> `2.31.20` | | [software.amazon.awssdk:dynamodb](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.18` -> `2.31.20` | | [software.amazon.awssdk:aws-core](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.18` -> `2.31.20` | | [software.amazon.awssdk:bom](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.18` -> `2.31.20` | | [software.amazon.awssdk:auth](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.18` -> `2.31.20` | --- ### Release Notes <details> <summary>square/okio (com.squareup.okio:okio-fakefilesystem)</summary> ### [`v3.11.0`](https://github.com/square/okio/blob/HEAD/CHANGELOG.md#Version-3110) *2025-04-09* - Fix: Clear the deflater's byte array reference - New: Faster implementation of `String.decodeHex()` on Kotlin/JS. - New: Declare `EXACTLY_ONCE` execution for blocks like `Closeable.use {}` and `FileSystem.read {}`. - Upgrade: \[Kotlin 2.1.20]\[kotlin\_2\_1\_20]. </details> <details> <summary>autonomousapps/dependency-analysis-android-gradle-plugin (com.autonomousapps.dependency-analysis)</summary> ### [`v2.16.0`](https://github.com/autonomousapps/dependency-analysis-android-gradle-plugin/blob/HEAD/CHANGELOG.md#Version-2160) - \[Feat]: support `com.android.test` projects. - \[Feat]: support typesafe project accessors with opt-in. ```kotlin dependencyAnalysis { useTypesafeProjectAccessors(true) // false by default } ``` </details> <details> <summary>datadog/dd-trace-java (com.datadoghq:dd-trace-api)</summary> ### [`v1.48.1`](https://github.com/DataDog/dd-trace-java/releases/tag/v1.48.1): 1.48.1 ### Components #### Tracer internal logging - 🐛 Remove print line causing unnecessary logs ([#&#8203;8687](DataDog/dd-trace-java#8687) - [@&#8203;sarahchen6](https://github.com/sarahchen6)) ### [`v1.48.0`](https://github.com/DataDog/dd-trace-java/releases/tag/v1.48.0): 1.48.0 ### Known Bugs > \[!NOTE] > If you are experiencing issues with spamming timeout logs, please update to the [latest version](https://github.com/DataDog/dd-trace-java/releases/latest) or set [JDK_SOCKET_ENABLED](https://github.com/DataDog/dd-trace-java/blob/33fc3c9a9b7cda3beda88b8b3e5224ae2b10764a/dd-trace-api/src/main/java/datadog/trace/api/config/GeneralConfig.java#L98) to false. ### Components #### Application Security Management (IAST) - ✨ Fix vulnerability location org.jose4j.lang.HashUtil ([#&#8203;8610](DataDog/dd-trace-java#8610) - [@&#8203;jandro996](https://github.com/jandro996)) - ✨ Fix weak randomness in oracle.ucp.util.OpaqueString ([#&#8203;8609](DataDog/dd-trace-java#8609) - [@&#8203;jandro996](https://github.com/jandro996)) - ✨ Fix weak hash false positive in oracle.security.o5logon.O5Logon ([#&#8203;8608](DataDog/dd-trace-java#8608) - [@&#8203;jandro996](https://github.com/jandro996)) - 🐛 Prevent before callsites targeting constructors in super calls ([#&#8203;8549](DataDog/dd-trace-java#8549) - [@&#8203;manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) #### Application Security Management (WAF) - ✨ Update login events public SDK to V2 ([#&#8203;8620](DataDog/dd-trace-java#8620) - [@&#8203;manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - 🐛 Send RASP LFI capability only when AppSec is statically enabled ([#&#8203;8573](DataDog/dd-trace-java#8573) - [@&#8203;jandro996](https://github.com/jandro996)) - ✨ Improve detection of missing request end events ([#&#8203;8510](DataDog/dd-trace-java#8510) - [@&#8203;smola](https://github.com/smola)) - 🧹 Remove remote configuration for API Security sampling rate ([#&#8203;8486](DataDog/dd-trace-java#8486) - [@&#8203;smola](https://github.com/smola)) - ✨ Add setUser to user monitoring SDK ([#&#8203;8482](DataDog/dd-trace-java#8482) - [@&#8203;manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Add missing address for signup event ([#&#8203;8469](DataDog/dd-trace-java#8469) - [@&#8203;manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Allow login events SDK to be used with appsec disabled ([#&#8203;8464](DataDog/dd-trace-java#8464) - [@&#8203;manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Add support for endpoint discovery in spring mvc ([#&#8203;8352](DataDog/dd-trace-java#8352) - [@&#8203;manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ New API Security sampling algorithm ([#&#8203;8178](DataDog/dd-trace-java#8178) - [@&#8203;ValentinZakharov](https://github.com/ValentinZakharov)) #### Build & Tooling - ✨ Add buffer size customizability to JDK UDS support ([#&#8203;8629](DataDog/dd-trace-java#8629) - [@&#8203;sarahchen6](https://github.com/sarahchen6)) - ✨ Add JDK built-in support for UDS on Java 16+ ([#&#8203;8314](DataDog/dd-trace-java#8314) - [@&#8203;sarahchen6](https://github.com/sarahchen6)) #### Configuration at Runtime - 🐛 Send RASP LFI capability only when AppSec is statically enabled ([#&#8203;8573](DataDog/dd-trace-java#8573) - [@&#8203;jandro996](https://github.com/jandro996)) #### Continuous Integration Visibility - 🐛 Prevent double reporting of Scalatest events when using SBT with test forking ([#&#8203;8682](DataDog/dd-trace-java#8682) - [@&#8203;nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Shutdown CI Visibility test event handlers before tracer ([#&#8203;8677](DataDog/dd-trace-java#8677) - [@&#8203;nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Do not apply JUnit 4 instrumentation to MUnit runners ([#&#8203;8675](DataDog/dd-trace-java#8675), [#&#8203;8683](DataDog/dd-trace-java#8683) - [@&#8203;nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Remove error log when source path resolution fails on isModified check ([#&#8203;8663](DataDog/dd-trace-java#8663) - [@&#8203;daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Implement tests reordering for JUnit 4 ([#&#8203;8650](DataDog/dd-trace-java#8650) - [@&#8203;daniel-mohedano](https://github.com/daniel-mohedano)) - 🐛 Set default Attempt to Fix retries if none provided from the backend ([#&#8203;8615](DataDog/dd-trace-java#8615) - [@&#8203;daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Allow to manually set PR info ([#&#8203;8566](DataDog/dd-trace-java#8566) - [@&#8203;nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Fix Test Optimization init when repo root cannot be determined ([#&#8203;8533](DataDog/dd-trace-java#8533) - [@&#8203;nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Add capabilities tagging ([#&#8203;8499](DataDog/dd-trace-java#8499), [#&#8203;8540](DataDog/dd-trace-java#8540) - [@&#8203;daniel-mohedano](https://github.com/daniel-mohedano)) #### Crash tracking - 🐛 Remove dependency on bash from crash/oome uploder scripts ([#&#8203;8652](DataDog/dd-trace-java#8652) - [@&#8203;jbachorik](https://github.com/jbachorik)) #### Data Streams Monitoring - ✨ e2e pipeline configuration when data jobs is enabled ([#&#8203;8553](DataDog/dd-trace-java#8553) - [@&#8203;kr-igor](https://github.com/kr-igor)) #### Dynamic Instrumentation - 🐛 Fix In-Product when config is empty ([#&#8203;8679](DataDog/dd-trace-java#8679) - [@&#8203;jpbempel](https://github.com/jpbempel)) - ✨ Add support for filtering shaded third-party libs ([#&#8203;8612](DataDog/dd-trace-java#8612) - [@&#8203;jpbempel](https://github.com/jpbempel)) - ✨ Add In-Product Enablement ([#&#8203;8587](DataDog/dd-trace-java#8587) - [@&#8203;jpbempel](https://github.com/jpbempel)) - ✨⚡ Reduce footprint of SourceFile tracking ([#&#8203;8524](DataDog/dd-trace-java#8524) - [@&#8203;jpbempel](https://github.com/jpbempel)) - ✨⚡ Optimize the SourceFile tracking ([#&#8203;8520](DataDog/dd-trace-java#8520) - [@&#8203;jpbempel](https://github.com/jpbempel)) #### OpenTracing - 🧹 Remove activeScope() use in OpenTracing shim ([#&#8203;8478](DataDog/dd-trace-java#8478) - [@&#8203;mcculls](https://github.com/mcculls)) #### Profiling - ✨ Add profiler env check command to AgentCLI ([#&#8203;8671](DataDog/dd-trace-java#8671) - [@&#8203;jbachorik](https://github.com/jbachorik)) - ✨ Bump ddprof to 1.23.0 ([#&#8203;8668](DataDog/dd-trace-java#8668) - [@&#8203;jbachorik](https://github.com/jbachorik)) - Fix a crash related to ElfParser::loadSymbolTable ([#&#8203;191](DataDog/dd-trace-java#191)) by [@&#8203;yanglong1010](https://github.com/yanglong1010) in DataDog/java-profiler#192 - Unwind String.indexOf intrinsic on AArch64 by [@&#8203;MattAlp](https://github.com/MattAlp) in DataDog/java-profiler#193 - Fix Java 24 support by [@&#8203;jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#194 - A set of fixes related to clang, aarch64 and musl pecularities of vmstructs stack unwinder by [@&#8203;jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#199 - 🐛 Remove process information from JFR recording ([#&#8203;8661](DataDog/dd-trace-java#8661) - [@&#8203;r1viollet](https://github.com/r1viollet)) - 🐛 Make TempLocationManager USER aware ([#&#8203;8605](DataDog/dd-trace-java#8605) - [@&#8203;jbachorik](https://github.com/jbachorik)) - ✨ Extract git tags from embedded git.properties and datadog_git.properties ([#&#8203;8561](DataDog/dd-trace-java#8561) - [@&#8203;wmouchere](https://github.com/wmouchere)) #### Telemetry - 🐛 Fix appsec.rasp.error and appsec.waf.error telemetry metrics ([#&#8203;8624](DataDog/dd-trace-java#8624) - [@&#8203;jandro996](https://github.com/jandro996)) - ✨ Create metric: appsec.rasp.rule.skipped ([#&#8203;8618](DataDog/dd-trace-java#8618) - [@&#8203;jandro996](https://github.com/jandro996)) - ✨ Extract git tags from embedded git.properties and datadog_git.properties ([#&#8203;8561](DataDog/dd-trace-java#8561) - [@&#8203;wmouchere](https://github.com/wmouchere)) #### Testing - 🧹 Simplify ssi tests one-pipeline ([#&#8203;8558](DataDog/dd-trace-java#8558) - [@&#8203;robertomonteromiguel](https://github.com/robertomonteromiguel)) - ✨ Add smoke tests for java's concurrent API ([#&#8203;8438](DataDog/dd-trace-java#8438) - [@&#8203;sarahchen6](https://github.com/sarahchen6)) #### Trace context propagation - ✨ Adding Support for `TRACE_PROPAGATION_BEHAVIOR_EXTRACT` ([#&#8203;8535](DataDog/dd-trace-java#8535) - [@&#8203;mhlidd](https://github.com/mhlidd)) #### Tracer core - 🐛 Ensure shaded helpers have unique names ([#&#8203;8559](DataDog/dd-trace-java#8559) - [@&#8203;amarziali](https://github.com/amarziali)) - ✨ Support common config sources for user-provided git info ([#&#8203;8547](DataDog/dd-trace-java#8547) - [@&#8203;nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Make the default config sources more robust when a security manager is installed ([#&#8203;8544](DataDog/dd-trace-java#8544) - [@&#8203;mcculls](https://github.com/mcculls)) - ✨ Support targeting services with configurations in stable configuration file ([#&#8203;8526](DataDog/dd-trace-java#8526) - [@&#8203;mtoffl01](https://github.com/mtoffl01)) - ✨ Add new parser for `DD_TAGS` and prioritizing `DD_SERVICE` ([#&#8203;8296](DataDog/dd-trace-java#8296) - [@&#8203;mhlidd](https://github.com/mhlidd)) #### Tracer internal logging - 🐛 Add missing debug log for the cloudPayloadTaggingServices config ([#&#8203;8600](DataDog/dd-trace-java#8600) - [@&#8203;ygree](https://github.com/ygree)) - ✨ Add the possibility to output the logs of the Java tracer in JSON ([#&#8203;8083](DataDog/dd-trace-java#8083) - [@&#8203;cecile75](https://github.com/cecile75)) #### Tracer public API - ✨ Introducing `DD_TRACE_EXPERIMENTAL_FEATURES_ENABLED` Config ([#&#8203;8536](DataDog/dd-trace-java#8536) - [@&#8203;mhlidd](https://github.com/mhlidd)) - ✨ Config Consistency Round 2 ([#&#8203;8489](DataDog/dd-trace-java#8489) - [@&#8203;mhlidd](https://github.com/mhlidd)) ### Instrumentations #### - 🐛 Fix NPE in getMdcCopy of LoggingEventInstrumentation ([#&#8203;8599](DataDog/dd-trace-java#8599) - [@&#8203;ygree](https://github.com/ygree)) #### Apache Spark instrumentation - ✨ Instrument Runtime.exit() to finish spark application spans ([#&#8203;8572](DataDog/dd-trace-java#8572) - [@&#8203;paul-laffon-dd](https://github.com/paul-laffon-dd)) - ✨ Configure OpenLineage if present in Spark instrumentation ([#&#8203;8541](DataDog/dd-trace-java#8541) - [@&#8203;mobuchowski](https://github.com/mobuchowski)) #### Armeria Instrumentation - ✨ Support armeria grpc 1.32.3 ([#&#8203;8606](DataDog/dd-trace-java#8606) - [@&#8203;github-actions](https://github.com/github-actions)\[bot]) #### AWS DynamoDB Instrumentation - ✨ Create DynamoDB instrumentation + add span pointers for `updateItem` and `deleteItem` ([#&#8203;8490](DataDog/dd-trace-java#8490) - [@&#8203;nhulston](https://github.com/nhulston)) #### AWS SDK instrumentation - ✨ Add DynamoDB in DEFAULT_TRACE_CLOUD_PAYLOAD_TAGGING_SERVICES ([#&#8203;8595](DataDog/dd-trace-java#8595) - [@&#8203;joeyzhao2018](https://github.com/joeyzhao2018)) #### Azure Functions instrumentation - ✨ Enable tracer computed trace metrics by default for Azure Functions ([#&#8203;8518](DataDog/dd-trace-java#8518) - [@&#8203;duncanpharvey](https://github.com/duncanpharvey)) - 💡 Add azure-functions instrumentation ([#&#8203;8432](DataDog/dd-trace-java#8432) - [@&#8203;duncanpharvey](https://github.com/duncanpharvey)) #### Core Java language instrumentation - 🐛 Fix ForkJoinPool.execute() instrumentation on Java 21+ ([#&#8203;8560](DataDog/dd-trace-java#8560) - [@&#8203;PerfectSlayer](https://github.com/PerfectSlayer)) #### Eclipse Vert.x instrumentation - ✨ Add vertx postgresql client instrumentation ([#&#8203;8471](DataDog/dd-trace-java#8471) - [@&#8203;vandonr](https://github.com/vandonr) - thanks for the contribution!) #### Kafka instrumentation - ✨ Support and test kafka-clients 4 ([#&#8203;8581](DataDog/dd-trace-java#8581) - [@&#8203;amarziali](https://github.com/amarziali)) #### Kotlin instrumentation - ✨ Avoid disconnected traces when using Kotlin flowOn ([#&#8203;8651](DataDog/dd-trace-java#8651) - [@&#8203;mcculls](https://github.com/mcculls)) #### OpenTelemetry instrumentation - 🧹 Migrate OtelContext wrapper to new internal Context API ([#&#8203;8645](DataDog/dd-trace-java#8645) - [@&#8203;mcculls](https://github.com/mcculls)) #### Spring instrumentation - 🐛 Support CompletableFuture on spring webmvc controllers ([#&#8203;8659](DataDog/dd-trace-java#8659) - [@&#8203;amarziali](https://github.com/amarziali)) - ✨ Add support for endpoint discovery in spring mvc ([#&#8203;8352](DataDog/dd-trace-java#8352) - [@&#8203;manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) #### WebSocket Instrumentation - ✨ Instrument Jetty websocket pojo ([#&#8203;8562](DataDog/dd-trace-java#8562) - [@&#8203;amarziali](https://github.com/amarziali)) - 💡 Instrument Java Websocket API (JSR356) ([#&#8203;8440](DataDog/dd-trace-java#8440) - [@&#8203;amarziali](https://github.com/amarziali)) #### All other instrumentations - ✨ Introduce cache for peer.hostname lookup ([#&#8203;8601](DataDog/dd-trace-java#8601) - [@&#8203;mcculls](https://github.com/mcculls)) - ✨ Support pekko http 1.1 ([#&#8203;8532](DataDog/dd-trace-java#8532) - [@&#8203;amarziali](https://github.com/amarziali)) </details> --- ### Configuration 📅 **Schedule**: Branch creation - "after 6pm every weekday,before 2am every weekday" in timezone Australia/Melbourne, Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Never, or you tick the rebase/retry checkbox. 👻 **Immortal**: This PR will be recreated if closed unmerged. Get [config help](https://github.com/renovatebot/renovate/discussions) if that's undesired. --- - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate). GitOrigin-RevId: 331314f71acaced3adc75ea5d7e855c248d593fc
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

2 participants