- Notifications
You must be signed in to change notification settings - Fork 313
Add SSI Appsec System tests #9048
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Hi! 👋 Thanks for your pull request! 🎉 To help us review it, please make sure to:
If you need help, please check our contributing guidelines. |
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 43 metrics, 10 unstable metrics. Startup time reports for petclinicgantt title petclinic - global startup overhead: candidate=1.52.0-SNAPSHOT~ea800bb7b1, baseline=1.52.0-SNAPSHOT~3abf3010b9 dateFormat X axisFormat %s section tracing Agent [baseline] (993.551 ms) : 0, 993551 Total [baseline] (10.635 s) : 0, 10635100 Agent [candidate] (993.147 ms) : 0, 993147 Total [candidate] (10.611 s) : 0, 10610706 section appsec Agent [baseline] (1.174 s) : 0, 1173638 Total [baseline] (10.708 s) : 0, 10707889 Agent [candidate] (1.172 s) : 0, 1172149 Total [candidate] (10.743 s) : 0, 10742592 section iast Agent [baseline] (1.133 s) : 0, 1132689 Total [baseline] (10.815 s) : 0, 10815205 Agent [candidate] (1.129 s) : 0, 1129436 Total [candidate] (10.803 s) : 0, 10802868 section profiling Agent [baseline] (1.246 s) : 0, 1245889 Total [baseline] (10.981 s) : 0, 10981172 Agent [candidate] (1.253 s) : 0, 1252706 Total [candidate] (11.028 s) : 0, 11028378
gantt title petclinic - break down per module: candidate=1.52.0-SNAPSHOT~ea800bb7b1, baseline=1.52.0-SNAPSHOT~3abf3010b9 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (685.469 ms) : 0, 685469 BytebuddyAgent [candidate] (685.399 ms) : 0, 685399 GlobalTracer [baseline] (242.03 ms) : 0, 242030 GlobalTracer [candidate] (241.837 ms) : 0, 241837 AppSec [baseline] (30.343 ms) : 0, 30343 AppSec [candidate] (30.205 ms) : 0, 30205 Debugger [baseline] (5.971 ms) : 0, 5971 Debugger [candidate] (6.046 ms) : 0, 6046 Remote Config [baseline] (671.525 µs) : 0, 672 Remote Config [candidate] (671.83 µs) : 0, 672 Telemetry [baseline] (8.209 ms) : 0, 8209 Telemetry [candidate] (8.208 ms) : 0, 8208 section appsec BytebuddyAgent [baseline] (708.224 ms) : 0, 708224 BytebuddyAgent [candidate] (707.815 ms) : 0, 707815 GlobalTracer [baseline] (235.633 ms) : 0, 235633 GlobalTracer [candidate] (234.789 ms) : 0, 234789 AppSec [baseline] (170.934 ms) : 0, 170934 AppSec [candidate] (170.873 ms) : 0, 170873 Debugger [baseline] (5.751 ms) : 0, 5751 Debugger [candidate] (5.704 ms) : 0, 5704 Remote Config [baseline] (610.314 µs) : 0, 610 Remote Config [candidate] (599.209 µs) : 0, 599 Telemetry [baseline] (8.056 ms) : 0, 8056 Telemetry [candidate] (8.013 ms) : 0, 8013 IAST [baseline] (23.674 ms) : 0, 23674 IAST [candidate] (23.518 ms) : 0, 23518 section iast BytebuddyAgent [baseline] (806.808 ms) : 0, 806808 BytebuddyAgent [candidate] (804.2 ms) : 0, 804200 GlobalTracer [baseline] (233.269 ms) : 0, 233269 GlobalTracer [candidate] (232.368 ms) : 0, 232368 AppSec [baseline] (27.924 ms) : 0, 27924 AppSec [candidate] (29.771 ms) : 0, 29771 Debugger [baseline] (5.713 ms) : 0, 5713 Debugger [candidate] (6.627 ms) : 0, 6627 Remote Config [baseline] (583.205 µs) : 0, 583 Remote Config [candidate] (574.762 µs) : 0, 575 Telemetry [baseline] (7.946 ms) : 0, 7946 Telemetry [candidate] (7.875 ms) : 0, 7875 IAST [baseline] (29.693 ms) : 0, 29693 IAST [candidate] (27.283 ms) : 0, 27283 section profiling BytebuddyAgent [baseline] (676.613 ms) : 0, 676613 BytebuddyAgent [candidate] (682.301 ms) : 0, 682301 GlobalTracer [baseline] (362.391 ms) : 0, 362391 GlobalTracer [candidate] (363.497 ms) : 0, 363497 AppSec [baseline] (34.033 ms) : 0, 34033 AppSec [candidate] (32.615 ms) : 0, 32615 Debugger [baseline] (10.484 ms) : 0, 10484 Debugger [candidate] (11.545 ms) : 0, 11545 Remote Config [baseline] (662.388 µs) : 0, 662 Remote Config [candidate] (668.581 µs) : 0, 669 Telemetry [baseline] (8.07 ms) : 0, 8070 Telemetry [candidate] (8.891 ms) : 0, 8891 ProfilingAgent [baseline] (104.991 ms) : 0, 104991 ProfilingAgent [candidate] (104.319 ms) : 0, 104319 Profiling [baseline] (105.016 ms) : 0, 105016 Profiling [candidate] (104.345 ms) : 0, 104345 Startup time reports for insecure-bankgantt title insecure-bank - global startup overhead: candidate=1.52.0-SNAPSHOT~ea800bb7b1, baseline=1.52.0-SNAPSHOT~3abf3010b9 dateFormat X axisFormat %s section tracing Agent [baseline] (991.09 ms) : 0, 991090 Total [baseline] (8.57 s) : 0, 8569868 Agent [candidate] (994.543 ms) : 0, 994543 Total [candidate] (8.585 s) : 0, 8584599 section iast Agent [baseline] (1.133 s) : 0, 1133043 Total [baseline] (9.275 s) : 0, 9275455 Agent [candidate] (1.132 s) : 0, 1131806 Total [candidate] (9.288 s) : 0, 9288106
gantt title insecure-bank - break down per module: candidate=1.52.0-SNAPSHOT~ea800bb7b1, baseline=1.52.0-SNAPSHOT~3abf3010b9 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (684.228 ms) : 0, 684228 BytebuddyAgent [candidate] (686.717 ms) : 0, 686717 GlobalTracer [baseline] (241.166 ms) : 0, 241166 GlobalTracer [candidate] (241.953 ms) : 0, 241953 AppSec [baseline] (30.17 ms) : 0, 30170 AppSec [candidate] (30.272 ms) : 0, 30272 Debugger [baseline] (5.952 ms) : 0, 5952 Debugger [candidate] (5.975 ms) : 0, 5975 Remote Config [baseline] (671.814 µs) : 0, 672 Remote Config [candidate] (673.886 µs) : 0, 674 Telemetry [baseline] (8.188 ms) : 0, 8188 Telemetry [candidate] (8.224 ms) : 0, 8224 section iast BytebuddyAgent [baseline] (808.518 ms) : 0, 808518 BytebuddyAgent [candidate] (806.57 ms) : 0, 806570 GlobalTracer [baseline] (231.973 ms) : 0, 231973 GlobalTracer [candidate] (232.347 ms) : 0, 232347 AppSec [baseline] (30.447 ms) : 0, 30447 AppSec [candidate] (27.166 ms) : 0, 27166 Debugger [baseline] (5.713 ms) : 0, 5713 Debugger [candidate] (7.516 ms) : 0, 7516 Remote Config [baseline] (573.735 µs) : 0, 574 Remote Config [candidate] (593.563 µs) : 0, 594 Telemetry [baseline] (7.869 ms) : 0, 7869 Telemetry [candidate] (7.905 ms) : 0, 7905 IAST [baseline] (27.201 ms) : 0, 27201 IAST [candidate] (29.066 ms) : 0, 29066 LoadParameters
See matching parameters
SummaryFound 2 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.
Request duration reports for petclinicgantt title petclinic - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~ea800bb7b1, baseline=1.52.0-SNAPSHOT~3abf3010b9 dateFormat X axisFormat %s section baseline no_agent (35.791 ms) : 35505, 36077 . : milestone, 35791, appsec (47.809 ms) : 47396, 48221 . : milestone, 47809, code_origins (46.232 ms) : 45831, 46634 . : milestone, 46232, iast (45.078 ms) : 44687, 45468 . : milestone, 45078, profiling (50.304 ms) : 49828, 50780 . : milestone, 50304, tracing (43.872 ms) : 43520, 44223 . : milestone, 43872, section candidate no_agent (35.61 ms) : 35326, 35894 . : milestone, 35610, appsec (47.897 ms) : 47459, 48336 . : milestone, 47897, code_origins (43.937 ms) : 43562, 44312 . : milestone, 43937, iast (42.171 ms) : 41803, 42538 . : milestone, 42171, profiling (50.761 ms) : 50302, 51221 . : milestone, 50761, tracing (42.863 ms) : 42506, 43220 . : milestone, 42863,
Request duration reports for insecure-bankgantt title insecure-bank - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~ea800bb7b1, baseline=1.52.0-SNAPSHOT~3abf3010b9 dateFormat X axisFormat %s section baseline no_agent (4.389 ms) : 4333, 4446 . : milestone, 4389, iast (9.444 ms) : 9287, 9601 . : milestone, 9444, iast_FULL (13.944 ms) : 13668, 14221 . : milestone, 13944, iast_GLOBAL (10.203 ms) : 10024, 10382 . : milestone, 10203, profiling (8.479 ms) : 8350, 8609 . : milestone, 8479, tracing (7.576 ms) : 7458, 7694 . : milestone, 7576, section candidate no_agent (4.368 ms) : 4318, 4417 . : milestone, 4368, iast (9.436 ms) : 9270, 9601 . : milestone, 9436, iast_FULL (13.631 ms) : 13362, 13900 . : milestone, 13631, iast_GLOBAL (10.091 ms) : 9914, 10269 . : milestone, 10091, profiling (8.751 ms) : 8600, 8901 . : milestone, 8751, tracing (7.436 ms) : 7328, 7545 . : milestone, 7436,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for tomcatgantt title tomcat - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~ea800bb7b1, baseline=1.52.0-SNAPSHOT~3abf3010b9 dateFormat X axisFormat %s section baseline no_agent (1.48 ms) : 1468, 1491 . : milestone, 1480, appsec (2.416 ms) : 2366, 2466 . : milestone, 2416, iast (2.186 ms) : 2124, 2248 . : milestone, 2186, iast_GLOBAL (2.239 ms) : 2176, 2301 . : milestone, 2239, profiling (2.056 ms) : 2005, 2108 . : milestone, 2056, tracing (2.017 ms) : 1969, 2066 . : milestone, 2017, section candidate no_agent (1.478 ms) : 1466, 1489 . : milestone, 1478, appsec (2.413 ms) : 2363, 2463 . : milestone, 2413, iast (2.194 ms) : 2132, 2256 . : milestone, 2194, iast_GLOBAL (2.239 ms) : 2176, 2302 . : milestone, 2239, profiling (2.039 ms) : 1989, 2089 . : milestone, 2039, tracing (2.009 ms) : 1961, 2058 . : milestone, 2009,
Execution time for biojavagantt title biojava - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~ea800bb7b1, baseline=1.52.0-SNAPSHOT~3abf3010b9 dateFormat X axisFormat %s section baseline no_agent (14.905 s) : 14905000, 14905000 . : milestone, 14905000, appsec (14.916 s) : 14916000, 14916000 . : milestone, 14916000, iast (18.442 s) : 18442000, 18442000 . : milestone, 18442000, iast_GLOBAL (17.873 s) : 17873000, 17873000 . : milestone, 17873000, profiling (15.119 s) : 15119000, 15119000 . : milestone, 15119000, tracing (14.747 s) : 14747000, 14747000 . : milestone, 14747000, section candidate no_agent (14.7 s) : 14700000, 14700000 . : milestone, 14700000, appsec (14.706 s) : 14706000, 14706000 . : milestone, 14706000, iast (18.698 s) : 18698000, 18698000 . : milestone, 18698000, iast_GLOBAL (18.218 s) : 18218000, 18218000 . : milestone, 18218000, profiling (14.928 s) : 14928000, 14928000 . : milestone, 14928000, tracing (14.666 s) : 14666000, 14666000 . : milestone, 14666000,
|
caa29ce
to 50ec4ca
Compare f15ade8
to ea800bb
Compare
What does this PR do?
Add the
simple_onboarding_appsec
to the gitlab workflow.Motivation
Add system tests scenario for SSI Appsec.
Additional Notes
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]