Dummy

[jbachorik]

No description provided.

[pr-commenter]

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jb/test_check
git_commit_date	1750931982	1750945949
git_commit_sha	0f9b46c	c8cad11
release_version	1.51.0-SNAPSHOT~0f9b46c752	1.51.0-SNAPSHOT~c8cad11de4

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1750947871	1750947871
ci_job_id	1000240086	1000240086
ci_pipeline_id	68861737	68861737
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-iun2vzqu-project-304-concurrent-0-4wzg12r4 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-iun2vzqu-project-304-concurrent-0-4wzg12r4 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 44 metrics, 9 unstable metrics.

Startup time reports for petclinic

gantt title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752 dateFormat X axisFormat %s section tracing Agent [baseline] (1.003 s) : 0, 1003300 Total [baseline] (10.788 s) : 0, 10788190 Agent [candidate] (999.98 ms) : 0, 999980 Total [candidate] (10.729 s) : 0, 10728539 section appsec Agent [baseline] (1.177 s) : 0, 1176597 Total [baseline] (10.77 s) : 0, 10769854 Agent [candidate] (1.18 s) : 0, 1179772 Total [candidate] (10.744 s) : 0, 10744192 section iast Agent [baseline] (1.133 s) : 0, 1133257 Total [baseline] (10.877 s) : 0, 10876940 Agent [candidate] (1.141 s) : 0, 1140664 Total [candidate] (10.829 s) : 0, 10829052 section profiling Agent [baseline] (1.245 s) : 0, 1244521 Total [baseline] (11.034 s) : 0, 11034250 Agent [candidate] (1.251 s) : 0, 1251393 Total [candidate] (11.057 s) : 0, 11056718 

Loading

• baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.003 s	-
Agent	appsec	1.177 s	173.297 ms (17.3%)
Agent	iast	1.133 s	129.958 ms (13.0%)
Agent	profiling	1.245 s	241.221 ms (24.0%)
Total	tracing	10.788 s	-
Total	appsec	10.77 s	-18.336 ms (-0.2%)
Total	iast	10.877 s	88.75 ms (0.8%)
Total	profiling	11.034 s	246.06 ms (2.3%)

• candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	999.98 ms	-
Agent	appsec	1.18 s	179.791 ms (18.0%)
Agent	iast	1.141 s	140.684 ms (14.1%)
Agent	profiling	1.251 s	251.412 ms (25.1%)
Total	tracing	10.729 s	-
Total	appsec	10.744 s	15.652 ms (0.1%)
Total	iast	10.829 s	100.512 ms (0.9%)
Total	profiling	11.057 s	328.179 ms (3.1%)

gantt title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (692.912 ms) : 0, 692912 BytebuddyAgent [candidate] (690.334 ms) : 0, 690334 GlobalTracer [baseline] (243.903 ms) : 0, 243903 GlobalTracer [candidate] (243.176 ms) : 0, 243176 AppSec [baseline] (30.538 ms) : 0, 30538 AppSec [candidate] (30.458 ms) : 0, 30458 Debugger [baseline] (6.052 ms) : 0, 6052 Debugger [candidate] (6.108 ms) : 0, 6108 Remote Config [baseline] (674.671 µs) : 0, 675 Remote Config [candidate] (683.738 µs) : 0, 684 Telemetry [baseline] (8.247 ms) : 0, 8247 Telemetry [candidate] (8.248 ms) : 0, 8248 section appsec BytebuddyAgent [baseline] (711.794 ms) : 0, 711794 BytebuddyAgent [candidate] (715.978 ms) : 0, 715978 GlobalTracer [baseline] (236.697 ms) : 0, 236697 GlobalTracer [candidate] (236.166 ms) : 0, 236166 IAST [baseline] (22.097 ms) : 0, 22097 IAST [candidate] (22.149 ms) : 0, 22149 AppSec [baseline] (170.653 ms) : 0, 170653 AppSec [candidate] (170.001 ms) : 0, 170001 Debugger [baseline] (5.817 ms) : 0, 5817 Debugger [candidate] (5.813 ms) : 0, 5813 Remote Config [baseline] (606.298 µs) : 0, 606 Remote Config [candidate] (603.552 µs) : 0, 604 Telemetry [baseline] (8.128 ms) : 0, 8128 Telemetry [candidate] (8.115 ms) : 0, 8115 section iast BytebuddyAgent [baseline] (809.229 ms) : 0, 809229 BytebuddyAgent [candidate] (815.054 ms) : 0, 815054 GlobalTracer [baseline] (233.27 ms) : 0, 233270 GlobalTracer [candidate] (234.231 ms) : 0, 234231 IAST [baseline] (24.655 ms) : 0, 24655 IAST [candidate] (28.156 ms) : 0, 28156 AppSec [baseline] (30.881 ms) : 0, 30881 AppSec [candidate] (27.801 ms) : 0, 27801 Debugger [baseline] (5.804 ms) : 0, 5804 Debugger [candidate] (5.851 ms) : 0, 5851 Remote Config [baseline] (577.76 µs) : 0, 578 Remote Config [candidate] (583.509 µs) : 0, 584 Telemetry [baseline] (7.954 ms) : 0, 7954 Telemetry [candidate] (8.01 ms) : 0, 8010 section profiling BytebuddyAgent [baseline] (678.144 ms) : 0, 678144 BytebuddyAgent [candidate] (684.374 ms) : 0, 684374 GlobalTracer [baseline] (361.681 ms) : 0, 361681 GlobalTracer [candidate] (362.056 ms) : 0, 362056 AppSec [baseline] (31.524 ms) : 0, 31524 AppSec [candidate] (32.427 ms) : 0, 32427 Debugger [baseline] (10.511 ms) : 0, 10511 Debugger [candidate] (11.322 ms) : 0, 11322 Remote Config [baseline] (1.413 ms) : 0, 1413 Remote Config [candidate] (659.947 µs) : 0, 660 Telemetry [baseline] (8.795 ms) : 0, 8795 Telemetry [candidate] (8.718 ms) : 0, 8718 ProfilingAgent [baseline] (103.075 ms) : 0, 103075 ProfilingAgent [candidate] (102.997 ms) : 0, 102997 Profiling [baseline] (103.102 ms) : 0, 103102 Profiling [candidate] (103.021 ms) : 0, 103021 

Loading

Startup time reports for insecure-bank

gantt title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752 dateFormat X axisFormat %s section tracing Agent [baseline] (997.106 ms) : 0, 997106 Total [baseline] (8.557 s) : 0, 8557476 Agent [candidate] (1.003 s) : 0, 1002694 Total [candidate] (8.572 s) : 0, 8571744 section iast Agent [baseline] (1.14 s) : 0, 1139828 Total [baseline] (9.301 s) : 0, 9301053 Agent [candidate] (1.148 s) : 0, 1147618 Total [candidate] (9.33 s) : 0, 9330447 

Loading

• baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	997.106 ms	-
Agent	iast	1.14 s	142.721 ms (14.3%)
Total	tracing	8.557 s	-
Total	iast	9.301 s	743.577 ms (8.7%)

• candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.003 s	-
Agent	iast	1.148 s	144.923 ms (14.5%)
Total	tracing	8.572 s	-
Total	iast	9.33 s	758.703 ms (8.9%)

gantt title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (688.244 ms) : 0, 688244 BytebuddyAgent [candidate] (693.055 ms) : 0, 693055 GlobalTracer [baseline] (242.561 ms) : 0, 242561 GlobalTracer [candidate] (243.355 ms) : 0, 243355 AppSec [baseline] (30.41 ms) : 0, 30410 AppSec [candidate] (30.376 ms) : 0, 30376 Debugger [baseline] (6.056 ms) : 0, 6056 Debugger [candidate] (6.078 ms) : 0, 6078 Remote Config [baseline] (672.75 µs) : 0, 673 Remote Config [candidate] (676.451 µs) : 0, 676 Telemetry [baseline] (8.31 ms) : 0, 8310 Telemetry [candidate] (8.248 ms) : 0, 8248 section iast BytebuddyAgent [baseline] (814.164 ms) : 0, 814164 BytebuddyAgent [candidate] (820.639 ms) : 0, 820639 GlobalTracer [baseline] (233.958 ms) : 0, 233958 GlobalTracer [candidate] (235.681 ms) : 0, 235681 IAST [baseline] (26.579 ms) : 0, 26579 IAST [candidate] (27.229 ms) : 0, 27229 AppSec [baseline] (29.654 ms) : 0, 29654 AppSec [candidate] (28.523 ms) : 0, 28523 Debugger [baseline] (5.852 ms) : 0, 5852 Debugger [candidate] (5.901 ms) : 0, 5901 Remote Config [baseline] (598.107 µs) : 0, 598 Remote Config [candidate] (589.273 µs) : 0, 589 Telemetry [baseline] (8.049 ms) : 0, 8049 Telemetry [candidate] (8.039 ms) : 0, 8039 

Loading

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jb/test_check
git_commit_date	1750931982	1750945949
git_commit_sha	0f9b46c	c8cad11
release_version	1.51.0-SNAPSHOT~0f9b46c752	1.51.0-SNAPSHOT~c8cad11de4

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1750947462	1750947462
ci_job_id	1000240087	1000240087
ci_pipeline_id	68861737	68861737
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-cpksuxk1-project-304-concurrent-0-w8xgy4i1 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-cpksuxk1-project-304-concurrent-0-w8xgy4i1 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	worse [+430.252µs; +820.212µs] or [+4.379%; +8.347%]	unstable [-86.246op/s; +30.184op/s] or [-18.242%; +6.384%]	10.452ms	444.750op/s	9.826ms	472.781op/s
scenario:load:petclinic:tracing:high_load	worse [+0.902ms; +1.706ms] or [+2.064%; +3.906%]	unstable [-9.079op/s; +5.587op/s] or [-8.480%; +5.218%]	44.983ms	105.316op/s	43.679ms	107.062op/s

Request duration reports for petclinic

gantt title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752 dateFormat X axisFormat %s section baseline no_agent (36.455 ms) : 36171, 36739 . : milestone, 36455, appsec (47.942 ms) : 47522, 48363 . : milestone, 47942, code_origins (44.541 ms) : 44169, 44913 . : milestone, 44541, iast (43.065 ms) : 42678, 43453 . : milestone, 43065, profiling (47.986 ms) : 47558, 48415 . : milestone, 47986, tracing (43.679 ms) : 43303, 44056 . : milestone, 43679, section candidate no_agent (37.052 ms) : 36748, 37355 . : milestone, 37052, appsec (48.262 ms) : 47832, 48692 . : milestone, 48262, code_origins (44.191 ms) : 43828, 44555 . : milestone, 44191, iast (43.705 ms) : 43317, 44093 . : milestone, 43705, profiling (47.343 ms) : 46915, 47772 . : milestone, 47343, tracing (44.983 ms) : 44612, 45354 . : milestone, 44983, 

Loading

• baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.455 ms [36.171 ms, 36.739 ms]	-
appsec	47.942 ms [47.522 ms, 48.363 ms]	11.487 ms (31.5%)
code_origins	44.541 ms [44.169 ms, 44.913 ms]	8.086 ms (22.2%)
iast	43.065 ms [42.678 ms, 43.453 ms]	6.61 ms (18.1%)
profiling	47.986 ms [47.558 ms, 48.415 ms]	11.531 ms (31.6%)
tracing	43.679 ms [43.303 ms, 44.056 ms]	7.224 ms (19.8%)

• candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.052 ms [36.748 ms, 37.355 ms]	-
appsec	48.262 ms [47.832 ms, 48.692 ms]	11.211 ms (30.3%)
code_origins	44.191 ms [43.828 ms, 44.555 ms]	7.14 ms (19.3%)
iast	43.705 ms [43.317 ms, 44.093 ms]	6.653 ms (18.0%)
profiling	47.343 ms [46.915 ms, 47.772 ms]	10.292 ms (27.8%)
tracing	44.983 ms [44.612 ms, 45.354 ms]	7.932 ms (21.4%)

Request duration reports for insecure-bank

gantt title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752 dateFormat X axisFormat %s section baseline no_agent (4.479 ms) : 4428, 4530 . : milestone, 4479, iast (9.294 ms) : 9132, 9456 . : milestone, 9294, iast_FULL (13.59 ms) : 13320, 13860 . : milestone, 13590, iast_GLOBAL (9.826 ms) : 9647, 10006 . : milestone, 9826, profiling (8.199 ms) : 8067, 8332 . : milestone, 8199, tracing (7.658 ms) : 7538, 7777 . : milestone, 7658, section candidate no_agent (4.378 ms) : 4329, 4427 . : milestone, 4378, iast (9.266 ms) : 9115, 9417 . : milestone, 9266, iast_FULL (13.631 ms) : 13363, 13899 . : milestone, 13631, iast_GLOBAL (10.452 ms) : 10269, 10634 . : milestone, 10452, profiling (8.422 ms) : 8295, 8549 . : milestone, 8422, tracing (7.766 ms) : 7645, 7886 . : milestone, 7766, 

Loading

• baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.479 ms [4.428 ms, 4.53 ms]	-
iast	9.294 ms [9.132 ms, 9.456 ms]	4.815 ms (107.5%)
iast_FULL	13.59 ms [13.32 ms, 13.86 ms]	9.111 ms (203.4%)
iast_GLOBAL	9.826 ms [9.647 ms, 10.006 ms]	5.347 ms (119.4%)
profiling	8.199 ms [8.067 ms, 8.332 ms]	3.72 ms (83.1%)
tracing	7.658 ms [7.538 ms, 7.777 ms]	3.179 ms (71.0%)

• candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.378 ms [4.329 ms, 4.427 ms]	-
iast	9.266 ms [9.115 ms, 9.417 ms]	4.888 ms (111.7%)
iast_FULL	13.631 ms [13.363 ms, 13.899 ms]	9.253 ms (211.4%)
iast_GLOBAL	10.452 ms [10.269 ms, 10.634 ms]	6.074 ms (138.7%)
profiling	8.422 ms [8.295 ms, 8.549 ms]	4.044 ms (92.4%)
tracing	7.766 ms [7.645 ms, 7.886 ms]	3.388 ms (77.4%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jb/test_check
git_commit_date	1750931982	1750945949
git_commit_sha	0f9b46c	c8cad11
release_version	1.51.0-SNAPSHOT~0f9b46c752	1.51.0-SNAPSHOT~c8cad11de4

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1750948047	1750948047
ci_job_id	1000240088	1000240088
ci_pipeline_id	68861737	68861737
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-wutn71ym-project-304-concurrent-0-g4j8m1oz 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-wutn71ym-project-304-concurrent-0-g4j8m1oz 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat

gantt title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752 dateFormat X axisFormat %s section baseline no_agent (1.472 ms) : 1461, 1484 . : milestone, 1472, appsec (2.402 ms) : 2353, 2451 . : milestone, 2402, iast (2.184 ms) : 2122, 2245 . : milestone, 2184, iast_GLOBAL (2.231 ms) : 2170, 2293 . : milestone, 2231, profiling (2.036 ms) : 1986, 2086 . : milestone, 2036, tracing (2.005 ms) : 1957, 2053 . : milestone, 2005, section candidate no_agent (1.473 ms) : 1462, 1485 . : milestone, 1473, appsec (2.396 ms) : 2347, 2445 . : milestone, 2396, iast (2.182 ms) : 2121, 2243 . : milestone, 2182, iast_GLOBAL (2.231 ms) : 2170, 2293 . : milestone, 2231, profiling (2.024 ms) : 1975, 2073 . : milestone, 2024, tracing (2.0 ms) : 1952, 2047 . : milestone, 2000, 

Loading

• baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.472 ms [1.461 ms, 1.484 ms]	-
appsec	2.402 ms [2.353 ms, 2.451 ms]	930.099 µs (63.2%)
iast	2.184 ms [2.122 ms, 2.245 ms]	711.689 µs (48.3%)
iast_GLOBAL	2.231 ms [2.17 ms, 2.293 ms]	759.143 µs (51.6%)
profiling	2.036 ms [1.986 ms, 2.086 ms]	564.337 µs (38.3%)
tracing	2.005 ms [1.957 ms, 2.053 ms]	533.032 µs (36.2%)

• candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.473 ms [1.462 ms, 1.485 ms]	-
appsec	2.396 ms [2.347 ms, 2.445 ms]	922.947 µs (62.7%)
iast	2.182 ms [2.121 ms, 2.243 ms]	709.096 µs (48.1%)
iast_GLOBAL	2.231 ms [2.17 ms, 2.293 ms]	758.146 µs (51.5%)
profiling	2.024 ms [1.975 ms, 2.073 ms]	550.656 µs (37.4%)
tracing	2.0 ms [1.952 ms, 2.047 ms]	526.703 µs (35.8%)

Execution time for biojava

gantt title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752 dateFormat X axisFormat %s section baseline no_agent (15.633 s) : 15633000, 15633000 . : milestone, 15633000, appsec (14.993 s) : 14993000, 14993000 . : milestone, 14993000, iast (18.487 s) : 18487000, 18487000 . : milestone, 18487000, iast_GLOBAL (18.069 s) : 18069000, 18069000 . : milestone, 18069000, profiling (15.197 s) : 15197000, 15197000 . : milestone, 15197000, tracing (14.808 s) : 14808000, 14808000 . : milestone, 14808000, section candidate no_agent (15.528 s) : 15528000, 15528000 . : milestone, 15528000, appsec (14.745 s) : 14745000, 14745000 . : milestone, 14745000, iast (18.843 s) : 18843000, 18843000 . : milestone, 18843000, iast_GLOBAL (18.091 s) : 18091000, 18091000 . : milestone, 18091000, profiling (15.332 s) : 15332000, 15332000 . : milestone, 15332000, tracing (14.792 s) : 14792000, 14792000 . : milestone, 14792000, 

Loading

• baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.633 s [15.633 s, 15.633 s]	-
appsec	14.993 s [14.993 s, 14.993 s]	-640.0 ms (-4.1%)
iast	18.487 s [18.487 s, 18.487 s]	2.854 s (18.3%)
iast_GLOBAL	18.069 s [18.069 s, 18.069 s]	2.436 s (15.6%)
profiling	15.197 s [15.197 s, 15.197 s]	-436.0 ms (-2.8%)
tracing	14.808 s [14.808 s, 14.808 s]	-825.0 ms (-5.3%)

• candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.528 s [15.528 s, 15.528 s]	-
appsec	14.745 s [14.745 s, 14.745 s]	-783.0 ms (-5.0%)
iast	18.843 s [18.843 s, 18.843 s]	3.315 s (21.3%)
iast_GLOBAL	18.091 s [18.091 s, 18.091 s]	2.563 s (16.5%)
profiling	15.332 s [15.332 s, 15.332 s]	-196.0 ms (-1.3%)
tracing	14.792 s [14.792 s, 14.792 s]	-736.0 ms (-4.7%)

[github-actions]

This pull request has been marked as stale because it has not had activity over the past quarter. It will be closed in 7 days if no further activity occurs. Feel free to reopen the PR if you are still working on it.