Drop the requirement of jvm environment variables for `testJvm` constraint #9968

bric3 · 2025-11-14T11:45:46Z

What Does This Do

Allow our testJvmContraint plugin to let Gradle find the relevant JVM using the Gradle Toolchain.

Also, in CI, discover dynamically the JAVA_x_HOME environment variables exposed by the DataDog/dd-trace-java-docker-build image.

Motivation

Easier local setup. And follow-up to

Drop fromEnv toolchain restriction for local environment #9950

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-11-14T12:30:03Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bdu/avoids-need-for-JVM-environment-variables
git_commit_date	1763111453	1763120394
git_commit_sha	`8ceb94d`	`501af3d`
release_version	1.56.0-SNAPSHOT~8ceb94de51	1.56.0-SNAPSHOT~501af3d457

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763122209	1763122209
ci_job_id	1235017307	1235017307
ci_pipeline_id	82397919	82397919
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-hxiya290 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-hxiya290 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 5 performance regressions! Performance is the same for 54 metrics, 6 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:iast:Debugger	worse [+4.556ms; +6.559ms] or [+7.593%; +10.931%]	65.562ms	60.004ms
scenario:startup:insecure-bank:tracing:Debugger	worse [+5.067ms; +7.701ms] or [+8.035%; +12.212%]	69.443ms	63.059ms
scenario:startup:petclinic:iast:Debugger	worse [+5.289ms; +7.729ms] or [+8.713%; +12.733%]	67.207ms	60.698ms
scenario:startup:petclinic:profiling:Debugger	worse [+4.885ms; +6.311ms] or [+7.761%; +10.027%]	68.540ms	62.942ms
scenario:startup:petclinic:tracing:Debugger	worse [+4.152ms; +5.881ms] or [+6.465%; +9.156%]	69.247ms	64.231ms

Startup time reports for insecure-bank

gantt title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~501af3d457, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section tracing Agent [baseline] (1.103 s) : 0, 1102543 Total [baseline] (8.85 s) : 0, 8850456 Agent [candidate] (1.117 s) : 0, 1117222 Total [candidate] (8.878 s) : 0, 8878293 section iast Agent [baseline] (1.241 s) : 0, 1240587 Total [baseline] (9.531 s) : 0, 9531049 Agent [candidate] (1.246 s) : 0, 1246139 Total [candidate] (9.547 s) : 0, 9547270

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.103 s	-
Agent	iast	1.241 s	138.044 ms (12.5%)
Total	tracing	8.85 s	-
Total	iast	9.531 s	680.593 ms (7.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.117 s	-
Agent	iast	1.246 s	128.917 ms (11.5%)
Total	tracing	8.878 s	-
Total	iast	9.547 s	668.977 ms (7.5%)

gantt title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~501af3d457, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section tracing crashtracking [baseline] (1.482 ms) : 0, 1482 crashtracking [candidate] (1.472 ms) : 0, 1472 BytebuddyAgent [baseline] (709.0 ms) : 0, 709000 BytebuddyAgent [candidate] (714.46 ms) : 0, 714460 GlobalTracer [baseline] (249.257 ms) : 0, 249257 GlobalTracer [candidate] (250.973 ms) : 0, 250973 AppSec [baseline] (32.413 ms) : 0, 32413 AppSec [candidate] (32.792 ms) : 0, 32792 Debugger [baseline] (63.059 ms) : 0, 63059 Debugger [candidate] (69.443 ms) : 0, 69443 Remote Config [baseline] (637.952 µs) : 0, 638 Remote Config [candidate] (657.09 µs) : 0, 657 Telemetry [baseline] (8.197 ms) : 0, 8197 Telemetry [candidate] (8.472 ms) : 0, 8472 Flare Poller [baseline] (3.703 ms) : 0, 3703 Flare Poller [candidate] (3.826 ms) : 0, 3826 section iast crashtracking [baseline] (1.454 ms) : 0, 1454 crashtracking [candidate] (1.465 ms) : 0, 1465 BytebuddyAgent [baseline] (833.067 ms) : 0, 833067 BytebuddyAgent [candidate] (831.522 ms) : 0, 831522 GlobalTracer [baseline] (237.681 ms) : 0, 237681 GlobalTracer [candidate] (238.988 ms) : 0, 238988 IAST [baseline] (28.532 ms) : 0, 28532 IAST [candidate] (27.653 ms) : 0, 27653 AppSec [baseline] (33.327 ms) : 0, 33327 AppSec [candidate] (34.214 ms) : 0, 34214 Debugger [baseline] (60.004 ms) : 0, 60004 Debugger [candidate] (65.562 ms) : 0, 65562 Remote Config [baseline] (550.746 µs) : 0, 551 Remote Config [candidate] (558.589 µs) : 0, 559 Telemetry [baseline] (7.674 ms) : 0, 7674 Telemetry [candidate] (7.709 ms) : 0, 7709 Flare Poller [baseline] (3.475 ms) : 0, 3475 Flare Poller [candidate] (3.577 ms) : 0, 3577

Startup time reports for petclinic

gantt title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~501af3d457, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section tracing Agent [baseline] (1.096 s) : 0, 1095625 Total [baseline] (10.775 s) : 0, 10774615 Agent [candidate] (1.108 s) : 0, 1107883 Total [candidate] (10.8 s) : 0, 10799978 section appsec Agent [baseline] (1.283 s) : 0, 1282933 Total [baseline] (11.119 s) : 0, 11119309 Agent [candidate] (1.288 s) : 0, 1287583 Total [candidate] (11.241 s) : 0, 11241264 section iast Agent [baseline] (1.239 s) : 0, 1238533 Total [baseline] (9.552 s) : 0, 9551759 Agent [candidate] (1.258 s) : 0, 1257758 Total [candidate] (11.401 s) : 0, 11401287 section profiling Agent [baseline] (1.226 s) : 0, 1226359 Total [baseline] (11.023 s) : 0, 11023262 Agent [candidate] (1.24 s) : 0, 1239515 Total [candidate] (11.069 s) : 0, 11069008

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.096 s	-
Agent	appsec	1.283 s	187.309 ms (17.1%)
Agent	iast	1.239 s	142.908 ms (13.0%)
Agent	profiling	1.226 s	130.734 ms (11.9%)
Total	tracing	10.775 s	-
Total	appsec	11.119 s	344.694 ms (3.2%)
Total	iast	9.552 s	-1.223 s (-11.3%)
Total	profiling	11.023 s	248.647 ms (2.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.108 s	-
Agent	appsec	1.288 s	179.7 ms (16.2%)
Agent	iast	1.258 s	149.876 ms (13.5%)
Agent	profiling	1.24 s	131.632 ms (11.9%)
Total	tracing	10.8 s	-
Total	appsec	11.241 s	441.286 ms (4.1%)
Total	iast	11.401 s	601.309 ms (5.6%)
Total	profiling	11.069 s	269.03 ms (2.5%)

gantt title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~501af3d457, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section tracing crashtracking [baseline] (1.447 ms) : 0, 1447 crashtracking [candidate] (1.463 ms) : 0, 1463 BytebuddyAgent [baseline] (703.424 ms) : 0, 703424 BytebuddyAgent [candidate] (708.189 ms) : 0, 708189 GlobalTracer [baseline] (247.166 ms) : 0, 247166 GlobalTracer [candidate] (249.191 ms) : 0, 249191 AppSec [baseline] (32.241 ms) : 0, 32241 AppSec [candidate] (32.463 ms) : 0, 32463 Debugger [baseline] (64.231 ms) : 0, 64231 Debugger [candidate] (69.247 ms) : 0, 69247 Remote Config [baseline] (622.184 µs) : 0, 622 Remote Config [candidate] (641.989 µs) : 0, 642 Telemetry [baseline] (8.09 ms) : 0, 8090 Telemetry [candidate] (8.126 ms) : 0, 8126 Flare Poller [baseline] (3.692 ms) : 0, 3692 Flare Poller [candidate] (3.732 ms) : 0, 3732 section appsec crashtracking [baseline] (1.456 ms) : 0, 1456 crashtracking [candidate] (1.468 ms) : 0, 1468 BytebuddyAgent [baseline] (732.469 ms) : 0, 732469 BytebuddyAgent [candidate] (733.818 ms) : 0, 733818 GlobalTracer [baseline] (240.8 ms) : 0, 240800 GlobalTracer [candidate] (242.828 ms) : 0, 242828 IAST [baseline] (24.949 ms) : 0, 24949 IAST [candidate] (25.092 ms) : 0, 25092 AppSec [baseline] (174.554 ms) : 0, 174554 AppSec [candidate] (174.938 ms) : 0, 174938 Debugger [baseline] (60.997 ms) : 0, 60997 Debugger [candidate] (61.471 ms) : 0, 61471 Remote Config [baseline] (673.708 µs) : 0, 674 Remote Config [candidate] (666.841 µs) : 0, 667 Telemetry [baseline] (8.297 ms) : 0, 8297 Telemetry [candidate] (8.338 ms) : 0, 8338 Flare Poller [baseline] (3.908 ms) : 0, 3908 Flare Poller [candidate] (3.912 ms) : 0, 3912 section iast crashtracking [baseline] (1.448 ms) : 0, 1448 crashtracking [candidate] (1.482 ms) : 0, 1482 BytebuddyAgent [baseline] (831.095 ms) : 0, 831095 BytebuddyAgent [candidate] (839.369 ms) : 0, 839369 GlobalTracer [baseline] (237.641 ms) : 0, 237641 GlobalTracer [candidate] (240.646 ms) : 0, 240646 IAST [baseline] (28.549 ms) : 0, 28549 IAST [candidate] (30.547 ms) : 0, 30547 AppSec [baseline] (32.888 ms) : 0, 32888 AppSec [candidate] (31.61 ms) : 0, 31610 Debugger [baseline] (60.698 ms) : 0, 60698 Debugger [candidate] (67.207 ms) : 0, 67207 Remote Config [baseline] (543.056 µs) : 0, 543 Remote Config [candidate] (549.282 µs) : 0, 549 Telemetry [baseline] (7.679 ms) : 0, 7679 Telemetry [candidate] (7.718 ms) : 0, 7718 Flare Poller [baseline] (3.461 ms) : 0, 3461 Flare Poller [candidate] (3.522 ms) : 0, 3522 section profiling crashtracking [baseline] (1.444 ms) : 0, 1444 crashtracking [candidate] (1.45 ms) : 0, 1450 BytebuddyAgent [baseline] (728.964 ms) : 0, 728964 BytebuddyAgent [candidate] (733.529 ms) : 0, 733529 GlobalTracer [baseline] (222.024 ms) : 0, 222024 GlobalTracer [candidate] (223.185 ms) : 0, 223185 AppSec [baseline] (32.299 ms) : 0, 32299 AppSec [candidate] (32.414 ms) : 0, 32414 Debugger [baseline] (62.942 ms) : 0, 62942 Debugger [candidate] (68.54 ms) : 0, 68540 Remote Config [baseline] (652.239 µs) : 0, 652 Remote Config [candidate] (657.58 µs) : 0, 658 Telemetry [baseline] (7.955 ms) : 0, 7955 Telemetry [candidate] (8.029 ms) : 0, 8029 Flare Poller [baseline] (3.786 ms) : 0, 3786 Flare Poller [candidate] (3.79 ms) : 0, 3790 ProfilingAgent [baseline] (96.891 ms) : 0, 96891 ProfilingAgent [candidate] (97.826 ms) : 0, 97826 Profiling [baseline] (97.48 ms) : 0, 97480 Profiling [candidate] (98.397 ms) : 0, 98397

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bdu/avoids-need-for-JVM-environment-variables
git_commit_date	1763111453	1763120394
git_commit_sha	`8ceb94d`	`501af3d`
release_version	1.56.0-SNAPSHOT~8ceb94de51	1.56.0-SNAPSHOT~501af3d457

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763122770	1763122770
ci_job_id	1235017308	1235017308
ci_pipeline_id	82397919	82397919
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-eqjxer2x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-eqjxer2x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 19 metrics, 17 unstable metrics.

Request duration reports for petclinic

gantt title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~501af3d457, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section baseline no_agent (18.563 ms) : 18372, 18754 . : milestone, 18563, appsec (18.878 ms) : 18686, 19069 . : milestone, 18878, code_origins (17.78 ms) : 17603, 17957 . : milestone, 17780, iast (17.456 ms) : 17281, 17632 . : milestone, 17456, profiling (18.551 ms) : 18364, 18738 . : milestone, 18551, tracing (17.792 ms) : 17613, 17971 . : milestone, 17792, section candidate no_agent (18.957 ms) : 18760, 19153 . : milestone, 18957, appsec (18.697 ms) : 18508, 18885 . : milestone, 18697, code_origins (17.832 ms) : 17655, 18009 . : milestone, 17832, iast (17.674 ms) : 17499, 17849 . : milestone, 17674, profiling (18.85 ms) : 18661, 19038 . : milestone, 18850, tracing (17.488 ms) : 17317, 17660 . : milestone, 17488,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.563 ms [18.372 ms, 18.754 ms]	-
appsec	18.878 ms [18.686 ms, 19.069 ms]	314.978 µs (1.7%)
code_origins	17.78 ms [17.603 ms, 17.957 ms]	-783.242 µs (-4.2%)
iast	17.456 ms [17.281 ms, 17.632 ms]	-1.106 ms (-6.0%)
profiling	18.551 ms [18.364 ms, 18.738 ms]	-11.935 µs (-0.1%)
tracing	17.792 ms [17.613 ms, 17.971 ms]	-770.531 µs (-4.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.957 ms [18.76 ms, 19.153 ms]	-
appsec	18.697 ms [18.508 ms, 18.885 ms]	-259.75 µs (-1.4%)
code_origins	17.832 ms [17.655 ms, 18.009 ms]	-1.125 ms (-5.9%)
iast	17.674 ms [17.499 ms, 17.849 ms]	-1.283 ms (-6.8%)
profiling	18.85 ms [18.661 ms, 19.038 ms]	-107.053 µs (-0.6%)
tracing	17.488 ms [17.317 ms, 17.66 ms]	-1.468 ms (-7.7%)

Request duration reports for insecure-bank

gantt title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~501af3d457, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section baseline no_agent (1.198 ms) : 1186, 1210 . : milestone, 1198, iast (3.279 ms) : 3245, 3313 . : milestone, 3279, iast_FULL (5.883 ms) : 5824, 5943 . : milestone, 5883, iast_GLOBAL (3.525 ms) : 3456, 3594 . : milestone, 3525, profiling (2.354 ms) : 2332, 2377 . : milestone, 2354, tracing (1.785 ms) : 1770, 1799 . : milestone, 1785, section candidate no_agent (1.188 ms) : 1176, 1200 . : milestone, 1188, iast (3.215 ms) : 3179, 3251 . : milestone, 3215, iast_FULL (5.864 ms) : 5804, 5924 . : milestone, 5864, iast_GLOBAL (3.462 ms) : 3408, 3515 . : milestone, 3462, profiling (2.317 ms) : 2292, 2342 . : milestone, 2317, tracing (1.81 ms) : 1795, 1825 . : milestone, 1810,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.198 ms [1.186 ms, 1.21 ms]	-
iast	3.279 ms [3.245 ms, 3.313 ms]	2.081 ms (173.6%)
iast_FULL	5.883 ms [5.824 ms, 5.943 ms]	4.685 ms (391.0%)
iast_GLOBAL	3.525 ms [3.456 ms, 3.594 ms]	2.327 ms (194.2%)
profiling	2.354 ms [2.332 ms, 2.377 ms]	1.156 ms (96.5%)
tracing	1.785 ms [1.77 ms, 1.799 ms]	586.262 µs (48.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.188 ms [1.176 ms, 1.2 ms]	-
iast	3.215 ms [3.179 ms, 3.251 ms]	2.027 ms (170.6%)
iast_FULL	5.864 ms [5.804 ms, 5.924 ms]	4.676 ms (393.7%)
iast_GLOBAL	3.462 ms [3.408 ms, 3.515 ms]	2.274 ms (191.4%)
profiling	2.317 ms [2.292 ms, 2.342 ms]	1.129 ms (95.1%)
tracing	1.81 ms [1.795 ms, 1.825 ms]	622.367 µs (52.4%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bdu/avoids-need-for-JVM-environment-variables
git_commit_date	1763111453	1763120394
git_commit_sha	`8ceb94d`	`501af3d`
release_version	1.56.0-SNAPSHOT~8ceb94de51	1.56.0-SNAPSHOT~501af3d457

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1763122437	1763122437
ci_job_id	1235017309	1235017309
ci_pipeline_id	82397919	82397919
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-arbjss13 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-arbjss13 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~501af3d457, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section baseline no_agent (1.479 ms) : 1467, 1490 . : milestone, 1479, appsec (3.649 ms) : 3433, 3864 . : milestone, 3649, iast (2.215 ms) : 2151, 2279 . : milestone, 2215, iast_GLOBAL (2.265 ms) : 2200, 2329 . : milestone, 2265, profiling (2.07 ms) : 2019, 2122 . : milestone, 2070, tracing (2.017 ms) : 1967, 2066 . : milestone, 2017, section candidate no_agent (1.479 ms) : 1467, 1490 . : milestone, 1479, appsec (3.726 ms) : 3506, 3946 . : milestone, 3726, iast (2.217 ms) : 2153, 2281 . : milestone, 2217, iast_GLOBAL (2.262 ms) : 2197, 2326 . : milestone, 2262, profiling (2.095 ms) : 2041, 2149 . : milestone, 2095, tracing (2.029 ms) : 1979, 2079 . : milestone, 2029,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.467 ms, 1.49 ms]	-
appsec	3.649 ms [3.433 ms, 3.864 ms]	2.17 ms (146.7%)
iast	2.215 ms [2.151 ms, 2.279 ms]	736.381 µs (49.8%)
iast_GLOBAL	2.265 ms [2.2 ms, 2.329 ms]	786.047 µs (53.2%)
profiling	2.07 ms [2.019 ms, 2.122 ms]	591.434 µs (40.0%)
tracing	2.017 ms [1.967 ms, 2.066 ms]	537.818 µs (36.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.467 ms, 1.49 ms]	-
appsec	3.726 ms [3.506 ms, 3.946 ms]	2.247 ms (152.0%)
iast	2.217 ms [2.153 ms, 2.281 ms]	738.299 µs (49.9%)
iast_GLOBAL	2.262 ms [2.197 ms, 2.326 ms]	782.987 µs (53.0%)
profiling	2.095 ms [2.041 ms, 2.149 ms]	616.258 µs (41.7%)
tracing	2.029 ms [1.979 ms, 2.079 ms]	550.666 µs (37.2%)

Execution time for biojava

gantt title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~501af3d457, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section baseline no_agent (14.912 s) : 14912000, 14912000 . : milestone, 14912000, appsec (14.823 s) : 14823000, 14823000 . : milestone, 14823000, iast (18.401 s) : 18401000, 18401000 . : milestone, 18401000, iast_GLOBAL (17.833 s) : 17833000, 17833000 . : milestone, 17833000, profiling (15.387 s) : 15387000, 15387000 . : milestone, 15387000, tracing (14.792 s) : 14792000, 14792000 . : milestone, 14792000, section candidate no_agent (15.187 s) : 15187000, 15187000 . : milestone, 15187000, appsec (14.809 s) : 14809000, 14809000 . : milestone, 14809000, iast (18.562 s) : 18562000, 18562000 . : milestone, 18562000, iast_GLOBAL (18.031 s) : 18031000, 18031000 . : milestone, 18031000, profiling (15.938 s) : 15938000, 15938000 . : milestone, 15938000, tracing (14.616 s) : 14616000, 14616000 . : milestone, 14616000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.912 s [14.912 s, 14.912 s]	-
appsec	14.823 s [14.823 s, 14.823 s]	-89.0 ms (-0.6%)
iast	18.401 s [18.401 s, 18.401 s]	3.489 s (23.4%)
iast_GLOBAL	17.833 s [17.833 s, 17.833 s]	2.921 s (19.6%)
profiling	15.387 s [15.387 s, 15.387 s]	475.0 ms (3.2%)
tracing	14.792 s [14.792 s, 14.792 s]	-120.0 ms (-0.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.187 s [15.187 s, 15.187 s]	-
appsec	14.809 s [14.809 s, 14.809 s]	-378.0 ms (-2.5%)
iast	18.562 s [18.562 s, 18.562 s]	3.375 s (22.2%)
iast_GLOBAL	18.031 s [18.031 s, 18.031 s]	2.844 s (18.7%)
profiling	15.938 s [15.938 s, 15.938 s]	751.0 ms (4.9%)
tracing	14.616 s [14.616 s, 14.616 s]	-571.0 ms (-3.8%)

AlexeyKuznetsov-DD · 2025-11-14T13:22:22Z

buildSrc/src/main/kotlin/datadog/gradle/plugin/testJvmConstraints/TestJvmSpec.kt

- if (javaVersions.isEmpty()) {
- throw GradleException("No valid JAVA_X_HOME environment variables found.")
+ when (testJvm) {
+ "stable" -> {


Could we rename stable -> latest? or similar? stable is kind of misleading to me, WDYT?

I'm hesitant to that right now, as there were prior discussions on this.

Maybe we can have both, like lastStable :D

AlexeyKuznetsov-DD · 2025-11-14T13:24:26Z

buildSrc/src/main/kotlin/datadog/gradle/plugin/testJvmConstraints/TestJvmSpec.kt

+ * Handles the `testJvm` property to resolve a Java launcher for testing.
+ *
+ * The `testJvm` property can be set via command line or environment variable to specify
+ * which JVM to use for running tests. E.g.
+ *
+ * ```shell
+ * ./gradlew test -DtestJvm=ZULU11
+ * ```


I wish we have TESTING.md with all this useful documentation from this class :)

Exactly, I started the kdoc here, so we can reuse this text for such a file.

sarahchen6 · 2025-11-14T18:12:47Z

buildSrc/src/main/kotlin/datadog/gradle/plugin/testJvmConstraints/TestJvmSpec.kt

+ * which JVM to use for running tests. E.g.
+ *
+ * ```shell
+ * ./gradlew test -DtestJvm=ZULU11


Suggested change

* ./gradlew test -DtestJvm=ZULU11

* ./gradlew test -PtestJvm=ZULU11

I think we should still be using -P here, since on line 44 below (project.providers.gradleProperty(TEST_JVM)), we are using testJvm as a Gradle project property (ref)

sarahchen6 · 2025-11-14T18:14:09Z

Nice!

bric3 added 3 commits November 14, 2025 11:47

feat: Allow discovery of testJvm without environment variables

1104f19

feat: Only rely on Gradle's toolchain to run tests

a690268

fix: Auto discover JAVA_xx_HOME variables from the build image

501af3d

bric3 requested review from AlexeyKuznetsov-DD and sarahchen6 November 14, 2025 11:45

bric3 changed the base branch from master to bdu/drop-fromEnv-toolchain-restriction November 14, 2025 11:46

AlexeyKuznetsov-DD reviewed Nov 14, 2025

View reviewed changes

AlexeyKuznetsov-DD approved these changes Nov 14, 2025

View reviewed changes

bric3 added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Nov 14, 2025

bric3 marked this pull request as ready for review November 14, 2025 13:37

bric3 requested review from a team as code owners November 14, 2025 13:37

bric3 requested review from randomanderson and ygree and removed request for a team November 14, 2025 13:37

bric3 mentioned this pull request Nov 14, 2025

Drop fromEnv toolchain restriction for local environment #9950

Open

sarahchen6 reviewed Nov 14, 2025

View reviewed changes

sarahchen6 approved these changes Nov 14, 2025

View reviewed changes

randomanderson removed their request for review November 17, 2025 18:25

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Drop the requirement of jvm environment variables for `testJvm` constraint #9968

Drop the requirement of jvm environment variables for `testJvm` constraint #9968

bric3 commented Nov 14, 2025

pr-commenter bot commented Nov 14, 2025

AlexeyKuznetsov-DD Nov 14, 2025

bric3 Nov 14, 2025

AlexeyKuznetsov-DD Nov 14, 2025

bric3 Nov 14, 2025

sarahchen6 Nov 14, 2025

sarahchen6 commented Nov 14, 2025

Labels

4 participants

	* ./gradlew test -DtestJvm=ZULU11
	* ./gradlew test -PtestJvm=ZULU11

Drop the requirement of jvm environment variables for testJvm constraint #9968

Are you sure you want to change the base?

Drop the requirement of jvm environment variables for testJvm constraint #9968

Conversation

bric3 commented Nov 14, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

pr-commenter bot commented Nov 14, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

AlexeyKuznetsov-DD Nov 14, 2025

Choose a reason for hiding this comment

bric3 Nov 14, 2025

Choose a reason for hiding this comment

AlexeyKuznetsov-DD Nov 14, 2025

Choose a reason for hiding this comment

bric3 Nov 14, 2025

Choose a reason for hiding this comment

sarahchen6 Nov 14, 2025

Choose a reason for hiding this comment

sarahchen6 commented Nov 14, 2025

Labels

4 participants

Drop the requirement of jvm environment variables for `testJvm` constraint #9968

Drop the requirement of jvm environment variables for `testJvm` constraint #9968