Increase MavenSmokeTest timeout #9040
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
daniel-mohedano added the tag: no release notes 
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 1 performance regressions! Performance is the same for 45 metrics, 7 unstable metrics.
Startup time reports for petclinicgantt title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~f50fa512c4, baseline=1.51.0-SNAPSHOT~0f9b46c752 dateFormat X axisFormat %s section tracing Agent [baseline] (996.216 ms) : 0, 996216 Total [baseline] (10.68 s) : 0, 10680230 Agent [candidate] (996.457 ms) : 0, 996457 Total [candidate] (10.716 s) : 0, 10716285 section appsec Agent [baseline] (1.177 s) : 0, 1177493 Total [baseline] (10.719 s) : 0, 10719485 Agent [candidate] (1.176 s) : 0, 1176017 Total [candidate] (10.737 s) : 0, 10736570 section iast Agent [baseline] (1.142 s) : 0, 1141666 Total [baseline] (10.84 s) : 0, 10840009 Agent [candidate] (1.133 s) : 0, 1133278 Total [candidate] (10.852 s) : 0, 10851764 section profiling Agent [baseline] (1.245 s) : 0, 1244549 Total [baseline] (11.016 s) : 0, 11015675 Agent [candidate] (1.267 s) : 0, 1266702 Total [candidate] (11.13 s) : 0, 11130018
gantt title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~f50fa512c4, baseline=1.51.0-SNAPSHOT~0f9b46c752 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (687.631 ms) : 0, 687631 BytebuddyAgent [candidate] (687.578 ms) : 0, 687578 GlobalTracer [baseline] (242.574 ms) : 0, 242574 GlobalTracer [candidate] (242.761 ms) : 0, 242761 AppSec [baseline] (30.273 ms) : 0, 30273 AppSec [candidate] (30.369 ms) : 0, 30369 Debugger [baseline] (6.067 ms) : 0, 6067 Debugger [candidate] (6.066 ms) : 0, 6066 Remote Config [baseline] (667.462 µs) : 0, 667 Remote Config [candidate] (666.056 µs) : 0, 666 Telemetry [baseline] (8.238 ms) : 0, 8238 Telemetry [candidate] (8.262 ms) : 0, 8262 section appsec BytebuddyAgent [baseline] (712.769 ms) : 0, 712769 BytebuddyAgent [candidate] (712.053 ms) : 0, 712053 GlobalTracer [baseline] (236.799 ms) : 0, 236799 GlobalTracer [candidate] (236.016 ms) : 0, 236016 AppSec [baseline] (170.474 ms) : 0, 170474 AppSec [candidate] (170.468 ms) : 0, 170468 Debugger [baseline] (5.786 ms) : 0, 5786 Debugger [candidate] (5.82 ms) : 0, 5820 Remote Config [baseline] (597.159 µs) : 0, 597 Remote Config [candidate] (608.754 µs) : 0, 609 Telemetry [baseline] (8.082 ms) : 0, 8082 Telemetry [candidate] (8.116 ms) : 0, 8116 IAST [baseline] (22.194 ms) : 0, 22194 IAST [candidate] (22.086 ms) : 0, 22086 section iast BytebuddyAgent [baseline] (815.952 ms) : 0, 815952 BytebuddyAgent [candidate] (809.53 ms) : 0, 809530 GlobalTracer [baseline] (234.339 ms) : 0, 234339 GlobalTracer [candidate] (232.893 ms) : 0, 232893 AppSec [baseline] (28.775 ms) : 0, 28775 AppSec [candidate] (26.842 ms) : 0, 26842 Debugger [baseline] (5.817 ms) : 0, 5817 Debugger [candidate] (5.834 ms) : 0, 5834 Remote Config [baseline] (577.469 µs) : 0, 577 Remote Config [candidate] (578.142 µs) : 0, 578 Telemetry [baseline] (7.969 ms) : 0, 7969 Telemetry [candidate] (7.963 ms) : 0, 7963 IAST [baseline] (27.288 ms) : 0, 27288 IAST [candidate] (28.834 ms) : 0, 28834 section profiling BytebuddyAgent [baseline] (677.677 ms) : 0, 677677 BytebuddyAgent [candidate] (689.941 ms) : 0, 689941 GlobalTracer [baseline] (361.683 ms) : 0, 361683 GlobalTracer [candidate] (367.412 ms) : 0, 367412 AppSec [baseline] (30.765 ms) : 0, 30765 AppSec [candidate] (35.854 ms) : 0, 35854 Debugger [baseline] (11.348 ms) : 0, 11348 Debugger [candidate] (7.856 ms) : 0, 7856 Remote Config [baseline] (652.571 µs) : 0, 653 Remote Config [candidate] (691.369 µs) : 0, 691 Telemetry [baseline] (10.28 ms) : 0, 10280 Telemetry [candidate] (9.754 ms) : 0, 9754 ProfilingAgent [baseline] (103.439 ms) : 0, 103439 ProfilingAgent [candidate] (105.897 ms) : 0, 105897 Profiling [baseline] (103.463 ms) : 0, 103463 Profiling [candidate] (105.923 ms) : 0, 105923 Startup time reports for insecure-bankgantt title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~f50fa512c4, baseline=1.51.0-SNAPSHOT~0f9b46c752 dateFormat X axisFormat %s section tracing Agent [baseline] (1.004 s) : 0, 1004076 Total [baseline] (8.581 s) : 0, 8581132 Agent [candidate] (998.8 ms) : 0, 998800 Total [candidate] (8.594 s) : 0, 8594047 section iast Agent [baseline] (1.132 s) : 0, 1132199 Total [baseline] (9.289 s) : 0, 9289176 Agent [candidate] (1.129 s) : 0, 1128703 Total [candidate] (9.286 s) : 0, 9286076
gantt title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~f50fa512c4, baseline=1.51.0-SNAPSHOT~0f9b46c752 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (693.3 ms) : 0, 693300 BytebuddyAgent [candidate] (688.983 ms) : 0, 688983 GlobalTracer [baseline] (244.127 ms) : 0, 244127 GlobalTracer [candidate] (243.54 ms) : 0, 243540 AppSec [baseline] (30.607 ms) : 0, 30607 AppSec [candidate] (30.412 ms) : 0, 30412 Debugger [baseline] (6.096 ms) : 0, 6096 Debugger [candidate] (6.12 ms) : 0, 6120 Remote Config [baseline] (678.431 µs) : 0, 678 Remote Config [candidate] (675.513 µs) : 0, 676 Telemetry [baseline] (8.321 ms) : 0, 8321 Telemetry [candidate] (8.321 ms) : 0, 8321 section iast BytebuddyAgent [baseline] (808.778 ms) : 0, 808778 BytebuddyAgent [candidate] (805.822 ms) : 0, 805822 GlobalTracer [baseline] (232.7 ms) : 0, 232700 GlobalTracer [candidate] (232.325 ms) : 0, 232325 AppSec [baseline] (26.093 ms) : 0, 26093 AppSec [candidate] (28.367 ms) : 0, 28367 Debugger [baseline] (5.817 ms) : 0, 5817 Debugger [candidate] (5.781 ms) : 0, 5781 Remote Config [baseline] (593.004 µs) : 0, 593 Remote Config [candidate] (584.56 µs) : 0, 585 Telemetry [baseline] (7.945 ms) : 0, 7945 Telemetry [candidate] (7.966 ms) : 0, 7966 IAST [baseline] (29.535 ms) : 0, 29535 IAST [candidate] (27.141 ms) : 0, 27141 LoadParameters
See matching parameters
SummaryFound 2 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.
Request duration reports for petclinicgantt title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~f50fa512c4, baseline=1.51.0-SNAPSHOT~0f9b46c752 dateFormat X axisFormat %s section baseline no_agent (36.758 ms) : 36455, 37061 . : milestone, 36758, appsec (46.962 ms) : 46549, 47375 . : milestone, 46962, code_origins (45.047 ms) : 44666, 45428 . : milestone, 45047, iast (44.523 ms) : 44130, 44916 . : milestone, 44523, profiling (47.259 ms) : 46849, 47669 . : milestone, 47259, tracing (45.623 ms) : 45234, 46013 . : milestone, 45623, section candidate no_agent (36.889 ms) : 36593, 37186 . : milestone, 36889, appsec (47.058 ms) : 46633, 47483 . : milestone, 47058, code_origins (45.839 ms) : 45463, 46215 . : milestone, 45839, iast (45.682 ms) : 45294, 46070 . : milestone, 45682, profiling (47.972 ms) : 47535, 48409 . : milestone, 47972, tracing (42.361 ms) : 41997, 42724 . : milestone, 42361,
Request duration reports for insecure-bankgantt title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~f50fa512c4, baseline=1.51.0-SNAPSHOT~0f9b46c752 dateFormat X axisFormat %s section baseline no_agent (4.456 ms) : 4403, 4510 . : milestone, 4456, iast (9.217 ms) : 9070, 9365 . : milestone, 9217, iast_FULL (14.089 ms) : 13808, 14370 . : milestone, 14089, iast_GLOBAL (10.376 ms) : 10196, 10557 . : milestone, 10376, profiling (8.632 ms) : 8490, 8774 . : milestone, 8632, tracing (7.786 ms) : 7668, 7903 . : milestone, 7786, section candidate no_agent (4.303 ms) : 4254, 4352 . : milestone, 4303, iast (9.384 ms) : 9223, 9545 . : milestone, 9384, iast_FULL (13.652 ms) : 13385, 13918 . : milestone, 13652, iast_GLOBAL (10.406 ms) : 10219, 10593 . : milestone, 10406, profiling (8.876 ms) : 8730, 9022 . : milestone, 8876, tracing (7.987 ms) : 7863, 8112 . : milestone, 7987,
Dacapo |
daniel-mohedano changed the title daniel-mohedano changed the title 
AlexeyKuznetsov-DD approved these changes Jun 27, 2025
daniel-mohedano deleted the daniel.mohedano/increase-maven-smoke-test-timeout branch 
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit. This suggestion is invalid because no changes were made to the code. Suggestions cannot be applied while the pull request is closed. Suggestions cannot be applied while viewing a subset of changes. Only one suggestion per line can be applied in a batch. Add this suggestion to a batch that can be applied as a single commit. Applying suggestions on deleted lines is not supported. You must change the existing code in this line in order to create a valid suggestion. Outdated suggestions cannot be applied. This suggestion has been applied or marked resolved. Suggestions cannot be applied from pending reviews. Suggestions cannot be applied on multi-line comments. Suggestions cannot be applied while the pull request is queued to merge. Suggestion cannot be applied right now. Please check back later.
What Does This Do
Motivation
After the Maven smoke tests were updated to use the Maven proxy for dependencies, they started to time out in CI. Their timeout value was doubled to keep them from failing because of this (#8997). With this change, although the smoke tests don't timeout individually anymore, the
:smokeTesttarget does sometimes go over the timeout limit for Gradle tests configured inconfigure_tests.gradle(example failure and failed jobs on master)After some preliminary investigation, it seems like the execution time for the whole job ranges from 10 to 19 minutes.
Additional Notes
Contributor Checklist
type:and (comp:orinst:) labels in addition to any usefull labelsclose,fixor any linking keywords when referencing an issue.Use
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]