Skip to content

Increase CiVis smoke tests timeout #9062

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 10 commits into from
Jul 9, 2025
Merged

Increase CiVis smoke tests timeout #9062

merged 10 commits into from
Jul 9, 2025

Conversation

daniel-mohedano
Copy link
Contributor

@daniel-mohedano daniel-mohedano commented Jun 30, 2025 •
edited
Loading

What Does This Do

  • Separates the Maven smoke tests' individual timeout between dependency resolution/downloads and test running. The dependency download timeout has been increased to 400s to avoid timeouts on the first test run, the test running timeouts have been reduced to 120s.
  • Increase Gradle task timeout for Maven smoke test to 25m (from 20m), to account for the increase timeout in dependency download.
  • Increase Gradle task timeout for Gradle smoke tests to 20m (from 15m).

Motivation

After fixing the Maven smoke test suite timeout in #9040, test failures are being correctly reported. Although the Maven smoke tests are passing, sometimes the first one or two individual smoke tests need a retry after timing out (usually test test_successful_maven_run, v3.5.4, less often test test_successful_maven_run, v3.6.3, which are coincidentally the first two tests in the suite). Currently there are limitations on both the caching of smoke tests dependencies and the caching of maven dependencies, as well as issues related to the Maven smoke tests setup. This changes serve as a patch for now until the implementation can be improved to make use of the dependencies caching capabilities.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]
@daniel-mohedano daniel-mohedano added type: bug Bug report and fix tag: do not merge Do not merge changes tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility labels Jun 30, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jun 30, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/maven-smoke-warmup-timeout
git_commit_date 1751549586 1751551030
git_commit_sha 53e4f70 99a5b11
release_version 1.51.0-SNAPSHOT~53e4f70038 1.51.0-SNAPSHOT~99a5b11ce8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1751552977 1751552977
ci_job_id 1012328896 1012328896
ci_pipeline_id 69564949 69564949
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-8pyzl8mv 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-8pyzl8mv 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 43 metrics, 10 unstable metrics.

Startup time reports for insecure-bank 
gantt title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038 dateFormat X axisFormat %s section tracing Agent [baseline] (999.837 ms) : 0, 999837 Total [baseline] (8.587 s) : 0, 8587211 Agent [candidate] (1.003 s) : 0, 1002690 Total [candidate] (8.578 s) : 0, 8577752 section iast Agent [baseline] (1.142 s) : 0, 1141622 Total [baseline] (9.283 s) : 0, 9282581 Agent [candidate] (1.159 s) : 0, 1159308 Total [candidate] (9.393 s) : 0, 9392591
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 999.837 ms -
Agent iast 1.142 s 141.785 ms (14.2%)
Total tracing 8.587 s -
Total iast 9.283 s 695.37 ms (8.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.003 s -
Agent iast 1.159 s 156.618 ms (15.6%)
Total tracing 8.578 s -
Total iast 9.393 s 814.839 ms (9.5%) 
gantt title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (691.87 ms) : 0, 691870 BytebuddyAgent [candidate] (692.35 ms) : 0, 692350 GlobalTracer [baseline] (241.884 ms) : 0, 241884 GlobalTracer [candidate] (243.728 ms) : 0, 243728 AppSec [baseline] (30.2 ms) : 0, 30200 AppSec [candidate] (30.637 ms) : 0, 30637 Debugger [baseline] (6.059 ms) : 0, 6059 Debugger [candidate] (6.105 ms) : 0, 6105 Remote Config [baseline] (681.981 µs) : 0, 682 Remote Config [candidate] (685.716 µs) : 0, 686 Telemetry [baseline] (8.226 ms) : 0, 8226 Telemetry [candidate] (8.268 ms) : 0, 8268 section iast BytebuddyAgent [baseline] (814.399 ms) : 0, 814399 BytebuddyAgent [candidate] (828.266 ms) : 0, 828266 GlobalTracer [baseline] (233.901 ms) : 0, 233901 GlobalTracer [candidate] (238.095 ms) : 0, 238095 IAST [baseline] (28.056 ms) : 0, 28056 IAST [candidate] (27.798 ms) : 0, 27798 AppSec [baseline] (28.966 ms) : 0, 28966 AppSec [candidate] (28.541 ms) : 0, 28541 Debugger [baseline] (6.708 ms) : 0, 6708 Debugger [candidate] (5.972 ms) : 0, 5972 Remote Config [baseline] (592.25 µs) : 0, 592 Remote Config [candidate] (589.08 µs) : 0, 589 Telemetry [baseline] (8.146 ms) : 0, 8146 Telemetry [candidate] (8.118 ms) : 0, 8118
Loading
Startup time reports for petclinic 
gantt title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038 dateFormat X axisFormat %s section tracing Agent [baseline] (998.571 ms) : 0, 998571 Total [baseline] (10.584 s) : 0, 10584149 Agent [candidate] (1.005 s) : 0, 1005320 Total [candidate] (10.702 s) : 0, 10702208 section appsec Agent [baseline] (1.176 s) : 0, 1176073 Total [baseline] (10.734 s) : 0, 10733872 Agent [candidate] (1.186 s) : 0, 1185820 Total [candidate] (10.765 s) : 0, 10765000 section iast Agent [baseline] (1.135 s) : 0, 1134898 Total [baseline] (10.846 s) : 0, 10845962 Agent [candidate] (1.133 s) : 0, 1132651 Total [candidate] (10.847 s) : 0, 10846717 section profiling Agent [baseline] (1.247 s) : 0, 1246580 Total [baseline] (10.949 s) : 0, 10949141 Agent [candidate] (1.245 s) : 0, 1245384 Total [candidate] (11.024 s) : 0, 11023838
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 998.571 ms -
Agent appsec 1.176 s 177.501 ms (17.8%)
Agent iast 1.135 s 136.326 ms (13.7%)
Agent profiling 1.247 s 248.008 ms (24.8%)
Total tracing 10.584 s -
Total appsec 10.734 s 149.723 ms (1.4%)
Total iast 10.846 s 261.813 ms (2.5%)
Total profiling 10.949 s 364.992 ms (3.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.005 s -
Agent appsec 1.186 s 180.5 ms (18.0%)
Agent iast 1.133 s 127.331 ms (12.7%)
Agent profiling 1.245 s 240.064 ms (23.9%)
Total tracing 10.702 s -
Total appsec 10.765 s 62.792 ms (0.6%)
Total iast 10.847 s 144.509 ms (1.4%)
Total profiling 11.024 s 321.63 ms (3.0%) 
gantt title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (689.737 ms) : 0, 689737 BytebuddyAgent [candidate] (694.246 ms) : 0, 694246 GlobalTracer [baseline] (242.835 ms) : 0, 242835 GlobalTracer [candidate] (244.27 ms) : 0, 244270 AppSec [baseline] (30.179 ms) : 0, 30179 AppSec [candidate] (30.76 ms) : 0, 30760 Debugger [baseline] (6.095 ms) : 0, 6095 Debugger [candidate] (6.144 ms) : 0, 6144 Remote Config [baseline] (685.831 µs) : 0, 686 Remote Config [candidate] (697.416 µs) : 0, 697 Telemetry [baseline] (8.235 ms) : 0, 8235 Telemetry [candidate] (8.3 ms) : 0, 8300 section appsec BytebuddyAgent [baseline] (711.053 ms) : 0, 711053 BytebuddyAgent [candidate] (717.758 ms) : 0, 717758 GlobalTracer [baseline] (234.907 ms) : 0, 234907 GlobalTracer [candidate] (237.851 ms) : 0, 237851 IAST [baseline] (23.228 ms) : 0, 23228 IAST [candidate] (22.407 ms) : 0, 22407 AppSec [baseline] (171.531 ms) : 0, 171531 AppSec [candidate] (172.213 ms) : 0, 172213 Debugger [baseline] (5.765 ms) : 0, 5765 Debugger [candidate] (5.852 ms) : 0, 5852 Remote Config [baseline] (601.52 µs) : 0, 602 Remote Config [candidate] (612.811 µs) : 0, 613 Telemetry [baseline] (8.123 ms) : 0, 8123 Telemetry [candidate] (8.211 ms) : 0, 8211 section iast BytebuddyAgent [baseline] (808.611 ms) : 0, 808611 BytebuddyAgent [candidate] (808.864 ms) : 0, 808864 GlobalTracer [baseline] (233.348 ms) : 0, 233348 GlobalTracer [candidate] (232.952 ms) : 0, 232952 IAST [baseline] (26.411 ms) : 0, 26411 IAST [candidate] (28.64 ms) : 0, 28640 AppSec [baseline] (30.271 ms) : 0, 30271 AppSec [candidate] (26.951 ms) : 0, 26951 Debugger [baseline] (6.758 ms) : 0, 6758 Debugger [candidate] (5.856 ms) : 0, 5856 Remote Config [baseline] (591.246 µs) : 0, 591 Remote Config [candidate] (593.399 µs) : 0, 593 Telemetry [baseline] (8.016 ms) : 0, 8016 Telemetry [candidate] (8.029 ms) : 0, 8029 section profiling BytebuddyAgent [baseline] (678.917 ms) : 0, 678917 BytebuddyAgent [candidate] (679.349 ms) : 0, 679349 GlobalTracer [baseline] (362.528 ms) : 0, 362528 GlobalTracer [candidate] (361.787 ms) : 0, 361787 AppSec [baseline] (31.579 ms) : 0, 31579 AppSec [candidate] (30.845 ms) : 0, 30845 Debugger [baseline] (12.176 ms) : 0, 12176 Debugger [candidate] (12.018 ms) : 0, 12018 Remote Config [baseline] (650.511 µs) : 0, 651 Remote Config [candidate] (2.141 ms) : 0, 2141 Telemetry [baseline] (8.796 ms) : 0, 8796 Telemetry [candidate] (8.057 ms) : 0, 8057 ProfilingAgent [baseline] (103.328 ms) : 0, 103328 ProfilingAgent [candidate] (102.54 ms) : 0, 102540 Profiling [baseline] (103.353 ms) : 0, 103353 Profiling [candidate] (102.565 ms) : 0, 102565
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/maven-smoke-warmup-timeout
git_commit_date 1751549586 1751551030
git_commit_sha 53e4f70 99a5b11
release_version 1.51.0-SNAPSHOT~53e4f70038 1.51.0-SNAPSHOT~99a5b11ce8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1751552656 1751552656
ci_job_id 1012328898 1012328898
ci_pipeline_id 69564949 69564949
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-hkw25hov 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-hkw25hov 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load better
[-220.465µs; -100.928µs] or [-4.930%; -2.257%]		 unstable
[-84.711op/s; +159.898op/s] or [-8.253%; +15.578%]		 4.312ms 1064.062op/s 4.472ms 1026.469op/s
scenario:load:petclinic:appsec:high_load better
[-2.015ms; -1.118ms] or [-4.211%; -2.336%]		 unstable
[-3.331op/s; +12.296op/s] or [-3.448%; +12.729%]		 46.286ms 101.088op/s 47.853ms 96.605op/s
scenario:load:petclinic:no_agent:high_load better
[-1.649ms; -1.006ms] or [-4.371%; -2.667%]		 unstable
[-5.799op/s; +11.687op/s] or [-4.621%; +9.313%]		 36.394ms 128.425op/s 37.721ms 125.481op/s
Request duration reports for insecure-bank 
gantt title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038 dateFormat X axisFormat %s section baseline no_agent (4.472 ms) : 4411, 4534 . : milestone, 4472, iast (8.94 ms) : 8796, 9085 . : milestone, 8940, iast_FULL (14.253 ms) : 13973, 14533 . : milestone, 14253, iast_GLOBAL (10.349 ms) : 10170, 10528 . : milestone, 10349, profiling (9.017 ms) : 8871, 9164 . : milestone, 9017, tracing (7.856 ms) : 7745, 7966 . : milestone, 7856, section candidate no_agent (4.312 ms) : 4263, 4360 . : milestone, 4312, iast (8.967 ms) : 8819, 9116 . : milestone, 8967, iast_FULL (13.784 ms) : 13510, 14058 . : milestone, 13784, iast_GLOBAL (10.018 ms) : 9834, 10202 . : milestone, 10018, profiling (8.774 ms) : 8637, 8910 . : milestone, 8774, tracing (7.698 ms) : 7578, 7817 . : milestone, 7698,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.472 ms [4.411 ms, 4.534 ms] -
iast 8.94 ms [8.796 ms, 9.085 ms] 4.468 ms (99.9%)
iast_FULL 14.253 ms [13.973 ms, 14.533 ms] 9.781 ms (218.7%)
iast_GLOBAL 10.349 ms [10.17 ms, 10.528 ms] 5.877 ms (131.4%)
profiling 9.017 ms [8.871 ms, 9.164 ms] 4.545 ms (101.6%)
tracing 7.856 ms [7.745 ms, 7.966 ms] 3.383 ms (75.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.312 ms [4.263 ms, 4.36 ms] -
iast 8.967 ms [8.819 ms, 9.116 ms] 4.656 ms (108.0%)
iast_FULL 13.784 ms [13.51 ms, 14.058 ms] 9.473 ms (219.7%)
iast_GLOBAL 10.018 ms [9.834 ms, 10.202 ms] 5.706 ms (132.4%)
profiling 8.774 ms [8.637 ms, 8.91 ms] 4.462 ms (103.5%)
tracing 7.698 ms [7.578 ms, 7.817 ms] 3.386 ms (78.5%)
Request duration reports for petclinic 
gantt title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038 dateFormat X axisFormat %s section baseline no_agent (37.721 ms) : 37418, 38024 . : milestone, 37721, appsec (47.853 ms) : 47422, 48284 . : milestone, 47853, code_origins (44.205 ms) : 43817, 44594 . : milestone, 44205, iast (44.41 ms) : 44018, 44802 . : milestone, 44410, profiling (45.822 ms) : 45422, 46222 . : milestone, 45822, tracing (43.679 ms) : 43310, 44048 . : milestone, 43679, section candidate no_agent (36.394 ms) : 36099, 36688 . : milestone, 36394, appsec (46.286 ms) : 45884, 46689 . : milestone, 46286, code_origins (44.603 ms) : 44217, 44990 . : milestone, 44603, iast (45.707 ms) : 45311, 46102 . : milestone, 45707, profiling (46.528 ms) : 46120, 46936 . : milestone, 46528, tracing (43.016 ms) : 42662, 43370 . : milestone, 43016,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.721 ms [37.418 ms, 38.024 ms] -
appsec 47.853 ms [47.422 ms, 48.284 ms] 10.132 ms (26.9%)
code_origins 44.205 ms [43.817 ms, 44.594 ms] 6.484 ms (17.2%)
iast 44.41 ms [44.018 ms, 44.802 ms] 6.689 ms (17.7%)
profiling 45.822 ms [45.422 ms, 46.222 ms] 8.101 ms (21.5%)
tracing 43.679 ms [43.31 ms, 44.048 ms] 5.958 ms (15.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.394 ms [36.099 ms, 36.688 ms] -
appsec 46.286 ms [45.884 ms, 46.689 ms] 9.893 ms (27.2%)
code_origins 44.603 ms [44.217 ms, 44.99 ms] 8.21 ms (22.6%)
iast 45.707 ms [45.311 ms, 46.102 ms] 9.313 ms (25.6%)
profiling 46.528 ms [46.12 ms, 46.936 ms] 10.134 ms (27.8%)
tracing 43.016 ms [42.662 ms, 43.37 ms] 6.622 ms (18.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/maven-smoke-warmup-timeout
git_commit_date 1751549586 1751551030
git_commit_sha 53e4f70 99a5b11
release_version 1.51.0-SNAPSHOT~53e4f70038 1.51.0-SNAPSHOT~99a5b11ce8
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1751553221 1751553221
ci_job_id 1012328899 1012328899
ci_pipeline_id 69564949 69564949
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-0zcwcycf 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-0zcwcycf 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038 dateFormat X axisFormat %s section baseline no_agent (14.773 s) : 14773000, 14773000 . : milestone, 14773000, appsec (15.266 s) : 15266000, 15266000 . : milestone, 15266000, iast (18.476 s) : 18476000, 18476000 . : milestone, 18476000, iast_GLOBAL (18.063 s) : 18063000, 18063000 . : milestone, 18063000, profiling (15.133 s) : 15133000, 15133000 . : milestone, 15133000, tracing (14.83 s) : 14830000, 14830000 . : milestone, 14830000, section candidate no_agent (14.982 s) : 14982000, 14982000 . : milestone, 14982000, appsec (14.843 s) : 14843000, 14843000 . : milestone, 14843000, iast (18.275 s) : 18275000, 18275000 . : milestone, 18275000, iast_GLOBAL (17.682 s) : 17682000, 17682000 . : milestone, 17682000, profiling (15.174 s) : 15174000, 15174000 . : milestone, 15174000, tracing (14.78 s) : 14780000, 14780000 . : milestone, 14780000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.773 s [14.773 s, 14.773 s] -
appsec 15.266 s [15.266 s, 15.266 s] 493.0 ms (3.3%)
iast 18.476 s [18.476 s, 18.476 s] 3.703 s (25.1%)
iast_GLOBAL 18.063 s [18.063 s, 18.063 s] 3.29 s (22.3%)
profiling 15.133 s [15.133 s, 15.133 s] 360.0 ms (2.4%)
tracing 14.83 s [14.83 s, 14.83 s] 57.0 ms (0.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.982 s [14.982 s, 14.982 s] -
appsec 14.843 s [14.843 s, 14.843 s] -139.0 ms (-0.9%)
iast 18.275 s [18.275 s, 18.275 s] 3.293 s (22.0%)
iast_GLOBAL 17.682 s [17.682 s, 17.682 s] 2.7 s (18.0%)
profiling 15.174 s [15.174 s, 15.174 s] 192.0 ms (1.3%)
tracing 14.78 s [14.78 s, 14.78 s] -202.0 ms (-1.3%)
Execution time for tomcat 
gantt title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038 dateFormat X axisFormat %s section baseline no_agent (1.483 ms) : 1471, 1494 . : milestone, 1483, appsec (2.422 ms) : 2373, 2471 . : milestone, 2422, iast (2.198 ms) : 2136, 2260 . : milestone, 2198, iast_GLOBAL (2.257 ms) : 2195, 2320 . : milestone, 2257, profiling (2.054 ms) : 2003, 2105 . : milestone, 2054, tracing (2.02 ms) : 1972, 2068 . : milestone, 2020, section candidate no_agent (1.479 ms) : 1467, 1490 . : milestone, 1479, appsec (2.423 ms) : 2373, 2473 . : milestone, 2423, iast (2.202 ms) : 2139, 2264 . : milestone, 2202, iast_GLOBAL (2.252 ms) : 2189, 2315 . : milestone, 2252, profiling (2.059 ms) : 2008, 2110 . : milestone, 2059, tracing (2.027 ms) : 1979, 2076 . : milestone, 2027,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.494 ms] -
appsec 2.422 ms [2.373 ms, 2.471 ms] 939.299 µs (63.3%)
iast 2.198 ms [2.136 ms, 2.26 ms] 715.135 µs (48.2%)
iast_GLOBAL 2.257 ms [2.195 ms, 2.32 ms] 774.438 µs (52.2%)
profiling 2.054 ms [2.003 ms, 2.105 ms] 570.842 µs (38.5%)
tracing 2.02 ms [1.972 ms, 2.068 ms] 537.025 µs (36.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.467 ms, 1.49 ms] -
appsec 2.423 ms [2.373 ms, 2.473 ms] 944.139 µs (63.9%)
iast 2.202 ms [2.139 ms, 2.264 ms] 723.138 µs (48.9%)
iast_GLOBAL 2.252 ms [2.189 ms, 2.315 ms] 773.594 µs (52.3%)
profiling 2.059 ms [2.008 ms, 2.11 ms] 580.321 µs (39.3%)
tracing 2.027 ms [1.979 ms, 2.076 ms] 548.845 µs (37.1%)
@daniel-mohedano daniel-mohedano changed the title Increase individual Maven smoke test timeout to 180 Increase CiVis smoke tests timeout Jun 30, 2025
@daniel-mohedano daniel-mohedano removed the tag: do not merge Do not merge changes label Jul 3, 2025
@daniel-mohedano daniel-mohedano marked this pull request as ready for review July 3, 2025 13:18
@daniel-mohedano daniel-mohedano requested a review from a team as a code owner July 3, 2025 13:18
nikita-tkachenko-datadog
nikita-tkachenko-datadog approved these changes Jul 3, 2025
View reviewed changes
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we bump the gradle task timeout for Maven smoke tests module as well?
@daniel-mohedano
Copy link
Contributor Author

Sounds good, let's bump it up to 25min just in case
@bric3
Copy link
Contributor

bric3 commented Jul 4, 2025

FYI there's this PR for possibly improving download latencies #9099
@daniel-mohedano
Copy link
Contributor Author

@bric3 We'll hold off on merging this PR to see how the download latencies improve and if those changes are enough 👍
@daniel-mohedano daniel-mohedano merged commit 37922ad into master Jul 9, 2025
509 checks passed
@daniel-mohedano daniel-mohedano deleted the daniel.mohedano/maven-smoke-warmup-timeout branch July 9, 2025 07:53
@github-actions github-actions bot added this to the 1.51.0 milestone Jul 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: ci visibility Continuous Integration Visibility tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

3 participants

@daniel-mohedano @bric3 @nikita-tkachenko-datadog