Skip to content

Add springboot smoke tests for the open feature SDK #9961

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: malvarez/open-feature-sdk
Choose a base branch
from
Open

Add springboot smoke tests for the open feature SDK #9961

wants to merge 1 commit into from

Conversation

@manuel-alvarez-alvarez
Copy link
Member

@manuel-alvarez-alvarez manuel-alvarez-alvarez commented Nov 14, 2025 •
edited
Loading

What Does This Do

Adds smoke tests for the OpenFeature Java provider (PR)

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]
@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from 6fcda55 to 188fdc6 Compare November 14, 2025 04:42
@manuel-alvarez-alvarez manuel-alvarez-alvarez mentioned this pull request Nov 14, 2025
Open
@manuel-alvarez-alvarez manuel-alvarez-alvarez marked this pull request as ready for review November 14, 2025 04:43
@manuel-alvarez-alvarez manuel-alvarez-alvarez requested review from AlexeyKuznetsov-DD and smola and removed request for a team November 14, 2025 04:43
@manuel-alvarez-alvarez manuel-alvarez-alvarez mentioned this pull request Nov 14, 2025
Closed
@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from 188fdc6 to de1816f Compare November 14, 2025 04:45
@pr-commenter
Copy link

pr-commenter bot commented Nov 14, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/open-feature-sdk-smoke
git_commit_date 1763111453 1763113799
git_commit_sha 8ceb94d 6fea068
release_version 1.56.0-SNAPSHOT~8ceb94de51 1.56.0-SNAPSHOT~6fea068444
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763115603 1763115603
ci_job_id 1234760074 1234760074
ci_pipeline_id 82385169 82385169
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-2lsxwt1a 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-2lsxwt1a 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 7 unstable metrics.

Startup time reports for petclinic 
gantt title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~6fea068444, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section tracing Agent [baseline] (1.099 s) : 0, 1099265 Total [baseline] (10.765 s) : 0, 10765391 Agent [candidate] (1.096 s) : 0, 1096133 Total [candidate] (10.728 s) : 0, 10727729 section appsec Agent [baseline] (1.279 s) : 0, 1279159 Total [baseline] (11.033 s) : 0, 11033406 Agent [candidate] (1.281 s) : 0, 1281129 Total [candidate] (11.048 s) : 0, 11047961 section iast Agent [baseline] (1.24 s) : 0, 1240323 Total [baseline] (11.324 s) : 0, 11323943 Agent [candidate] (1.264 s) : 0, 1264087 Total [candidate] (11.274 s) : 0, 11273905 section profiling Agent [baseline] (1.23 s) : 0, 1230219 Total [baseline] (11.1 s) : 0, 11100332 Agent [candidate] (1.228 s) : 0, 1228364 Total [candidate] (11.166 s) : 0, 11166386
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.099 s -
Agent appsec 1.279 s 179.895 ms (16.4%)
Agent iast 1.24 s 141.059 ms (12.8%)
Agent profiling 1.23 s 130.955 ms (11.9%)
Total tracing 10.765 s -
Total appsec 11.033 s 268.016 ms (2.5%)
Total iast 11.324 s 558.553 ms (5.2%)
Total profiling 11.1 s 334.941 ms (3.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.096 s -
Agent appsec 1.281 s 184.996 ms (16.9%)
Agent iast 1.264 s 167.954 ms (15.3%)
Agent profiling 1.228 s 132.231 ms (12.1%)
Total tracing 10.728 s -
Total appsec 11.048 s 320.231 ms (3.0%)
Total iast 11.274 s 546.176 ms (5.1%)
Total profiling 11.166 s 438.657 ms (4.1%) 
gantt title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~6fea068444, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section tracing crashtracking [baseline] (1.478 ms) : 0, 1478 crashtracking [candidate] (1.456 ms) : 0, 1456 BytebuddyAgent [baseline] (705.59 ms) : 0, 705590 BytebuddyAgent [candidate] (703.18 ms) : 0, 703180 GlobalTracer [baseline] (248.244 ms) : 0, 248244 GlobalTracer [candidate] (248.335 ms) : 0, 248335 AppSec [baseline] (32.201 ms) : 0, 32201 AppSec [candidate] (32.116 ms) : 0, 32116 Debugger [baseline] (64.604 ms) : 0, 64604 Debugger [candidate] (63.993 ms) : 0, 63993 Remote Config [baseline] (641.453 µs) : 0, 641 Remote Config [candidate] (621.733 µs) : 0, 622 Telemetry [baseline] (8.138 ms) : 0, 8138 Telemetry [candidate] (8.063 ms) : 0, 8063 Flare Poller [baseline] (3.641 ms) : 0, 3641 Flare Poller [candidate] (3.662 ms) : 0, 3662 section appsec crashtracking [baseline] (1.47 ms) : 0, 1470 crashtracking [candidate] (1.455 ms) : 0, 1455 BytebuddyAgent [baseline] (730.252 ms) : 0, 730252 BytebuddyAgent [candidate] (730.217 ms) : 0, 730217 GlobalTracer [baseline] (240.167 ms) : 0, 240167 GlobalTracer [candidate] (240.681 ms) : 0, 240681 AppSec [baseline] (173.586 ms) : 0, 173586 AppSec [candidate] (174.559 ms) : 0, 174559 Debugger [baseline] (61.473 ms) : 0, 61473 Debugger [candidate] (61.638 ms) : 0, 61638 Remote Config [baseline] (712.731 µs) : 0, 713 Remote Config [candidate] (726.02 µs) : 0, 726 Telemetry [baseline] (8.106 ms) : 0, 8106 Telemetry [candidate] (8.218 ms) : 0, 8218 Flare Poller [baseline] (3.799 ms) : 0, 3799 Flare Poller [candidate] (3.909 ms) : 0, 3909 IAST [baseline] (24.717 ms) : 0, 24717 IAST [candidate] (24.736 ms) : 0, 24736 section iast crashtracking [baseline] (1.458 ms) : 0, 1458 crashtracking [candidate] (1.483 ms) : 0, 1483 BytebuddyAgent [baseline] (830.073 ms) : 0, 830073 BytebuddyAgent [candidate] (849.487 ms) : 0, 849487 GlobalTracer [baseline] (239.016 ms) : 0, 239016 GlobalTracer [candidate] (241.116 ms) : 0, 241116 AppSec [baseline] (30.731 ms) : 0, 30731 AppSec [candidate] (30.992 ms) : 0, 30992 Debugger [baseline] (61.452 ms) : 0, 61452 Debugger [candidate] (62.214 ms) : 0, 62214 Remote Config [baseline] (567.234 µs) : 0, 567 Remote Config [candidate] (566.504 µs) : 0, 567 Telemetry [baseline] (7.744 ms) : 0, 7744 Telemetry [candidate] (7.911 ms) : 0, 7911 Flare Poller [baseline] (3.541 ms) : 0, 3541 Flare Poller [candidate] (3.563 ms) : 0, 3563 IAST [baseline] (30.892 ms) : 0, 30892 IAST [candidate] (31.646 ms) : 0, 31646 section profiling ProfilingAgent [baseline] (98.297 ms) : 0, 98297 ProfilingAgent [candidate] (97.219 ms) : 0, 97219 crashtracking [baseline] (1.455 ms) : 0, 1455 crashtracking [candidate] (1.439 ms) : 0, 1439 BytebuddyAgent [baseline] (729.9 ms) : 0, 729900 BytebuddyAgent [candidate] (730.036 ms) : 0, 730036 GlobalTracer [baseline] (222.654 ms) : 0, 222654 GlobalTracer [candidate] (222.237 ms) : 0, 222237 AppSec [baseline] (32.182 ms) : 0, 32182 AppSec [candidate] (32.152 ms) : 0, 32152 Debugger [baseline] (63.713 ms) : 0, 63713 Debugger [candidate] (63.271 ms) : 0, 63271 Remote Config [baseline] (666.284 µs) : 0, 666 Remote Config [candidate] (627.791 µs) : 0, 628 Telemetry [baseline] (8.053 ms) : 0, 8053 Telemetry [candidate] (7.897 ms) : 0, 7897 Flare Poller [baseline] (3.727 ms) : 0, 3727 Flare Poller [candidate] (3.747 ms) : 0, 3747 Profiling [baseline] (98.884 ms) : 0, 98884 Profiling [candidate] (97.805 ms) : 0, 97805
Loading
Startup time reports for insecure-bank 
gantt title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~6fea068444, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section tracing Agent [baseline] (1.102 s) : 0, 1101905 Total [baseline] (8.859 s) : 0, 8859410 Agent [candidate] (1.107 s) : 0, 1107219 Total [candidate] (8.847 s) : 0, 8847145 section iast Agent [baseline] (1.252 s) : 0, 1252441 Total [baseline] (9.588 s) : 0, 9588176 Agent [candidate] (1.239 s) : 0, 1239056 Total [candidate] (9.591 s) : 0, 9591350
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.102 s -
Agent iast 1.252 s 150.536 ms (13.7%)
Total tracing 8.859 s -
Total iast 9.588 s 728.766 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.107 s -
Agent iast 1.239 s 131.836 ms (11.9%)
Total tracing 8.847 s -
Total iast 9.591 s 744.206 ms (8.4%) 
gantt title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~6fea068444, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section tracing crashtracking [baseline] (1.471 ms) : 0, 1471 crashtracking [candidate] (1.469 ms) : 0, 1469 BytebuddyAgent [baseline] (708.743 ms) : 0, 708743 BytebuddyAgent [candidate] (711.427 ms) : 0, 711427 GlobalTracer [baseline] (248.421 ms) : 0, 248421 GlobalTracer [candidate] (250.27 ms) : 0, 250270 AppSec [baseline] (32.308 ms) : 0, 32308 AppSec [candidate] (32.646 ms) : 0, 32646 Debugger [baseline] (63.493 ms) : 0, 63493 Debugger [candidate] (63.756 ms) : 0, 63756 Remote Config [baseline] (633.9 µs) : 0, 634 Remote Config [candidate] (637.781 µs) : 0, 638 Telemetry [baseline] (8.239 ms) : 0, 8239 Telemetry [candidate] (8.29 ms) : 0, 8290 Flare Poller [baseline] (3.715 ms) : 0, 3715 Flare Poller [candidate] (3.698 ms) : 0, 3698 section iast crashtracking [baseline] (1.488 ms) : 0, 1488 crashtracking [candidate] (1.463 ms) : 0, 1463 BytebuddyAgent [baseline] (842.362 ms) : 0, 842362 BytebuddyAgent [candidate] (831.031 ms) : 0, 831031 GlobalTracer [baseline] (238.95 ms) : 0, 238950 GlobalTracer [candidate] (238.463 ms) : 0, 238463 IAST [baseline] (27.67 ms) : 0, 27670 IAST [candidate] (27.403 ms) : 0, 27403 AppSec [baseline] (34.611 ms) : 0, 34611 AppSec [candidate] (34.163 ms) : 0, 34163 Debugger [baseline] (60.472 ms) : 0, 60472 Debugger [candidate] (59.896 ms) : 0, 59896 Remote Config [baseline] (548.466 µs) : 0, 548 Remote Config [candidate] (573.072 µs) : 0, 573 Telemetry [baseline] (7.7 ms) : 0, 7700 Telemetry [candidate] (7.693 ms) : 0, 7693 Flare Poller [baseline] (3.478 ms) : 0, 3478 Flare Poller [candidate] (3.452 ms) : 0, 3452
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/open-feature-sdk-smoke
git_commit_date 1763111453 1763113799
git_commit_sha 8ceb94d 6fea068
release_version 1.56.0-SNAPSHOT~8ceb94de51 1.56.0-SNAPSHOT~6fea068444
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763116008 1763116008
ci_job_id 1234760075 1234760075
ci_pipeline_id 82385169 82385169
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-lobcbwke 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-lobcbwke 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 5 performance regressions! Performance is the same for 15 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+97.660µs; +225.693µs] or [+6.254%; +14.453%]		 unstable
[+541.594µs; +1352.483µs] or [+13.122%; +32.768%]		 unstable
[-549.488op/s; -46.762op/s] or [-22.803%; -1.941%]		 1.723ms 5.075ms 2111.625op/s 1.562ms 4.127ms 2409.750op/s
scenario:load:petclinic:iast:high_load worse
[+0.685ms; +1.560ms] or [+3.961%; +9.023%]		 worse
[+1.149ms; +2.405ms] or [+4.050%; +8.477%]		 unstable
[-42.063op/s; +10.813op/s] or [-15.891%; +4.085%]		 18.411ms 30.149ms 249.062op/s 17.289ms 28.372ms 264.688op/s
scenario:load:petclinic:tracing:high_load worse
[+576.246µs; +1394.090µs] or [+3.311%; +8.011%]		 unsure
[+154.071µs; +1593.289µs] or [+0.537%; +5.550%]		 unstable
[-38.846op/s; +14.721op/s] or [-14.793%; +5.606%]		 18.388ms 29.582ms 250.531op/s 17.403ms 28.709ms 262.594op/s
scenario:load:petclinic:code_origins:high_load worse
[+349.733µs; +1304.263µs] or [+2.002%; +7.466%]		 same
[-292.249µs; +1820.113µs] or [-1.006%; +6.264%]		 unstable
[-35.839op/s; +17.152op/s] or [-13.743%; +6.577%]		 18.296ms 29.822ms 251.438op/s 17.469ms 29.058ms 260.781op/s
Request duration reports for insecure-bank 
gantt title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~6fea068444, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section baseline no_agent (1.176 ms) : 1164, 1187 . : milestone, 1176, iast (3.193 ms) : 3147, 3239 . : milestone, 3193, iast_FULL (5.706 ms) : 5649, 5762 . : milestone, 5706, iast_GLOBAL (3.54 ms) : 3489, 3591 . : milestone, 3540, profiling (1.871 ms) : 1855, 1886 . : milestone, 1871, tracing (1.818 ms) : 1803, 1833 . : milestone, 1818, section candidate no_agent (1.195 ms) : 1184, 1207 . : milestone, 1195, iast (3.292 ms) : 3196, 3387 . : milestone, 3292, iast_FULL (5.855 ms) : 5796, 5914 . : milestone, 5855, iast_GLOBAL (3.475 ms) : 3429, 3522 . : milestone, 3475, profiling (2.143 ms) : 2123, 2162 . : milestone, 2143, tracing (1.802 ms) : 1787, 1816 . : milestone, 1802,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.176 ms [1.164 ms, 1.187 ms] -
iast 3.193 ms [3.147 ms, 3.239 ms] 2.017 ms (171.6%)
iast_FULL 5.706 ms [5.649 ms, 5.762 ms] 4.53 ms (385.3%)
iast_GLOBAL 3.54 ms [3.489 ms, 3.591 ms] 2.365 ms (201.1%)
profiling 1.871 ms [1.855 ms, 1.886 ms] 694.927 µs (59.1%)
tracing 1.818 ms [1.803 ms, 1.833 ms] 642.005 µs (54.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.195 ms [1.184 ms, 1.207 ms] -
iast 3.292 ms [3.196 ms, 3.387 ms] 2.096 ms (175.3%)
iast_FULL 5.855 ms [5.796 ms, 5.914 ms] 4.659 ms (389.8%)
iast_GLOBAL 3.475 ms [3.429 ms, 3.522 ms] 2.28 ms (190.7%)
profiling 2.143 ms [2.123 ms, 2.162 ms] 947.125 µs (79.2%)
tracing 1.802 ms [1.787 ms, 1.816 ms] 606.5 µs (50.7%)
Request duration reports for petclinic 
gantt title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~6fea068444, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section baseline no_agent (17.999 ms) : 17815, 18183 . : milestone, 17999, appsec (18.45 ms) : 18262, 18638 . : milestone, 18450, code_origins (17.896 ms) : 17716, 18076 . : milestone, 17896, iast (17.626 ms) : 17450, 17802 . : milestone, 17626, profiling (18.507 ms) : 18325, 18688 . : milestone, 18507, tracing (17.772 ms) : 17595, 17950 . : milestone, 17772, section candidate no_agent (18.154 ms) : 17967, 18340 . : milestone, 18154, appsec (18.656 ms) : 18464, 18847 . : milestone, 18656, code_origins (18.566 ms) : 18379, 18753 . : milestone, 18566, iast (18.74 ms) : 18548, 18932 . : milestone, 18740, profiling (18.888 ms) : 18701, 19074 . : milestone, 18888, tracing (18.627 ms) : 18441, 18814 . : milestone, 18627,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.999 ms [17.815 ms, 18.183 ms] -
appsec 18.45 ms [18.262 ms, 18.638 ms] 450.645 µs (2.5%)
code_origins 17.896 ms [17.716 ms, 18.076 ms] -102.917 µs (-0.6%)
iast 17.626 ms [17.45 ms, 17.802 ms] -373.339 µs (-2.1%)
profiling 18.507 ms [18.325 ms, 18.688 ms] 507.635 µs (2.8%)
tracing 17.772 ms [17.595 ms, 17.95 ms] -226.829 µs (-1.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.154 ms [17.967 ms, 18.34 ms] -
appsec 18.656 ms [18.464 ms, 18.847 ms] 501.938 µs (2.8%)
code_origins 18.566 ms [18.379 ms, 18.753 ms] 412.434 µs (2.3%)
iast 18.74 ms [18.548 ms, 18.932 ms] 586.189 µs (3.2%)
profiling 18.888 ms [18.701 ms, 19.074 ms] 734.069 µs (4.0%)
tracing 18.627 ms [18.441 ms, 18.814 ms] 473.691 µs (2.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/open-feature-sdk-smoke
git_commit_date 1763111453 1763113799
git_commit_sha 8ceb94d 6fea068
release_version 1.56.0-SNAPSHOT~8ceb94de51 1.56.0-SNAPSHOT~6fea068444
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1763117585 1763117585
ci_job_id 1234849369 1234849369
ci_pipeline_id 82385169 82385169
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-t3fdlq0k 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-t3fdlq0k 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava 
gantt title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~6fea068444, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section baseline no_agent (14.931 s) : 14931000, 14931000 . : milestone, 14931000, appsec (14.698 s) : 14698000, 14698000 . : milestone, 14698000, iast (18.057 s) : 18057000, 18057000 . : milestone, 18057000, iast_GLOBAL (18.075 s) : 18075000, 18075000 . : milestone, 18075000, profiling (15.021 s) : 15021000, 15021000 . : milestone, 15021000, tracing (14.563 s) : 14563000, 14563000 . : milestone, 14563000, section candidate no_agent (15.628 s) : 15628000, 15628000 . : milestone, 15628000, appsec (14.886 s) : 14886000, 14886000 . : milestone, 14886000, iast (18.548 s) : 18548000, 18548000 . : milestone, 18548000, iast_GLOBAL (18.027 s) : 18027000, 18027000 . : milestone, 18027000, profiling (15.476 s) : 15476000, 15476000 . : milestone, 15476000, tracing (14.821 s) : 14821000, 14821000 . : milestone, 14821000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.931 s [14.931 s, 14.931 s] -
appsec 14.698 s [14.698 s, 14.698 s] -233.0 ms (-1.6%)
iast 18.057 s [18.057 s, 18.057 s] 3.126 s (20.9%)
iast_GLOBAL 18.075 s [18.075 s, 18.075 s] 3.144 s (21.1%)
profiling 15.021 s [15.021 s, 15.021 s] 90.0 ms (0.6%)
tracing 14.563 s [14.563 s, 14.563 s] -368.0 ms (-2.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.628 s [15.628 s, 15.628 s] -
appsec 14.886 s [14.886 s, 14.886 s] -742.0 ms (-4.7%)
iast 18.548 s [18.548 s, 18.548 s] 2.92 s (18.7%)
iast_GLOBAL 18.027 s [18.027 s, 18.027 s] 2.399 s (15.4%)
profiling 15.476 s [15.476 s, 15.476 s] -152.0 ms (-1.0%)
tracing 14.821 s [14.821 s, 14.821 s] -807.0 ms (-5.2%)
Execution time for tomcat 
gantt title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~6fea068444, baseline=1.56.0-SNAPSHOT~8ceb94de51 dateFormat X axisFormat %s section baseline no_agent (1.479 ms) : 1467, 1490 . : milestone, 1479, appsec (3.717 ms) : 3501, 3934 . : milestone, 3717, iast (2.226 ms) : 2162, 2289 . : milestone, 2226, iast_GLOBAL (2.262 ms) : 2198, 2326 . : milestone, 2262, profiling (2.508 ms) : 2341, 2676 . : milestone, 2508, tracing (2.033 ms) : 1983, 2082 . : milestone, 2033, section candidate no_agent (1.48 ms) : 1468, 1491 . : milestone, 1480, appsec (3.725 ms) : 3507, 3942 . : milestone, 3725, iast (2.221 ms) : 2157, 2285 . : milestone, 2221, iast_GLOBAL (2.266 ms) : 2202, 2330 . : milestone, 2266, profiling (2.064 ms) : 2012, 2115 . : milestone, 2064, tracing (2.039 ms) : 1990, 2088 . : milestone, 2039,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.467 ms, 1.49 ms] -
appsec 3.717 ms [3.501 ms, 3.934 ms] 2.239 ms (151.4%)
iast 2.226 ms [2.162 ms, 2.289 ms] 747.262 µs (50.5%)
iast_GLOBAL 2.262 ms [2.198 ms, 2.326 ms] 783.673 µs (53.0%)
profiling 2.508 ms [2.341 ms, 2.676 ms] 1.03 ms (69.6%)
tracing 2.033 ms [1.983 ms, 2.082 ms] 554.226 µs (37.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.468 ms, 1.491 ms] -
appsec 3.725 ms [3.507 ms, 3.942 ms] 2.245 ms (151.7%)
iast 2.221 ms [2.157 ms, 2.285 ms] 741.303 µs (50.1%)
iast_GLOBAL 2.266 ms [2.202 ms, 2.33 ms] 786.748 µs (53.2%)
profiling 2.064 ms [2.012 ms, 2.115 ms] 584.228 µs (39.5%)
tracing 2.039 ms [1.99 ms, 2.088 ms] 559.227 µs (37.8%)
@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from de1816f to 9478361 Compare November 14, 2025 09:04
@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk-smoke branch from 9478361 to 6fea068 Compare November 14, 2025 09:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

2 participants

@manuel-alvarez-alvarez