Skip to content

Conversation

sezen-datadog
Copy link
Contributor

@sezen-datadog sezen-datadog commented May 16, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: APPSEC-57259

@sezen-datadog sezen-datadog force-pushed the sezen.leblay/APPSEC-57259 branch 2 times, most recently from 891c835 to a2809f5 Compare May 16, 2025 13:40
@pr-commenter
Copy link

pr-commenter bot commented May 16, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sezen.leblay/APPSEC-57259
git_commit_date 1746789389 1749037898
git_commit_sha ad6d5fe cab7bfe
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~cab7bfe297
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1749040343 1749040343
ci_job_id 967307418 967307418
ci_pipeline_id 66920181 66920181
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ul4n-y4k-project-304-concurrent-1-iay1xjmu 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ul4n-y4k-project-304-concurrent-1-iay1xjmu 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 55 metrics, 12 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:AppSec better
[-8.608ms; -5.164ms] or [-15.395%; -9.235%]
49.027ms 55.913ms
scenario:startup:insecure-bank:tracing:AppSec worse
[+1.345ms; +5.151ms] or [+2.477%; +9.489%]
57.536ms 54.288ms
scenario:startup:petclinic:profiling:GlobalTracer better
[-23.730ms; -17.034ms] or [-6.225%; -4.469%]
360.802ms 381.184ms
scenario:startup:petclinic:profiling:AppSec worse
[+5.362ms; +9.052ms] or [+9.891%; +16.696%]
61.419ms 54.213ms
Startup time reports for petclinic
gantt title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~cab7bfe297, baseline=1.50.0-SNAPSHOT~ad6d5fef42 dateFormat X axisFormat %s section tracing Agent [baseline] (1.021 s) : 0, 1020555 Total [baseline] (11.031 s) : 0, 11030857 Agent [candidate] (1.021 s) : 0, 1021229 Total [candidate] (11.189 s) : 0, 11188907 section appsec Agent [baseline] (1.157 s) : 0, 1157353 Total [baseline] (11.202 s) : 0, 11202086 Agent [candidate] (1.164 s) : 0, 1164267 Total [candidate] (11.245 s) : 0, 11244894 section iast Agent [baseline] (1.149 s) : 0, 1149484 Total [baseline] (11.318 s) : 0, 11317532 Agent [candidate] (1.149 s) : 0, 1149204 Total [candidate] (11.39 s) : 0, 11389579 section profiling Agent [baseline] (1.294 s) : 0, 1293532 Total [baseline] (11.416 s) : 0, 11416222 Agent [candidate] (1.268 s) : 0, 1268059 Total [candidate] (11.452 s) : 0, 11452467 
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent appsec 1.157 s 136.798 ms (13.4%)
Agent iast 1.149 s 128.929 ms (12.6%)
Agent profiling 1.294 s 272.977 ms (26.7%)
Total tracing 11.031 s -
Total appsec 11.202 s 171.229 ms (1.6%)
Total iast 11.318 s 286.675 ms (2.6%)
Total profiling 11.416 s 385.365 ms (3.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent appsec 1.164 s 143.038 ms (14.0%)
Agent iast 1.149 s 127.975 ms (12.5%)
Agent profiling 1.268 s 246.83 ms (24.2%)
Total tracing 11.189 s -
Total appsec 11.245 s 55.987 ms (0.5%)
Total iast 11.39 s 200.672 ms (1.8%)
Total profiling 11.452 s 263.56 ms (2.4%)
gantt title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~cab7bfe297, baseline=1.50.0-SNAPSHOT~ad6d5fef42 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (681.292 ms) : 0, 681292 BytebuddyAgent [candidate] (684.075 ms) : 0, 684075 GlobalTracer [baseline] (239.181 ms) : 0, 239181 GlobalTracer [candidate] (240.578 ms) : 0, 240578 AppSec [baseline] (54.562 ms) : 0, 54562 AppSec [candidate] (56.242 ms) : 0, 56242 Debugger [baseline] (11.234 ms) : 0, 11234 Debugger [candidate] (6.197 ms) : 0, 6197 Remote Config [baseline] (697.897 µs) : 0, 698 Remote Config [candidate] (726.523 µs) : 0, 727 Telemetry [baseline] (9.995 ms) : 0, 9995 Telemetry [candidate] (9.879 ms) : 0, 9879 section appsec BytebuddyAgent [baseline] (698.066 ms) : 0, 698066 BytebuddyAgent [candidate] (701.639 ms) : 0, 701639 GlobalTracer [baseline] (235.849 ms) : 0, 235849 GlobalTracer [candidate] (237.519 ms) : 0, 237519 AppSec [baseline] (175.223 ms) : 0, 175223 AppSec [candidate] (176.676 ms) : 0, 176676 Debugger [baseline] (5.908 ms) : 0, 5908 Debugger [candidate] (5.95 ms) : 0, 5950 Remote Config [baseline] (634.54 µs) : 0, 635 Remote Config [candidate] (634.58 µs) : 0, 635 Telemetry [baseline] (7.354 ms) : 0, 7354 Telemetry [candidate] (7.347 ms) : 0, 7347 IAST [baseline] (21.771 ms) : 0, 21771 IAST [candidate] (21.74 ms) : 0, 21740 section iast BytebuddyAgent [baseline] (802.466 ms) : 0, 802466 BytebuddyAgent [candidate] (801.275 ms) : 0, 801275 GlobalTracer [baseline] (230.227 ms) : 0, 230227 GlobalTracer [candidate] (230.515 ms) : 0, 230515 AppSec [baseline] (50.285 ms) : 0, 50285 AppSec [candidate] (53.201 ms) : 0, 53201 Debugger [baseline] (5.944 ms) : 0, 5944 Debugger [candidate] (5.985 ms) : 0, 5985 Remote Config [baseline] (617.188 µs) : 0, 617 Remote Config [candidate] (584.407 µs) : 0, 584 Telemetry [baseline] (7.971 ms) : 0, 7971 Telemetry [candidate] (7.873 ms) : 0, 7873 IAST [baseline] (27.77 ms) : 0, 27770 IAST [candidate] (26.235 ms) : 0, 26235 section profiling ProfilingAgent [baseline] (109.084 ms) : 0, 109084 ProfilingAgent [candidate] (105.117 ms) : 0, 105117 BytebuddyAgent [baseline] (683.156 ms) : 0, 683156 BytebuddyAgent [candidate] (675.119 ms) : 0, 675119 GlobalTracer [baseline] (381.184 ms) : 0, 381184 GlobalTracer [candidate] (360.802 ms) : 0, 360802 AppSec [baseline] (54.213 ms) : 0, 54213 AppSec [candidate] (61.419 ms) : 0, 61419 Debugger [baseline] (6.113 ms) : 0, 6113 Debugger [candidate] (6.093 ms) : 0, 6093 Remote Config [baseline] (661.527 µs) : 0, 662 Remote Config [candidate] (646.915 µs) : 0, 647 Telemetry [baseline] (8.096 ms) : 0, 8096 Telemetry [candidate] (8.125 ms) : 0, 8125 Profiling [baseline] (109.108 ms) : 0, 109108 Profiling [candidate] (105.142 ms) : 0, 105142 
Loading
Startup time reports for insecure-bank
gantt title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~cab7bfe297, baseline=1.50.0-SNAPSHOT~ad6d5fef42 dateFormat X axisFormat %s section tracing Agent [baseline] (1.019 s) : 0, 1018797 Total [baseline] (8.475 s) : 0, 8475132 Agent [candidate] (1.023 s) : 0, 1023303 Total [candidate] (8.488 s) : 0, 8488326 section iast Agent [baseline] (1.148 s) : 0, 1147507 Total [baseline] (9.15 s) : 0, 9150467 Agent [candidate] (1.164 s) : 0, 1163615 Total [candidate] (9.165 s) : 0, 9165448 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.149 s) : 0, 1148637 Total [baseline] (9.086 s) : 0, 9085529 Agent [candidate] (1.156 s) : 0, 1156434 Total [candidate] (9.128 s) : 0, 9127924 section iast_TELEMETRY_OFF Agent [baseline] (1.144 s) : 0, 1143633 Total [baseline] (9.25 s) : 0, 9249936 Agent [candidate] (1.146 s) : 0, 1146139 Total [candidate] (9.192 s) : 0, 9192449 
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.019 s -
Agent iast 1.148 s 128.71 ms (12.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.149 s 129.84 ms (12.7%)
Agent iast_TELEMETRY_OFF 1.144 s 124.837 ms (12.3%)
Total tracing 8.475 s -
Total iast 9.15 s 675.334 ms (8.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.086 s 610.396 ms (7.2%)
Total iast_TELEMETRY_OFF 9.25 s 774.803 ms (9.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent iast 1.164 s 140.312 ms (13.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.156 s 133.131 ms (13.0%)
Agent iast_TELEMETRY_OFF 1.146 s 122.836 ms (12.0%)
Total tracing 8.488 s -
Total iast 9.165 s 677.122 ms (8.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.128 s 639.598 ms (7.5%)
Total iast_TELEMETRY_OFF 9.192 s 704.123 ms (8.3%)
gantt title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~cab7bfe297, baseline=1.50.0-SNAPSHOT~ad6d5fef42 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (681.425 ms) : 0, 681425 BytebuddyAgent [candidate] (684.403 ms) : 0, 684403 GlobalTracer [baseline] (239.046 ms) : 0, 239046 GlobalTracer [candidate] (240.278 ms) : 0, 240278 AppSec [baseline] (54.288 ms) : 0, 54288 AppSec [candidate] (57.536 ms) : 0, 57536 Debugger [baseline] (9.146 ms) : 0, 9146 Debugger [candidate] (6.152 ms) : 0, 6152 Remote Config [baseline] (700.673 µs) : 0, 701 Remote Config [candidate] (732.16 µs) : 0, 732 Telemetry [baseline] (10.68 ms) : 0, 10680 Telemetry [candidate] (10.607 ms) : 0, 10607 section iast BytebuddyAgent [baseline] (801.535 ms) : 0, 801535 BytebuddyAgent [candidate] (813.514 ms) : 0, 813514 GlobalTracer [baseline] (229.896 ms) : 0, 229896 GlobalTracer [candidate] (231.625 ms) : 0, 231625 IAST [baseline] (30.027 ms) : 0, 30027 IAST [candidate] (27.17 ms) : 0, 27170 AppSec [baseline] (47.584 ms) : 0, 47584 AppSec [candidate] (52.974 ms) : 0, 52974 Debugger [baseline] (5.913 ms) : 0, 5913 Debugger [candidate] (6.001 ms) : 0, 6001 Remote Config [baseline] (585.865 µs) : 0, 586 Remote Config [candidate] (599.884 µs) : 0, 600 Telemetry [baseline] (7.801 ms) : 0, 7801 Telemetry [candidate] (8.026 ms) : 0, 8026 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (802.111 ms) : 0, 802111 BytebuddyAgent [candidate] (807.606 ms) : 0, 807606 GlobalTracer [baseline] (229.972 ms) : 0, 229972 GlobalTracer [candidate] (231.205 ms) : 0, 231205 IAST [baseline] (30.298 ms) : 0, 30298 IAST [candidate] (26.352 ms) : 0, 26352 AppSec [baseline] (47.666 ms) : 0, 47666 AppSec [candidate] (53.12 ms) : 0, 53120 Debugger [baseline] (5.927 ms) : 0, 5927 Debugger [candidate] (5.982 ms) : 0, 5982 Remote Config [baseline] (595.168 µs) : 0, 595 Remote Config [candidate] (603.645 µs) : 0, 604 Telemetry [baseline] (7.879 ms) : 0, 7879 Telemetry [candidate] (7.898 ms) : 0, 7898 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (797.618 ms) : 0, 797618 BytebuddyAgent [candidate] (799.324 ms) : 0, 799324 GlobalTracer [baseline] (229.876 ms) : 0, 229876 GlobalTracer [candidate] (230.625 ms) : 0, 230625 IAST [baseline] (22.441 ms) : 0, 22441 IAST [candidate] (29.462 ms) : 0, 29462 AppSec [baseline] (55.913 ms) : 0, 55913 AppSec [candidate] (49.027 ms) : 0, 49027 Debugger [baseline] (5.982 ms) : 0, 5982 Debugger [candidate] (5.889 ms) : 0, 5889 Remote Config [baseline] (604.336 µs) : 0, 604 Remote Config [candidate] (645.255 µs) : 0, 645 Telemetry [baseline] (7.754 ms) : 0, 7754 Telemetry [candidate] (7.788 ms) : 0, 7788 
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-06-04T12:11:40 2025-06-04T12:16:50
git_branch master sezen.leblay/APPSEC-57259
git_commit_date 1746789389 1749037898
git_commit_sha ad6d5fe cab7bfe
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~cab7bfe297
start_time 2025-06-04T12:11:19 2025-06-04T12:16:01
See matching parameters
Baseline Candidate
application petclinic petclinic
ci_job_date 1749039410 1749039410
ci_job_id 967307420 967307420
ci_pipeline_id 66920181 66920181
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ul4n-y4k-project-304-concurrent-2-odoswnxm 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ul4n-y4k-project-304-concurrent-2-odoswnxm 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
thresholds_or_results results results
variant appsec appsec

Summary

Found 0 performance improvements and 4 performance regressions! Performance is the same for 0 metrics, 10 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:iast unstable
[+69.492ms; +73.962ms] or [+639.133%; +680.239%]
worse
[-414.208op/s; -380.708op/s] or [-90.903%; -83.551%]
82.600ms 58.200op/s 10.873ms 455.658op/s
scenario:load:petclinic:no_agent unstable
[+39.608ms; +41.032ms] or [+507.004%; +525.231%]
worse
[-548.389op/s; -518.548op/s] or [-86.371%; -81.671%]
48.132ms 101.452op/s 7.812ms 634.921op/s
scenario:load:petclinic:profiling unstable
[+51.557ms; +53.628ms] or [+532.382%; +553.775%]
worse
[-452.599op/s; -410.033op/s] or [-88.822%; -80.469%]
62.277ms 78.238op/s 9.684ms 509.554op/s
scenario:load:petclinic:tracing unstable
[+45.546ms; +47.228ms] or [+544.618%; +564.734%]
worse
[-514.586op/s; -482.765op/s] or [-87.480%; -82.070%]
54.750ms 89.560op/s 8.363ms 588.235op/s
Request duration reports for petclinic
gantt title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~cab7bfe297, baseline=1.50.0-SNAPSHOT~ad6d5fef42 dateFormat X axisFormat %s section baseline no_agent (7.812 ms) : 7789, 7836 . : milestone, 7812, appsec (1.14 ms) : 1091, 1188 . : milestone, 1140, appsec_no_iast (436.915 µs) : 402, 471 . : milestone, 437, code_origins (29.742 ms) : 29641, 29842 . : milestone, 29742, iast (10.873 ms) : 10827, 10919 . : milestone, 10873, profiling (9.684 ms) : 9641, 9727 . : milestone, 9684, tracing (8.363 ms) : 8336, 8390 . : milestone, 8363, section candidate no_agent (48.132 ms) : 47197, 49068 . : milestone, 48132, appsec (69.991 ms) : 68292, 71690 . : milestone, 69991, appsec_no_iast (77.31 ms) : 75133, 79487 . : milestone, 77310, code_origins (88.658 ms) : 83648, 93668 . : milestone, 88658, iast (82.6 ms) : 79663, 85536 . : milestone, 82600, profiling (62.277 ms) : 60916, 63637 . : milestone, 62277, tracing (54.75 ms) : 53644, 55855 . : milestone, 54750, 
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 7.812 ms [7.789 ms, 7.836 ms] -
appsec 1.14 ms [1.091 ms, 1.188 ms] -6.673 ms (-85.4%)
appsec_no_iast 436.915 µs [402.456 µs, 471.375 µs] -7.375 ms (-94.4%)
code_origins 29.742 ms [29.641 ms, 29.842 ms] 21.929 ms (280.7%)
iast 10.873 ms [10.827 ms, 10.919 ms] 3.061 ms (39.2%)
profiling 9.684 ms [9.641 ms, 9.727 ms] 1.872 ms (24.0%)
tracing 8.363 ms [8.336 ms, 8.39 ms] 550.638 µs (7.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 48.132 ms [47.197 ms, 49.068 ms] -
appsec 69.991 ms [68.292 ms, 71.69 ms] 21.858 ms (45.4%)
appsec_no_iast 77.31 ms [75.133 ms, 79.487 ms] 29.178 ms (60.6%)
code_origins 88.658 ms [83.648 ms, 93.668 ms] 40.526 ms (84.2%)
iast 82.6 ms [79.663 ms, 85.536 ms] 34.467 ms (71.6%)
profiling 62.277 ms [60.916 ms, 63.637 ms] 14.144 ms (29.4%)
tracing 54.75 ms [53.644 ms, 55.855 ms] 6.617 ms (13.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sezen.leblay/APPSEC-57259
git_commit_date 1746789389 1749037898
git_commit_sha ad6d5fe cab7bfe
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~cab7bfe297
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1749039981 1749039981
ci_job_id 967307422 967307422
ci_pipeline_id 66920181 66920181
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-o6ycphvs-project-304-concurrent-0-9gm8qes8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-o6ycphvs-project-304-concurrent-0-9gm8qes8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~cab7bfe297, baseline=1.50.0-SNAPSHOT~ad6d5fef42 dateFormat X axisFormat %s section baseline no_agent (15.044 s) : 15044000, 15044000 . : milestone, 15044000, appsec (14.742 s) : 14742000, 14742000 . : milestone, 14742000, iast (18.982 s) : 18982000, 18982000 . : milestone, 18982000, iast_GLOBAL (18.182 s) : 18182000, 18182000 . : milestone, 18182000, profiling (15.927 s) : 15927000, 15927000 . : milestone, 15927000, tracing (14.88 s) : 14880000, 14880000 . : milestone, 14880000, section candidate no_agent (15.669 s) : 15669000, 15669000 . : milestone, 15669000, appsec (15.023 s) : 15023000, 15023000 . : milestone, 15023000, iast (18.884 s) : 18884000, 18884000 . : milestone, 18884000, iast_GLOBAL (17.984 s) : 17984000, 17984000 . : milestone, 17984000, profiling (15.822 s) : 15822000, 15822000 . : milestone, 15822000, tracing (14.91 s) : 14910000, 14910000 . : milestone, 14910000, 
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.044 s [15.044 s, 15.044 s] -
appsec 14.742 s [14.742 s, 14.742 s] -302.0 ms (-2.0%)
iast 18.982 s [18.982 s, 18.982 s] 3.938 s (26.2%)
iast_GLOBAL 18.182 s [18.182 s, 18.182 s] 3.138 s (20.9%)
profiling 15.927 s [15.927 s, 15.927 s] 883.0 ms (5.9%)
tracing 14.88 s [14.88 s, 14.88 s] -164.0 ms (-1.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.669 s [15.669 s, 15.669 s] -
appsec 15.023 s [15.023 s, 15.023 s] -646.0 ms (-4.1%)
iast 18.884 s [18.884 s, 18.884 s] 3.215 s (20.5%)
iast_GLOBAL 17.984 s [17.984 s, 17.984 s] 2.315 s (14.8%)
profiling 15.822 s [15.822 s, 15.822 s] 153.0 ms (1.0%)
tracing 14.91 s [14.91 s, 14.91 s] -759.0 ms (-4.8%)
Execution time for tomcat
gantt title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~cab7bfe297, baseline=1.50.0-SNAPSHOT~ad6d5fef42 dateFormat X axisFormat %s section baseline no_agent (1.474 ms) : 1463, 1486 . : milestone, 1474, appsec (2.41 ms) : 2361, 2459 . : milestone, 2410, iast (2.179 ms) : 2118, 2239 . : milestone, 2179, iast_GLOBAL (2.223 ms) : 2162, 2285 . : milestone, 2223, profiling (2.013 ms) : 1965, 2061 . : milestone, 2013, tracing (2.001 ms) : 1954, 2048 . : milestone, 2001, section candidate no_agent (1.476 ms) : 1465, 1488 . : milestone, 1476, appsec (2.4 ms) : 2351, 2448 . : milestone, 2400, iast (2.19 ms) : 2129, 2251 . : milestone, 2190, iast_GLOBAL (2.234 ms) : 2173, 2295 . : milestone, 2234, profiling (2.053 ms) : 2002, 2104 . : milestone, 2053, tracing (2.01 ms) : 1962, 2058 . : milestone, 2010, 
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 2.41 ms [2.361 ms, 2.459 ms] 935.335 µs (63.4%)
iast 2.179 ms [2.118 ms, 2.239 ms] 704.155 µs (47.8%)
iast_GLOBAL 2.223 ms [2.162 ms, 2.285 ms] 748.99 µs (50.8%)
profiling 2.013 ms [1.965 ms, 2.061 ms] 538.909 µs (36.6%)
tracing 2.001 ms [1.954 ms, 2.048 ms] 526.575 µs (35.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 2.4 ms [2.351 ms, 2.448 ms] 923.494 µs (62.6%)
iast 2.19 ms [2.129 ms, 2.251 ms] 713.895 µs (48.4%)
iast_GLOBAL 2.234 ms [2.173 ms, 2.295 ms] 758.071 µs (51.4%)
profiling 2.053 ms [2.002 ms, 2.104 ms] 577.071 µs (39.1%)
tracing 2.01 ms [1.962 ms, 2.058 ms] 533.887 µs (36.2%)
@sezen-datadog sezen-datadog force-pushed the sezen.leblay/APPSEC-57259 branch 2 times, most recently from ff2d34f to 4d7fed2 Compare May 16, 2025 14:19
@smola smola added type: enhancement Enhancements and improvements comp: asm waf Application Security Management (WAF) labels May 19, 2025
@sezen-datadog sezen-datadog force-pushed the sezen.leblay/APPSEC-57259 branch 7 times, most recently from f686487 to c4de9a0 Compare May 26, 2025 10:05
@sezen-datadog sezen-datadog force-pushed the sezen.leblay/APPSEC-57259 branch 2 times, most recently from 5bee816 to 6e49d48 Compare May 28, 2025 13:34
@sezen-datadog sezen-datadog force-pushed the sezen.leblay/APPSEC-57259 branch 5 times, most recently from 7f3daca to 462a5a5 Compare June 4, 2025 10:54
Signed-off-by: sezen.leblay <sezen.leblay@datadoghq.com>
@sezen-datadog sezen-datadog force-pushed the sezen.leblay/APPSEC-57259 branch from 462a5a5 to f8b5c97 Compare June 4, 2025 11:18
Signed-off-by: sezen.leblay <sezen.leblay@datadoghq.com>
@sezen-datadog sezen-datadog deleted the sezen.leblay/APPSEC-57259 branch June 5, 2025 10:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: asm waf Application Security Management (WAF) type: enhancement Enhancements and improvements

2 participants