Skip to content

Fix REASON-9: empty allocations returns DEFAULT instead of GENERAL error#11193

Draft
typotter wants to merge 1 commit intomasterfrom
typo/ffe-reason-9-empty-allocs-default
Draft

Fix REASON-9: empty allocations returns DEFAULT instead of GENERAL error#11193
typotter wants to merge 1 commit intomasterfrom
typo/ffe-reason-9-empty-allocs-default

Conversation

@typotter
Copy link
Copy Markdown
Contributor

Summary

  • Removes the early-exit guard that returned ErrorCode.GENERAL when flag.allocations was an empty list.
  • With the guard removed, the for loop at line 111 simply does not iterate, and execution falls through to the existing return DEFAULT at line 155.
  • Per ADR-001, an empty allocations waterfall is a platform data-invariant violation, not an SDK error. The SDK must return the coded default with reason=DEFAULT and no error code.

Behaviour change

Scenario Before After
flag.allocations is empty reason=ERROR, errorCode=GENERAL reason=DEFAULT, no error code
flag.allocations is null reason=ERROR, errorCode=GENERAL (explicit guard) reason=ERROR, errorCode=GENERAL (NPE caught by existing catch block)

Test plan

  • Unit tests covering evaluate() with an empty allocations list assert reason=DEFAULT and no error code.
  • Existing tests for the null-allocations path still pass (behaviour unchanged for null).

@typotter typotter added the tag: no release notes Changes to exclude from release notes label Apr 23, 2026
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Apr 23, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master typo/ffe-reason-9-empty-allocs-default
git_commit_date 1776961796 1776981800
git_commit_sha 9aedff2 4104dc6
release_version 1.62.0-SNAPSHOT~9aedff24d2 1.62.0-SNAPSHOT~4104dc661a
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776983616 1776983616
ci_job_id 1626536208 1626536208
ci_pipeline_id 109441943 109441943
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-dzal8arn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-dzal8arn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~4104dc661a, baseline=1.62.0-SNAPSHOT~9aedff24d2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1064631
Total [baseline] (8.834 s) : 0, 8833822
Agent [candidate] (1.055 s) : 0, 1054824
Total [candidate] (8.806 s) : 0, 8806456
section iast
Agent [baseline] (1.246 s) : 0, 1245516
Total [baseline] (9.576 s) : 0, 9575986
Agent [candidate] (1.237 s) : 0, 1237039
Total [candidate] (9.557 s) : 0, 9557410
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent iast 1.246 s 180.885 ms (17.0%)
Total tracing 8.834 s -
Total iast 9.576 s 742.163 ms (8.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.237 s 182.215 ms (17.3%)
Total tracing 8.806 s -
Total iast 9.557 s 750.954 ms (8.5%)
gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~4104dc661a, baseline=1.62.0-SNAPSHOT~9aedff24d2

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.244 ms) : 0, 1244
crashtracking [candidate] (1.232 ms) : 0, 1232
BytebuddyAgent [baseline] (642.994 ms) : 0, 642994
BytebuddyAgent [candidate] (634.878 ms) : 0, 634878
AgentMeter [baseline] (29.541 ms) : 0, 29541
AgentMeter [candidate] (29.418 ms) : 0, 29418
GlobalTracer [baseline] (249.477 ms) : 0, 249477
GlobalTracer [candidate] (248.283 ms) : 0, 248283
AppSec [baseline] (32.444 ms) : 0, 32444
AppSec [candidate] (32.364 ms) : 0, 32364
Debugger [baseline] (59.752 ms) : 0, 59752
Debugger [candidate] (59.53 ms) : 0, 59530
Remote Config [baseline] (607.007 µs) : 0, 607
Remote Config [candidate] (610.249 µs) : 0, 610
Telemetry [baseline] (7.986 ms) : 0, 7986
Telemetry [candidate] (7.998 ms) : 0, 7998
Flare Poller [baseline] (4.301 ms) : 0, 4301
Flare Poller [candidate] (4.41 ms) : 0, 4410
section iast
crashtracking [baseline] (1.239 ms) : 0, 1239
crashtracking [candidate] (1.228 ms) : 0, 1228
BytebuddyAgent [baseline] (820.516 ms) : 0, 820516
BytebuddyAgent [candidate] (813.372 ms) : 0, 813372
AgentMeter [baseline] (11.556 ms) : 0, 11556
AgentMeter [candidate] (11.437 ms) : 0, 11437
GlobalTracer [baseline] (240.968 ms) : 0, 240968
GlobalTracer [candidate] (239.674 ms) : 0, 239674
AppSec [baseline] (31.691 ms) : 0, 31691
AppSec [candidate] (31.452 ms) : 0, 31452
Debugger [baseline] (64.746 ms) : 0, 64746
Debugger [candidate] (64.064 ms) : 0, 64064
Remote Config [baseline] (533.598 µs) : 0, 534
Remote Config [candidate] (541.123 µs) : 0, 541
Telemetry [baseline] (7.809 ms) : 0, 7809
Telemetry [candidate] (7.94 ms) : 0, 7940
Flare Poller [baseline] (3.471 ms) : 0, 3471
Flare Poller [candidate] (3.539 ms) : 0, 3539
IAST [baseline] (26.741 ms) : 0, 26741
IAST [candidate] (27.661 ms) : 0, 27661
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~4104dc661a, baseline=1.62.0-SNAPSHOT~9aedff24d2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1054724
Total [baseline] (11.027 s) : 0, 11027082
Agent [candidate] (1.058 s) : 0, 1058078
Total [candidate] (11.008 s) : 0, 11008172
section appsec
Agent [baseline] (1.264 s) : 0, 1264381
Total [baseline] (11.089 s) : 0, 11089008
Agent [candidate] (1.259 s) : 0, 1259193
Total [candidate] (11.064 s) : 0, 11063594
section iast
Agent [baseline] (1.234 s) : 0, 1233723
Total [baseline] (11.189 s) : 0, 11189145
Agent [candidate] (1.235 s) : 0, 1234652
Total [candidate] (11.299 s) : 0, 11299161
section profiling
Agent [baseline] (1.192 s) : 0, 1191971
Total [baseline] (11.026 s) : 0, 11025857
Agent [candidate] (1.186 s) : 0, 1186172
Total [candidate] (10.996 s) : 0, 10996195
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent appsec 1.264 s 209.657 ms (19.9%)
Agent iast 1.234 s 178.999 ms (17.0%)
Agent profiling 1.192 s 137.247 ms (13.0%)
Total tracing 11.027 s -
Total appsec 11.089 s 61.926 ms (0.6%)
Total iast 11.189 s 162.063 ms (1.5%)
Total profiling 11.026 s -1.225 ms (-0.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent appsec 1.259 s 201.115 ms (19.0%)
Agent iast 1.235 s 176.574 ms (16.7%)
Agent profiling 1.186 s 128.094 ms (12.1%)
Total tracing 11.008 s -
Total appsec 11.064 s 55.421 ms (0.5%)
Total iast 11.299 s 290.989 ms (2.6%)
Total profiling 10.996 s -11.978 ms (-0.1%)
gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~4104dc661a, baseline=1.62.0-SNAPSHOT~9aedff24d2

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.221 ms) : 0, 1221
crashtracking [candidate] (1.225 ms) : 0, 1225
BytebuddyAgent [baseline] (633.201 ms) : 0, 633201
BytebuddyAgent [candidate] (636.613 ms) : 0, 636613
AgentMeter [baseline] (29.355 ms) : 0, 29355
AgentMeter [candidate] (29.374 ms) : 0, 29374
GlobalTracer [baseline] (248.572 ms) : 0, 248572
GlobalTracer [candidate] (249.026 ms) : 0, 249026
AppSec [baseline] (32.076 ms) : 0, 32076
AppSec [candidate] (32.354 ms) : 0, 32354
Debugger [baseline] (60.356 ms) : 0, 60356
Debugger [candidate] (60.373 ms) : 0, 60373
Remote Config [baseline] (601.72 µs) : 0, 602
Remote Config [candidate] (598.087 µs) : 0, 598
Telemetry [baseline] (8.791 ms) : 0, 8791
Telemetry [candidate] (8.778 ms) : 0, 8778
Flare Poller [baseline] (4.376 ms) : 0, 4376
Flare Poller [candidate] (3.565 ms) : 0, 3565
section appsec
crashtracking [baseline] (1.221 ms) : 0, 1221
crashtracking [candidate] (1.212 ms) : 0, 1212
BytebuddyAgent [baseline] (676.007 ms) : 0, 676007
BytebuddyAgent [candidate] (673.396 ms) : 0, 673396
AgentMeter [baseline] (12.226 ms) : 0, 12226
AgentMeter [candidate] (12.194 ms) : 0, 12194
GlobalTracer [baseline] (249.912 ms) : 0, 249912
GlobalTracer [candidate] (248.385 ms) : 0, 248385
AppSec [baseline] (187.207 ms) : 0, 187207
AppSec [candidate] (185.628 ms) : 0, 185628
Debugger [baseline] (65.031 ms) : 0, 65031
Debugger [candidate] (66.068 ms) : 0, 66068
Remote Config [baseline] (579.727 µs) : 0, 580
Remote Config [candidate] (590.101 µs) : 0, 590
Telemetry [baseline] (7.874 ms) : 0, 7874
Telemetry [candidate] (7.889 ms) : 0, 7889
Flare Poller [baseline] (3.449 ms) : 0, 3449
Flare Poller [candidate] (3.463 ms) : 0, 3463
IAST [baseline] (24.457 ms) : 0, 24457
IAST [candidate] (24.159 ms) : 0, 24159
section iast
crashtracking [baseline] (1.231 ms) : 0, 1231
crashtracking [candidate] (1.236 ms) : 0, 1236
BytebuddyAgent [baseline] (810.526 ms) : 0, 810526
BytebuddyAgent [candidate] (811.804 ms) : 0, 811804
AgentMeter [baseline] (11.364 ms) : 0, 11364
AgentMeter [candidate] (11.418 ms) : 0, 11418
GlobalTracer [baseline] (239.11 ms) : 0, 239110
GlobalTracer [candidate] (239.177 ms) : 0, 239177
AppSec [baseline] (29.552 ms) : 0, 29552
AppSec [candidate] (27.715 ms) : 0, 27715
Debugger [baseline] (66.388 ms) : 0, 66388
Debugger [candidate] (65.382 ms) : 0, 65382
Remote Config [baseline] (549.945 µs) : 0, 550
Remote Config [candidate] (532.232 µs) : 0, 532
Telemetry [baseline] (7.827 ms) : 0, 7827
Telemetry [candidate] (7.733 ms) : 0, 7733
Flare Poller [baseline] (3.494 ms) : 0, 3494
Flare Poller [candidate] (3.477 ms) : 0, 3477
IAST [baseline] (27.537 ms) : 0, 27537
IAST [candidate] (30.133 ms) : 0, 30133
section profiling
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (697.125 ms) : 0, 697125
BytebuddyAgent [candidate] (692.989 ms) : 0, 692989
AgentMeter [baseline] (8.969 ms) : 0, 8969
AgentMeter [candidate] (9.025 ms) : 0, 9025
GlobalTracer [baseline] (208.875 ms) : 0, 208875
GlobalTracer [candidate] (207.568 ms) : 0, 207568
AppSec [baseline] (32.8 ms) : 0, 32800
AppSec [candidate] (32.491 ms) : 0, 32491
Debugger [baseline] (65.937 ms) : 0, 65937
Debugger [candidate] (65.738 ms) : 0, 65738
Remote Config [baseline] (578.146 µs) : 0, 578
Remote Config [candidate] (573.658 µs) : 0, 574
Telemetry [baseline] (7.832 ms) : 0, 7832
Telemetry [candidate] (7.82 ms) : 0, 7820
Flare Poller [baseline] (3.513 ms) : 0, 3513
Flare Poller [candidate] (3.508 ms) : 0, 3508
ProfilingAgent [baseline] (93.233 ms) : 0, 93233
ProfilingAgent [candidate] (93.675 ms) : 0, 93675
Profiling [baseline] (93.798 ms) : 0, 93798
Profiling [candidate] (94.235 ms) : 0, 94235
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master typo/ffe-reason-9-empty-allocs-default
git_commit_date 1776961796 1776981800
git_commit_sha 9aedff2 4104dc6
release_version 1.62.0-SNAPSHOT~9aedff24d2 1.62.0-SNAPSHOT~4104dc661a
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776984112 1776984112
ci_job_id 1626536209 1626536209
ci_pipeline_id 109441943 109441943
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-nl4ibhyt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-nl4ibhyt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+130.471µs; +225.986µs] or [+7.767%; +13.453%]
unstable
[+0.845ms; +1.607ms] or [+18.547%; +35.288%]
unstable
[-557.302op/s; -113.948op/s] or [-25.124%; -5.137%]
1.858ms 5.779ms 1882.594op/s 1.680ms 4.554ms 2218.219op/s
scenario:load:insecure-bank:iast:high_load better
[-280.588µs; -73.914µs] or [-10.204%; -2.688%]
unstable
[-1304.272µs; +132.131µs] or [-16.021%; +1.623%]
unstable
[-77.918op/s; +211.980op/s] or [-5.897%; +16.042%]
2.572ms 7.555ms 1388.438op/s 2.750ms 8.141ms 1321.406op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~4104dc661a, baseline=1.62.0-SNAPSHOT~9aedff24d2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.243 ms) : 1232, 1254
.   : milestone, 1243,
iast (3.467 ms) : 3412, 3522
.   : milestone, 3467,
iast_FULL (5.876 ms) : 5816, 5937
.   : milestone, 5876,
iast_GLOBAL (3.631 ms) : 3564, 3697
.   : milestone, 3631,
profiling (2.034 ms) : 2016, 2052
.   : milestone, 2034,
tracing (1.895 ms) : 1879, 1911
.   : milestone, 1895,
section candidate
no_agent (1.262 ms) : 1249, 1274
.   : milestone, 1262,
iast (3.297 ms) : 3250, 3343
.   : milestone, 3297,
iast_FULL (5.918 ms) : 5860, 5977
.   : milestone, 5918,
iast_GLOBAL (3.535 ms) : 3483, 3587
.   : milestone, 3535,
profiling (2.411 ms) : 2386, 2436
.   : milestone, 2411,
tracing (1.936 ms) : 1919, 1953
.   : milestone, 1936,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.243 ms [1.232 ms, 1.254 ms] -
iast 3.467 ms [3.412 ms, 3.522 ms] 2.224 ms (179.0%)
iast_FULL 5.876 ms [5.816 ms, 5.937 ms] 4.634 ms (372.8%)
iast_GLOBAL 3.631 ms [3.564 ms, 3.697 ms] 2.388 ms (192.1%)
profiling 2.034 ms [2.016 ms, 2.052 ms] 791.001 µs (63.6%)
tracing 1.895 ms [1.879 ms, 1.911 ms] 652.11 µs (52.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.262 ms [1.249 ms, 1.274 ms] -
iast 3.297 ms [3.25 ms, 3.343 ms] 2.035 ms (161.2%)
iast_FULL 5.918 ms [5.86 ms, 5.977 ms] 4.657 ms (369.0%)
iast_GLOBAL 3.535 ms [3.483 ms, 3.587 ms] 2.273 ms (180.1%)
profiling 2.411 ms [2.386 ms, 2.436 ms] 1.149 ms (91.1%)
tracing 1.936 ms [1.919 ms, 1.953 ms] 674.073 µs (53.4%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~4104dc661a, baseline=1.62.0-SNAPSHOT~9aedff24d2
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.133 ms) : 17949, 18317
.   : milestone, 18133,
appsec (18.661 ms) : 18475, 18846
.   : milestone, 18661,
code_origins (18.012 ms) : 17837, 18188
.   : milestone, 18012,
iast (17.759 ms) : 17581, 17937
.   : milestone, 17759,
profiling (18.63 ms) : 18447, 18813
.   : milestone, 18630,
tracing (17.93 ms) : 17754, 18107
.   : milestone, 17930,
section candidate
no_agent (18.126 ms) : 17943, 18309
.   : milestone, 18126,
appsec (18.74 ms) : 18552, 18929
.   : milestone, 18740,
code_origins (17.759 ms) : 17585, 17933
.   : milestone, 17759,
iast (17.845 ms) : 17668, 18022
.   : milestone, 17845,
profiling (18.448 ms) : 18267, 18628
.   : milestone, 18448,
tracing (17.992 ms) : 17814, 18171
.   : milestone, 17992,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.133 ms [17.949 ms, 18.317 ms] -
appsec 18.661 ms [18.475 ms, 18.846 ms] 527.352 µs (2.9%)
code_origins 18.012 ms [17.837 ms, 18.188 ms] -120.782 µs (-0.7%)
iast 17.759 ms [17.581 ms, 17.937 ms] -373.734 µs (-2.1%)
profiling 18.63 ms [18.447 ms, 18.813 ms] 497.05 µs (2.7%)
tracing 17.93 ms [17.754 ms, 18.107 ms] -202.881 µs (-1.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.126 ms [17.943 ms, 18.309 ms] -
appsec 18.74 ms [18.552 ms, 18.929 ms] 614.153 µs (3.4%)
code_origins 17.759 ms [17.585 ms, 17.933 ms] -366.967 µs (-2.0%)
iast 17.845 ms [17.668 ms, 18.022 ms] -281.439 µs (-1.6%)
profiling 18.448 ms [18.267 ms, 18.628 ms] 321.313 µs (1.8%)
tracing 17.992 ms [17.814 ms, 18.171 ms] -133.964 µs (-0.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master typo/ffe-reason-9-empty-allocs-default
git_commit_date 1776961796 1776981800
git_commit_sha 9aedff2 4104dc6
release_version 1.62.0-SNAPSHOT~9aedff24d2 1.62.0-SNAPSHOT~4104dc661a
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1776983763 1776983763
ci_job_id 1626536210 1626536210
ci_pipeline_id 109441943 109441943
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-1eyn0l99 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-1eyn0l99 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.457ms; -1.108ms] or [-38.100%; -28.974%]
2.541ms 3.823ms
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~4104dc661a, baseline=1.62.0-SNAPSHOT~9aedff24d2
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.06 s) : 15060000, 15060000
.   : milestone, 15060000,
appsec (14.838 s) : 14838000, 14838000
.   : milestone, 14838000,
iast (18.38 s) : 18380000, 18380000
.   : milestone, 18380000,
iast_GLOBAL (18.064 s) : 18064000, 18064000
.   : milestone, 18064000,
profiling (14.95 s) : 14950000, 14950000
.   : milestone, 14950000,
tracing (14.724 s) : 14724000, 14724000
.   : milestone, 14724000,
section candidate
no_agent (15.554 s) : 15554000, 15554000
.   : milestone, 15554000,
appsec (14.622 s) : 14622000, 14622000
.   : milestone, 14622000,
iast (18.528 s) : 18528000, 18528000
.   : milestone, 18528000,
iast_GLOBAL (18.152 s) : 18152000, 18152000
.   : milestone, 18152000,
profiling (15.057 s) : 15057000, 15057000
.   : milestone, 15057000,
tracing (14.977 s) : 14977000, 14977000
.   : milestone, 14977000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.06 s [15.06 s, 15.06 s] -
appsec 14.838 s [14.838 s, 14.838 s] -222.0 ms (-1.5%)
iast 18.38 s [18.38 s, 18.38 s] 3.32 s (22.0%)
iast_GLOBAL 18.064 s [18.064 s, 18.064 s] 3.004 s (19.9%)
profiling 14.95 s [14.95 s, 14.95 s] -110.0 ms (-0.7%)
tracing 14.724 s [14.724 s, 14.724 s] -336.0 ms (-2.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.554 s [15.554 s, 15.554 s] -
appsec 14.622 s [14.622 s, 14.622 s] -932.0 ms (-6.0%)
iast 18.528 s [18.528 s, 18.528 s] 2.974 s (19.1%)
iast_GLOBAL 18.152 s [18.152 s, 18.152 s] 2.598 s (16.7%)
profiling 15.057 s [15.057 s, 15.057 s] -497.0 ms (-3.2%)
tracing 14.977 s [14.977 s, 14.977 s] -577.0 ms (-3.7%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~4104dc661a, baseline=1.62.0-SNAPSHOT~9aedff24d2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1472, 1495
.   : milestone, 1483,
appsec (3.823 ms) : 3601, 4046
.   : milestone, 3823,
iast (2.275 ms) : 2205, 2345
.   : milestone, 2275,
iast_GLOBAL (2.315 ms) : 2245, 2385
.   : milestone, 2315,
profiling (2.099 ms) : 2044, 2155
.   : milestone, 2099,
tracing (2.078 ms) : 2024, 2132
.   : milestone, 2078,
section candidate
no_agent (1.484 ms) : 1472, 1496
.   : milestone, 1484,
appsec (2.541 ms) : 2486, 2596
.   : milestone, 2541,
iast (2.278 ms) : 2208, 2348
.   : milestone, 2278,
iast_GLOBAL (2.307 ms) : 2237, 2378
.   : milestone, 2307,
profiling (2.096 ms) : 2041, 2151
.   : milestone, 2096,
tracing (2.094 ms) : 2040, 2148
.   : milestone, 2094,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.472 ms, 1.495 ms] -
appsec 3.823 ms [3.601 ms, 4.046 ms] 2.34 ms (157.7%)
iast 2.275 ms [2.205 ms, 2.345 ms] 791.627 µs (53.4%)
iast_GLOBAL 2.315 ms [2.245 ms, 2.385 ms] 831.617 µs (56.1%)
profiling 2.099 ms [2.044 ms, 2.155 ms] 615.912 µs (41.5%)
tracing 2.078 ms [2.024 ms, 2.132 ms] 594.235 µs (40.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.484 ms [1.472 ms, 1.496 ms] -
appsec 2.541 ms [2.486 ms, 2.596 ms] 1.057 ms (71.2%)
iast 2.278 ms [2.208 ms, 2.348 ms] 794.273 µs (53.5%)
iast_GLOBAL 2.307 ms [2.237 ms, 2.378 ms] 823.443 µs (55.5%)
profiling 2.096 ms [2.041 ms, 2.151 ms] 612.009 µs (41.2%)
tracing 2.094 ms [2.04 ms, 2.148 ms] 610.049 µs (41.1%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant