Fix FFE evaluation reason logic: SPLIT precedence, DEFAULT for waterfall catch-all, ADR-003 date window by typotter · Pull Request #11194 · DataDog/dd-trace-java

typotter · 2026-04-23T22:04:10Z

Summary

ADR-004 (REASON-17): When an allocation has both rules and shards, the old code returned TARGETING_MATCH. ADR-004 requires SPLIT to win when a shard contributed to the result. The new resolveReason method checks rules+shards together first and returns SPLIT.
Group A (REASON-14, 16, 18, 20, 24, 26): Multi-allocation waterfall catch-all allocations (no rules, no shards, index > 0) returned STATIC. RFC says catch-all allocations in a waterfall must return DEFAULT. Fix: STATIC is now returned only when the flag has exactly one allocation and no date-window constraints.
ADR-003 (REASON-21, 23): Allocations with startAt/endAt but no rules returned STATIC. ADR-003 says time-gated results are not permanently stable, so STATIC is inappropriate — DEFAULT must be returned instead. Fix: hasDateWindow check precludes STATIC in the sole-allocation case.

The inline ternary in resolveVariant is replaced by a call to the new private static resolveReason(Allocation, Split, Flag) method.

Test plan

Run unit tests: ./gradlew :products:feature-flagging:feature-flagging-api:test
Verify REASON-14, 16, 17, 18, 20, 21, 23, 24, 26 scenario cases return the correct reason
Verify existing STATIC/TARGETING_MATCH/SPLIT cases are unaffected

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	typo/ffe-reason-evaluator-reason-logic
git_commit_date	1776961796	1776981805
git_commit_sha	`9aedff2`	`cd472e2`
release_version	1.62.0-SNAPSHOT~9aedff24d2	1.62.0-SNAPSHOT~cd472e2d81

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1776983611	1776983611
ci_job_id	1626536472	1626536472
ci_pipeline_id	109441948	109441948
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-tsemygdg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-tsemygdg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 11 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~cd472e2d81, baseline=1.62.0-SNAPSHOT~9aedff24d2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1057696
Total [baseline] (11.046 s) : 0, 11045971
Agent [candidate] (1.055 s) : 0, 1055496
Total [candidate] (11.053 s) : 0, 11052998
section appsec
Agent [baseline] (1.264 s) : 0, 1264296
Total [baseline] (11.121 s) : 0, 11120987
Agent [candidate] (1.26 s) : 0, 1259926
Total [candidate] (11.021 s) : 0, 11020927
section iast
Agent [baseline] (1.242 s) : 0, 1241743
Total [baseline] (11.339 s) : 0, 11339042
Agent [candidate] (1.243 s) : 0, 1243308
Total [candidate] (11.253 s) : 0, 11252869
section profiling
Agent [baseline] (1.194 s) : 0, 1193801
Total [baseline] (11.109 s) : 0, 11109391
Agent [candidate] (1.198 s) : 0, 1198010
Total [candidate] (10.998 s) : 0, 10997523

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.058 s	-
Agent	appsec	1.264 s	206.6 ms (19.5%)
Agent	iast	1.242 s	184.047 ms (17.4%)
Agent	profiling	1.194 s	136.105 ms (12.9%)
Total	tracing	11.046 s	-
Total	appsec	11.121 s	75.016 ms (0.7%)
Total	iast	11.339 s	293.072 ms (2.7%)
Total	profiling	11.109 s	63.42 ms (0.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.055 s	-
Agent	appsec	1.26 s	204.43 ms (19.4%)
Agent	iast	1.243 s	187.812 ms (17.8%)
Agent	profiling	1.198 s	142.514 ms (13.5%)
Total	tracing	11.053 s	-
Total	appsec	11.021 s	-32.071 ms (-0.3%)
Total	iast	11.253 s	199.871 ms (1.8%)
Total	profiling	10.998 s	-55.475 ms (-0.5%)

gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~cd472e2d81, baseline=1.62.0-SNAPSHOT~9aedff24d2

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.24 ms) : 0, 1240
crashtracking [candidate] (1.218 ms) : 0, 1218
BytebuddyAgent [baseline] (635.85 ms) : 0, 635850
BytebuddyAgent [candidate] (634.401 ms) : 0, 634401
AgentMeter [baseline] (29.347 ms) : 0, 29347
AgentMeter [candidate] (29.338 ms) : 0, 29338
GlobalTracer [baseline] (249.25 ms) : 0, 249250
GlobalTracer [candidate] (248.728 ms) : 0, 248728
AppSec [baseline] (32.282 ms) : 0, 32282
AppSec [candidate] (32.289 ms) : 0, 32289
Debugger [baseline] (60.51 ms) : 0, 60510
Debugger [candidate] (60.501 ms) : 0, 60501
Remote Config [baseline] (610.323 µs) : 0, 610
Remote Config [candidate] (599.671 µs) : 0, 600
Telemetry [baseline] (8.012 ms) : 0, 8012
Telemetry [candidate] (8.04 ms) : 0, 8040
Flare Poller [baseline] (4.412 ms) : 0, 4412
Flare Poller [candidate] (4.35 ms) : 0, 4350
section appsec
crashtracking [baseline] (1.222 ms) : 0, 1222
crashtracking [candidate] (1.219 ms) : 0, 1219
BytebuddyAgent [baseline] (676.892 ms) : 0, 676892
BytebuddyAgent [candidate] (673.747 ms) : 0, 673747
AgentMeter [baseline] (12.261 ms) : 0, 12261
AgentMeter [candidate] (12.236 ms) : 0, 12236
GlobalTracer [baseline] (249.234 ms) : 0, 249234
GlobalTracer [candidate] (248.282 ms) : 0, 248282
IAST [baseline] (24.376 ms) : 0, 24376
IAST [candidate] (24.103 ms) : 0, 24103
AppSec [baseline] (186.089 ms) : 0, 186089
AppSec [candidate] (187.354 ms) : 0, 187354
Debugger [baseline] (65.986 ms) : 0, 65986
Debugger [candidate] (64.837 ms) : 0, 64837
Remote Config [baseline] (591.259 µs) : 0, 591
Remote Config [candidate] (568.061 µs) : 0, 568
Telemetry [baseline] (7.864 ms) : 0, 7864
Telemetry [candidate] (7.858 ms) : 0, 7858
Flare Poller [baseline] (3.422 ms) : 0, 3422
Flare Poller [candidate] (3.46 ms) : 0, 3460
section iast
crashtracking [baseline] (1.249 ms) : 0, 1249
crashtracking [candidate] (1.236 ms) : 0, 1236
BytebuddyAgent [baseline] (818.024 ms) : 0, 818024
BytebuddyAgent [candidate] (819.087 ms) : 0, 819087
AgentMeter [baseline] (11.518 ms) : 0, 11518
AgentMeter [candidate] (11.418 ms) : 0, 11418
GlobalTracer [baseline] (239.824 ms) : 0, 239824
GlobalTracer [candidate] (240.09 ms) : 0, 240090
IAST [baseline] (29.969 ms) : 0, 29969
IAST [candidate] (29.163 ms) : 0, 29163
AppSec [baseline] (27.636 ms) : 0, 27636
AppSec [candidate] (29.385 ms) : 0, 29385
Debugger [baseline] (65.564 ms) : 0, 65564
Debugger [candidate] (64.954 ms) : 0, 64954
Remote Config [baseline] (543.376 µs) : 0, 543
Remote Config [candidate] (534.975 µs) : 0, 535
Telemetry [baseline] (7.778 ms) : 0, 7778
Telemetry [candidate] (7.807 ms) : 0, 7807
Flare Poller [baseline] (3.45 ms) : 0, 3450
Flare Poller [candidate] (3.448 ms) : 0, 3448
section profiling
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (697.274 ms) : 0, 697274
BytebuddyAgent [candidate] (701.143 ms) : 0, 701143
AgentMeter [baseline] (9.017 ms) : 0, 9017
AgentMeter [candidate] (9.051 ms) : 0, 9051
GlobalTracer [baseline] (209.398 ms) : 0, 209398
GlobalTracer [candidate] (209.951 ms) : 0, 209951
AppSec [baseline] (32.825 ms) : 0, 32825
AppSec [candidate] (32.817 ms) : 0, 32817
Debugger [baseline] (66.009 ms) : 0, 66009
Debugger [candidate] (65.901 ms) : 0, 65901
Remote Config [baseline] (590.235 µs) : 0, 590
Remote Config [candidate] (595.591 µs) : 0, 596
Telemetry [baseline] (7.789 ms) : 0, 7789
Telemetry [candidate] (7.818 ms) : 0, 7818
Flare Poller [baseline] (3.527 ms) : 0, 3527
Flare Poller [candidate] (3.483 ms) : 0, 3483
ProfilingAgent [baseline] (94.027 ms) : 0, 94027
ProfilingAgent [candidate] (93.739 ms) : 0, 93739
Profiling [baseline] (94.595 ms) : 0, 94595
Profiling [candidate] (94.307 ms) : 0, 94307

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~cd472e2d81, baseline=1.62.0-SNAPSHOT~9aedff24d2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1062171
Total [baseline] (8.89 s) : 0, 8889993
Agent [candidate] (1.057 s) : 0, 1056709
Total [candidate] (8.845 s) : 0, 8844924
section iast
Agent [baseline] (1.233 s) : 0, 1233062
Total [baseline] (9.526 s) : 0, 9525655
Agent [candidate] (1.234 s) : 0, 1234189
Total [candidate] (9.507 s) : 0, 9507256

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.062 s	-
Agent	iast	1.233 s	170.891 ms (16.1%)
Total	tracing	8.89 s	-
Total	iast	9.526 s	635.661 ms (7.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.057 s	-
Agent	iast	1.234 s	177.479 ms (16.8%)
Total	tracing	8.845 s	-
Total	iast	9.507 s	662.332 ms (7.5%)

gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~cd472e2d81, baseline=1.62.0-SNAPSHOT~9aedff24d2

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.235 ms) : 0, 1235
crashtracking [candidate] (1.228 ms) : 0, 1228
BytebuddyAgent [baseline] (639.021 ms) : 0, 639021
BytebuddyAgent [candidate] (635.928 ms) : 0, 635928
AgentMeter [baseline] (29.603 ms) : 0, 29603
AgentMeter [candidate] (29.475 ms) : 0, 29475
GlobalTracer [baseline] (249.901 ms) : 0, 249901
GlobalTracer [candidate] (248.314 ms) : 0, 248314
AppSec [baseline] (32.49 ms) : 0, 32490
AppSec [candidate] (32.234 ms) : 0, 32234
Debugger [baseline] (59.902 ms) : 0, 59902
Debugger [candidate] (59.572 ms) : 0, 59572
Remote Config [baseline] (608.024 µs) : 0, 608
Remote Config [candidate] (620.435 µs) : 0, 620
Telemetry [baseline] (8.824 ms) : 0, 8824
Telemetry [candidate] (8.829 ms) : 0, 8829
Flare Poller [baseline] (4.313 ms) : 0, 4313
Flare Poller [candidate] (4.311 ms) : 0, 4311
section iast
crashtracking [baseline] (1.236 ms) : 0, 1236
crashtracking [candidate] (1.234 ms) : 0, 1234
BytebuddyAgent [baseline] (810.899 ms) : 0, 810899
BytebuddyAgent [candidate] (811.786 ms) : 0, 811786
AgentMeter [baseline] (11.367 ms) : 0, 11367
AgentMeter [candidate] (11.404 ms) : 0, 11404
GlobalTracer [baseline] (239.342 ms) : 0, 239342
GlobalTracer [candidate] (239.734 ms) : 0, 239734
IAST [baseline] (29.939 ms) : 0, 29939
IAST [candidate] (28.452 ms) : 0, 28452
AppSec [baseline] (26.626 ms) : 0, 26626
AppSec [candidate] (27.802 ms) : 0, 27802
Debugger [baseline] (65.819 ms) : 0, 65819
Debugger [candidate] (65.847 ms) : 0, 65847
Remote Config [baseline] (530.109 µs) : 0, 530
Remote Config [candidate] (531.19 µs) : 0, 531
Telemetry [baseline] (7.768 ms) : 0, 7768
Telemetry [candidate] (7.825 ms) : 0, 7825
Flare Poller [baseline] (3.494 ms) : 0, 3494
Flare Poller [candidate] (3.486 ms) : 0, 3486

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	typo/ffe-reason-evaluator-reason-logic
git_commit_date	1776961796	1776981805
git_commit_sha	`9aedff2`	`cd472e2`
release_version	1.62.0-SNAPSHOT~9aedff24d2	1.62.0-SNAPSHOT~cd472e2d81

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1776984088	1776984088
ci_job_id	1626536474	1626536474
ci_pipeline_id	109441948	109441948
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-y7o16evf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-y7o16evf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 3 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	worse [+85.037µs; +183.358µs] or [+2.951%; +6.363%]	same [-192.169µs; +513.236µs] or [-2.361%; +6.304%]	unstable [-191.362op/s; +88.237op/s] or [-15.228%; +7.022%]	3.016ms	8.302ms	1205.062op/s	2.882ms	8.141ms	1256.625op/s
scenario:load:insecure-bank:iast_FULL:high_load	better [-521.673µs; -223.314µs] or [-9.414%; -4.030%]	better [-1.766ms; -0.459ms] or [-13.509%; -3.514%]	unstable [-78.902op/s; +111.663op/s] or [-10.570%; +14.960%]	5.169ms	11.962ms	762.818op/s	5.542ms	13.075ms	746.438op/s
scenario:load:petclinic:appsec:high_load	worse [+527.603µs; +887.265µs] or [+2.906%; +4.887%]	same [-35.251µs; +1147.378µs] or [-0.120%; +3.900%]	unstable [-33.712op/s; +16.462op/s] or [-13.365%; +6.526%]	18.862ms	29.973ms	243.625op/s	18.155ms	29.417ms	252.250op/s
scenario:load:petclinic:tracing:high_load	better [-878.061µs; -391.394µs] or [-4.892%; -2.181%]	same [-930.651µs; +477.815µs] or [-3.219%; +1.652%]	unstable [-20.406op/s; +32.531op/s] or [-7.965%; +12.698%]	17.314ms	28.689ms	262.250op/s	17.949ms	28.915ms	256.188op/s
scenario:load:petclinic:no_agent:high_load	worse [+1.715ms; +2.955ms] or [+10.440%; +17.991%]	unstable [+1.837ms; +5.023ms] or [+6.610%; +18.077%]	unstable [-63.232op/s; -7.643op/s] or [-22.908%; -2.769%]	18.761ms	31.215ms	240.594op/s	16.426ms	27.786ms	276.031op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~cd472e2d81, baseline=1.62.0-SNAPSHOT~9aedff24d2
    dateFormat X
    axisFormat %s
section baseline
no_agent (16.9 ms) : 16735, 17066
.   : milestone, 16900,
appsec (18.498 ms) : 18314, 18681
.   : milestone, 18498,
code_origins (18.105 ms) : 17926, 18284
.   : milestone, 18105,
iast (17.908 ms) : 17729, 18086
.   : milestone, 17908,
profiling (18.28 ms) : 18099, 18460
.   : milestone, 18280,
tracing (18.213 ms) : 18034, 18392
.   : milestone, 18213,
section candidate
no_agent (19.396 ms) : 19196, 19597
.   : milestone, 19396,
appsec (19.161 ms) : 18972, 19350
.   : milestone, 19161,
code_origins (18.11 ms) : 17932, 18287
.   : milestone, 18110,
iast (17.952 ms) : 17770, 18134
.   : milestone, 17952,
profiling (18.138 ms) : 17958, 18317
.   : milestone, 18138,
tracing (17.793 ms) : 17619, 17966
.   : milestone, 17793,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	16.9 ms [16.735 ms, 17.066 ms]	-
appsec	18.498 ms [18.314 ms, 18.681 ms]	1.597 ms (9.5%)
code_origins	18.105 ms [17.926 ms, 18.284 ms]	1.205 ms (7.1%)
iast	17.908 ms [17.729 ms, 18.086 ms]	1.007 ms (6.0%)
profiling	18.28 ms [18.099 ms, 18.46 ms]	1.379 ms (8.2%)
tracing	18.213 ms [18.034 ms, 18.392 ms]	1.313 ms (7.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.396 ms [19.196 ms, 19.597 ms]	-
appsec	19.161 ms [18.972 ms, 19.35 ms]	-235.389 µs (-1.2%)
code_origins	18.11 ms [17.932 ms, 18.287 ms]	-1.286 ms (-6.6%)
iast	17.952 ms [17.77 ms, 18.134 ms]	-1.444 ms (-7.4%)
profiling	18.138 ms [17.958 ms, 18.317 ms]	-1.258 ms (-6.5%)
tracing	17.793 ms [17.619 ms, 17.966 ms]	-1.604 ms (-8.3%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~cd472e2d81, baseline=1.62.0-SNAPSHOT~9aedff24d2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.259 ms) : 1247, 1271
.   : milestone, 1259,
iast (3.207 ms) : 3164, 3251
.   : milestone, 3207,
iast_FULL (6.199 ms) : 6135, 6263
.   : milestone, 6199,
iast_GLOBAL (3.648 ms) : 3589, 3708
.   : milestone, 3648,
profiling (2.139 ms) : 2119, 2159
.   : milestone, 2139,
tracing (1.917 ms) : 1902, 1933
.   : milestone, 1917,
section candidate
no_agent (1.247 ms) : 1235, 1259
.   : milestone, 1247,
iast (3.377 ms) : 3329, 3425
.   : milestone, 3377,
iast_FULL (5.876 ms) : 5818, 5935
.   : milestone, 5876,
iast_GLOBAL (3.808 ms) : 3744, 3872
.   : milestone, 3808,
profiling (2.331 ms) : 2308, 2355
.   : milestone, 2331,
tracing (1.859 ms) : 1844, 1874
.   : milestone, 1859,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.259 ms [1.247 ms, 1.271 ms]	-
iast	3.207 ms [3.164 ms, 3.251 ms]	1.949 ms (154.8%)
iast_FULL	6.199 ms [6.135 ms, 6.263 ms]	4.94 ms (392.5%)
iast_GLOBAL	3.648 ms [3.589 ms, 3.708 ms]	2.39 ms (189.8%)
profiling	2.139 ms [2.119 ms, 2.159 ms]	880.106 µs (69.9%)
tracing	1.917 ms [1.902 ms, 1.933 ms]	658.659 µs (52.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.247 ms [1.235 ms, 1.259 ms]	-
iast	3.377 ms [3.329 ms, 3.425 ms]	2.13 ms (170.8%)
iast_FULL	5.876 ms [5.818 ms, 5.935 ms]	4.629 ms (371.3%)
iast_GLOBAL	3.808 ms [3.744 ms, 3.872 ms]	2.561 ms (205.4%)
profiling	2.331 ms [2.308 ms, 2.355 ms]	1.084 ms (86.9%)
tracing	1.859 ms [1.844 ms, 1.874 ms]	612.347 µs (49.1%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	typo/ffe-reason-evaluator-reason-logic
git_commit_date	1776961796	1776981805
git_commit_sha	`9aedff2`	`cd472e2`
release_version	1.62.0-SNAPSHOT~9aedff24d2	1.62.0-SNAPSHOT~cd472e2d81

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1776983850	1776983850
ci_job_id	1626536476	1626536476
ci_pipeline_id	109441948	109441948
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-a608t3t3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-a608t3t3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:dacapo:tomcat:appsec	better [-1.505ms; -1.155ms] or [-38.876%; -29.842%]	2.541ms	3.872ms

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~cd472e2d81, baseline=1.62.0-SNAPSHOT~9aedff24d2
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.497 s) : 15497000, 15497000
.   : milestone, 15497000,
appsec (14.749 s) : 14749000, 14749000
.   : milestone, 14749000,
iast (18.215 s) : 18215000, 18215000
.   : milestone, 18215000,
iast_GLOBAL (18.002 s) : 18002000, 18002000
.   : milestone, 18002000,
profiling (14.977 s) : 14977000, 14977000
.   : milestone, 14977000,
tracing (15.092 s) : 15092000, 15092000
.   : milestone, 15092000,
section candidate
no_agent (15.612 s) : 15612000, 15612000
.   : milestone, 15612000,
appsec (14.979 s) : 14979000, 14979000
.   : milestone, 14979000,
iast (18.97 s) : 18970000, 18970000
.   : milestone, 18970000,
iast_GLOBAL (17.96 s) : 17960000, 17960000
.   : milestone, 17960000,
profiling (14.827 s) : 14827000, 14827000
.   : milestone, 14827000,
tracing (15.023 s) : 15023000, 15023000
.   : milestone, 15023000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.497 s [15.497 s, 15.497 s]	-
appsec	14.749 s [14.749 s, 14.749 s]	-748.0 ms (-4.8%)
iast	18.215 s [18.215 s, 18.215 s]	2.718 s (17.5%)
iast_GLOBAL	18.002 s [18.002 s, 18.002 s]	2.505 s (16.2%)
profiling	14.977 s [14.977 s, 14.977 s]	-520.0 ms (-3.4%)
tracing	15.092 s [15.092 s, 15.092 s]	-405.0 ms (-2.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.612 s [15.612 s, 15.612 s]	-
appsec	14.979 s [14.979 s, 14.979 s]	-633.0 ms (-4.1%)
iast	18.97 s [18.97 s, 18.97 s]	3.358 s (21.5%)
iast_GLOBAL	17.96 s [17.96 s, 17.96 s]	2.348 s (15.0%)
profiling	14.827 s [14.827 s, 14.827 s]	-785.0 ms (-5.0%)
tracing	15.023 s [15.023 s, 15.023 s]	-589.0 ms (-3.8%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~cd472e2d81, baseline=1.62.0-SNAPSHOT~9aedff24d2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.494 ms) : 1482, 1505
.   : milestone, 1494,
appsec (3.872 ms) : 3649, 4095
.   : milestone, 3872,
iast (2.299 ms) : 2229, 2370
.   : milestone, 2299,
iast_GLOBAL (2.324 ms) : 2253, 2394
.   : milestone, 2324,
profiling (2.121 ms) : 2065, 2177
.   : milestone, 2121,
tracing (2.093 ms) : 2038, 2148
.   : milestone, 2093,
section candidate
no_agent (1.49 ms) : 1478, 1502
.   : milestone, 1490,
appsec (2.541 ms) : 2486, 2597
.   : milestone, 2541,
iast (2.286 ms) : 2216, 2357
.   : milestone, 2286,
iast_GLOBAL (2.33 ms) : 2259, 2401
.   : milestone, 2330,
profiling (2.102 ms) : 2047, 2158
.   : milestone, 2102,
tracing (2.082 ms) : 2028, 2136
.   : milestone, 2082,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.494 ms [1.482 ms, 1.505 ms]	-
appsec	3.872 ms [3.649 ms, 4.095 ms]	2.378 ms (159.2%)
iast	2.299 ms [2.229 ms, 2.37 ms]	805.855 µs (54.0%)
iast_GLOBAL	2.324 ms [2.253 ms, 2.394 ms]	830.012 µs (55.6%)
profiling	2.121 ms [2.065 ms, 2.177 ms]	627.606 µs (42.0%)
tracing	2.093 ms [2.038 ms, 2.148 ms]	599.354 µs (40.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.49 ms [1.478 ms, 1.502 ms]	-
appsec	2.541 ms [2.486 ms, 2.597 ms]	1.052 ms (70.6%)
iast	2.286 ms [2.216 ms, 2.357 ms]	796.415 µs (53.5%)
iast_GLOBAL	2.33 ms [2.259 ms, 2.401 ms]	840.149 µs (56.4%)
profiling	2.102 ms [2.047 ms, 2.158 ms]	612.354 µs (41.1%)
tracing	2.082 ms [2.028 ms, 2.136 ms]	592.511 µs (39.8%)

Fix evaluation reason logic: SPLIT precedence (ADR-004), DEFAULT for …

cd472e2

…catch-all allocs, date window precludes STATIC (ADR-003)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fix FFE evaluation reason logic: SPLIT precedence, DEFAULT for waterfall catch-all, ADR-003 date window#11194

Fix FFE evaluation reason logic: SPLIT precedence, DEFAULT for waterfall catch-all, ADR-003 date window#11194
typotter wants to merge 1 commit intomasterfrom
typo/ffe-reason-evaluator-reason-logic

typotter commented Apr 23, 2026

Uh oh!

pr-commenter Bot commented Apr 23, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

typotter commented Apr 23, 2026

Summary

Test plan

Tags

Uh oh!

pr-commenter Bot commented Apr 23, 2026

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant