Re-enable INTEGRATIONS_AWS and CROSSED_TRACING_LIBRARIES scenarios #10357

mcculls · 2026-01-13T11:49:30Z

Motivation

These system tests can now run on CI without requiring additional credentials

This leaves APM_TRACING_E2E_OTEL and APM_TRACING_E2E_SINGLE_SPAN excluded because they are still considered flaky. The PROFILING scenario will be re-enabled in a separate PR.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2026-01-13T12:35:46Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mcculls/enable-aws-scenarios
git_commit_date	1768321816	1768322276
git_commit_sha	`00258ad`	`4c389cd`
release_version	1.59.0-SNAPSHOT~00258ad3e1	1.59.0-SNAPSHOT~4c389cd268

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1768324288	1768324288
ci_job_id	1347030742	1347030742
ci_pipeline_id	90463089	90463089
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-5-uq9z7v81 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-5-uq9z7v81 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 9 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~4c389cd268, baseline=1.59.0-SNAPSHOT~00258ad3e1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.092 s) : 0, 1091660
Total [baseline] (10.862 s) : 0, 10861584
Agent [candidate] (1.087 s) : 0, 1087033
Total [candidate] (10.837 s) : 0, 10837241
section appsec
Agent [baseline] (1.267 s) : 0, 1266606
Total [baseline] (10.955 s) : 0, 10955267
Agent [candidate] (1.267 s) : 0, 1267301
Total [candidate] (11.009 s) : 0, 11008824
section iast
Agent [baseline] (1.241 s) : 0, 1241405
Total [baseline] (11.147 s) : 0, 11147153
Agent [candidate] (1.223 s) : 0, 1222652
Total [candidate] (11.176 s) : 0, 11175714
section profiling
Agent [baseline] (1.206 s) : 0, 1205598
Total [baseline] (10.916 s) : 0, 10915537
Agent [candidate] (1.204 s) : 0, 1203873
Total [candidate] (10.857 s) : 0, 10857135

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.092 s	-
Agent	appsec	1.267 s	174.946 ms (16.0%)
Agent	iast	1.241 s	149.745 ms (13.7%)
Agent	profiling	1.206 s	113.938 ms (10.4%)
Total	tracing	10.862 s	-
Total	appsec	10.955 s	93.683 ms (0.9%)
Total	iast	11.147 s	285.569 ms (2.6%)
Total	profiling	10.916 s	53.953 ms (0.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.087 s	-
Agent	appsec	1.267 s	180.268 ms (16.6%)
Agent	iast	1.223 s	135.619 ms (12.5%)
Agent	profiling	1.204 s	116.839 ms (10.7%)
Total	tracing	10.837 s	-
Total	appsec	11.009 s	171.583 ms (1.6%)
Total	iast	11.176 s	338.473 ms (3.1%)
Total	profiling	10.857 s	19.894 ms (0.2%)

gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~4c389cd268, baseline=1.59.0-SNAPSHOT~00258ad3e1

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (655.299 ms) : 0, 655299
BytebuddyAgent [candidate] (652.848 ms) : 0, 652848
GlobalTracer [baseline] (284.24 ms) : 0, 284240
GlobalTracer [candidate] (283.382 ms) : 0, 283382
AppSec [baseline] (32.86 ms) : 0, 32860
AppSec [candidate] (32.705 ms) : 0, 32705
Debugger [baseline] (68.621 ms) : 0, 68621
Debugger [candidate] (67.854 ms) : 0, 67854
Remote Config [baseline] (648.092 µs) : 0, 648
Remote Config [candidate] (642.583 µs) : 0, 643
Telemetry [baseline] (9.102 ms) : 0, 9102
Telemetry [candidate] (9.004 ms) : 0, 9004
Flare Poller [baseline] (3.891 ms) : 0, 3891
Flare Poller [candidate] (3.775 ms) : 0, 3775
section appsec
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (691.908 ms) : 0, 691908
BytebuddyAgent [candidate] (692.744 ms) : 0, 692744
GlobalTracer [baseline] (258.575 ms) : 0, 258575
GlobalTracer [candidate] (259.149 ms) : 0, 259149
IAST [baseline] (24.665 ms) : 0, 24665
IAST [candidate] (24.548 ms) : 0, 24548
AppSec [baseline] (173.161 ms) : 0, 173161
AppSec [candidate] (172.798 ms) : 0, 172798
Debugger [baseline] (67.591 ms) : 0, 67591
Debugger [candidate] (67.565 ms) : 0, 67565
Remote Config [baseline] (793.679 µs) : 0, 794
Remote Config [candidate] (748.942 µs) : 0, 749
Telemetry [baseline] (9.38 ms) : 0, 9380
Telemetry [candidate] (9.303 ms) : 0, 9303
Flare Poller [baseline] (3.782 ms) : 0, 3782
Flare Poller [candidate] (3.761 ms) : 0, 3761
section iast
crashtracking [baseline] (1.214 ms) : 0, 1214
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (803.281 ms) : 0, 803281
BytebuddyAgent [candidate] (790.194 ms) : 0, 790194
GlobalTracer [baseline] (260.025 ms) : 0, 260025
GlobalTracer [candidate] (256.117 ms) : 0, 256117
IAST [baseline] (27.503 ms) : 0, 27503
IAST [candidate] (26.922 ms) : 0, 26922
AppSec [baseline] (34.163 ms) : 0, 34163
AppSec [candidate] (33.552 ms) : 0, 33552
Debugger [baseline] (66.695 ms) : 0, 66695
Debugger [candidate] (66.633 ms) : 0, 66633
Remote Config [baseline] (557.097 µs) : 0, 557
Remote Config [candidate] (593.914 µs) : 0, 594
Telemetry [baseline] (8.529 ms) : 0, 8529
Telemetry [candidate] (8.518 ms) : 0, 8518
Flare Poller [baseline] (3.559 ms) : 0, 3559
Flare Poller [candidate] (3.522 ms) : 0, 3522
section profiling
crashtracking [baseline] (1.215 ms) : 0, 1215
crashtracking [candidate] (1.208 ms) : 0, 1208
BytebuddyAgent [baseline] (702.464 ms) : 0, 702464
BytebuddyAgent [candidate] (700.459 ms) : 0, 700459
GlobalTracer [baseline] (221.483 ms) : 0, 221483
GlobalTracer [candidate] (220.676 ms) : 0, 220676
AppSec [baseline] (32.131 ms) : 0, 32131
AppSec [candidate] (31.985 ms) : 0, 31985
Debugger [baseline] (67.863 ms) : 0, 67863
Debugger [candidate] (68.997 ms) : 0, 68997
Remote Config [baseline] (646.684 µs) : 0, 647
Remote Config [candidate] (626.725 µs) : 0, 627
Telemetry [baseline] (8.896 ms) : 0, 8896
Telemetry [candidate] (8.999 ms) : 0, 8999
Flare Poller [baseline] (3.754 ms) : 0, 3754
Flare Poller [candidate] (3.761 ms) : 0, 3761
ProfilingAgent [baseline] (97.25 ms) : 0, 97250
ProfilingAgent [candidate] (97.314 ms) : 0, 97314
Profiling [baseline] (97.834 ms) : 0, 97834
Profiling [candidate] (97.892 ms) : 0, 97892

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~4c389cd268, baseline=1.59.0-SNAPSHOT~00258ad3e1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.094 s) : 0, 1094040
Total [baseline] (8.761 s) : 0, 8760643
Agent [candidate] (1.084 s) : 0, 1083889
Total [candidate] (8.776 s) : 0, 8775798
section iast
Agent [baseline] (1.228 s) : 0, 1227928
Total [baseline] (9.344 s) : 0, 9344302
Agent [candidate] (1.222 s) : 0, 1221743
Total [candidate] (9.331 s) : 0, 9330848

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.094 s	-
Agent	iast	1.228 s	133.888 ms (12.2%)
Total	tracing	8.761 s	-
Total	iast	9.344 s	583.66 ms (6.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.084 s	-
Agent	iast	1.222 s	137.853 ms (12.7%)
Total	tracing	8.776 s	-
Total	iast	9.331 s	555.05 ms (6.3%)

gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~4c389cd268, baseline=1.59.0-SNAPSHOT~00258ad3e1

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (656.984 ms) : 0, 656984
BytebuddyAgent [candidate] (650.738 ms) : 0, 650738
GlobalTracer [baseline] (286.254 ms) : 0, 286254
GlobalTracer [candidate] (283.106 ms) : 0, 283106
AppSec [baseline] (33.049 ms) : 0, 33049
AppSec [candidate] (32.544 ms) : 0, 32544
Debugger [baseline] (67.276 ms) : 0, 67276
Debugger [candidate] (67.29 ms) : 0, 67290
Remote Config [baseline] (621.36 µs) : 0, 621
Remote Config [candidate] (622.127 µs) : 0, 622
Telemetry [baseline] (9.152 ms) : 0, 9152
Telemetry [candidate] (8.922 ms) : 0, 8922
Flare Poller [baseline] (3.802 ms) : 0, 3802
Flare Poller [candidate] (3.801 ms) : 0, 3801
section iast
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.172 ms) : 0, 1172
BytebuddyAgent [baseline] (793.062 ms) : 0, 793062
BytebuddyAgent [candidate] (789.801 ms) : 0, 789801
GlobalTracer [baseline] (258.332 ms) : 0, 258332
GlobalTracer [candidate] (256.566 ms) : 0, 256566
IAST [baseline] (27.178 ms) : 0, 27178
IAST [candidate] (26.909 ms) : 0, 26909
AppSec [baseline] (34.54 ms) : 0, 34540
AppSec [candidate] (34.645 ms) : 0, 34645
Debugger [baseline] (65.235 ms) : 0, 65235
Debugger [candidate] (64.616 ms) : 0, 64616
Remote Config [baseline] (592.07 µs) : 0, 592
Remote Config [candidate] (584.635 µs) : 0, 585
Telemetry [baseline] (8.571 ms) : 0, 8571
Telemetry [candidate] (8.455 ms) : 0, 8455
Flare Poller [baseline] (3.601 ms) : 0, 3601
Flare Poller [candidate] (3.608 ms) : 0, 3608

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mcculls/enable-aws-scenarios
git_commit_date	1768321816	1768322276
git_commit_sha	`00258ad`	`4c389cd`
release_version	1.59.0-SNAPSHOT~00258ad3e1	1.59.0-SNAPSHOT~4c389cd268

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1768324682	1768324682
ci_job_id	1347030743	1347030743
ci_pipeline_id	90463089	90463089
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-6-bntlylm4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-6-bntlylm4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 1 performance regressions! Performance is the same for 12 metrics, 19 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:petclinic:iast:high_load	better [-1.512ms; -0.663ms] or [-8.246%; -3.617%]	better [-2.137ms; -0.668ms] or [-7.145%; -2.231%]	unstable [-14.974op/s; +42.036op/s] or [-5.973%; +16.768%]	17.254ms	28.511ms	264.219op/s	18.341ms	29.913ms	250.688op/s
scenario:load:petclinic:no_agent:high_load	worse [+0.883ms; +2.433ms] or [+5.253%; +14.473%]	unstable [+0.428ms; +3.811ms] or [+1.501%; +13.368%]	unstable [-55.051op/s; +4.489op/s] or [-20.298%; +1.655%]	18.469ms	30.629ms	245.938op/s	16.811ms	28.510ms	271.219op/s
scenario:load:petclinic:profiling:high_load	better [-2.575ms; -2.099ms] or [-12.611%; -10.277%]	better [-3.413ms; -2.249ms] or [-10.568%; -6.965%]	unstable [+1.002op/s; +53.561op/s] or [+0.442%; +23.611%]	18.084ms	29.462ms	254.125op/s	20.421ms	32.293ms	226.844op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~4c389cd268, baseline=1.59.0-SNAPSHOT~00258ad3e1
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.203 ms) : 17033, 17373
.   : milestone, 17203,
appsec (18.755 ms) : 18566, 18944
.   : milestone, 18755,
code_origins (17.788 ms) : 17608, 17968
.   : milestone, 17788,
iast (18.616 ms) : 18429, 18803
.   : milestone, 18616,
profiling (20.588 ms) : 20383, 20794
.   : milestone, 20588,
tracing (17.493 ms) : 17318, 17668
.   : milestone, 17493,
section candidate
no_agent (18.979 ms) : 18783, 19174
.   : milestone, 18979,
appsec (18.274 ms) : 18091, 18458
.   : milestone, 18274,
code_origins (17.672 ms) : 17496, 17849
.   : milestone, 17672,
iast (17.665 ms) : 17491, 17839
.   : milestone, 17665,
profiling (18.361 ms) : 18178, 18543
.   : milestone, 18361,
tracing (17.57 ms) : 17397, 17744
.   : milestone, 17570,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.203 ms [17.033 ms, 17.373 ms]	-
appsec	18.755 ms [18.566 ms, 18.944 ms]	1.552 ms (9.0%)
code_origins	17.788 ms [17.608 ms, 17.968 ms]	585.065 µs (3.4%)
iast	18.616 ms [18.429 ms, 18.803 ms]	1.413 ms (8.2%)
profiling	20.588 ms [20.383 ms, 20.794 ms]	3.385 ms (19.7%)
tracing	17.493 ms [17.318 ms, 17.668 ms]	289.908 µs (1.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.979 ms [18.783 ms, 19.174 ms]	-
appsec	18.274 ms [18.091 ms, 18.458 ms]	-704.289 µs (-3.7%)
code_origins	17.672 ms [17.496 ms, 17.849 ms]	-1.306 ms (-6.9%)
iast	17.665 ms [17.491 ms, 17.839 ms]	-1.313 ms (-6.9%)
profiling	18.361 ms [18.178 ms, 18.543 ms]	-617.852 µs (-3.3%)
tracing	17.57 ms [17.397 ms, 17.744 ms]	-1.408 ms (-7.4%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~4c389cd268, baseline=1.59.0-SNAPSHOT~00258ad3e1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.194 ms) : 1183, 1206
.   : milestone, 1194,
iast (3.179 ms) : 3137, 3220
.   : milestone, 3179,
iast_FULL (5.72 ms) : 5664, 5777
.   : milestone, 5720,
iast_GLOBAL (3.631 ms) : 3575, 3687
.   : milestone, 3631,
profiling (1.916 ms) : 1900, 1931
.   : milestone, 1916,
tracing (1.82 ms) : 1803, 1837
.   : milestone, 1820,
section candidate
no_agent (1.193 ms) : 1181, 1205
.   : milestone, 1193,
iast (3.153 ms) : 3112, 3193
.   : milestone, 3153,
iast_FULL (5.934 ms) : 5874, 5995
.   : milestone, 5934,
iast_GLOBAL (3.593 ms) : 3533, 3652
.   : milestone, 3593,
profiling (1.93 ms) : 1915, 1946
.   : milestone, 1930,
tracing (1.78 ms) : 1764, 1796
.   : milestone, 1780,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.194 ms [1.183 ms, 1.206 ms]	-
iast	3.179 ms [3.137 ms, 3.22 ms]	1.984 ms (166.2%)
iast_FULL	5.72 ms [5.664 ms, 5.777 ms]	4.526 ms (379.0%)
iast_GLOBAL	3.631 ms [3.575 ms, 3.687 ms]	2.436 ms (204.0%)
profiling	1.916 ms [1.9 ms, 1.931 ms]	721.338 µs (60.4%)
tracing	1.82 ms [1.803 ms, 1.837 ms]	626.084 µs (52.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.193 ms [1.181 ms, 1.205 ms]	-
iast	3.153 ms [3.112 ms, 3.193 ms]	1.96 ms (164.3%)
iast_FULL	5.934 ms [5.874 ms, 5.995 ms]	4.741 ms (397.5%)
iast_GLOBAL	3.593 ms [3.533 ms, 3.652 ms]	2.4 ms (201.2%)
profiling	1.93 ms [1.915 ms, 1.946 ms]	737.219 µs (61.8%)
tracing	1.78 ms [1.764 ms, 1.796 ms]	587.006 µs (49.2%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mcculls/enable-aws-scenarios
git_commit_date	1768321816	1768322276
git_commit_sha	`00258ad`	`4c389cd`
release_version	1.59.0-SNAPSHOT~00258ad3e1	1.59.0-SNAPSHOT~4c389cd268

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1768324387	1768324387
ci_job_id	1347030744	1347030744
ci_pipeline_id	90463089	90463089
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-7-a4f8ceab 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-7-a4f8ceab 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~4c389cd268, baseline=1.59.0-SNAPSHOT~00258ad3e1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1471, 1494
.   : milestone, 1482,
appsec (2.467 ms) : 2414, 2519
.   : milestone, 2467,
iast (2.237 ms) : 2171, 2302
.   : milestone, 2237,
iast_GLOBAL (2.28 ms) : 2214, 2347
.   : milestone, 2280,
profiling (2.078 ms) : 2025, 2132
.   : milestone, 2078,
tracing (2.048 ms) : 1997, 2099
.   : milestone, 2048,
section candidate
no_agent (1.481 ms) : 1470, 1493
.   : milestone, 1481,
appsec (3.756 ms) : 3534, 3978
.   : milestone, 3756,
iast (2.231 ms) : 2166, 2297
.   : milestone, 2231,
iast_GLOBAL (2.281 ms) : 2215, 2347
.   : milestone, 2281,
profiling (2.085 ms) : 2032, 2138
.   : milestone, 2085,
tracing (2.044 ms) : 1993, 2095
.   : milestone, 2044,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.482 ms [1.471 ms, 1.494 ms]	-
appsec	2.467 ms [2.414 ms, 2.519 ms]	984.569 µs (66.4%)
iast	2.237 ms [2.171 ms, 2.302 ms]	754.571 µs (50.9%)
iast_GLOBAL	2.28 ms [2.214 ms, 2.347 ms]	798.202 µs (53.9%)
profiling	2.078 ms [2.025 ms, 2.132 ms]	596.305 µs (40.2%)
tracing	2.048 ms [1.997 ms, 2.099 ms]	566.035 µs (38.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.481 ms [1.47 ms, 1.493 ms]	-
appsec	3.756 ms [3.534 ms, 3.978 ms]	2.275 ms (153.5%)
iast	2.231 ms [2.166 ms, 2.297 ms]	749.94 µs (50.6%)
iast_GLOBAL	2.281 ms [2.215 ms, 2.347 ms]	799.611 µs (54.0%)
profiling	2.085 ms [2.032 ms, 2.138 ms]	603.519 µs (40.7%)
tracing	2.044 ms [1.993 ms, 2.095 ms]	562.172 µs (37.9%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~4c389cd268, baseline=1.59.0-SNAPSHOT~00258ad3e1
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.454 s) : 15454000, 15454000
.   : milestone, 15454000,
appsec (14.724 s) : 14724000, 14724000
.   : milestone, 14724000,
iast (18.384 s) : 18384000, 18384000
.   : milestone, 18384000,
iast_GLOBAL (17.873 s) : 17873000, 17873000
.   : milestone, 17873000,
profiling (14.951 s) : 14951000, 14951000
.   : milestone, 14951000,
tracing (14.689 s) : 14689000, 14689000
.   : milestone, 14689000,
section candidate
no_agent (15.561 s) : 15561000, 15561000
.   : milestone, 15561000,
appsec (14.751 s) : 14751000, 14751000
.   : milestone, 14751000,
iast (18.727 s) : 18727000, 18727000
.   : milestone, 18727000,
iast_GLOBAL (17.642 s) : 17642000, 17642000
.   : milestone, 17642000,
profiling (15.54 s) : 15540000, 15540000
.   : milestone, 15540000,
tracing (14.594 s) : 14594000, 14594000
.   : milestone, 14594000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.454 s [15.454 s, 15.454 s]	-
appsec	14.724 s [14.724 s, 14.724 s]	-730.0 ms (-4.7%)
iast	18.384 s [18.384 s, 18.384 s]	2.93 s (19.0%)
iast_GLOBAL	17.873 s [17.873 s, 17.873 s]	2.419 s (15.7%)
profiling	14.951 s [14.951 s, 14.951 s]	-503.0 ms (-3.3%)
tracing	14.689 s [14.689 s, 14.689 s]	-765.0 ms (-5.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.561 s [15.561 s, 15.561 s]	-
appsec	14.751 s [14.751 s, 14.751 s]	-810.0 ms (-5.2%)
iast	18.727 s [18.727 s, 18.727 s]	3.166 s (20.3%)
iast_GLOBAL	17.642 s [17.642 s, 17.642 s]	2.081 s (13.4%)
profiling	15.54 s [15.54 s, 15.54 s]	-21.0 ms (-0.1%)
tracing	14.594 s [14.594 s, 14.594 s]	-967.0 ms (-6.2%)

mcculls added comp: testing Testing tag: no release notes Changes to exclude from release notes type: refactoring labels Jan 13, 2026

Re-enable INTEGRATIONS_AWS and CROSSED_TRACING_LIBRARIES scenarios

4c389cd

mcculls force-pushed the mcculls/enable-aws-scenarios branch from f903457 to 4c389cd Compare January 13, 2026 16:38

mcculls marked this pull request as ready for review January 13, 2026 16:39

mcculls requested a review from a team as a code owner January 13, 2026 16:39

mcculls requested review from AlexeyKuznetsov-DD and removed request for a team January 13, 2026 16:39

AlexeyKuznetsov-DD approved these changes Jan 13, 2026

View reviewed changes

mcculls merged commit ef66e51 into master Jan 13, 2026
550 of 569 checks passed

mcculls deleted the mcculls/enable-aws-scenarios branch January 13, 2026 18:11

github-actions bot added this to the 1.59.0 milestone Jan 13, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Re-enable INTEGRATIONS_AWS and CROSSED_TRACING_LIBRARIES scenarios #10357

Re-enable INTEGRATIONS_AWS and CROSSED_TRACING_LIBRARIES scenarios #10357

mcculls commented Jan 13, 2026 •

edited

Loading

Uh oh!

pr-commenter bot commented Jan 13, 2026 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Re-enable INTEGRATIONS_AWS and CROSSED_TRACING_LIBRARIES scenarios #10357

Re-enable INTEGRATIONS_AWS and CROSSED_TRACING_LIBRARIES scenarios #10357

Conversation

mcculls commented Jan 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Motivation

Contributor Checklist

Uh oh!

pr-commenter bot commented Jan 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

mcculls commented Jan 13, 2026 •

edited

Loading

pr-commenter bot commented Jan 13, 2026 •

edited

Loading