Skip to content

[TEST] Check if test is running in CI #10072

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 3 commits into
base: master
Choose a base branch
from
Draft

[TEST] Check if test is running in CI #10072

wants to merge 3 commits into from
+20 −16

Conversation

@sarahchen6
Copy link
Contributor

@sarahchen6 sarahchen6 commented Dec 3, 2025 •
edited
Loading

What Does This Do

Make the test plain request is traced test fail

Motivation

Check if the test plain request is traced test fails on CI. It fails locally with ./gradlew :dd-java-agent:instrumentation:synapse-3.0:test --tests "datadog.trace.instrumentation.synapse3.SynapseTest.test plain request is traced", but according to this dashboard, it hasn't run on CI at all since Nov 12th.

Additional Notes

After running flaky tests on this PR and analyzing the artifacts, I see that the test plain request is traced test does not in fact run on CI. This is because the SynapseForkedTests first fail with an initializationError, so it never gets to the remaining tests. We can see from the following screenshots that the test plain request is traced test runs stop after the initializationErrors begin, and the failure rate for this test has been 100% since the first failure was documented.

image image image

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@pr-commenter
Copy link

pr-commenter bot commented Dec 3, 2025 •
edited
Loading

Benchmarks

⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/is-test-running
git_commit_date 1764857220 1764857749
git_commit_sha 29408ce 318c9ba
release_version 1.57.0-SNAPSHOT~29408ce141 1.57.0-SNAPSHOT~318c9ba1eb
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1764859877 1764859877
ci_job_id 1270274084 1270274084
ci_pipeline_id 84888606 84888606
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-if6nn13d 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-if6nn13d 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 4 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 9 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Telemetry better
[-1132.045µs; -563.150µs] or [-12.823%; -6.379%]		 7.980ms 8.828ms
scenario:startup:insecure-bank:tracing:Flare Poller better
[-329.828µs; -139.919µs] or [-7.702%; -3.267%]		 4.048ms 4.282ms
scenario:startup:petclinic:appsec:Telemetry better
[-815.359µs; -512.026µs] or [-9.320%; -5.853%]		 8.085ms 8.749ms
scenario:startup:petclinic:iast:Telemetry better
[-1066.685µs; -492.307µs] or [-12.114%; -5.591%]		 8.026ms 8.806ms
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~318c9ba1eb, baseline=1.57.0-SNAPSHOT~29408ce141

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1055113
Total [baseline] (10.946 s) : 0, 10945768
Agent [candidate] (1.049 s) : 0, 1049265
Total [candidate] (10.786 s) : 0, 10785816
section appsec
Agent [baseline] (1.227 s) : 0, 1226711
Total [baseline] (10.892 s) : 0, 10892001
Agent [candidate] (1.226 s) : 0, 1226462
Total [candidate] (10.826 s) : 0, 10825596
section iast
Agent [baseline] (1.194 s) : 0, 1193516
Total [baseline] (11.184 s) : 0, 11183650
Agent [candidate] (1.2 s) : 0, 1200277
Total [candidate] (11.192 s) : 0, 11191860
section profiling
Agent [baseline] (1.198 s) : 0, 1198432
Total [baseline] (10.94 s) : 0, 10940459
Agent [candidate] (1.206 s) : 0, 1206066
Total [candidate] (10.893 s) : 0, 10893202
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent appsec 1.227 s 171.598 ms (16.3%)
Agent iast 1.194 s 138.403 ms (13.1%)
Agent profiling 1.198 s 143.319 ms (13.6%)
Total tracing 10.946 s -
Total appsec 10.892 s -53.766 ms (-0.5%)
Total iast 11.184 s 237.882 ms (2.2%)
Total profiling 10.94 s -5.309 ms (-0.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent appsec 1.226 s 177.196 ms (16.9%)
Agent iast 1.2 s 151.012 ms (14.4%)
Agent profiling 1.206 s 156.801 ms (14.9%)
Total tracing 10.786 s -
Total appsec 10.826 s 39.78 ms (0.4%)
Total iast 11.192 s 406.044 ms (3.8%)
Total profiling 10.893 s 107.387 ms (1.0%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~318c9ba1eb, baseline=1.57.0-SNAPSHOT~29408ce141

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.472 ms) : 0, 1472
BytebuddyAgent [baseline] (708.88 ms) : 0, 708880
BytebuddyAgent [candidate] (705.386 ms) : 0, 705386
GlobalTracer [baseline] (249.726 ms) : 0, 249726
GlobalTracer [candidate] (248.662 ms) : 0, 248662
AppSec [baseline] (31.996 ms) : 0, 31996
AppSec [candidate] (31.993 ms) : 0, 31993
Debugger [baseline] (6.37 ms) : 0, 6370
Debugger [candidate] (6.405 ms) : 0, 6405
Remote Config [baseline] (675.591 µs) : 0, 676
Remote Config [candidate] (673.345 µs) : 0, 673
Telemetry [baseline] (15.135 ms) : 0, 15135
Telemetry [candidate] (15.214 ms) : 0, 15214
Flare Poller [baseline] (5.921 ms) : 0, 5921
Flare Poller [candidate] (4.819 ms) : 0, 4819
section appsec
crashtracking [baseline] (1.463 ms) : 0, 1463
crashtracking [candidate] (1.476 ms) : 0, 1476
BytebuddyAgent [baseline] (731.061 ms) : 0, 731061
BytebuddyAgent [candidate] (730.451 ms) : 0, 730451
GlobalTracer [baseline] (240.504 ms) : 0, 240504
GlobalTracer [candidate] (241.202 ms) : 0, 241202
AppSec [baseline] (174.509 ms) : 0, 174509
AppSec [candidate] (174.717 ms) : 0, 174717
Debugger [baseline] (6.253 ms) : 0, 6253
Debugger [candidate] (6.216 ms) : 0, 6216
Remote Config [baseline] (691.718 µs) : 0, 692
Remote Config [candidate] (678.719 µs) : 0, 679
Telemetry [baseline] (8.749 ms) : 0, 8749
Telemetry [candidate] (8.085 ms) : 0, 8085
Flare Poller [baseline] (4.006 ms) : 0, 4006
Flare Poller [candidate] (3.978 ms) : 0, 3978
IAST [baseline] (24.553 ms) : 0, 24553
IAST [candidate] (24.748 ms) : 0, 24748
section iast
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.486 ms) : 0, 1486
BytebuddyAgent [baseline] (831.933 ms) : 0, 831933
BytebuddyAgent [candidate] (838.735 ms) : 0, 838735
GlobalTracer [baseline] (237.626 ms) : 0, 237626
GlobalTracer [candidate] (238.155 ms) : 0, 238155
AppSec [baseline] (32.109 ms) : 0, 32109
AppSec [candidate] (29.661 ms) : 0, 29661
Debugger [baseline] (6.043 ms) : 0, 6043
Debugger [candidate] (6.029 ms) : 0, 6029
Remote Config [baseline] (605.084 µs) : 0, 605
Remote Config [candidate] (601.66 µs) : 0, 602
Telemetry [baseline] (8.805 ms) : 0, 8805
Telemetry [candidate] (8.026 ms) : 0, 8026
Flare Poller [baseline] (10.71 ms) : 0, 10710
Flare Poller [candidate] (10.844 ms) : 0, 10844
IAST [baseline] (29.003 ms) : 0, 29003
IAST [candidate] (31.806 ms) : 0, 31806
section profiling
crashtracking [baseline] (1.436 ms) : 0, 1436
crashtracking [candidate] (1.435 ms) : 0, 1435
BytebuddyAgent [baseline] (734.557 ms) : 0, 734557
BytebuddyAgent [candidate] (737.766 ms) : 0, 737766
GlobalTracer [baseline] (222.318 ms) : 0, 222318
GlobalTracer [candidate] (224.476 ms) : 0, 224476
AppSec [baseline] (32.132 ms) : 0, 32132
AppSec [candidate] (32.608 ms) : 0, 32608
Debugger [baseline] (6.685 ms) : 0, 6685
Debugger [candidate] (8.518 ms) : 0, 8518
Remote Config [baseline] (677.104 µs) : 0, 677
Remote Config [candidate] (713.81 µs) : 0, 714
Telemetry [baseline] (16.726 ms) : 0, 16726
Telemetry [candidate] (14.95 ms) : 0, 14950
Flare Poller [baseline] (4.231 ms) : 0, 4231
Flare Poller [candidate] (4.22 ms) : 0, 4220
ProfilingAgent [baseline] (110.311 ms) : 0, 110311
ProfilingAgent [candidate] (112.043 ms) : 0, 112043
Profiling [baseline] (110.927 ms) : 0, 110927
Profiling [candidate] (112.704 ms) : 0, 112704
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~318c9ba1eb, baseline=1.57.0-SNAPSHOT~29408ce141

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058550
Total [baseline] (8.673 s) : 0, 8672689
Agent [candidate] (1.049 s) : 0, 1049113
Total [candidate] (8.642 s) : 0, 8641555
section iast
Agent [baseline] (1.197 s) : 0, 1196884
Total [baseline] (9.352 s) : 0, 9351820
Agent [candidate] (1.199 s) : 0, 1199081
Total [candidate] (9.296 s) : 0, 9296316
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent iast 1.197 s 138.335 ms (13.1%)
Total tracing 8.673 s -
Total iast 9.352 s 679.13 ms (7.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent iast 1.199 s 149.968 ms (14.3%)
Total tracing 8.642 s -
Total iast 9.296 s 654.761 ms (7.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~318c9ba1eb, baseline=1.57.0-SNAPSHOT~29408ce141

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.481 ms) : 0, 1481
crashtracking [candidate] (1.479 ms) : 0, 1479
BytebuddyAgent [baseline] (711.969 ms) : 0, 711969
BytebuddyAgent [candidate] (705.652 ms) : 0, 705652
GlobalTracer [baseline] (249.659 ms) : 0, 249659
GlobalTracer [candidate] (248.14 ms) : 0, 248140
AppSec [baseline] (32.227 ms) : 0, 32227
AppSec [candidate] (31.884 ms) : 0, 31884
Debugger [baseline] (6.376 ms) : 0, 6376
Debugger [candidate] (6.329 ms) : 0, 6329
Remote Config [baseline] (675.521 µs) : 0, 676
Remote Config [candidate] (666.391 µs) : 0, 666
Telemetry [baseline] (16.748 ms) : 0, 16748
Telemetry [candidate] (16.104 ms) : 0, 16104
Flare Poller [baseline] (4.282 ms) : 0, 4282
Flare Poller [candidate] (4.048 ms) : 0, 4048
section iast
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.487 ms) : 0, 1487
BytebuddyAgent [baseline] (833.221 ms) : 0, 833221
BytebuddyAgent [candidate] (836.591 ms) : 0, 836591
GlobalTracer [baseline] (238.812 ms) : 0, 238812
GlobalTracer [candidate] (238.629 ms) : 0, 238629
AppSec [baseline] (30.694 ms) : 0, 30694
AppSec [candidate] (28.053 ms) : 0, 28053
Debugger [baseline] (6.123 ms) : 0, 6123
Debugger [candidate] (6.055 ms) : 0, 6055
Remote Config [baseline] (613.278 µs) : 0, 613
Remote Config [candidate] (614.444 µs) : 0, 614
Telemetry [baseline] (8.828 ms) : 0, 8828
Telemetry [candidate] (7.98 ms) : 0, 7980
Flare Poller [baseline] (10.708 ms) : 0, 10708
Flare Poller [candidate] (10.986 ms) : 0, 10986
IAST [baseline] (31.342 ms) : 0, 31342
IAST [candidate] (33.681 ms) : 0, 33681
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/is-test-running
git_commit_date 1764857220 1764857749
git_commit_sha 29408ce 318c9ba
release_version 1.57.0-SNAPSHOT~29408ce141 1.57.0-SNAPSHOT~318c9ba1eb
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1764860467 1764860467
ci_job_id 1270274086 1270274086
ci_pipeline_id 84888606 84888606
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-9agocml9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-9agocml9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 15 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+39.504µs; +142.164µs] or [+2.492%; +8.969%]		 unstable
[+40.579µs; +806.267µs] or [+0.948%; +18.845%]		 unstable
[-410.887op/s; +114.262op/s] or [-17.472%; +4.859%]		 1.676ms 4.702ms 2203.312op/s 1.585ms 4.278ms 2351.625op/s
scenario:load:insecure-bank:tracing:high_load better
[-268.123µs; -112.731µs] or [-15.624%; -6.569%]		 unstable
[-1351.744µs; -478.458µs] or [-26.599%; -9.415%]		 unstable
[+37.407op/s; +596.718op/s] or [+1.771%; +28.257%]		 1.526ms 4.167ms 2428.781op/s 1.716ms 5.082ms 2111.719op/s
scenario:load:petclinic:profiling:high_load better
[-2.699ms; -1.990ms] or [-13.204%; -9.735%]		 better
[-3.465ms; -1.710ms] or [-10.705%; -5.283%]		 unstable
[+3.317op/s; +51.370op/s] or [+1.474%; +22.834%]		 18.097ms 29.783ms 252.312op/s 20.441ms 32.371ms 224.969op/s
scenario:load:petclinic:iast:high_load worse
[+0.668ms; +1.436ms] or [+3.880%; +8.346%]		 unsure
[+0.443ms; +1.781ms] or [+1.553%; +6.238%]		 unstable
[-40.108op/s; +13.233op/s] or [-15.181%; +5.009%]		 18.254ms 29.665ms 250.750op/s 17.203ms 28.553ms 264.188op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~318c9ba1eb, baseline=1.57.0-SNAPSHOT~29408ce141
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.241 ms) : 1228, 1255
.   : milestone, 1241,
iast (3.265 ms) : 3216, 3315
.   : milestone, 3265,
iast_FULL (5.929 ms) : 5869, 5989
.   : milestone, 5929,
iast_GLOBAL (3.526 ms) : 3476, 3576
.   : milestone, 3526,
profiling (1.916 ms) : 1900, 1932
.   : milestone, 1916,
tracing (2.141 ms) : 2120, 2162
.   : milestone, 2141,
section candidate
no_agent (1.196 ms) : 1185, 1207
.   : milestone, 1196,
iast (3.266 ms) : 3222, 3309
.   : milestone, 3266,
iast_FULL (5.707 ms) : 5651, 5763
.   : milestone, 5707,
iast_GLOBAL (3.652 ms) : 3592, 3713
.   : milestone, 3652,
profiling (2.05 ms) : 2032, 2068
.   : milestone, 2050,
tracing (1.852 ms) : 1837, 1867
.   : milestone, 1852,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.241 ms [1.228 ms, 1.255 ms] -
iast 3.265 ms [3.216 ms, 3.315 ms] 2.024 ms (163.1%)
iast_FULL 5.929 ms [5.869 ms, 5.989 ms] 4.688 ms (377.7%)
iast_GLOBAL 3.526 ms [3.476 ms, 3.576 ms] 2.284 ms (184.1%)
profiling 1.916 ms [1.9 ms, 1.932 ms] 674.788 µs (54.4%)
tracing 2.141 ms [2.12 ms, 2.162 ms] 899.997 µs (72.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.196 ms [1.185 ms, 1.207 ms] -
iast 3.266 ms [3.222 ms, 3.309 ms] 2.07 ms (173.0%)
iast_FULL 5.707 ms [5.651 ms, 5.763 ms] 4.511 ms (377.2%)
iast_GLOBAL 3.652 ms [3.592 ms, 3.713 ms] 2.456 ms (205.4%)
profiling 2.05 ms [2.032 ms, 2.068 ms] 853.897 µs (71.4%)
tracing 1.852 ms [1.837 ms, 1.867 ms] 656.053 µs (54.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~318c9ba1eb, baseline=1.57.0-SNAPSHOT~29408ce141
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.312 ms) : 19112, 19512
.   : milestone, 19312,
appsec (18.454 ms) : 18265, 18642
.   : milestone, 18454,
code_origins (17.69 ms) : 17515, 17864
.   : milestone, 17690,
iast (17.661 ms) : 17484, 17837
.   : milestone, 17661,
profiling (20.757 ms) : 20547, 20967
.   : milestone, 20757,
tracing (17.691 ms) : 17516, 17865
.   : milestone, 17691,
section candidate
no_agent (18.297 ms) : 18111, 18482
.   : milestone, 18297,
appsec (18.779 ms) : 18588, 18971
.   : milestone, 18779,
code_origins (17.974 ms) : 17794, 18154
.   : milestone, 17974,
iast (18.613 ms) : 18425, 18800
.   : milestone, 18613,
profiling (18.495 ms) : 18311, 18679
.   : milestone, 18495,
tracing (17.928 ms) : 17750, 18107
.   : milestone, 17928,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.312 ms [19.112 ms, 19.512 ms] -
appsec 18.454 ms [18.265 ms, 18.642 ms] -858.358 µs (-4.4%)
code_origins 17.69 ms [17.515 ms, 17.864 ms] -1.622 ms (-8.4%)
iast 17.661 ms [17.484 ms, 17.837 ms] -1.651 ms (-8.5%)
profiling 20.757 ms [20.547 ms, 20.967 ms] 1.445 ms (7.5%)
tracing 17.691 ms [17.516 ms, 17.865 ms] -1.621 ms (-8.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.297 ms [18.111 ms, 18.482 ms] -
appsec 18.779 ms [18.588 ms, 18.971 ms] 482.608 µs (2.6%)
code_origins 17.974 ms [17.794 ms, 18.154 ms] -322.577 µs (-1.8%)
iast 18.613 ms [18.425 ms, 18.8 ms] 316.153 µs (1.7%)
profiling 18.495 ms [18.311 ms, 18.679 ms] 198.018 µs (1.1%)
tracing 17.928 ms [17.75 ms, 18.107 ms] -368.261 µs (-2.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/is-test-running
git_commit_date 1764857220 1764857749
git_commit_sha 29408ce 318c9ba
release_version 1.57.0-SNAPSHOT~29408ce141 1.57.0-SNAPSHOT~318c9ba1eb
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1764860328 1764860328
ci_job_id 1270274087 1270274087
ci_pipeline_id 84888606 84888606
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-gp30w5cf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-gp30w5cf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~318c9ba1eb, baseline=1.57.0-SNAPSHOT~29408ce141
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (2.473 ms) : 2421, 2526
.   : milestone, 2473,
iast (2.21 ms) : 2145, 2275
.   : milestone, 2210,
iast_GLOBAL (2.259 ms) : 2193, 2324
.   : milestone, 2259,
profiling (2.49 ms) : 2327, 2653
.   : milestone, 2490,
tracing (2.052 ms) : 2001, 2103
.   : milestone, 2052,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.475 ms) : 2423, 2528
.   : milestone, 2475,
iast (2.214 ms) : 2149, 2279
.   : milestone, 2214,
iast_GLOBAL (2.258 ms) : 2192, 2323
.   : milestone, 2258,
profiling (2.104 ms) : 2049, 2158
.   : milestone, 2104,
tracing (2.046 ms) : 1995, 2098
.   : milestone, 2046,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 2.473 ms [2.421 ms, 2.526 ms] 994.266 µs (67.2%)
iast 2.21 ms [2.145 ms, 2.275 ms] 730.542 µs (49.4%)
iast_GLOBAL 2.259 ms [2.193 ms, 2.324 ms] 779.381 µs (52.7%)
profiling 2.49 ms [2.327 ms, 2.653 ms] 1.011 ms (68.4%)
tracing 2.052 ms [2.001 ms, 2.103 ms] 572.592 µs (38.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 2.475 ms [2.423 ms, 2.528 ms] 999.059 µs (67.7%)
iast 2.214 ms [2.149 ms, 2.279 ms] 737.398 µs (49.9%)
iast_GLOBAL 2.258 ms [2.192 ms, 2.323 ms] 781.497 µs (52.9%)
profiling 2.104 ms [2.049 ms, 2.158 ms] 627.349 µs (42.5%)
tracing 2.046 ms [1.995 ms, 2.098 ms] 570.079 µs (38.6%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~318c9ba1eb, baseline=1.57.0-SNAPSHOT~29408ce141
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.613 s) : 15613000, 15613000
.   : milestone, 15613000,
appsec (14.602 s) : 14602000, 14602000
.   : milestone, 14602000,
iast (18.465 s) : 18465000, 18465000
.   : milestone, 18465000,
iast_GLOBAL (18.035 s) : 18035000, 18035000
.   : milestone, 18035000,
profiling (15.209 s) : 15209000, 15209000
.   : milestone, 15209000,
tracing (14.81 s) : 14810000, 14810000
.   : milestone, 14810000,
section candidate
no_agent (15.095 s) : 15095000, 15095000
.   : milestone, 15095000,
appsec (14.552 s) : 14552000, 14552000
.   : milestone, 14552000,
iast (18.054 s) : 18054000, 18054000
.   : milestone, 18054000,
iast_GLOBAL (18.089 s) : 18089000, 18089000
.   : milestone, 18089000,
profiling (14.649 s) : 14649000, 14649000
.   : milestone, 14649000,
tracing (14.591 s) : 14591000, 14591000
.   : milestone, 14591000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.613 s [15.613 s, 15.613 s] -
appsec 14.602 s [14.602 s, 14.602 s] -1.011 s (-6.5%)
iast 18.465 s [18.465 s, 18.465 s] 2.852 s (18.3%)
iast_GLOBAL 18.035 s [18.035 s, 18.035 s] 2.422 s (15.5%)
profiling 15.209 s [15.209 s, 15.209 s] -404.0 ms (-2.6%)
tracing 14.81 s [14.81 s, 14.81 s] -803.0 ms (-5.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.095 s [15.095 s, 15.095 s] -
appsec 14.552 s [14.552 s, 14.552 s] -543.0 ms (-3.6%)
iast 18.054 s [18.054 s, 18.054 s] 2.959 s (19.6%)
iast_GLOBAL 18.089 s [18.089 s, 18.089 s] 2.994 s (19.8%)
profiling 14.649 s [14.649 s, 14.649 s] -446.0 ms (-3.0%)
tracing 14.591 s [14.591 s, 14.591 s] -504.0 ms (-3.3%)

@sarahchen6 sarahchen6 added the tag: do not merge Do not merge changes label Dec 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

tag: do not merge Do not merge changes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@sarahchen6