Skip to content

Dummy #9041

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from
Draft

Dummy #9041

wants to merge 1 commit into from

Conversation

jbachorik
Copy link
Contributor

No description provided.

@pr-commenter
Copy link

pr-commenter bot commented Jun 26, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/test_check
git_commit_date 1750931982 1750945949
git_commit_sha 0f9b46c c8cad11
release_version 1.51.0-SNAPSHOT~0f9b46c752 1.51.0-SNAPSHOT~c8cad11de4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1750947871 1750947871
ci_job_id 1000240086 1000240086
ci_pipeline_id 68861737 68861737
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-iun2vzqu-project-304-concurrent-0-4wzg12r4 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-iun2vzqu-project-304-concurrent-0-4wzg12r4 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 44 metrics, 9 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.003 s) : 0, 1003300
Total [baseline] (10.788 s) : 0, 10788190
Agent [candidate] (999.98 ms) : 0, 999980
Total [candidate] (10.729 s) : 0, 10728539
section appsec
Agent [baseline] (1.177 s) : 0, 1176597
Total [baseline] (10.77 s) : 0, 10769854
Agent [candidate] (1.18 s) : 0, 1179772
Total [candidate] (10.744 s) : 0, 10744192
section iast
Agent [baseline] (1.133 s) : 0, 1133257
Total [baseline] (10.877 s) : 0, 10876940
Agent [candidate] (1.141 s) : 0, 1140664
Total [candidate] (10.829 s) : 0, 10829052
section profiling
Agent [baseline] (1.245 s) : 0, 1244521
Total [baseline] (11.034 s) : 0, 11034250
Agent [candidate] (1.251 s) : 0, 1251393
Total [candidate] (11.057 s) : 0, 11056718
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.003 s -
Agent appsec 1.177 s 173.297 ms (17.3%)
Agent iast 1.133 s 129.958 ms (13.0%)
Agent profiling 1.245 s 241.221 ms (24.0%)
Total tracing 10.788 s -
Total appsec 10.77 s -18.336 ms (-0.2%)
Total iast 10.877 s 88.75 ms (0.8%)
Total profiling 11.034 s 246.06 ms (2.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 999.98 ms -
Agent appsec 1.18 s 179.791 ms (18.0%)
Agent iast 1.141 s 140.684 ms (14.1%)
Agent profiling 1.251 s 251.412 ms (25.1%)
Total tracing 10.729 s -
Total appsec 10.744 s 15.652 ms (0.1%)
Total iast 10.829 s 100.512 ms (0.9%)
Total profiling 11.057 s 328.179 ms (3.1%)
gantt
    title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (692.912 ms) : 0, 692912
BytebuddyAgent [candidate] (690.334 ms) : 0, 690334
GlobalTracer [baseline] (243.903 ms) : 0, 243903
GlobalTracer [candidate] (243.176 ms) : 0, 243176
AppSec [baseline] (30.538 ms) : 0, 30538
AppSec [candidate] (30.458 ms) : 0, 30458
Debugger [baseline] (6.052 ms) : 0, 6052
Debugger [candidate] (6.108 ms) : 0, 6108
Remote Config [baseline] (674.671 µs) : 0, 675
Remote Config [candidate] (683.738 µs) : 0, 684
Telemetry [baseline] (8.247 ms) : 0, 8247
Telemetry [candidate] (8.248 ms) : 0, 8248
section appsec
BytebuddyAgent [baseline] (711.794 ms) : 0, 711794
BytebuddyAgent [candidate] (715.978 ms) : 0, 715978
GlobalTracer [baseline] (236.697 ms) : 0, 236697
GlobalTracer [candidate] (236.166 ms) : 0, 236166
IAST [baseline] (22.097 ms) : 0, 22097
IAST [candidate] (22.149 ms) : 0, 22149
AppSec [baseline] (170.653 ms) : 0, 170653
AppSec [candidate] (170.001 ms) : 0, 170001
Debugger [baseline] (5.817 ms) : 0, 5817
Debugger [candidate] (5.813 ms) : 0, 5813
Remote Config [baseline] (606.298 µs) : 0, 606
Remote Config [candidate] (603.552 µs) : 0, 604
Telemetry [baseline] (8.128 ms) : 0, 8128
Telemetry [candidate] (8.115 ms) : 0, 8115
section iast
BytebuddyAgent [baseline] (809.229 ms) : 0, 809229
BytebuddyAgent [candidate] (815.054 ms) : 0, 815054
GlobalTracer [baseline] (233.27 ms) : 0, 233270
GlobalTracer [candidate] (234.231 ms) : 0, 234231
IAST [baseline] (24.655 ms) : 0, 24655
IAST [candidate] (28.156 ms) : 0, 28156
AppSec [baseline] (30.881 ms) : 0, 30881
AppSec [candidate] (27.801 ms) : 0, 27801
Debugger [baseline] (5.804 ms) : 0, 5804
Debugger [candidate] (5.851 ms) : 0, 5851
Remote Config [baseline] (577.76 µs) : 0, 578
Remote Config [candidate] (583.509 µs) : 0, 584
Telemetry [baseline] (7.954 ms) : 0, 7954
Telemetry [candidate] (8.01 ms) : 0, 8010
section profiling
BytebuddyAgent [baseline] (678.144 ms) : 0, 678144
BytebuddyAgent [candidate] (684.374 ms) : 0, 684374
GlobalTracer [baseline] (361.681 ms) : 0, 361681
GlobalTracer [candidate] (362.056 ms) : 0, 362056
AppSec [baseline] (31.524 ms) : 0, 31524
AppSec [candidate] (32.427 ms) : 0, 32427
Debugger [baseline] (10.511 ms) : 0, 10511
Debugger [candidate] (11.322 ms) : 0, 11322
Remote Config [baseline] (1.413 ms) : 0, 1413
Remote Config [candidate] (659.947 µs) : 0, 660
Telemetry [baseline] (8.795 ms) : 0, 8795
Telemetry [candidate] (8.718 ms) : 0, 8718
ProfilingAgent [baseline] (103.075 ms) : 0, 103075
ProfilingAgent [candidate] (102.997 ms) : 0, 102997
Profiling [baseline] (103.102 ms) : 0, 103102
Profiling [candidate] (103.021 ms) : 0, 103021
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (997.106 ms) : 0, 997106
Total [baseline] (8.557 s) : 0, 8557476
Agent [candidate] (1.003 s) : 0, 1002694
Total [candidate] (8.572 s) : 0, 8571744
section iast
Agent [baseline] (1.14 s) : 0, 1139828
Total [baseline] (9.301 s) : 0, 9301053
Agent [candidate] (1.148 s) : 0, 1147618
Total [candidate] (9.33 s) : 0, 9330447
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 997.106 ms -
Agent iast 1.14 s 142.721 ms (14.3%)
Total tracing 8.557 s -
Total iast 9.301 s 743.577 ms (8.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.003 s -
Agent iast 1.148 s 144.923 ms (14.5%)
Total tracing 8.572 s -
Total iast 9.33 s 758.703 ms (8.9%)
gantt
    title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (688.244 ms) : 0, 688244
BytebuddyAgent [candidate] (693.055 ms) : 0, 693055
GlobalTracer [baseline] (242.561 ms) : 0, 242561
GlobalTracer [candidate] (243.355 ms) : 0, 243355
AppSec [baseline] (30.41 ms) : 0, 30410
AppSec [candidate] (30.376 ms) : 0, 30376
Debugger [baseline] (6.056 ms) : 0, 6056
Debugger [candidate] (6.078 ms) : 0, 6078
Remote Config [baseline] (672.75 µs) : 0, 673
Remote Config [candidate] (676.451 µs) : 0, 676
Telemetry [baseline] (8.31 ms) : 0, 8310
Telemetry [candidate] (8.248 ms) : 0, 8248
section iast
BytebuddyAgent [baseline] (814.164 ms) : 0, 814164
BytebuddyAgent [candidate] (820.639 ms) : 0, 820639
GlobalTracer [baseline] (233.958 ms) : 0, 233958
GlobalTracer [candidate] (235.681 ms) : 0, 235681
IAST [baseline] (26.579 ms) : 0, 26579
IAST [candidate] (27.229 ms) : 0, 27229
AppSec [baseline] (29.654 ms) : 0, 29654
AppSec [candidate] (28.523 ms) : 0, 28523
Debugger [baseline] (5.852 ms) : 0, 5852
Debugger [candidate] (5.901 ms) : 0, 5901
Remote Config [baseline] (598.107 µs) : 0, 598
Remote Config [candidate] (589.273 µs) : 0, 589
Telemetry [baseline] (8.049 ms) : 0, 8049
Telemetry [candidate] (8.039 ms) : 0, 8039
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/test_check
git_commit_date 1750931982 1750945949
git_commit_sha 0f9b46c c8cad11
release_version 1.51.0-SNAPSHOT~0f9b46c752 1.51.0-SNAPSHOT~c8cad11de4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1750947462 1750947462
ci_job_id 1000240087 1000240087
ci_pipeline_id 68861737 68861737
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-cpksuxk1-project-304-concurrent-0-w8xgy4i1 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-cpksuxk1-project-304-concurrent-0-w8xgy4i1 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+430.252µs; +820.212µs] or [+4.379%; +8.347%]
unstable
[-86.246op/s; +30.184op/s] or [-18.242%; +6.384%]
10.452ms 444.750op/s 9.826ms 472.781op/s
scenario:load:petclinic:tracing:high_load worse
[+0.902ms; +1.706ms] or [+2.064%; +3.906%]
unstable
[-9.079op/s; +5.587op/s] or [-8.480%; +5.218%]
44.983ms 105.316op/s 43.679ms 107.062op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.455 ms) : 36171, 36739
.   : milestone, 36455,
appsec (47.942 ms) : 47522, 48363
.   : milestone, 47942,
code_origins (44.541 ms) : 44169, 44913
.   : milestone, 44541,
iast (43.065 ms) : 42678, 43453
.   : milestone, 43065,
profiling (47.986 ms) : 47558, 48415
.   : milestone, 47986,
tracing (43.679 ms) : 43303, 44056
.   : milestone, 43679,
section candidate
no_agent (37.052 ms) : 36748, 37355
.   : milestone, 37052,
appsec (48.262 ms) : 47832, 48692
.   : milestone, 48262,
code_origins (44.191 ms) : 43828, 44555
.   : milestone, 44191,
iast (43.705 ms) : 43317, 44093
.   : milestone, 43705,
profiling (47.343 ms) : 46915, 47772
.   : milestone, 47343,
tracing (44.983 ms) : 44612, 45354
.   : milestone, 44983,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.455 ms [36.171 ms, 36.739 ms] -
appsec 47.942 ms [47.522 ms, 48.363 ms] 11.487 ms (31.5%)
code_origins 44.541 ms [44.169 ms, 44.913 ms] 8.086 ms (22.2%)
iast 43.065 ms [42.678 ms, 43.453 ms] 6.61 ms (18.1%)
profiling 47.986 ms [47.558 ms, 48.415 ms] 11.531 ms (31.6%)
tracing 43.679 ms [43.303 ms, 44.056 ms] 7.224 ms (19.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.052 ms [36.748 ms, 37.355 ms] -
appsec 48.262 ms [47.832 ms, 48.692 ms] 11.211 ms (30.3%)
code_origins 44.191 ms [43.828 ms, 44.555 ms] 7.14 ms (19.3%)
iast 43.705 ms [43.317 ms, 44.093 ms] 6.653 ms (18.0%)
profiling 47.343 ms [46.915 ms, 47.772 ms] 10.292 ms (27.8%)
tracing 44.983 ms [44.612 ms, 45.354 ms] 7.932 ms (21.4%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.479 ms) : 4428, 4530
.   : milestone, 4479,
iast (9.294 ms) : 9132, 9456
.   : milestone, 9294,
iast_FULL (13.59 ms) : 13320, 13860
.   : milestone, 13590,
iast_GLOBAL (9.826 ms) : 9647, 10006
.   : milestone, 9826,
profiling (8.199 ms) : 8067, 8332
.   : milestone, 8199,
tracing (7.658 ms) : 7538, 7777
.   : milestone, 7658,
section candidate
no_agent (4.378 ms) : 4329, 4427
.   : milestone, 4378,
iast (9.266 ms) : 9115, 9417
.   : milestone, 9266,
iast_FULL (13.631 ms) : 13363, 13899
.   : milestone, 13631,
iast_GLOBAL (10.452 ms) : 10269, 10634
.   : milestone, 10452,
profiling (8.422 ms) : 8295, 8549
.   : milestone, 8422,
tracing (7.766 ms) : 7645, 7886
.   : milestone, 7766,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.479 ms [4.428 ms, 4.53 ms] -
iast 9.294 ms [9.132 ms, 9.456 ms] 4.815 ms (107.5%)
iast_FULL 13.59 ms [13.32 ms, 13.86 ms] 9.111 ms (203.4%)
iast_GLOBAL 9.826 ms [9.647 ms, 10.006 ms] 5.347 ms (119.4%)
profiling 8.199 ms [8.067 ms, 8.332 ms] 3.72 ms (83.1%)
tracing 7.658 ms [7.538 ms, 7.777 ms] 3.179 ms (71.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.378 ms [4.329 ms, 4.427 ms] -
iast 9.266 ms [9.115 ms, 9.417 ms] 4.888 ms (111.7%)
iast_FULL 13.631 ms [13.363 ms, 13.899 ms] 9.253 ms (211.4%)
iast_GLOBAL 10.452 ms [10.269 ms, 10.634 ms] 6.074 ms (138.7%)
profiling 8.422 ms [8.295 ms, 8.549 ms] 4.044 ms (92.4%)
tracing 7.766 ms [7.645 ms, 7.886 ms] 3.388 ms (77.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/test_check
git_commit_date 1750931982 1750945949
git_commit_sha 0f9b46c c8cad11
release_version 1.51.0-SNAPSHOT~0f9b46c752 1.51.0-SNAPSHOT~c8cad11de4
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1750948047 1750948047
ci_job_id 1000240088 1000240088
ci_pipeline_id 68861737 68861737
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-wutn71ym-project-304-concurrent-0-g4j8m1oz 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-wutn71ym-project-304-concurrent-0-g4j8m1oz 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.402 ms) : 2353, 2451
.   : milestone, 2402,
iast (2.184 ms) : 2122, 2245
.   : milestone, 2184,
iast_GLOBAL (2.231 ms) : 2170, 2293
.   : milestone, 2231,
profiling (2.036 ms) : 1986, 2086
.   : milestone, 2036,
tracing (2.005 ms) : 1957, 2053
.   : milestone, 2005,
section candidate
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (2.396 ms) : 2347, 2445
.   : milestone, 2396,
iast (2.182 ms) : 2121, 2243
.   : milestone, 2182,
iast_GLOBAL (2.231 ms) : 2170, 2293
.   : milestone, 2231,
profiling (2.024 ms) : 1975, 2073
.   : milestone, 2024,
tracing (2.0 ms) : 1952, 2047
.   : milestone, 2000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 2.402 ms [2.353 ms, 2.451 ms] 930.099 µs (63.2%)
iast 2.184 ms [2.122 ms, 2.245 ms] 711.689 µs (48.3%)
iast_GLOBAL 2.231 ms [2.17 ms, 2.293 ms] 759.143 µs (51.6%)
profiling 2.036 ms [1.986 ms, 2.086 ms] 564.337 µs (38.3%)
tracing 2.005 ms [1.957 ms, 2.053 ms] 533.032 µs (36.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 2.396 ms [2.347 ms, 2.445 ms] 922.947 µs (62.7%)
iast 2.182 ms [2.121 ms, 2.243 ms] 709.096 µs (48.1%)
iast_GLOBAL 2.231 ms [2.17 ms, 2.293 ms] 758.146 µs (51.5%)
profiling 2.024 ms [1.975 ms, 2.073 ms] 550.656 µs (37.4%)
tracing 2.0 ms [1.952 ms, 2.047 ms] 526.703 µs (35.8%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.633 s) : 15633000, 15633000
.   : milestone, 15633000,
appsec (14.993 s) : 14993000, 14993000
.   : milestone, 14993000,
iast (18.487 s) : 18487000, 18487000
.   : milestone, 18487000,
iast_GLOBAL (18.069 s) : 18069000, 18069000
.   : milestone, 18069000,
profiling (15.197 s) : 15197000, 15197000
.   : milestone, 15197000,
tracing (14.808 s) : 14808000, 14808000
.   : milestone, 14808000,
section candidate
no_agent (15.528 s) : 15528000, 15528000
.   : milestone, 15528000,
appsec (14.745 s) : 14745000, 14745000
.   : milestone, 14745000,
iast (18.843 s) : 18843000, 18843000
.   : milestone, 18843000,
iast_GLOBAL (18.091 s) : 18091000, 18091000
.   : milestone, 18091000,
profiling (15.332 s) : 15332000, 15332000
.   : milestone, 15332000,
tracing (14.792 s) : 14792000, 14792000
.   : milestone, 14792000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.633 s [15.633 s, 15.633 s] -
appsec 14.993 s [14.993 s, 14.993 s] -640.0 ms (-4.1%)
iast 18.487 s [18.487 s, 18.487 s] 2.854 s (18.3%)
iast_GLOBAL 18.069 s [18.069 s, 18.069 s] 2.436 s (15.6%)
profiling 15.197 s [15.197 s, 15.197 s] -436.0 ms (-2.8%)
tracing 14.808 s [14.808 s, 14.808 s] -825.0 ms (-5.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.528 s [15.528 s, 15.528 s] -
appsec 14.745 s [14.745 s, 14.745 s] -783.0 ms (-5.0%)
iast 18.843 s [18.843 s, 18.843 s] 3.315 s (21.3%)
iast_GLOBAL 18.091 s [18.091 s, 18.091 s] 2.563 s (16.5%)
profiling 15.332 s [15.332 s, 15.332 s] -196.0 ms (-1.3%)
tracing 14.792 s [14.792 s, 14.792 s] -736.0 ms (-4.7%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant