Skip to content

Nikita tkachenko/test env 6a2bd8d1ecc54c7c918efdbd1e62027619269fc2 #8497

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

nikita-tkachenko-datadog
Copy link
Contributor

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

PerfectSlayer and others added 2 commits February 28, 2025 13:34
* feat(core): Clean up old propagation API
* feat(core): Refactor disabled tracing propagator
…ives (#8462)

Excluded by the iast instrumenter

com.azure.core.amqp.ExponentialAmqpRetryPolicy
com.azure.core.util.CoreUtils
com.azure.cosmos.implementation.directconnectivity.GoneAndRetryWithRetryPolicy$RetryWithRetryPolicy
com.azure.cosmos.implementation.directconnectivity.StoreReader
com.azure.cosmos.implementation.directconnectivity.addressEnumerator.AddressEnumeratorUsingPermutations
com.azure.cosmos.implementation.uuid.UUIDTimer
com.azure.messaging.eventhubs.EventProcessorClient
com.azure.messaging.eventhubs.PartitionBasedLoadBalancer
com.launchdarkly.shaded.com.launchdarkly.eventsource.EventSource
com.microsoft.sqlserver.jdbc.SQLServerConnection
@nikita-tkachenko-datadog nikita-tkachenko-datadog added the tag: do not merge Do not merge changes label Mar 4, 2025
@@ -51,8 +52,7 @@ public class HttpCodec {
static final String CF_CONNECTING_IP_V6_KEY = "cf-connecting-ipv6";

public interface Injector {
<C> void inject(
final DDSpanContext context, final C carrier, final AgentPropagation.Setter<C> setter);
<C> void inject(final DDSpanContext context, final C carrier, final CarrierSetter<C> setter);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Quality Violation

Suggested change
<C> void inject(final DDSpanContext context, final C carrier, final CarrierSetter<C> setter);
<C> void inject(final DDSpanContext context, final C carrier, CarrierSetter<C> setter);
Avoid declaring as final as it may not be used (...read more)

The rule "Avoid useless final type in interface method" advises against the unnecessary use of the final keyword in the method parameters of an interface. In Java, the final keyword is used to denote that a variable cannot be changed once assigned. However, in the context of an interface method, this is redundant as the value of the parameter cannot be changed within the method anyway.

The importance of this rule lies in the clarity and simplicity of code. Unnecessary use of final in this context can lead to confusion for those reading the code, as it suggests that there may be a specific reason for its use when there is not. It can also clutter the code, making it less readable.

Good coding practices to avoid this rule violation include simply not using the final keyword in the method parameters of an interface. This does not affect the functionality of the code, but it makes it cleaner and easier to understand. For example, instead of writing void process(final Object arg);, you can write void process(Object arg);. This maintains the same functionality but improves the readability of the code.

View in Datadog  Leave us feedback  Documentation

@pr-commenter
Copy link

pr-commenter bot commented Mar 4, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/test-env-6a2bd8d1ecc54c7c918efdbd1e62027619269fc2
git_commit_date 1741082792 1740747659
git_commit_sha 8f945b0 6a2bd8d
release_version 1.47.0-SNAPSHOT~8f945b02a7 1.47.0-SNAPSHOT~6a2bd8d1ec
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741091628 1741091628
ci_job_id 831517807 831517807
ci_pipeline_id 57626474 57626474
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner--t2f38de-project-304-concurrent-2-pw1j54n8 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner--t2f38de-project-304-concurrent-2-pw1j54n8 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 21 performance improvements and 5 performance regressions! Performance is the same for 27 metrics, 10 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent better
[-667.080ms; -589.532ms] or [-6.781%; -5.992%]
9.210s 9.838s
scenario:startup:insecure-bank:iast:Agent.start better
[-96.299ms; -61.995ms] or [-7.685%; -4.947%]
1.174s 1.253s
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Agent better
[-677.093ms; -568.627ms] or [-6.898%; -5.793%]
9.193s 9.815s
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Agent.start better
[-119.915ms; -66.940ms] or [-9.430%; -5.264%]
1.178s 1.272s
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Agent better
[-709.467ms; -630.275ms] or [-7.182%; -6.381%]
9.208s 9.878s
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Agent.start better
[-110.972ms; -75.202ms] or [-8.809%; -5.970%]
1.167s 1.260s
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Remote Config worse
[+59.487µs; +97.745µs] or [+11.295%; +18.559%]
605.296µs 526.680µs
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Telemetry better
[-3.874ms; -3.361ms] or [-31.842%; -27.626%]
8.548ms 12.166ms
scenario:startup:insecure-bank:tracing:Agent better
[-692.713ms; -551.613ms] or [-7.472%; -5.950%]
8.648s 9.270s
scenario:startup:insecure-bank:tracing:Agent.start better
[-104.850ms; -95.287ms] or [-9.209%; -8.369%]
1.038s 1.139s
scenario:startup:insecure-bank:tracing:Remote Config worse
[+73.745µs; +122.809µs] or [+12.532%; +20.869%]
686.743µs 588.466µs
scenario:startup:petclinic:appsec:Agent better
[-1006.257ms; -864.155ms] or [-8.648%; -7.426%]
10.701s 11.636s
scenario:startup:petclinic:appsec:Agent.start better
[-105.164ms; -82.244ms] or [-8.246%; -6.449%]
1.182s 1.275s
scenario:startup:petclinic:appsec:Telemetry better
[-4.186ms; -3.852ms] or [-34.096%; -31.378%]
8.258ms 12.277ms
scenario:startup:petclinic:iast:Agent better
[-1058.820ms; -904.486ms] or [-8.888%; -7.593%]
10.931s 11.912s
scenario:startup:petclinic:iast:Agent.start better
[-113.784ms; -78.709ms] or [-8.977%; -6.210%]
1.171s 1.267s
scenario:startup:petclinic:iast:Remote Config worse
[+75.144µs; +107.770µs] or [+14.600%; +20.939%]
606.133µs 514.675µs
scenario:startup:petclinic:profiling:Agent better
[-989.283ms; -754.666ms] or [-8.432%; -6.432%]
10.860s 11.732s
scenario:startup:petclinic:profiling:Agent.start better
[-138.463ms; -105.449ms] or [-9.985%; -7.604%]
1.265s 1.387s
scenario:startup:petclinic:profiling:ProfilingAgent better
[-28.812ms; -25.187ms] or [-23.327%; -20.392%]
96.514ms 123.513ms
scenario:startup:petclinic:profiling:Remote Config worse
[+36.232µs; +89.111µs] or [+5.969%; +14.682%]
669.630µs 606.958µs
scenario:startup:petclinic:profiling:Telemetry better
[-3.840ms; -3.249ms] or [-30.399%; -25.719%]
9.089ms 12.633ms
scenario:startup:petclinic:profiling:Profiling better
[-28.810ms; -25.185ms] or [-23.321%; -20.387%]
96.538ms 123.535ms
scenario:startup:petclinic:tracing:Agent better
[-1.179s; -0.926s] or [-10.245%; -8.051%]
10.456s 11.508s
scenario:startup:petclinic:tracing:Agent.start better
[-95.757ms; -87.587ms] or [-8.456%; -7.734%]
1.041s 1.132s
scenario:startup:petclinic:tracing:Remote Config worse
[+87.742µs; +128.717µs] or [+14.831%; +21.758%]
699.828µs 591.598µs
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~6a2bd8d1ec, baseline=1.47.0-SNAPSHOT~8f945b02a7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.132 s) : 0, 1132419
Total [baseline] (11.508 s) : 0, 11508253
Agent [candidate] (1.041 s) : 0, 1040747
Total [candidate] (10.456 s) : 0, 10455522
section appsec
Agent [baseline] (1.275 s) : 0, 1275284
Total [baseline] (11.636 s) : 0, 11636166
Agent [candidate] (1.182 s) : 0, 1181580
Total [candidate] (10.701 s) : 0, 10700960
section iast
Agent [baseline] (1.267 s) : 0, 1267444
Total [baseline] (11.912 s) : 0, 11912454
Agent [candidate] (1.171 s) : 0, 1171198
Total [candidate] (10.931 s) : 0, 10930801
section profiling
Agent [baseline] (1.387 s) : 0, 1386688
Total [baseline] (11.732 s) : 0, 11732112
Agent [candidate] (1.265 s) : 0, 1264732
Total [candidate] (10.86 s) : 0, 10860138
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.132 s -
Agent appsec 1.275 s 142.865 ms (12.6%)
Agent iast 1.267 s 135.025 ms (11.9%)
Agent profiling 1.387 s 254.269 ms (22.5%)
Total tracing 11.508 s -
Total appsec 11.636 s 127.913 ms (1.1%)
Total iast 11.912 s 404.201 ms (3.5%)
Total profiling 11.732 s 223.859 ms (1.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent appsec 1.182 s 140.833 ms (13.5%)
Agent iast 1.171 s 130.451 ms (12.5%)
Agent profiling 1.265 s 223.985 ms (21.5%)
Total tracing 10.456 s -
Total appsec 10.701 s 245.437 ms (2.3%)
Total iast 10.931 s 475.278 ms (4.5%)
Total profiling 10.86 s 404.616 ms (3.9%)
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~6a2bd8d1ec, baseline=1.47.0-SNAPSHOT~8f945b02a7

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (714.741 ms) : 0, 714741
BytebuddyAgent [candidate] (716.944 ms) : 0, 716944
GlobalTracer [baseline] (238.93 ms) : 0, 238930
GlobalTracer [candidate] (239.266 ms) : 0, 239266
AppSec [baseline] (55.669 ms) : 0, 55669
AppSec [candidate] (55.708 ms) : 0, 55708
Remote Config [baseline] (591.598 µs) : 0, 592
Remote Config [candidate] (699.828 µs) : 0, 700
Telemetry [baseline] (12.446 ms) : 0, 12446
Telemetry [candidate] (13.148 ms) : 0, 13148
Debugger [baseline] (95.096 ms) : 0, 95096
section appsec
BytebuddyAgent [baseline] (737.21 ms) : 0, 737210
BytebuddyAgent [candidate] (734.572 ms) : 0, 734572
GlobalTracer [baseline] (237.156 ms) : 0, 237156
GlobalTracer [candidate] (235.61 ms) : 0, 235610
IAST [baseline] (21.791 ms) : 0, 21791
IAST [candidate] (21.599 ms) : 0, 21599
AppSec [baseline] (177.521 ms) : 0, 177521
AppSec [candidate] (176.74 ms) : 0, 176740
Remote Config [baseline] (638.699 µs) : 0, 639
Remote Config [candidate] (652.571 µs) : 0, 653
Telemetry [baseline] (12.277 ms) : 0, 12277
Telemetry [candidate] (8.258 ms) : 0, 8258
Debugger [baseline] (84.534 ms) : 0, 84534
section iast
BytebuddyAgent [baseline] (842.185 ms) : 0, 842185
BytebuddyAgent [candidate] (836.48 ms) : 0, 836480
GlobalTracer [baseline] (231.474 ms) : 0, 231474
GlobalTracer [candidate] (230.134 ms) : 0, 230134
IAST [baseline] (23.817 ms) : 0, 23817
IAST [candidate] (22.862 ms) : 0, 22862
AppSec [baseline] (56.601 ms) : 0, 56601
AppSec [candidate] (57.336 ms) : 0, 57336
Remote Config [baseline] (514.675 µs) : 0, 515
Remote Config [candidate] (606.133 µs) : 0, 606
Telemetry [baseline] (13.664 ms) : 0, 13664
Telemetry [candidate] (8.766 ms) : 0, 8766
Debugger [baseline] (84.007 ms) : 0, 84007
section profiling
BytebuddyAgent [baseline] (713.159 ms) : 0, 713159
BytebuddyAgent [candidate] (711.424 ms) : 0, 711424
GlobalTracer [baseline] (351.537 ms) : 0, 351537
GlobalTracer [candidate] (351.791 ms) : 0, 351791
AppSec [baseline] (55.854 ms) : 0, 55854
AppSec [candidate] (54.831 ms) : 0, 54831
Remote Config [baseline] (606.958 µs) : 0, 607
Remote Config [candidate] (669.63 µs) : 0, 670
Telemetry [baseline] (12.633 ms) : 0, 12633
Telemetry [candidate] (9.089 ms) : 0, 9089
Debugger [baseline] (88.724 ms) : 0, 88724
ProfilingAgent [baseline] (123.513 ms) : 0, 123513
ProfilingAgent [candidate] (96.514 ms) : 0, 96514
Profiling [baseline] (123.535 ms) : 0, 123535
Profiling [candidate] (96.538 ms) : 0, 96538
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~6a2bd8d1ec, baseline=1.47.0-SNAPSHOT~8f945b02a7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.139 s) : 0, 1138528
Total [baseline] (9.27 s) : 0, 9270192
Agent [candidate] (1.038 s) : 0, 1038459
Total [candidate] (8.648 s) : 0, 8648029
section iast
Agent [baseline] (1.253 s) : 0, 1253132
Total [baseline] (9.838 s) : 0, 9837976
Agent [candidate] (1.174 s) : 0, 1173985
Total [candidate] (9.21 s) : 0, 9209670
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.272 s) : 0, 1271691
Total [baseline] (9.815 s) : 0, 9815403
Agent [candidate] (1.178 s) : 0, 1178263
Total [candidate] (9.193 s) : 0, 9192543
section iast_TELEMETRY_OFF
Agent [baseline] (1.26 s) : 0, 1259752
Total [baseline] (9.878 s) : 0, 9878110
Agent [candidate] (1.167 s) : 0, 1166665
Total [candidate] (9.208 s) : 0, 9208240
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.139 s -
Agent iast 1.253 s 114.604 ms (10.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.272 s 133.163 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.26 s 121.224 ms (10.6%)
Total tracing 9.27 s -
Total iast 9.838 s 567.784 ms (6.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.815 s 545.21 ms (5.9%)
Total iast_TELEMETRY_OFF 9.878 s 607.918 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.038 s -
Agent iast 1.174 s 135.525 ms (13.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.178 s 139.804 ms (13.5%)
Agent iast_TELEMETRY_OFF 1.167 s 128.206 ms (12.3%)
Total tracing 8.648 s -
Total iast 9.21 s 561.641 ms (6.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.193 s 544.513 ms (6.3%)
Total iast_TELEMETRY_OFF 9.208 s 560.21 ms (6.5%)
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~6a2bd8d1ec, baseline=1.47.0-SNAPSHOT~8f945b02a7

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.616 ms) : 0, 718616
BytebuddyAgent [candidate] (716.039 ms) : 0, 716039
GlobalTracer [baseline] (240.463 ms) : 0, 240463
GlobalTracer [candidate] (238.37 ms) : 0, 238370
AppSec [baseline] (55.588 ms) : 0, 55588
AppSec [candidate] (55.535 ms) : 0, 55535
Remote Config [baseline] (588.466 µs) : 0, 588
Remote Config [candidate] (686.743 µs) : 0, 687
Telemetry [baseline] (12.549 ms) : 0, 12549
Telemetry [candidate] (12.951 ms) : 0, 12951
Debugger [baseline] (95.693 ms) : 0, 95693
section iast
BytebuddyAgent [baseline] (832.695 ms) : 0, 832695
BytebuddyAgent [candidate] (840.112 ms) : 0, 840112
GlobalTracer [baseline] (229.834 ms) : 0, 229834
GlobalTracer [candidate] (229.912 ms) : 0, 229912
IAST [baseline] (22.692 ms) : 0, 22692
IAST [candidate] (22.839 ms) : 0, 22839
AppSec [baseline] (56.961 ms) : 0, 56961
AppSec [candidate] (56.733 ms) : 0, 56733
Remote Config [baseline] (512.738 µs) : 0, 513
Remote Config [candidate] (619.613 µs) : 0, 620
Telemetry [baseline] (12.86 ms) : 0, 12860
Telemetry [candidate] (8.705 ms) : 0, 8705
Debugger [baseline] (82.672 ms) : 0, 82672
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (844.283 ms) : 0, 844283
BytebuddyAgent [candidate] (842.318 ms) : 0, 842318
GlobalTracer [baseline] (232.612 ms) : 0, 232612
GlobalTracer [candidate] (230.9 ms) : 0, 230900
IAST [baseline] (23.255 ms) : 0, 23255
IAST [candidate] (22.935 ms) : 0, 22935
AppSec [baseline] (57.965 ms) : 0, 57965
AppSec [candidate] (57.624 ms) : 0, 57624
Remote Config [baseline] (530.73 µs) : 0, 531
Remote Config [candidate] (611.948 µs) : 0, 612
Telemetry [baseline] (13.78 ms) : 0, 13780
Telemetry [candidate] (8.803 ms) : 0, 8803
Debugger [baseline] (84.147 ms) : 0, 84147
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (837.572 ms) : 0, 837572
BytebuddyAgent [candidate] (833.52 ms) : 0, 833520
GlobalTracer [baseline] (230.981 ms) : 0, 230981
GlobalTracer [candidate] (229.864 ms) : 0, 229864
IAST [baseline] (23.283 ms) : 0, 23283
IAST [candidate] (24.657 ms) : 0, 24657
AppSec [baseline] (56.371 ms) : 0, 56371
AppSec [candidate] (54.474 ms) : 0, 54474
Remote Config [baseline] (526.68 µs) : 0, 527
Remote Config [candidate] (605.296 µs) : 0, 605
Telemetry [baseline] (12.166 ms) : 0, 12166
Telemetry [candidate] (8.548 ms) : 0, 8548
Debugger [baseline] (83.714 ms) : 0, 83714
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-04T12:04:27 2025-03-04T12:12:21
git_branch master nikita-tkachenko/test-env-6a2bd8d1ecc54c7c918efdbd1e62027619269fc2
git_commit_date 1741082792 1740747659
git_commit_sha 8f945b0 6a2bd8d
release_version 1.47.0-SNAPSHOT~8f945b02a7 1.47.0-SNAPSHOT~6a2bd8d1ec
start_time 2025-03-04T12:04:13 2025-03-04T12:12:07
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741090738 1741090738
ci_job_id 831517808 831517808
ci_pipeline_id 57626474 57626474
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-8ksbllmc-project-304-concurrent-1-cprnt9cg 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-8ksbllmc-project-304-concurrent-1-cprnt9cg 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 17 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~6a2bd8d1ec, baseline=1.47.0-SNAPSHOT~8f945b02a7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.372 ms) : 1351, 1393
.   : milestone, 1372,
appsec (1.735 ms) : 1710, 1760
.   : milestone, 1735,
appsec_no_iast (1.714 ms) : 1690, 1739
.   : milestone, 1714,
code_origins (1.706 ms) : 1673, 1738
.   : milestone, 1706,
iast (1.518 ms) : 1493, 1544
.   : milestone, 1518,
profiling (1.558 ms) : 1522, 1595
.   : milestone, 1558,
tracing (1.496 ms) : 1473, 1520
.   : milestone, 1496,
section candidate
no_agent (1.355 ms) : 1335, 1375
.   : milestone, 1355,
appsec (1.755 ms) : 1731, 1778
.   : milestone, 1755,
appsec_no_iast (1.731 ms) : 1706, 1757
.   : milestone, 1731,
code_origins (1.668 ms) : 1634, 1702
.   : milestone, 1668,
iast (1.506 ms) : 1482, 1530
.   : milestone, 1506,
profiling (1.5 ms) : 1476, 1524
.   : milestone, 1500,
tracing (1.49 ms) : 1465, 1514
.   : milestone, 1490,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.372 ms [1.351 ms, 1.393 ms] -
appsec 1.735 ms [1.71 ms, 1.76 ms] 362.956 µs (26.5%)
appsec_no_iast 1.714 ms [1.69 ms, 1.739 ms] 342.579 µs (25.0%)
code_origins 1.706 ms [1.673 ms, 1.738 ms] 333.658 µs (24.3%)
iast 1.518 ms [1.493 ms, 1.544 ms] 146.542 µs (10.7%)
profiling 1.558 ms [1.522 ms, 1.595 ms] 186.58 µs (13.6%)
tracing 1.496 ms [1.473 ms, 1.52 ms] 124.409 µs (9.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.355 ms [1.335 ms, 1.375 ms] -
appsec 1.755 ms [1.731 ms, 1.778 ms] 399.266 µs (29.5%)
appsec_no_iast 1.731 ms [1.706 ms, 1.757 ms] 375.829 µs (27.7%)
code_origins 1.668 ms [1.634 ms, 1.702 ms] 312.507 µs (23.1%)
iast 1.506 ms [1.482 ms, 1.53 ms] 150.463 µs (11.1%)
profiling 1.5 ms [1.476 ms, 1.524 ms] 144.658 µs (10.7%)
tracing 1.49 ms [1.465 ms, 1.514 ms] 134.344 µs (9.9%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~6a2bd8d1ec, baseline=1.47.0-SNAPSHOT~8f945b02a7
    dateFormat X
    axisFormat %s
section baseline
no_agent (390.338 µs) : 370, 410
.   : milestone, 390,
iast (516.403 µs) : 492, 541
.   : milestone, 516,
iast_FULL (732.748 µs) : 711, 755
.   : milestone, 733,
iast_GLOBAL (560.154 µs) : 538, 582
.   : milestone, 560,
iast_HARDCODED_SECRET_DISABLED (514.01 µs) : 492, 536
.   : milestone, 514,
iast_INACTIVE (456.367 µs) : 435, 478
.   : milestone, 456,
iast_TELEMETRY_OFF (510.258 µs) : 487, 533
.   : milestone, 510,
tracing (451.748 µs) : 431, 473
.   : milestone, 452,
section candidate
no_agent (372.528 µs) : 353, 392
.   : milestone, 373,
iast (512.211 µs) : 489, 535
.   : milestone, 512,
iast_FULL (724.308 µs) : 702, 747
.   : milestone, 724,
iast_GLOBAL (552.747 µs) : 531, 574
.   : milestone, 553,
iast_HARDCODED_SECRET_DISABLED (511.017 µs) : 489, 533
.   : milestone, 511,
iast_INACTIVE (464.752 µs) : 443, 486
.   : milestone, 465,
iast_TELEMETRY_OFF (501.333 µs) : 478, 525
.   : milestone, 501,
tracing (451.161 µs) : 430, 472
.   : milestone, 451,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 390.338 µs [370.382 µs, 410.295 µs] -
iast 516.403 µs [491.86 µs, 540.946 µs] 126.065 µs (32.3%)
iast_FULL 732.748 µs [710.74 µs, 754.755 µs] 342.409 µs (87.7%)
iast_GLOBAL 560.154 µs [538.024 µs, 582.285 µs] 169.816 µs (43.5%)
iast_HARDCODED_SECRET_DISABLED 514.01 µs [492.199 µs, 535.821 µs] 123.671 µs (31.7%)
iast_INACTIVE 456.367 µs [435.196 µs, 477.537 µs] 66.028 µs (16.9%)
iast_TELEMETRY_OFF 510.258 µs [487.424 µs, 533.092 µs] 119.92 µs (30.7%)
tracing 451.748 µs [430.604 µs, 472.891 µs] 61.409 µs (15.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 372.528 µs [352.805 µs, 392.25 µs] -
iast 512.211 µs [489.419 µs, 535.003 µs] 139.683 µs (37.5%)
iast_FULL 724.308 µs [702.078 µs, 746.537 µs] 351.78 µs (94.4%)
iast_GLOBAL 552.747 µs [531.266 µs, 574.227 µs] 180.219 µs (48.4%)
iast_HARDCODED_SECRET_DISABLED 511.017 µs [488.863 µs, 533.171 µs] 138.489 µs (37.2%)
iast_INACTIVE 464.752 µs [443.368 µs, 486.136 µs] 92.225 µs (24.8%)
iast_TELEMETRY_OFF 501.333 µs [478.111 µs, 524.554 µs] 128.805 µs (34.6%)
tracing 451.161 µs [430.419 µs, 471.903 µs] 78.633 µs (21.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/test-env-6a2bd8d1ecc54c7c918efdbd1e62027619269fc2
git_commit_date 1741082792 1740747659
git_commit_sha 8f945b0 6a2bd8d
release_version 1.47.0-SNAPSHOT~8f945b02a7 1.47.0-SNAPSHOT~6a2bd8d1ec
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1741091167 1741091167
ci_job_id 831517809 831517809
ci_pipeline_id 57626474 57626474
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner--t2f38de-project-304-concurrent-3-06zwv02n 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner--t2f38de-project-304-concurrent-3-06zwv02n 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~6a2bd8d1ec, baseline=1.47.0-SNAPSHOT~8f945b02a7
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.457 s) : 15457000, 15457000
.   : milestone, 15457000,
appsec (15.259 s) : 15259000, 15259000
.   : milestone, 15259000,
iast (18.893 s) : 18893000, 18893000
.   : milestone, 18893000,
iast_GLOBAL (18.001 s) : 18001000, 18001000
.   : milestone, 18001000,
profiling (15.075 s) : 15075000, 15075000
.   : milestone, 15075000,
tracing (14.985 s) : 14985000, 14985000
.   : milestone, 14985000,
section candidate
no_agent (15.586 s) : 15586000, 15586000
.   : milestone, 15586000,
appsec (14.872 s) : 14872000, 14872000
.   : milestone, 14872000,
iast (18.649 s) : 18649000, 18649000
.   : milestone, 18649000,
iast_GLOBAL (18.031 s) : 18031000, 18031000
.   : milestone, 18031000,
profiling (15.103 s) : 15103000, 15103000
.   : milestone, 15103000,
tracing (14.94 s) : 14940000, 14940000
.   : milestone, 14940000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.457 s [15.457 s, 15.457 s] -
appsec 15.259 s [15.259 s, 15.259 s] -198.0 ms (-1.3%)
iast 18.893 s [18.893 s, 18.893 s] 3.436 s (22.2%)
iast_GLOBAL 18.001 s [18.001 s, 18.001 s] 2.544 s (16.5%)
profiling 15.075 s [15.075 s, 15.075 s] -382.0 ms (-2.5%)
tracing 14.985 s [14.985 s, 14.985 s] -472.0 ms (-3.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.586 s [15.586 s, 15.586 s] -
appsec 14.872 s [14.872 s, 14.872 s] -714.0 ms (-4.6%)
iast 18.649 s [18.649 s, 18.649 s] 3.063 s (19.7%)
iast_GLOBAL 18.031 s [18.031 s, 18.031 s] 2.445 s (15.7%)
profiling 15.103 s [15.103 s, 15.103 s] -483.0 ms (-3.1%)
tracing 14.94 s [14.94 s, 14.94 s] -646.0 ms (-4.1%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~6a2bd8d1ec, baseline=1.47.0-SNAPSHOT~8f945b02a7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (2.338 ms) : 2295, 2382
.   : milestone, 2338,
iast (2.123 ms) : 2068, 2178
.   : milestone, 2123,
iast_GLOBAL (2.162 ms) : 2107, 2218
.   : milestone, 2162,
profiling (1.965 ms) : 1921, 2008
.   : milestone, 1965,
tracing (1.952 ms) : 1910, 1994
.   : milestone, 1952,
section candidate
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (2.337 ms) : 2294, 2380
.   : milestone, 2337,
iast (2.119 ms) : 2063, 2174
.   : milestone, 2119,
iast_GLOBAL (2.159 ms) : 2103, 2214
.   : milestone, 2159,
profiling (1.973 ms) : 1929, 2018
.   : milestone, 1973,
tracing (1.952 ms) : 1910, 1995
.   : milestone, 1952,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.458 ms, 1.481 ms] -
appsec 2.338 ms [2.295 ms, 2.382 ms] 868.821 µs (59.1%)
iast 2.123 ms [2.068 ms, 2.178 ms] 653.426 µs (44.5%)
iast_GLOBAL 2.162 ms [2.107 ms, 2.218 ms] 692.582 µs (47.1%)
profiling 1.965 ms [1.921 ms, 2.008 ms] 495.133 µs (33.7%)
tracing 1.952 ms [1.91 ms, 1.994 ms] 482.493 µs (32.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 2.337 ms [2.294 ms, 2.38 ms] 864.397 µs (58.7%)
iast 2.119 ms [2.063 ms, 2.174 ms] 645.875 µs (43.9%)
iast_GLOBAL 2.159 ms [2.103 ms, 2.214 ms] 686.111 µs (46.6%)
profiling 1.973 ms [1.929 ms, 2.018 ms] 500.59 µs (34.0%)
tracing 1.952 ms [1.91 ms, 1.995 ms] 479.389 µs (32.6%)

@nikita-tkachenko-datadog nikita-tkachenko-datadog deleted the nikita-tkachenko/test-env-6a2bd8d1ecc54c7c918efdbd1e62027619269fc2 branch March 4, 2025 14:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tag: do not merge Do not merge changes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants