Skip to content

Nikita tkachenko/test env c8886fbcec351b29b985f0e1cda16311baa1fc19 #8493

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 2 commits into from
Closed

Nikita tkachenko/test env c8886fbcec351b29b985f0e1cda16311baa1fc19 #8493

wants to merge 2 commits into from

Conversation

nikita-tkachenko-datadog
Copy link
Contributor

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

jpbempel and others added 2 commits February 28, 2025 18:55
@jpbempel
Add In-Product Enablement (#8461)
dceca28 
Introduce the ability to start and stop Debugger features:
 - Dynamic Instrumentation
 - Exception Replay
 - Code Origin
 - Distributed Debugger
dynamically based on RemoteConfig record: APM_TRACING
DebuggerAgent is now run every time at startup to have the base of
some feature ready and be able to start the minimum required foe each
feature.
Ability to stop also the feature at any time to uninstall probes.
Add smoke tests
@evanchooly
use proper class def to find interfaces (#8476)
c8886fb
@nikita-tkachenko-datadog nikita-tkachenko-datadog added the tag: do not merge Do not merge changes label Mar 4, 2025
@pr-commenter
Copy link

pr-commenter bot commented Mar 4, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/test-env-c8886fbcec351b29b985f0e1cda16311baa1fc19
git_commit_date 1741082792 1740770051
git_commit_sha 8f945b0 c8886fb
release_version 1.47.0-SNAPSHOT~8f945b02a7 1.47.0-SNAPSHOT~c8886fbcec
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741091806 1741091806
ci_job_id 831519274 831519274
ci_pipeline_id 57626523 57626523
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-8ksbllmc-project-304-concurrent-3-fo1vb0z8 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-8ksbllmc-project-304-concurrent-3-fo1vb0z8 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~c8886fbcec, baseline=1.47.0-SNAPSHOT~8f945b02a7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.14 s) : 0, 1139532
Total [baseline] (9.257 s) : 0, 9256919
Agent [candidate] (1.134 s) : 0, 1133714
Total [candidate] (9.265 s) : 0, 9265137
section iast
Agent [baseline] (1.26 s) : 0, 1260359
Total [baseline] (9.845 s) : 0, 9844929
Agent [candidate] (1.255 s) : 0, 1255061
Total [candidate] (9.858 s) : 0, 9857769
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.256 s) : 0, 1255644
Total [baseline] (9.83 s) : 0, 9830461
Agent [candidate] (1.265 s) : 0, 1265424
Total [candidate] (9.835 s) : 0, 9834917
section iast_TELEMETRY_OFF
Agent [baseline] (1.255 s) : 0, 1254583
Total [baseline] (9.886 s) : 0, 9886132
Agent [candidate] (1.254 s) : 0, 1253618
Total [candidate] (9.856 s) : 0, 9855749
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.14 s -
Agent iast 1.26 s 120.827 ms (10.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.256 s 116.112 ms (10.2%)
Agent iast_TELEMETRY_OFF 1.255 s 115.052 ms (10.1%)
Total tracing 9.257 s -
Total iast 9.845 s 588.01 ms (6.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.83 s 573.542 ms (6.2%)
Total iast_TELEMETRY_OFF 9.886 s 629.213 ms (6.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.134 s -
Agent iast 1.255 s 121.347 ms (10.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.265 s 131.709 ms (11.6%)
Agent iast_TELEMETRY_OFF 1.254 s 119.904 ms (10.6%)
Total tracing 9.265 s -
Total iast 9.858 s 592.632 ms (6.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.835 s 569.779 ms (6.1%)
Total iast_TELEMETRY_OFF 9.856 s 590.612 ms (6.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~c8886fbcec, baseline=1.47.0-SNAPSHOT~8f945b02a7

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (720.785 ms) : 0, 720785
BytebuddyAgent [candidate] (716.303 ms) : 0, 716303
GlobalTracer [baseline] (239.802 ms) : 0, 239802
GlobalTracer [candidate] (238.938 ms) : 0, 238938
AppSec [baseline] (55.714 ms) : 0, 55714
AppSec [candidate] (55.642 ms) : 0, 55642
Debugger [baseline] (95.296 ms) : 0, 95296
Debugger [candidate] (94.884 ms) : 0, 94884
Remote Config [baseline] (591.359 µs) : 0, 591
Remote Config [candidate] (581.998 µs) : 0, 582
Telemetry [baseline] (12.312 ms) : 0, 12312
Telemetry [candidate] (12.317 ms) : 0, 12317
section iast
BytebuddyAgent [baseline] (835.836 ms) : 0, 835836
BytebuddyAgent [candidate] (834.508 ms) : 0, 834508
GlobalTracer [baseline] (230.075 ms) : 0, 230075
GlobalTracer [candidate] (229.479 ms) : 0, 229479
IAST [baseline] (23.029 ms) : 0, 23029
IAST [candidate] (22.776 ms) : 0, 22776
AppSec [baseline] (56.621 ms) : 0, 56621
AppSec [candidate] (57.065 ms) : 0, 57065
Debugger [baseline] (83.624 ms) : 0, 83624
Debugger [candidate] (83.481 ms) : 0, 83481
Remote Config [baseline] (518.98 µs) : 0, 519
Remote Config [candidate] (517.994 µs) : 0, 518
Telemetry [baseline] (15.637 ms) : 0, 15637
Telemetry [candidate] (12.172 ms) : 0, 12172
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (834.096 ms) : 0, 834096
BytebuddyAgent [candidate] (842.08 ms) : 0, 842080
GlobalTracer [baseline] (229.779 ms) : 0, 229779
GlobalTracer [candidate] (231.131 ms) : 0, 231131
IAST [baseline] (22.681 ms) : 0, 22681
IAST [candidate] (23.014 ms) : 0, 23014
AppSec [baseline] (57.092 ms) : 0, 57092
AppSec [candidate] (57.327 ms) : 0, 57327
Debugger [baseline] (83.575 ms) : 0, 83575
Debugger [candidate] (83.792 ms) : 0, 83792
Remote Config [baseline] (514.664 µs) : 0, 515
Remote Config [candidate] (530.117 µs) : 0, 530
Telemetry [baseline] (12.813 ms) : 0, 12813
Telemetry [candidate] (12.399 ms) : 0, 12399
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (832.975 ms) : 0, 832975
BytebuddyAgent [candidate] (832.737 ms) : 0, 832737
GlobalTracer [baseline] (230.743 ms) : 0, 230743
GlobalTracer [candidate] (229.736 ms) : 0, 229736
IAST [baseline] (22.397 ms) : 0, 22397
IAST [candidate] (22.286 ms) : 0, 22286
AppSec [baseline] (57.325 ms) : 0, 57325
AppSec [candidate] (57.482 ms) : 0, 57482
Debugger [baseline] (83.547 ms) : 0, 83547
Debugger [candidate] (83.772 ms) : 0, 83772
Remote Config [baseline] (528.126 µs) : 0, 528
Remote Config [candidate] (549.226 µs) : 0, 549
Telemetry [baseline] (12.033 ms) : 0, 12033
Telemetry [candidate] (12.033 ms) : 0, 12033
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~c8886fbcec, baseline=1.47.0-SNAPSHOT~8f945b02a7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.139 s) : 0, 1139353
Total [baseline] (11.486 s) : 0, 11485932
Agent [candidate] (1.141 s) : 0, 1140818
Total [candidate] (11.496 s) : 0, 11496462
section appsec
Agent [baseline] (1.271 s) : 0, 1271413
Total [baseline] (11.654 s) : 0, 11654483
Agent [candidate] (1.276 s) : 0, 1276137
Total [candidate] (11.728 s) : 0, 11728340
section iast
Agent [baseline] (1.258 s) : 0, 1257784
Total [baseline] (11.91 s) : 0, 11910446
Agent [candidate] (1.272 s) : 0, 1271852
Total [candidate] (11.96 s) : 0, 11960290
section profiling
Agent [baseline] (1.377 s) : 0, 1377247
Total [baseline] (11.793 s) : 0, 11793415
Agent [candidate] (1.389 s) : 0, 1388790
Total [candidate] (11.889 s) : 0, 11889398
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.139 s -
Agent appsec 1.271 s 132.06 ms (11.6%)
Agent iast 1.258 s 118.431 ms (10.4%)
Agent profiling 1.377 s 237.894 ms (20.9%)
Total tracing 11.486 s -
Total appsec 11.654 s 168.552 ms (1.5%)
Total iast 11.91 s 424.514 ms (3.7%)
Total profiling 11.793 s 307.483 ms (2.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.141 s -
Agent appsec 1.276 s 135.319 ms (11.9%)
Agent iast 1.272 s 131.034 ms (11.5%)
Agent profiling 1.389 s 247.972 ms (21.7%)
Total tracing 11.496 s -
Total appsec 11.728 s 231.877 ms (2.0%)
Total iast 11.96 s 463.828 ms (4.0%)
Total profiling 11.889 s 392.936 ms (3.4%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~c8886fbcec, baseline=1.47.0-SNAPSHOT~8f945b02a7

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (719.072 ms) : 0, 719072
BytebuddyAgent [candidate] (720.829 ms) : 0, 720829
GlobalTracer [baseline] (240.439 ms) : 0, 240439
GlobalTracer [candidate] (240.481 ms) : 0, 240481
AppSec [baseline] (55.875 ms) : 0, 55875
AppSec [candidate] (55.687 ms) : 0, 55687
Debugger [baseline] (95.773 ms) : 0, 95773
Debugger [candidate] (95.573 ms) : 0, 95573
Remote Config [baseline] (579.95 µs) : 0, 580
Remote Config [candidate] (593.356 µs) : 0, 593
Telemetry [baseline] (12.512 ms) : 0, 12512
Telemetry [candidate] (12.52 ms) : 0, 12520
section appsec
BytebuddyAgent [baseline] (734.107 ms) : 0, 734107
BytebuddyAgent [candidate] (737.462 ms) : 0, 737462
GlobalTracer [baseline] (236.54 ms) : 0, 236540
GlobalTracer [candidate] (236.636 ms) : 0, 236636
IAST [baseline] (21.446 ms) : 0, 21446
IAST [candidate] (21.957 ms) : 0, 21957
AppSec [baseline] (176.499 ms) : 0, 176499
AppSec [candidate] (178.288 ms) : 0, 178288
Debugger [baseline] (85.565 ms) : 0, 85565
Debugger [candidate] (84.574 ms) : 0, 84574
Remote Config [baseline] (629.007 µs) : 0, 629
Remote Config [candidate] (638.092 µs) : 0, 638
Telemetry [baseline] (12.327 ms) : 0, 12327
Telemetry [candidate] (12.432 ms) : 0, 12432
section iast
BytebuddyAgent [baseline] (835.325 ms) : 0, 835325
BytebuddyAgent [candidate] (846.561 ms) : 0, 846561
GlobalTracer [baseline] (230.66 ms) : 0, 230660
GlobalTracer [candidate] (232.201 ms) : 0, 232201
IAST [baseline] (22.576 ms) : 0, 22576
IAST [candidate] (23.881 ms) : 0, 23881
AppSec [baseline] (57.13 ms) : 0, 57130
AppSec [candidate] (56.815 ms) : 0, 56815
Debugger [baseline] (83.502 ms) : 0, 83502
Debugger [candidate] (84.19 ms) : 0, 84190
Remote Config [baseline] (522.13 µs) : 0, 522
Remote Config [candidate] (527.684 µs) : 0, 528
Telemetry [baseline] (12.956 ms) : 0, 12956
Telemetry [candidate] (12.39 ms) : 0, 12390
section profiling
BytebuddyAgent [baseline] (707.777 ms) : 0, 707777
BytebuddyAgent [candidate] (715.189 ms) : 0, 715189
GlobalTracer [baseline] (349.271 ms) : 0, 349271
GlobalTracer [candidate] (353.237 ms) : 0, 353237
AppSec [baseline] (55.092 ms) : 0, 55092
AppSec [candidate] (54.944 ms) : 0, 54944
Debugger [baseline] (88.605 ms) : 0, 88605
Debugger [candidate] (88.883 ms) : 0, 88883
Remote Config [baseline] (617.71 µs) : 0, 618
Remote Config [candidate] (626.462 µs) : 0, 626
Telemetry [baseline] (12.447 ms) : 0, 12447
Telemetry [candidate] (12.736 ms) : 0, 12736
ProfilingAgent [baseline] (123.012 ms) : 0, 123012
ProfilingAgent [candidate] (122.379 ms) : 0, 122379
Profiling [baseline] (123.033 ms) : 0, 123033
Profiling [candidate] (122.399 ms) : 0, 122399
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-04T12:04:17 2025-03-04T12:12:09
git_branch master nikita-tkachenko/test-env-c8886fbcec351b29b985f0e1cda16311baa1fc19
git_commit_date 1741082792 1740770051
git_commit_sha 8f945b0 c8886fb
release_version 1.47.0-SNAPSHOT~8f945b02a7 1.47.0-SNAPSHOT~c8886fbcec
start_time 2025-03-04T12:04:03 2025-03-04T12:11:55
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741090734 1741090734
ci_job_id 831519275 831519275
ci_pipeline_id 57626523 57626523
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner--t2f38de-project-304-concurrent-6-3aupeynl 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner--t2f38de-project-304-concurrent-6-3aupeynl 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~c8886fbcec, baseline=1.47.0-SNAPSHOT~8f945b02a7
    dateFormat X
    axisFormat %s
section baseline
no_agent (375.692 µs) : 356, 395
.   : milestone, 376,
iast (512.046 µs) : 490, 534
.   : milestone, 512,
iast_FULL (724.807 µs) : 703, 747
.   : milestone, 725,
iast_GLOBAL (551.747 µs) : 530, 574
.   : milestone, 552,
iast_HARDCODED_SECRET_DISABLED (508.876 µs) : 487, 530
.   : milestone, 509,
iast_INACTIVE (459.054 µs) : 437, 481
.   : milestone, 459,
iast_TELEMETRY_OFF (492.298 µs) : 471, 514
.   : milestone, 492,
tracing (449.409 µs) : 427, 472
.   : milestone, 449,
section candidate
no_agent (378.322 µs) : 358, 399
.   : milestone, 378,
iast (512.72 µs) : 490, 535
.   : milestone, 513,
iast_FULL (719.804 µs) : 698, 742
.   : milestone, 720,
iast_GLOBAL (545.937 µs) : 523, 569
.   : milestone, 546,
iast_HARDCODED_SECRET_DISABLED (504.999 µs) : 483, 527
.   : milestone, 505,
iast_INACTIVE (463.238 µs) : 442, 485
.   : milestone, 463,
iast_TELEMETRY_OFF (495.311 µs) : 473, 517
.   : milestone, 495,
tracing (454.856 µs) : 433, 477
.   : milestone, 455,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 375.692 µs [356.004 µs, 395.38 µs] -
iast 512.046 µs [490.106 µs, 533.985 µs] 136.354 µs (36.3%)
iast_FULL 724.807 µs [702.713 µs, 746.901 µs] 349.115 µs (92.9%)
iast_GLOBAL 551.747 µs [529.944 µs, 573.549 µs] 176.055 µs (46.9%)
iast_HARDCODED_SECRET_DISABLED 508.876 µs [487.361 µs, 530.391 µs] 133.184 µs (35.5%)
iast_INACTIVE 459.054 µs [437.008 µs, 481.101 µs] 83.362 µs (22.2%)
iast_TELEMETRY_OFF 492.298 µs [470.627 µs, 513.97 µs] 116.606 µs (31.0%)
tracing 449.409 µs [427.039 µs, 471.779 µs] 73.717 µs (19.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.322 µs [357.77 µs, 398.874 µs] -
iast 512.72 µs [490.324 µs, 535.116 µs] 134.398 µs (35.5%)
iast_FULL 719.804 µs [697.704 µs, 741.904 µs] 341.482 µs (90.3%)
iast_GLOBAL 545.937 µs [523.121 µs, 568.754 µs] 167.615 µs (44.3%)
iast_HARDCODED_SECRET_DISABLED 504.999 µs [483.385 µs, 526.613 µs] 126.677 µs (33.5%)
iast_INACTIVE 463.238 µs [441.919 µs, 484.556 µs] 84.916 µs (22.4%)
iast_TELEMETRY_OFF 495.311 µs [473.24 µs, 517.382 µs] 116.989 µs (30.9%)
tracing 454.856 µs [432.718 µs, 476.993 µs] 76.534 µs (20.2%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~c8886fbcec, baseline=1.47.0-SNAPSHOT~8f945b02a7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.354 ms) : 1335, 1374
.   : milestone, 1354,
appsec (1.735 ms) : 1712, 1759
.   : milestone, 1735,
appsec_no_iast (1.717 ms) : 1693, 1741
.   : milestone, 1717,
code_origins (1.688 ms) : 1655, 1720
.   : milestone, 1688,
iast (1.492 ms) : 1467, 1517
.   : milestone, 1492,
profiling (1.566 ms) : 1539, 1592
.   : milestone, 1566,
tracing (1.485 ms) : 1462, 1509
.   : milestone, 1485,
section candidate
no_agent (1.331 ms) : 1311, 1351
.   : milestone, 1331,
appsec (1.719 ms) : 1695, 1743
.   : milestone, 1719,
appsec_no_iast (1.717 ms) : 1693, 1742
.   : milestone, 1717,
code_origins (1.691 ms) : 1659, 1724
.   : milestone, 1691,
iast (1.505 ms) : 1480, 1531
.   : milestone, 1505,
profiling (1.551 ms) : 1525, 1576
.   : milestone, 1551,
tracing (1.482 ms) : 1457, 1506
.   : milestone, 1482,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.354 ms [1.335 ms, 1.374 ms] -
appsec 1.735 ms [1.712 ms, 1.759 ms] 381.14 µs (28.1%)
appsec_no_iast 1.717 ms [1.693 ms, 1.741 ms] 362.397 µs (26.8%)
code_origins 1.688 ms [1.655 ms, 1.72 ms] 333.147 µs (24.6%)
iast 1.492 ms [1.467 ms, 1.517 ms] 137.818 µs (10.2%)
profiling 1.566 ms [1.539 ms, 1.592 ms] 211.481 µs (15.6%)
tracing 1.485 ms [1.462 ms, 1.509 ms] 130.825 µs (9.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.331 ms [1.311 ms, 1.351 ms] -
appsec 1.719 ms [1.695 ms, 1.743 ms] 388.603 µs (29.2%)
appsec_no_iast 1.717 ms [1.693 ms, 1.742 ms] 386.486 µs (29.0%)
code_origins 1.691 ms [1.659 ms, 1.724 ms] 360.678 µs (27.1%)
iast 1.505 ms [1.48 ms, 1.531 ms] 174.411 µs (13.1%)
profiling 1.551 ms [1.525 ms, 1.576 ms] 220.038 µs (16.5%)
tracing 1.482 ms [1.457 ms, 1.506 ms] 150.932 µs (11.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/test-env-c8886fbcec351b29b985f0e1cda16311baa1fc19
git_commit_date 1741082792 1740770051
git_commit_sha 8f945b0 c8886fb
release_version 1.47.0-SNAPSHOT~8f945b02a7 1.47.0-SNAPSHOT~c8886fbcec
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1741091287 1741091287
ci_job_id 831519276 831519276
ci_pipeline_id 57626523 57626523
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-8ksbllmc-project-304-concurrent-4-8rg2p9ci 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-8ksbllmc-project-304-concurrent-4-8rg2p9ci 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~c8886fbcec, baseline=1.47.0-SNAPSHOT~8f945b02a7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.468 ms) : 1456, 1479
.   : milestone, 1468,
appsec (2.355 ms) : 2311, 2399
.   : milestone, 2355,
iast (2.127 ms) : 2071, 2183
.   : milestone, 2127,
iast_GLOBAL (2.169 ms) : 2113, 2225
.   : milestone, 2169,
profiling (1.981 ms) : 1937, 2026
.   : milestone, 1981,
tracing (1.954 ms) : 1912, 1997
.   : milestone, 1954,
section candidate
no_agent (1.474 ms) : 1462, 1486
.   : milestone, 1474,
appsec (2.349 ms) : 2305, 2393
.   : milestone, 2349,
iast (2.13 ms) : 2074, 2186
.   : milestone, 2130,
iast_GLOBAL (2.163 ms) : 2107, 2219
.   : milestone, 2163,
profiling (1.972 ms) : 1928, 2016
.   : milestone, 1972,
tracing (1.946 ms) : 1903, 1989
.   : milestone, 1946,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.456 ms, 1.479 ms] -
appsec 2.355 ms [2.311 ms, 2.399 ms] 887.111 µs (60.4%)
iast 2.127 ms [2.071 ms, 2.183 ms] 659.514 µs (44.9%)
iast_GLOBAL 2.169 ms [2.113 ms, 2.225 ms] 701.723 µs (47.8%)
profiling 1.981 ms [1.937 ms, 2.026 ms] 513.838 µs (35.0%)
tracing 1.954 ms [1.912 ms, 1.997 ms] 486.425 µs (33.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.486 ms] -
appsec 2.349 ms [2.305 ms, 2.393 ms] 874.803 µs (59.4%)
iast 2.13 ms [2.074 ms, 2.186 ms] 655.831 µs (44.5%)
iast_GLOBAL 2.163 ms [2.107 ms, 2.219 ms] 689.302 µs (46.8%)
profiling 1.972 ms [1.928 ms, 2.016 ms] 497.834 µs (33.8%)
tracing 1.946 ms [1.903 ms, 1.989 ms] 471.971 µs (32.0%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~c8886fbcec, baseline=1.47.0-SNAPSHOT~8f945b02a7
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.078 s) : 15078000, 15078000
.   : milestone, 15078000,
appsec (15.027 s) : 15027000, 15027000
.   : milestone, 15027000,
iast (18.733 s) : 18733000, 18733000
.   : milestone, 18733000,
iast_GLOBAL (18.191 s) : 18191000, 18191000
.   : milestone, 18191000,
profiling (15.032 s) : 15032000, 15032000
.   : milestone, 15032000,
tracing (14.957 s) : 14957000, 14957000
.   : milestone, 14957000,
section candidate
no_agent (15.405 s) : 15405000, 15405000
.   : milestone, 15405000,
appsec (14.998 s) : 14998000, 14998000
.   : milestone, 14998000,
iast (18.905 s) : 18905000, 18905000
.   : milestone, 18905000,
iast_GLOBAL (18.128 s) : 18128000, 18128000
.   : milestone, 18128000,
profiling (14.84 s) : 14840000, 14840000
.   : milestone, 14840000,
tracing (14.973 s) : 14973000, 14973000
.   : milestone, 14973000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.078 s [15.078 s, 15.078 s] -
appsec 15.027 s [15.027 s, 15.027 s] -51.0 ms (-0.3%)
iast 18.733 s [18.733 s, 18.733 s] 3.655 s (24.2%)
iast_GLOBAL 18.191 s [18.191 s, 18.191 s] 3.113 s (20.6%)
profiling 15.032 s [15.032 s, 15.032 s] -46.0 ms (-0.3%)
tracing 14.957 s [14.957 s, 14.957 s] -121.0 ms (-0.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.405 s [15.405 s, 15.405 s] -
appsec 14.998 s [14.998 s, 14.998 s] -407.0 ms (-2.6%)
iast 18.905 s [18.905 s, 18.905 s] 3.5 s (22.7%)
iast_GLOBAL 18.128 s [18.128 s, 18.128 s] 2.723 s (17.7%)
profiling 14.84 s [14.84 s, 14.84 s] -565.0 ms (-3.7%)
tracing 14.973 s [14.973 s, 14.973 s] -432.0 ms (-2.8%)

@nikita-tkachenko-datadog nikita-tkachenko-datadog deleted the nikita-tkachenko/test-env-c8886fbcec351b29b985f0e1cda16311baa1fc19 branch March 4, 2025 14:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
tag: do not merge Do not merge changes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@nikita-tkachenko-datadog @jpbempel @evanchooly