-
Notifications
You must be signed in to change notification settings - Fork 311
Add SSI Appsec System tests #9048
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Hi! 👋 Thanks for your pull request! 🎉 To help us review it, please make sure to:
If you need help, please check our contributing guidelines. |
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 43 metrics, 10 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.52.0-SNAPSHOT~ea800bb7b1, baseline=1.52.0-SNAPSHOT~3abf3010b9
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (993.551 ms) : 0, 993551
Total [baseline] (10.635 s) : 0, 10635100
Agent [candidate] (993.147 ms) : 0, 993147
Total [candidate] (10.611 s) : 0, 10610706
section appsec
Agent [baseline] (1.174 s) : 0, 1173638
Total [baseline] (10.708 s) : 0, 10707889
Agent [candidate] (1.172 s) : 0, 1172149
Total [candidate] (10.743 s) : 0, 10742592
section iast
Agent [baseline] (1.133 s) : 0, 1132689
Total [baseline] (10.815 s) : 0, 10815205
Agent [candidate] (1.129 s) : 0, 1129436
Total [candidate] (10.803 s) : 0, 10802868
section profiling
Agent [baseline] (1.246 s) : 0, 1245889
Total [baseline] (10.981 s) : 0, 10981172
Agent [candidate] (1.253 s) : 0, 1252706
Total [candidate] (11.028 s) : 0, 11028378
gantt
title petclinic - break down per module: candidate=1.52.0-SNAPSHOT~ea800bb7b1, baseline=1.52.0-SNAPSHOT~3abf3010b9
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (685.469 ms) : 0, 685469
BytebuddyAgent [candidate] (685.399 ms) : 0, 685399
GlobalTracer [baseline] (242.03 ms) : 0, 242030
GlobalTracer [candidate] (241.837 ms) : 0, 241837
AppSec [baseline] (30.343 ms) : 0, 30343
AppSec [candidate] (30.205 ms) : 0, 30205
Debugger [baseline] (5.971 ms) : 0, 5971
Debugger [candidate] (6.046 ms) : 0, 6046
Remote Config [baseline] (671.525 µs) : 0, 672
Remote Config [candidate] (671.83 µs) : 0, 672
Telemetry [baseline] (8.209 ms) : 0, 8209
Telemetry [candidate] (8.208 ms) : 0, 8208
section appsec
BytebuddyAgent [baseline] (708.224 ms) : 0, 708224
BytebuddyAgent [candidate] (707.815 ms) : 0, 707815
GlobalTracer [baseline] (235.633 ms) : 0, 235633
GlobalTracer [candidate] (234.789 ms) : 0, 234789
AppSec [baseline] (170.934 ms) : 0, 170934
AppSec [candidate] (170.873 ms) : 0, 170873
Debugger [baseline] (5.751 ms) : 0, 5751
Debugger [candidate] (5.704 ms) : 0, 5704
Remote Config [baseline] (610.314 µs) : 0, 610
Remote Config [candidate] (599.209 µs) : 0, 599
Telemetry [baseline] (8.056 ms) : 0, 8056
Telemetry [candidate] (8.013 ms) : 0, 8013
IAST [baseline] (23.674 ms) : 0, 23674
IAST [candidate] (23.518 ms) : 0, 23518
section iast
BytebuddyAgent [baseline] (806.808 ms) : 0, 806808
BytebuddyAgent [candidate] (804.2 ms) : 0, 804200
GlobalTracer [baseline] (233.269 ms) : 0, 233269
GlobalTracer [candidate] (232.368 ms) : 0, 232368
AppSec [baseline] (27.924 ms) : 0, 27924
AppSec [candidate] (29.771 ms) : 0, 29771
Debugger [baseline] (5.713 ms) : 0, 5713
Debugger [candidate] (6.627 ms) : 0, 6627
Remote Config [baseline] (583.205 µs) : 0, 583
Remote Config [candidate] (574.762 µs) : 0, 575
Telemetry [baseline] (7.946 ms) : 0, 7946
Telemetry [candidate] (7.875 ms) : 0, 7875
IAST [baseline] (29.693 ms) : 0, 29693
IAST [candidate] (27.283 ms) : 0, 27283
section profiling
BytebuddyAgent [baseline] (676.613 ms) : 0, 676613
BytebuddyAgent [candidate] (682.301 ms) : 0, 682301
GlobalTracer [baseline] (362.391 ms) : 0, 362391
GlobalTracer [candidate] (363.497 ms) : 0, 363497
AppSec [baseline] (34.033 ms) : 0, 34033
AppSec [candidate] (32.615 ms) : 0, 32615
Debugger [baseline] (10.484 ms) : 0, 10484
Debugger [candidate] (11.545 ms) : 0, 11545
Remote Config [baseline] (662.388 µs) : 0, 662
Remote Config [candidate] (668.581 µs) : 0, 669
Telemetry [baseline] (8.07 ms) : 0, 8070
Telemetry [candidate] (8.891 ms) : 0, 8891
ProfilingAgent [baseline] (104.991 ms) : 0, 104991
ProfilingAgent [candidate] (104.319 ms) : 0, 104319
Profiling [baseline] (105.016 ms) : 0, 105016
Profiling [candidate] (104.345 ms) : 0, 104345
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.52.0-SNAPSHOT~ea800bb7b1, baseline=1.52.0-SNAPSHOT~3abf3010b9
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (991.09 ms) : 0, 991090
Total [baseline] (8.57 s) : 0, 8569868
Agent [candidate] (994.543 ms) : 0, 994543
Total [candidate] (8.585 s) : 0, 8584599
section iast
Agent [baseline] (1.133 s) : 0, 1133043
Total [baseline] (9.275 s) : 0, 9275455
Agent [candidate] (1.132 s) : 0, 1131806
Total [candidate] (9.288 s) : 0, 9288106
gantt
title insecure-bank - break down per module: candidate=1.52.0-SNAPSHOT~ea800bb7b1, baseline=1.52.0-SNAPSHOT~3abf3010b9
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (684.228 ms) : 0, 684228
BytebuddyAgent [candidate] (686.717 ms) : 0, 686717
GlobalTracer [baseline] (241.166 ms) : 0, 241166
GlobalTracer [candidate] (241.953 ms) : 0, 241953
AppSec [baseline] (30.17 ms) : 0, 30170
AppSec [candidate] (30.272 ms) : 0, 30272
Debugger [baseline] (5.952 ms) : 0, 5952
Debugger [candidate] (5.975 ms) : 0, 5975
Remote Config [baseline] (671.814 µs) : 0, 672
Remote Config [candidate] (673.886 µs) : 0, 674
Telemetry [baseline] (8.188 ms) : 0, 8188
Telemetry [candidate] (8.224 ms) : 0, 8224
section iast
BytebuddyAgent [baseline] (808.518 ms) : 0, 808518
BytebuddyAgent [candidate] (806.57 ms) : 0, 806570
GlobalTracer [baseline] (231.973 ms) : 0, 231973
GlobalTracer [candidate] (232.347 ms) : 0, 232347
AppSec [baseline] (30.447 ms) : 0, 30447
AppSec [candidate] (27.166 ms) : 0, 27166
Debugger [baseline] (5.713 ms) : 0, 5713
Debugger [candidate] (7.516 ms) : 0, 7516
Remote Config [baseline] (573.735 µs) : 0, 574
Remote Config [candidate] (593.563 µs) : 0, 594
Telemetry [baseline] (7.869 ms) : 0, 7869
Telemetry [candidate] (7.905 ms) : 0, 7905
IAST [baseline] (27.201 ms) : 0, 27201
IAST [candidate] (29.066 ms) : 0, 29066
LoadParameters
See matching parameters
SummaryFound 2 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~ea800bb7b1, baseline=1.52.0-SNAPSHOT~3abf3010b9
dateFormat X
axisFormat %s
section baseline
no_agent (35.791 ms) : 35505, 36077
. : milestone, 35791,
appsec (47.809 ms) : 47396, 48221
. : milestone, 47809,
code_origins (46.232 ms) : 45831, 46634
. : milestone, 46232,
iast (45.078 ms) : 44687, 45468
. : milestone, 45078,
profiling (50.304 ms) : 49828, 50780
. : milestone, 50304,
tracing (43.872 ms) : 43520, 44223
. : milestone, 43872,
section candidate
no_agent (35.61 ms) : 35326, 35894
. : milestone, 35610,
appsec (47.897 ms) : 47459, 48336
. : milestone, 47897,
code_origins (43.937 ms) : 43562, 44312
. : milestone, 43937,
iast (42.171 ms) : 41803, 42538
. : milestone, 42171,
profiling (50.761 ms) : 50302, 51221
. : milestone, 50761,
tracing (42.863 ms) : 42506, 43220
. : milestone, 42863,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~ea800bb7b1, baseline=1.52.0-SNAPSHOT~3abf3010b9
dateFormat X
axisFormat %s
section baseline
no_agent (4.389 ms) : 4333, 4446
. : milestone, 4389,
iast (9.444 ms) : 9287, 9601
. : milestone, 9444,
iast_FULL (13.944 ms) : 13668, 14221
. : milestone, 13944,
iast_GLOBAL (10.203 ms) : 10024, 10382
. : milestone, 10203,
profiling (8.479 ms) : 8350, 8609
. : milestone, 8479,
tracing (7.576 ms) : 7458, 7694
. : milestone, 7576,
section candidate
no_agent (4.368 ms) : 4318, 4417
. : milestone, 4368,
iast (9.436 ms) : 9270, 9601
. : milestone, 9436,
iast_FULL (13.631 ms) : 13362, 13900
. : milestone, 13631,
iast_GLOBAL (10.091 ms) : 9914, 10269
. : milestone, 10091,
profiling (8.751 ms) : 8600, 8901
. : milestone, 8751,
tracing (7.436 ms) : 7328, 7545
. : milestone, 7436,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~ea800bb7b1, baseline=1.52.0-SNAPSHOT~3abf3010b9
dateFormat X
axisFormat %s
section baseline
no_agent (1.48 ms) : 1468, 1491
. : milestone, 1480,
appsec (2.416 ms) : 2366, 2466
. : milestone, 2416,
iast (2.186 ms) : 2124, 2248
. : milestone, 2186,
iast_GLOBAL (2.239 ms) : 2176, 2301
. : milestone, 2239,
profiling (2.056 ms) : 2005, 2108
. : milestone, 2056,
tracing (2.017 ms) : 1969, 2066
. : milestone, 2017,
section candidate
no_agent (1.478 ms) : 1466, 1489
. : milestone, 1478,
appsec (2.413 ms) : 2363, 2463
. : milestone, 2413,
iast (2.194 ms) : 2132, 2256
. : milestone, 2194,
iast_GLOBAL (2.239 ms) : 2176, 2302
. : milestone, 2239,
profiling (2.039 ms) : 1989, 2089
. : milestone, 2039,
tracing (2.009 ms) : 1961, 2058
. : milestone, 2009,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~ea800bb7b1, baseline=1.52.0-SNAPSHOT~3abf3010b9
dateFormat X
axisFormat %s
section baseline
no_agent (14.905 s) : 14905000, 14905000
. : milestone, 14905000,
appsec (14.916 s) : 14916000, 14916000
. : milestone, 14916000,
iast (18.442 s) : 18442000, 18442000
. : milestone, 18442000,
iast_GLOBAL (17.873 s) : 17873000, 17873000
. : milestone, 17873000,
profiling (15.119 s) : 15119000, 15119000
. : milestone, 15119000,
tracing (14.747 s) : 14747000, 14747000
. : milestone, 14747000,
section candidate
no_agent (14.7 s) : 14700000, 14700000
. : milestone, 14700000,
appsec (14.706 s) : 14706000, 14706000
. : milestone, 14706000,
iast (18.698 s) : 18698000, 18698000
. : milestone, 18698000,
iast_GLOBAL (18.218 s) : 18218000, 18218000
. : milestone, 18218000,
profiling (14.928 s) : 14928000, 14928000
. : milestone, 14928000,
tracing (14.666 s) : 14666000, 14666000
. : milestone, 14666000,
|
caa29ce
to
50ec4ca
Compare
f15ade8
to
ea800bb
Compare
What does this PR do?
Add the
simple_onboarding_appsec
to the gitlab workflow.Motivation
Add system tests scenario for SSI Appsec.
Additional Notes
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]