Set fullnameOverride and validate Otel kube-stack deployment datastreams are being written (metrics, traces) #7754

rogercoll · 2025-04-08T11:32:48Z

What does this PR do?

Adds tests to ensure the Helm chart is correctly deployed and data pushed to Elasticsearch:

Validates metrics collected with the kubeletstats receiver are written to Elasticsearch.
Deploys a Java application to validate auto-instrumentation works properly and the corresponding traces documents are available in Elasticsearch. As an alternative, I tried to install the OpenTelemetry demo Helm Chart and assert its traces, but it is too heavy (big images, e.g. flagd → 1.2GB) for the testing timeouts.

Why is it important?

mergify · 2025-04-08T11:33:29Z

This pull request does not have a backport label. Could you fix it @rogercoll? 🙏
To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

backport-./d./d is the label that automatically backports to the 8./d branch. /d is the digit
backport-active-all is the label that automatically backports to all active branches.
backport-active-8 is the label that automatically backports to all active minor branches for the 8 major.
backport-active-9 is the label that automatically backports to all active minor branches for the 9 major.

deploy/helm/edot-collector/kube-stack/managed_otlp/values.yaml

testing/integration/kubernetes_agent_standalone_test.go

testing/integration/otel_helm_test.go

elastic-sonarqube · 2025-04-28T08:58:49Z

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarQube

github-actions · 2025-04-28T10:19:11Z

@Mergifyio backport 8.17 8.18 8.19 9.0

mergify · 2025-04-28T10:19:19Z

backport 8.17 8.18 8.19 9.0

✅ Backports have been created

#8000 [8.17] (backport #7754) Set fullnameOverride and validate Otel kube-stack deployment datastreams are being written (metrics, traces) has been created for branch 8.17 but encountered conflicts
#8001 [8.18] (backport #7754) Set fullnameOverride and validate Otel kube-stack deployment datastreams are being written (metrics, traces) has been created for branch 8.18 but encountered conflicts
#8002 [8.19] (backport #7754) Set fullnameOverride and validate Otel kube-stack deployment datastreams are being written (metrics, traces) has been created for branch 8.19 but encountered conflicts
#8003 [9.0] (backport #7754) Set fullnameOverride and validate Otel kube-stack deployment datastreams are being written (metrics, traces) has been created for branch 9.0

…ams are being written (metrics, traces) (#7754) (cherry picked from commit 8ec0229) # Conflicts: # testing/integration/otel_helm_test.go

…ams are being written (metrics, traces) (#7754) (cherry picked from commit 8ec0229) # Conflicts: # testing/integration/kubernetes_agent_standalone_test.go # testing/integration/otel_helm_test.go

…ams are being written (metrics, traces) (#7754) (cherry picked from commit 8ec0229) # Conflicts: # testing/integration/otel_helm_test.go

…ams are being written (metrics, traces) (#7754) (cherry picked from commit 8ec0229)

…ams are being written (metrics, traces) (#7754) (#8003) (cherry picked from commit 8ec0229) Co-authored-by: Roger Coll <[email protected]>

…tack deployment datastreams are being written (metrics, traces) (#8000) * Set fullnameOverride and validate Otel kube-stack deployment datastreams are being written (metrics, traces) (#7754) (cherry picked from commit 8ec0229) # Conflicts: # testing/integration/kubernetes_agent_standalone_test.go # testing/integration/otel_helm_test.go * fix: merge conflicts --------- Co-authored-by: Roger Coll <[email protected]>

…tack deployment datastreams are being written (metrics, traces) (#8001) * Set fullnameOverride and validate Otel kube-stack deployment datastreams are being written (metrics, traces) (#7754) (cherry picked from commit 8ec0229) # Conflicts: # testing/integration/otel_helm_test.go * fix: merge conflicts --------- Co-authored-by: Roger Coll <[email protected]>

…tack deployment datastreams are being written (metrics, traces) (#8002) * Set fullnameOverride and validate Otel kube-stack deployment datastreams are being written (metrics, traces) (#7754) (cherry picked from commit 8ec0229) # Conflicts: # testing/integration/otel_helm_test.go * fix: merge conflicts --------- Co-authored-by: Roger Coll <[email protected]>

mergify bot assigned rogercoll Apr 8, 2025

rogercoll force-pushed the add_datastream_tests branch from 3c7c0c7 to eb6ecf2 Compare April 8, 2025 13:01

rogercoll added the skip-changelog label Apr 8, 2025

rogercoll changed the title ~~Add datastream tests~~ [chore] Validate kube-stack datastreams are being written Apr 8, 2025

rogercoll added 2 commits April 8, 2025 17:18

test: validate kubelet datastream hits

e306e2a

override gateway collector name

963d70b

rogercoll force-pushed the add_datastream_tests branch from eb6ecf2 to 963d70b Compare April 8, 2025 15:18

rogercoll added 5 commits April 9, 2025 12:51

fix: datastream namespace

3ed2a06

fix: elasticsearch exporter requires encoded api_key

9c250bf

test: unify edot and elastic-agent test cases

11e5b43

test: add auto-instrumentation java app

764fc20

chore: set explicity fullNameOverride values

ca715d4

rogercoll commented Apr 10, 2025

View reviewed changes

deploy/helm/edot-collector/kube-stack/managed_otlp/values.yaml Outdated Show resolved Hide resolved

rogercoll commented Apr 10, 2025

View reviewed changes

testing/integration/kubernetes_agent_standalone_test.go Show resolved Hide resolved

rogercoll commented Apr 10, 2025

View reviewed changes

testing/integration/otel_helm_test.go Show resolved Hide resolved

rogercoll added 2 commits April 10, 2025 13:10

test: validate generic.otel logs datastream

76c72aa

Merge branch 'main' into add_datastream_tests

175177a

rogercoll changed the title ~~[chore] Validate kube-stack datastreams are being written~~ [chore] Validate kube-stack datastreams are being written (metrics, logs, traces) Apr 10, 2025

rogercoll changed the title ~~[chore] Validate kube-stack datastreams are being written (metrics, logs, traces)~~ [chore] Validate Otel kube-stack deployment datastreams are being written (metrics, logs, traces) Apr 10, 2025

rogercoll marked this pull request as ready for review April 10, 2025 11:14

rogercoll requested review from a team as code owners April 10, 2025 11:14

rogercoll requested review from blakerouse and kaanyalti April 10, 2025 11:14

rogercoll added the backport-active-all Automated backport with mergify to all the active branches label Apr 10, 2025

rogercoll added 2 commits April 10, 2025 15:53

output datastream name for errors

46d4217

test: disable logs case

b291412

rogercoll changed the title ~~[chore] Validate Otel kube-stack deployment datastreams are being written (metrics, logs, traces)~~ [chore] Validate Otel kube-stack deployment datastreams are being written (metrics, traces) Apr 11, 2025

pierrehilbert added the Team:Elastic-Agent-Control-Plane Label for the Agent Control Plane team label Apr 11, 2025

rogercoll added 2 commits April 28, 2025 09:52

Merge branch 'main' into add_datastream_tests

81eacfe

fix: set valid managed cluster collector name

b624221

rogercoll dismissed stale reviews from ChrsMark and swiatekm via b624221 April 28, 2025 07:55

rogercoll requested review from ChrsMark and swiatekm April 28, 2025 09:51

swiatekm approved these changes Apr 28, 2025

View reviewed changes

ChrsMark approved these changes Apr 28, 2025

View reviewed changes

ChrsMark merged commit 8ec0229 into elastic:main Apr 28, 2025
12 checks passed

mergify bot pushed a commit that referenced this pull request Apr 28, 2025

Set fullnameOverride and validate Otel kube-stack deployment datastre…

7e6ad5f

…ams are being written (metrics, traces) (#7754) (cherry picked from commit 8ec0229)

mergify bot mentioned this pull request Apr 28, 2025

[9.0] (backport #7754) Set fullnameOverride and validate Otel kube-stack deployment datastreams are being written (metrics, traces) #8003

Merged

rogercoll mentioned this pull request May 5, 2025

Improve testing elastic/opentelemetry#61

Open

pkoutsovasilis mentioned this pull request Jun 18, 2025

[ci] fix k8s integration tests flakiness #8575

Merged

8 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Set fullnameOverride and validate Otel kube-stack deployment datastreams are being written (metrics, traces) #7754

Set fullnameOverride and validate Otel kube-stack deployment datastreams are being written (metrics, traces) #7754

Uh oh!

rogercoll commented Apr 8, 2025 •

edited

Loading

Uh oh!

mergify bot commented Apr 8, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

elastic-sonarqube bot commented Apr 28, 2025

Uh oh!

Uh oh!

github-actions bot commented Apr 28, 2025

Uh oh!

mergify bot commented Apr 28, 2025 •

edited

Loading

Uh oh!

Uh oh!

Set fullnameOverride and validate Otel kube-stack deployment datastreams are being written (metrics, traces) #7754

Set fullnameOverride and validate Otel kube-stack deployment datastreams are being written (metrics, traces) #7754

Uh oh!

Conversation

rogercoll commented Apr 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What does this PR do?

Why is it important?

Uh oh!

mergify bot commented Apr 8, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

elastic-sonarqube bot commented Apr 28, 2025

Quality Gate passed

Uh oh!

Uh oh!

github-actions bot commented Apr 28, 2025

Uh oh!

mergify bot commented Apr 28, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

✅ Backports have been created

Uh oh!

Uh oh!

rogercoll commented Apr 8, 2025 •

edited

Loading

mergify bot commented Apr 28, 2025 •

edited

Loading