http addon using Ingress, NGINX Ingress Controller and ExternalName Service

[shreya0910]

Report

I am trying to setup keda + httpadd on is in keda ns & application + ingress is in app ns. Created Ingress, NGINX Ingress Controller and ExternalName Service setup(in app ns)

Here is the external service manifest

apiVersion: v1
kind: Service
  metadata:
    name: keda-add-ons-http-interceptor-proxy
    namespace: app
spec:
  type: ExternalName
  externalName: keda-add-ons-http-interceptor-proxy.keda.svc.cluster.local

Ingress

apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
  annotations:
    artifact.spinnaker.io/location: app
    artifact.spinnaker.io/name: health-check-svc
    artifact.spinnaker.io/type: kubernetes/ingress
    artifact.spinnaker.io/version: ''
    kubernetes.io/ingress.class: nginx
    nginx.ingress.kubernetes.io/rewrite-target: /path/
  labels:
  ## some labels
  name: health-check-svc
  namespace: app
spec:
  rules:
    - host: test.com
      http:
        paths:
          - backend:
              service:
                name: keda-add-ons-http-interceptor-proxy
                port:
                  number: 8080
            path: /dshc/
            pathType: ImplementationSpecific

Scaledobject

apiVersion: http.keda.sh/v1alpha1
kind: HTTPScaledObject
metadata:
  name: health-check-svc
  namespace: app
spec:
  hosts:
    - test.com
  pathPrefixes:
    - /path
  replicas:
    max: 5
    min: 0
  scaleTargetRef:
    deployment: health-check-svc
    name: health-check-svc
    port: 8080
    service: health-check-svc
  targetPendingRequests: 1

but so far its not working as expected
keda-add-ons-http-interceptor-proxy is not reachable from nginx. Here is the log

[26/Apr/2024:22:31:42 +0000] "GET /path HTTP/1.1" 499 0 "-" "-" 120 15.993 [apps-keda-add-ons-http-interceptor-proxy-8080] []
[26/Apr/2024:22:31:42 +0000] "GET /path HTTP/1.1" 502 150 "-" "-" 120 2.025 [apps-keda-add-ons-http-interceptor-proxy-8080] []

Expected Behavior

Request should be able to reach interceptor-proxy

Actual Behavior

[26/Apr/2024:22:31:42 +0000] "GET /path HTTP/1.1" 499 0 "-" "-" 120 15.993 [apps-keda-add-ons-http-interceptor-proxy-8080] []
[26/Apr/2024:22:31:42 +0000] "GET /path HTTP/1.1" 502 150 "-" "-" 120 2.025 [apps-keda-add-ons-http-interceptor-proxy-8080] []

Steps to Reproduce the Problem

1. Install keda & keda http add on in keda ns
2. Deploy application, ingress & external svc in app ns
3. Try to curl the host

Logs from KEDA HTTP operator

example

operator logs

│ 2024-04-26T22:48:40Z    INFO    setup    Running on Kubernetes 1.26+    {"version": "v1.26.14-eks-b9c9ed7"}                                                                                                                                                                                                             │
│ 2024-04-26T22:48:40Z    INFO    setup    WARNING: KEDA 2.13.0 hasn't been tested on Kubernetes v1.26.14-eks-b9c9ed7                                                                                                                                                                                                     │
│ 2024-04-26T22:48:40Z    INFO    setup    You can check recommended versions on https://keda.sh                                                                                                                                                                                                                          │
│ 2024-04-26T22:48:40Z    INFO    controller-runtime.metrics    Starting metrics server                                                                                                                                                                                                                                   │
│ 2024-04-26T22:48:40Z    INFO    starting server    {"kind": "health probe", "addr": ":8081"}                                                                                                                                                                                                                            │
│ I0426 22:48:40.968974       1 leaderelection.go:250] attempting to acquire leader lease keda/operator.keda.sh...                                                                                                                                                                                                        │
│ 2024-04-26T22:48:40Z    INFO    controller-runtime.metrics    Serving metrics server    {"bindAddress": ":8080", "secure": false}                                                                                                                                                                                       │
│ I0426 22:49:23.897424       1 leaderelection.go:260] successfully acquired lease keda/operator.keda.sh                                                                                                                                                                                                                  │
│ 2024-04-26T22:49:23Z    INFO    Starting EventSource    {"controller": "scaledobject", "controllerGroup": "keda.sh", "controllerKind": "ScaledObject", "source": "kind source: *v1alpha1.ScaledObject"}                                                                                                                 │
│ 2024-04-26T22:49:23Z    INFO    Starting EventSource    {"controller": "scaledobject", "controllerGroup": "keda.sh", "controllerKind": "ScaledObject", "source": "kind source: *v2.HorizontalPodAutoscaler"}                                                                                                            │
│ 2024-04-26T22:49:23Z    INFO    Starting Controller    {"controller": "scaledobject", "controllerGroup": "keda.sh", "controllerKind": "ScaledObject"}                                                                                                                                                                   │
│ 2024-04-26T22:49:23Z    INFO    Starting EventSource    {"controller": "triggerauthentication", "controllerGroup": "keda.sh", "controllerKind": "TriggerAuthentication", "source": "kind source: *v1alpha1.TriggerAuthentication"}                                                                                      │
│ 2024-04-26T22:49:23Z    INFO    Starting Controller    {"controller": "triggerauthentication", "controllerGroup": "keda.sh", "controllerKind": "TriggerAuthentication"}                                                                                                                                                 │
│ 2024-04-26T22:49:23Z    INFO    Starting EventSource    {"controller": "scaledjob", "controllerGroup": "keda.sh", "controllerKind": "ScaledJob", "source": "kind source: *v1alpha1.ScaledJob"}                                                                                                                          │
│ 2024-04-26T22:49:23Z    INFO    Starting Controller    {"controller": "scaledjob", "controllerGroup": "keda.sh", "controllerKind": "ScaledJob"}                                                                                                                                                                         │
│ 2024-04-26T22:49:23Z    INFO    Starting EventSource    {"controller": "cloudeventsource", "controllerGroup": "eventing.keda.sh", "controllerKind": "CloudEventSource", "source": "kind source: *v1alpha1.CloudEventSource"}                                                                                            │
│ 2024-04-26T22:49:23Z    INFO    Starting Controller    {"controller": "cloudeventsource", "controllerGroup": "eventing.keda.sh", "controllerKind": "CloudEventSource"}                                                                                                                                                  │
│ 2024-04-26T22:49:23Z    INFO    Starting EventSource    {"controller": "clustertriggerauthentication", "controllerGroup": "keda.sh", "controllerKind": "ClusterTriggerAuthentication", "source": "kind source: *v1alpha1.ClusterTriggerAuthentication"}                                                                 │
│ 2024-04-26T22:49:23Z    INFO    Starting Controller    {"controller": "clustertriggerauthentication", "controllerGroup": "keda.sh", "controllerKind": "ClusterTriggerAuthentication"}                                                                                                                                   │
│ 2024-04-26T22:49:23Z    INFO    cert-rotation    starting cert rotator controller                                                                                                                                                                                                                                       │
│ 2024-04-26T22:49:23Z    INFO    Starting EventSource    {"controller": "cert-rotator", "source": "kind source: *v1.Secret"}                                                                                                                                                                                             │
│ 2024-04-26T22:49:23Z    INFO    Starting EventSource    {"controller": "cert-rotator", "source": "kind source: *unstructured.Unstructured"}                                                                                                                                                                             │
│ 2024-04-26T22:49:23Z    INFO    Starting EventSource    {"controller": "cert-rotator", "source": "kind source: *unstructured.Unstructured"}                                                                                                                                                                             │
│ 2024-04-26T22:49:23Z    INFO    Starting Controller    {"controller": "cert-rotator"}                                                                                                                                                                                                                                   │
│     /workspace/controllers/keda/scaledobject_controller.go:264                                                                                                                                                                                                                                                          │
│ github.com/kedacore/keda/v2/controllers/keda.(*ScaledObjectReconciler).Reconcile                                                                                                                                                                                                                                        │
│     /workspace/controllers/keda/scaledobject_controller.go:191                                                                                                                                                                                                                                                          │
│ sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile                                                                                                                                                                                                                                          │
│     /workspace/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:119                                                                                                                                                                                                                          │
│ sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler                                                                                                                                                                                                                                   │
│     /workspace/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:316                                                                                                                                                                                                                          │
│ sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem                                                                                                                                                                                                                                │
│     /workspace/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:266                                                                                                                                                                                                                          │
│ sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2                                                                                                                                                                                                                                      │
│     /workspace/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:227                                                                                                                                                                                                                          │
│ 2024-04-26T22:49:24Z    ERROR    ****ScaledObject doesn't have correct scaleTargetRef specification    {"controller": "scaledobject", "controllerGroup": "keda.sh", "controllerKind": "ScaledObject", "ScaledObject": {"name":"keda-http-helm-chart-interceptor","namespace":"keda"}, "namespace": "keda", "name": "keda-ht │
│ github.com/kedacore/keda/v2/controllers/keda.(*ScaledObjectReconciler).Reconcile****    

interceptor logs

{"level":"info","ts":1714163786.658197,"logger":"LoggingMiddleware","caller":"middleware/logging.go:73","msg":"10.10.227.111:41246 - - [26/Apr/2024:20:36:26 +0000] \"GET /livez HTTP/1.1\" 200 2 \"\" \"kube-probe/1.26+\""}                                                                                           │
│ {"level":"info","ts":1714163786.6583877,"logger":"LoggingMiddleware","caller":"middleware/logging.go:73","msg":"10.10.227.111:41244 - - [26/Apr/2024:20:36:26 +0000] \"GET /readyz HTTP/1.1\" 200 2 \"\" \"kube-probe/1.26+\""}                                                                                         │
│ W0426 20:36:28.114572       1 reflector.go:535] k8s.io/client-go@v0.28.2/tools/cache/reflector.go:229: failed to list *v1.Deployment: deployments.apps is forbidden: User "system:serviceaccount:keda:keda-http-helm-chart-interceptor" cannot list resource "deployments" in API group "apps" at the cluster scope     │
│ E0426 20:36:28.114602       1 reflector.go:147] k8s.io/client-go@v0.28.2/tools/cache/reflector.go:229: Failed to watch *v1.Deployment: failed to list *v1.Deployment: deployments.apps is forbidden: User "system:serviceaccount:keda:keda-http-helm-chart-interceptor" cannot list resource "deployments" in API group │

HTTP Add-on Version

0.6.0

Kubernetes Version

< 1.27

Platform

Amazon Web Services

Anything else?

No response

[JorTurFer]

Hello!
From your manifests, I think that the externalName service is called demo-externalname but the service called from nginx is keda-add-ons-http-interceptor-proxy.
I assume that your ingress is in the application namespace, so the route is

• ingress -> external name service -> http-add-on service -> interceptor -> you app service -> your app
  Try changing the service in the ingress to the externalName service

[JorTurFer]

I can see also an issue related with RBAC in the interceptor, I'd suggest upgrading to v0.7.0. For going live, I'd wait until v0.8.0, because we found an error on helm chart that blocks the helm upgrade, forcing to remove and reinstall (so, for evaluating the add-on can be enough v0.7.0, but for something stable you should wait for v0.8.0)

v0.8.0 will be released soon, and your problem isn't related with the version but with ingress config

[shreya0910]

Hello! From your manifests, I think that the externalName service is called demo-externalname but the service called from nginx is keda-add-ons-http-interceptor-proxy. I assume that your ingress is in the application namespace, so the route is

• ingress -> external name service -> http-add-on service -> interceptor -> you app service -> your app
  Try changing the service in the ingress to the externalName service

Hello!! Sorry that was a typo. I have updated it.
Yes the route is this - ingress -> external name service -> http-add-on service -> interceptor -> you app service -> your app.. Is this standard approach in such scenario when ingress is in application ns? If possible could you share some references. Thanks

[JorTurFer]

Is this standard approach in such scenario when ingress is in application ns?

Yeah, it's a good option indeed

Yes the route is this - ingress -> external name service -> http-add-on service -> interceptor -> you app service -> your app

Your ingress is pointing directly to http-add-on service, which probably isn't correct as you should refer to the external name service

apiVersion: networking.k8s.io/v1
kind: Ingress
...
spec:
  rules:
    - host: test.com
      http:
        paths:
          - backend:
              service:
                name: keda-add-ons-http-interceptor-proxy
                ....

Is that your configuration at ingress level?

[shreya0910]

Is this standard approach in such scenario when ingress is in application ns?

Yeah, it's a good option indeed

Yes the route is this - ingress -> external name service -> http-add-on service -> interceptor -> you app service -> your app

Your ingress is pointing directly to http-add-on service, which probably isn't correct as you should refer to the external name service

apiVersion: networking.k8s.io/v1
kind: Ingress
...
spec:
  rules:
    - host: test.com
      http:
        paths:
          - backend:
              service:
                name: keda-add-ons-http-interceptor-proxy
                ....

Is that your configuration at ingress level?

Thanks for your inputs. I am closing this issue now.

[SevginGalibov]

I have a similar problem

So let me summarize the topic.

http add ons and keda operator are installed in the "keda" namespace. The service list is as follows;

keda-add-ons-http-controller-manager-metrics-service   ClusterIP   x.x.x.x  	<none>        8443/TCP           2d8h
keda-add-ons-http-external-scaler                      ClusterIP   x.x.x.x      <none>        9090/TCP           2d8h
keda-add-ons-http-interceptor-admin                    ClusterIP   x.x.x.x     	<none>        9090/TCP           2d8h
keda-add-ons-http-interceptor-proxy                    ClusterIP   x.x.x.x    	<none>        8080/TCP           2d8h
keda-admission-webhooks                                ClusterIP   x.x.x.x    	<none>        443/TCP            2d9h
keda-interceptor-proxy                                 ClusterIP   x.x.x.x   	<none>        8080/TCP           2d8h
keda-operator                                          ClusterIP   x.x.x.x  	<none>        9666/TCP           2d9h
keda-operator-metrics-apiserver

I have an external API service in the "test" namespace and an externalname service for the keda interceptor.

api-service                   ClusterIP      x.x.x.x  <none>                                                       		  80/TCP    2d8h
keda-interceptor-proxy-test   ExternalName   <none>          keda-add-ons-http-interceptor-proxy.keda.svc.cluster.local   80/TCP    2d8h

The content of my external service in the "test" namespace is as follows;

  externalName: keda-add-ons-http-interceptor-proxy.keda.svc.cluster.local
  ports:
  - port: 80
    protocol: TCP
    targetPort: 8080
  sessionAffinity: None
  type: ExternalName
status:
  loadBalancer: {}

I also have an nginx ingress for my api-service in the "test" namespace;

apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
  annotations:
  generation: 6
  name: api-ingress
  namespace: test
spec:
  ingressClassName: nginx
  rules:
  - host: www.api.com
    http:
      paths:
      - backend:
          service:
            name: keda-interceptor-proxy-test
            port:
              number: 80
        path: /
        pathType: Prefix
status:
  loadBalancer:
    ingress:
    - hostname: x.x.x.x

keda-add-ons-http-interceptor logs;

2025-02-09T22:21:04Z	ERROR	LoggingMiddleware.RoutingMiddleware.StaticHandler	Not Found	{"routingKey": "//www.api.com/weatherforecast/", "namespacedNameError": "PANIC=value method k8s.io/apimachinery/pkg/types.NamespacedName.MarshalLog called using nil *NamespacedName pointer", "stream": "<nil>"}
github.com/kedacore/http-add-on/interceptor/handler.(*Static).ServeHTTP
	github.com/kedacore/http-add-on/interceptor/handler/static.go:36
github.com/kedacore/http-add-on/interceptor/middleware.(*Routing).ServeHTTP
	github.com/kedacore/http-add-on/interceptor/middleware/routing.go:54
github.com/kedacore/http-add-on/interceptor/middleware.(*Logging).ServeHTTP
	github.com/kedacore/http-add-on/interceptor/middleware/logging.go:42
github.com/kedacore/http-add-on/interceptor/middleware.(*Metrics).ServeHTTP
	github.com/kedacore/http-add-on/interceptor/middleware/metrics.go:24
net/http.serverHandler.ServeHTTP
	net/http/server.go:3210
net/http.(*conn).serve
	net/http/server.go:2092

When I send the request I get a not found warning on a black page.

What is the problem in this case?

[JorTurFer]

What is the problem in this case?

The error is related with missing route (no HTTPScaledObject), could you share your HTTPScaledObject?

[SevginGalibov]

What is the problem in this case?

The error is related with missing route (no HTTPScaledObject), could you share your HTTPScaledObject?

thank you, I solved my problem. The reason it gave 404 not found was that I did not deploy the http scaled object. I did not know that the https scaled object was doing the redirection. :)

[pmmridul]

Is this standard approach in such scenario when ingress is in application ns?

Yeah, it's a good option indeed

Yes the route is this - ingress -> external name service -> http-add-on service -> interceptor -> you app service -> your app

Your ingress is pointing directly to http-add-on service, which probably isn't correct as you should refer to the external name service

apiVersion: networking.k8s.io/v1
kind: Ingress
...
spec:
rules:
- host: test.com
http:
paths:
- backend:
service:
name: keda-add-ons-http-interceptor-proxy
....
Is that your configuration at ingress level?

@JorTurFer AWS ALB Ingress doesn't allow pointing to an ExternalName service. I tried creating a separate ingress in Keda namespace that routes traffic directly to Keda Interceptor Proxy. But this gives me a 404 error. What could I be missing here?

[mansour188]

apiVersion: v1
kind: Service
metadata:
name: scale-application-service-proxy
namespace: default
annotations: # Moved annotations to metadata section
service.alpha.kubernetes.io/tolerate-unready-endpoints: "true"
spec:
externalName: keda-add-ons-http-interceptor-proxy.keda.svc.cluster.local
type: ExternalName

---

apiVersion: v1
kind: Service
metadata:
name: unsloth-llm-service
spec:
selector:
app: unsloth-llm
ports:
- protocol: TCP
port: 80
targetPort: 8000
type: ClusterIP # Changed from LoadBalancer

è-----------------------
apiVersion: http.keda.sh/v1alpha1
kind: HTTPScaledObject
metadata:
name: unsloth-llm.com
spec:
hosts:

• scale-application-service-proxy # Updated to the new proxy
  scaleTargetRef:
  name: unsloth-llm # Deployment name
  kind: Deployment # The kind of resource (Deployment)
  apiVersion: apps/v1 # API version for the Deployment
  service: unsloth-llm-service
  port: 8000
  replicas:
  min: 0
  max: 3
  targetPendingRequests: 1

---

apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
name: unsloth-llm-ingress
annotations:
nginx.ingress.kubernetes.io/proxy-read-timeout: "600"
nginx.ingress.kubernetes.io/proxy-send-timeout: "600"
nginx.ingress.kubernetes.io/proxy-body-size: "64m"
nginx.ingress.kubernetes.io/upstream-vhost: "unsloth-llm-service.default.svc.cluster.local"

# Alternative to configuration-snippet
nginx.ingress.kubernetes.io/proxy-set-headers: "k8s-nginx-proxy-headers"

spec:
ingressClassName: nginx
rules:

• host: "unsloth-llm.com" # Replace with your actual domain
  http:
  paths:
  • path: /
    pathType: Prefix
    backend:
    service:
    name: scale-application-service-proxy
    port:
    number: 80

---

th-llm-http-scaler","namespace":"default"}, "namespace": "default", "name": "unsloth-llm-http-scaler", "reconcileID": "58493fa3-fb09-4eae-a8ff-f1f53e5ab09b"}
2025-05-08T14:15:11Z ERROR external_push_scaler error running internalRun {"type": "ScaledObject", "namespace": "default", "name": "unsloth-llm-http-scaler", "error": "rpc error: code = Canceled desc = context canceled"}
github.com/kedacore/keda/v2/pkg/scalers.(*externalPushScaler).Run.func1
/workspace/pkg/scalers/external_scaler.go:260
github.com/kedacore/keda/v2/pkg/scalers.(*externalPushScaler).Run
/workspace/pkg/scalers/external_scaler.go:279
2025-05-08T14:15:11Z INFO Successfully restored scaleTarget's replica count back to the original {"controller": "scaledobject", "controllerGroup": "keda.sh", "controllerKind": "ScaledObject", "ScaledObject": {"name":"unsloth-llm-http-scaler","namespace":"default"}, "namespace": "default", "name": "unsloth-llm-http-scaler", "reconcileID": "58493fa3-fb09-4eae-a8ff-f1f53e5ab09b", "replicaCount": 0}
2025-05-08T14:15:11Z INFO Successfully finalized ScaledObject {"controller": "scaledobject", "controllerGroup": "keda.sh", "controllerKind": "ScaledObject", "ScaledObject": {"name":"unsloth-llm-http-scaler","namespace":"default"}, "namespace": "default", "name": "unsloth-llm-http-scaler", "reconcileID": "58493fa3-fb09-4eae-a8ff-f1f53e5ab09b"}
2025-05-08T14:24:54Z INFO Reconciling ScaledObject {"controller": "scaledobject", "controllerGroup": "keda.sh", "controllerKind": "ScaledObject", "ScaledObject": {"name":"unsloth-llm.com","namespace":"default"}, "namespace": "default", "name": "unsloth-llm.com", "reconcileID": "26ebb6ff-fb52-4cca-ae5e-8d4d09767cbe"}
2025-05-08T14:24:54Z INFO Adding Finalizer for the ScaledObject {"controller": "scaledobject", "controllerGroup": "keda.sh", "controllerKind": "ScaledObject", "ScaledObject": {"name":"unsloth-llm.com","namespace":"default"}, "namespace": "default", "name": "unsloth-llm.com", "reconcileID": "26ebb6ff-fb52-4cca-ae5e-8d4d09767cbe"}
2025-05-08T14:24:55Z INFO Detected resource targeted for scaling {"controller": "scaledobject", "controllerGroup": "keda.sh", "controllerKind": "ScaledObject", "ScaledObject": {"name":"unsloth-llm.com","namespace":"default"}, "namespace": "default", "name": "unsloth-llm.com", "reconcileID": "26ebb6ff-fb52-4cca-ae5e-8d4d09767cbe", "resource": "apps/v1.Deployment", "name": "unsloth-llm"}
2025-05-08T14:24:55Z INFO Creating a new HPA {"controller": "scaledobject", "controllerGroup": "keda.sh", "controllerKind": "ScaledObject", "ScaledObject": {"name":"unsloth-llm.com","namespace":"default"}, "namespace": "default", "name": "unsloth-llm.com", "reconcileID": "26ebb6ff-fb52-4cca-ae5e-8d4d09767cbe", "HPA.Namespace": "default", "HPA.Name": "keda-hpa-unsloth-llm.com"}
2025-05-08T14:24:55Z INFO Initializing Scaling logic according to ScaledObject Specification {"controller": "scaledobject", "controllerGroup": "keda.sh", "controllerKind": "ScaledObject", "ScaledObject": {"name":"unsloth-llm.com","namespace":"default"}, "namespace": "default", "name": "unsloth-llm.com", "reconcileID": "26ebb6ff-fb52-4cca-ae5e-8d4d09767cbe"}
2025-05-08T14:24:55Z INFO Reconciling ScaledObject {"controller": "scaledobject", "controllerGroup": "keda.sh", "controllerKind": "ScaledObject", "ScaledObject": {"name":"unsloth-llm.com","namespace":"default"}, "namespace": "default", "name": "unsloth-llm.com", "reconcileID": "4b384fca-5428-4cf4-a23d-c201dfae5e8a"}
2025-05-08T14:24:55Z INFO Detected resource targeted for scaling {"controller": "scaledobject", "controllerGroup": "keda.sh", "controllerKind": "ScaledObject", "ScaledObject": {"name":"unsloth-llm.com","namespace":"default"}, "namespace": "default", "name": "unsloth-llm.com", "reconcileID": "4b384fca-5428-4cf4-a23d-c201dfae5e8a", "resource": "apps/v1.Deployment", "name": "unsloth-llm"}

---

when try acces from external
http://unsloth-llm.com/infrence i get time out
no scaling and no pods run of my apps
what is the problem
pls heelp