Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

In dapr standalone mode, keda scaling doesn't work #514

Open
GlobeFishNG opened this issue Jan 17, 2024 · 0 comments
Open

In dapr standalone mode, keda scaling doesn't work #514

GlobeFishNG opened this issue Jan 17, 2024 · 0 comments
Assignees
@wrongerror
Labels
bug Something isn't working

Comments

@GlobeFishNG
Copy link

Description
KEDA scaling works in dapr sidecar mode but doesn't work in standalone mode.

Environmental
Microk8s

  • Operating System Information
  • kubernetes version: v1.27.8
  • OpenFunction version: 1.2.0
  • Versions of dependent components (e.g. dapr, keda, shipwright, knative)
    • keda: 2.12.1
    • dapr: 1.11.3

Expected behavior
KEDA scaling works both in dapr sidecar mode and standalone mode for async functions.

Actual behavior
KEDA scaling works in dapr sidecar mode and doesn't work in standalone mode for async functions.

To Reproduce
Steps to reproduce the behavior:

  1. Create an async functions as below
apiVersion: core.openfunction.io/v1beta2
kind: Function
metadata:
  name: rabbitmq-python-hello
spec:
  version: "1.0.0"
  image: "rabbitmq-python:1.0.0"
  serving:
    annotations:
      dapr.io/app-protocol: grpc
      dapr.io/log-as-json: "false"
      dapr.io/log-level: debug
      openfunction.io/enable-dapr: "true"
      openfunction.io/dapr-service-mode: "sidecar"
    scaleOptions:
      minReplicas: 0
      maxReplicas: 10
      keda:
        triggers:
          - type: rabbitmq
            metadata:
              host: amqp://test:test@rabbitmq.rabbitmq.svc.cluster.local:5672/openfunction 
              protocol: auto
              mode: QueueLength
              value: "10"
              queueName: rabbitmq-hello-python-in
        scaledObject:
          pollingInterval: 15
          cooldownPeriod: 60
          advanced:
            horizontalPodAutoscalerConfig:
              behavior:
                scaleDown:
                  stabilizationWindowSeconds: 45
                  policies:
                    - type: Percent
                      value: 50
                      periodSeconds: 15
                scaleUp:
                  stabilizationWindowSeconds: 0
    bindings:
      rabbitmq-in:
        type: bindings.rabbitmq
        version: v1
        metadata:
          - name: queueName
            value: rabbitmq-hello-python-in
          - name: host
            value: amqp://test:test@rabbitmq.rabbitmq.svc.cluster.local:5672/openfunction
          - name: contentType
            value: "application/cloudevents+json"
          - name: durable
            value: "true"
          - name: direction
            value: input
      rabbitmq-out:
        type: bindings.rabbitmq
        version: v1
        metadata:
          - name: queueName
            value: "rabbitmq-hello-python-out"
          - name: host
            value: amqp://test:test@rabbitmq.rabbitmq.svc.cluster.local:5672/openfunction
          - name: durable
            value: "true"
          - name: contentType
            value: "application/cloudevents+json"
          - name: direction
            value: output
    triggers:
      dapr:
        - name: rabbitmq-in
          type: bindings.rabbitmq
    outputs:
      - dapr:
          name: rabbitmq-out
          operation: create
          type: bindings.rabbitmq
    params:
      # DEBUG: common:*,ofn:*
      FUNCTION_TARGET: function
    template:
      containers:
        - name: function
          imagePullPolicy: Always
          env:
            - name: TZ
              value: Asia/Shanghai
  1. Send a message to RabbitMQ queue rabbitmq-hello-python-in.
  2. The function is scaled up to 1 replica and then to process the message.
  3. 30 seconds latter, the function is scaled down to 0.
  4. Change the function annatation openfunction.io/dapr-service-mode: "sidecar" to openfunction.io/dapr-service-mode: "standalone"
  5. Send a message to RabbitMQ queue rabbitmq-hello-python-in again.
  6. The function is not scaled up to 1.
  7. The dapr sidecar pod warns a error.
❯ k get pods
❯ k get functions.core.openfunction.io
NAME                    BUILDSTATE   SERVINGSTATE   BUILDER   SERVING         ADDRESS   AGE
rabbitmq-python-hello   Skipped      Running                  serving-xnz24             45m
NAME                                                        READY   STATUS    RESTARTS   AGE
serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj   2/2     Running   0          45m
❯ kl -f serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj dapr-proxy
dapr client initializing for: 127.0.0.1:50001
dapr client initializing for: 127.0.0.1:50001
I0117 07:20:27.698716       1 async.go:137] registered bindings handler: serving-xnz24-bindings-rabbitmq-in-tvnhk
I0117 07:20:27.698750       1 async.go:77] Async Function serving grpc: listening on port 8080
E0117 07:22:02.825166       1 main.go:102] No available endpoints
❯ kl -f serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj daprd | head -n 60
time="2024-01-17T07:20:26.365782818Z" level=info msg="starting Dapr Runtime -- version 1.11.3 -- commit 9f99c6adca78dfc04b8063974f27b3a7534ae798" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.365820624Z" level=info msg="log level set to: debug" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.365954422Z" level=info msg="metrics server started on :9090/" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.metrics type=log ver=1.11.3
time="2024-01-17T07:20:26.366076483Z" level=info msg="Initializing the operator client" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.376990249Z" level=info msg="loading default configuration" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.378875062Z" level=debug msg="No resiliency policies found" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.378919881Z" level=debug msg="Found 0 resiliency configurations from Kubernetes" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.378952154Z" level=info msg="Resiliency configuration loaded" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.379389177Z" level=info msg="kubernetes mode configured" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.379458911Z" level=info msg="app id: rabbitmq-python-hello-pisces" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.379478938Z" level=info msg="mTLS enabled. creating sidecar authenticator" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.37957295Z" level=info msg="trust anchors and cert chain extracted successfully" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.security type=log ver=1.11.3
time="2024-01-17T07:20:26.379593202Z" level=info msg="authenticator created" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.387339757Z" level=info msg="Dapr trace sampler initialized: DaprTraceSampler(P=0.000100)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.38741793Z" level=info msg="Initialized name resolution to kubernetes" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.387496456Z" level=debug msg="Loading component: kubernetes (secretstores.kubernetes/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.387559326Z" level=info msg="Loading components…" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.388112653Z" level=info msg="Component loaded: kubernetes (secretstores.kubernetes/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.389450586Z" level=debug msg="Found component: serving-xnz24-bindings-rabbitmq-in-tvnhk (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.389476712Z" level=debug msg="Found component: serving-xnz24-bindings-rabbitmq-out-hslmd (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.389491063Z" level=debug msg="Loading component: serving-xnz24-bindings-rabbitmq-in-tvnhk (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.405928855Z" level=info msg="Connected to RabbitMQ" app_id=rabbitmq-python-hello-pisces component="serving-xnz24-bindings-rabbitmq-in-tvnhk (bindings.rabbitmq/v1)" instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.contrib type=log ver=1.11.3
time="2024-01-17T07:20:26.406030522Z" level=info msg="successful init for output binding serving-xnz24-bindings-rabbitmq-in-tvnhk (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.413822328Z" level=info msg="Connected to RabbitMQ" app_id=rabbitmq-python-hello-pisces component="serving-xnz24-bindings-rabbitmq-in-tvnhk (bindings.rabbitmq/v1)" instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.contrib type=log ver=1.11.3
time="2024-01-17T07:20:26.413857867Z" level=info msg="successful init for input binding serving-xnz24-bindings-rabbitmq-in-tvnhk (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.413898719Z" level=info msg="Component loaded: serving-xnz24-bindings-rabbitmq-in-tvnhk (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.413933363Z" level=debug msg="Loading component: serving-xnz24-bindings-rabbitmq-out-hslmd (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.414023984Z" level=info msg="Waiting for all outstanding components to be processed" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.421084515Z" level=info msg="Connected to RabbitMQ" app_id=rabbitmq-python-hello-pisces component="serving-xnz24-bindings-rabbitmq-out-hslmd (bindings.rabbitmq/v1)" instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.contrib type=log ver=1.11.3
time="2024-01-17T07:20:26.421115905Z" level=info msg="successful init for output binding serving-xnz24-bindings-rabbitmq-out-hslmd (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.428187648Z" level=info msg="Connected to RabbitMQ" app_id=rabbitmq-python-hello-pisces component="serving-xnz24-bindings-rabbitmq-out-hslmd (bindings.rabbitmq/v1)" instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.contrib type=log ver=1.11.3
time="2024-01-17T07:20:26.428237596Z" level=info msg="successful init for input binding serving-xnz24-bindings-rabbitmq-out-hslmd (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.428279726Z" level=info msg="Component loaded: serving-xnz24-bindings-rabbitmq-out-hslmd (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.428330168Z" level=info msg="All outstanding components processed" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.428374716Z" level=info msg="Loading endpoints" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.429711532Z" level=debug msg="No http endpoints found" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.httpendpoints type=log ver=1.11.3
time="2024-01-17T07:20:26.429757977Z" level=info msg="Waiting for all outstanding http endpoints to be processed" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.429781622Z" level=info msg="All outstanding http endpoints processed" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.429803785Z" level=info msg="gRPC proxy enabled" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.429905791Z" level=info msg="gRPC server listening on TCP address: [::]:50001" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.api type=log ver=1.11.3
time="2024-01-17T07:20:26.429984177Z" level=debug msg="Failed to listen for gRPC server on TCP address 0.0.0.0:50001 with error: listen tcp 0.0.0.0:50001: bind: address already in use" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.api type=log ver=1.11.3
time="2024-01-17T07:20:26.430014568Z" level=info msg="Enabled gRPC tracing middleware" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.api type=log ver=1.11.3
time="2024-01-17T07:20:26.430034611Z" level=info msg="Enabled gRPC metrics middleware" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.api type=log ver=1.11.3
time="2024-01-17T07:20:26.430182305Z" level=info msg="Registering workflow engine for gRPC endpoint: [::]:50001" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.api type=log ver=1.11.3
time="2024-01-17T07:20:26.430250864Z" level=info msg="API gRPC server is running on port 50001" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.431226713Z" level=info msg="enabled metrics http middleware" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.http type=log ver=1.11.3
time="2024-01-17T07:20:26.431259452Z" level=info msg="enabled tracing http middleware" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.http type=log ver=1.11.3
time="2024-01-17T07:20:26.431319995Z" level=info msg="HTTP server listening on TCP address: [::]:3500" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.http type=log ver=1.11.3
time="2024-01-17T07:20:26.431374599Z" level=debug msg="Failed to listen for HTTP server on TCP address 0.0.0.0:3500 with error: listen tcp 0.0.0.0:3500: bind: address already in use" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.http type=log ver=1.11.3
time="2024-01-17T07:20:26.43145482Z" level=info msg="enabled metrics http middleware" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.http type=log ver=1.11.3
time="2024-01-17T07:20:26.431474952Z" level=info msg="enabled tracing http middleware" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.http type=log ver=1.11.3
time="2024-01-17T07:20:26.431507212Z" level=info msg="http server is running on port 3500" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.431532628Z" level=info msg="The request body size parameter is: 4" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.431579507Z" level=info msg="gRPC server listening on TCP address: :50002" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.internal type=log ver=1.11.3
time="2024-01-17T07:20:26.431609339Z" level=info msg="Enabled gRPC tracing middleware" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.internal type=log ver=1.11.3
time="2024-01-17T07:20:26.431628036Z" level=info msg="Enabled gRPC metrics middleware" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.internal type=log ver=1.11.3
time="2024-01-17T07:20:26.431650382Z" level=info msg="sending workload csr request to sentry" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.internal type=log ver=1.11.3
time="2024-01-17T07:20:26.463839176Z" level=info msg="certificate signed successfully" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.internal type=log ver=1.11.3
time="2024-01-17T07:20:26.464131702Z" level=info msg="internal gRPC server is running on port 50002" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.464173842Z" level=info msg="application protocol: grpc. waiting on port 8080.  This will block until the app is listening on that port." app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
❯ kl -f serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj daprd | head -n 100
time="2024-01-17T07:20:26.365782818Z" level=info msg="starting Dapr Runtime -- version 1.11.3 -- commit 9f99c6adca78dfc04b8063974f27b3a7534ae798" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.365820624Z" level=info msg="log level set to: debug" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.365954422Z" level=info msg="metrics server started on :9090/" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.metrics type=log ver=1.11.3
time="2024-01-17T07:20:26.366076483Z" level=info msg="Initializing the operator client" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.376990249Z" level=info msg="loading default configuration" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.378875062Z" level=debug msg="No resiliency policies found" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.378919881Z" level=debug msg="Found 0 resiliency configurations from Kubernetes" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.378952154Z" level=info msg="Resiliency configuration loaded" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.379389177Z" level=info msg="kubernetes mode configured" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.379458911Z" level=info msg="app id: rabbitmq-python-hello-pisces" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.379478938Z" level=info msg="mTLS enabled. creating sidecar authenticator" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.37957295Z" level=info msg="trust anchors and cert chain extracted successfully" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.security type=log ver=1.11.3
time="2024-01-17T07:20:26.379593202Z" level=info msg="authenticator created" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.387339757Z" level=info msg="Dapr trace sampler initialized: DaprTraceSampler(P=0.000100)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.38741793Z" level=info msg="Initialized name resolution to kubernetes" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.387496456Z" level=debug msg="Loading component: kubernetes (secretstores.kubernetes/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.387559326Z" level=info msg="Loading components…" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.388112653Z" level=info msg="Component loaded: kubernetes (secretstores.kubernetes/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.389450586Z" level=debug msg="Found component: serving-xnz24-bindings-rabbitmq-in-tvnhk (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.389476712Z" level=debug msg="Found component: serving-xnz24-bindings-rabbitmq-out-hslmd (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.389491063Z" level=debug msg="Loading component: serving-xnz24-bindings-rabbitmq-in-tvnhk (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.405928855Z" level=info msg="Connected to RabbitMQ" app_id=rabbitmq-python-hello-pisces component="serving-xnz24-bindings-rabbitmq-in-tvnhk (bindings.rabbitmq/v1)" instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.contrib type=log ver=1.11.3
time="2024-01-17T07:20:26.406030522Z" level=info msg="successful init for output binding serving-xnz24-bindings-rabbitmq-in-tvnhk (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.413822328Z" level=info msg="Connected to RabbitMQ" app_id=rabbitmq-python-hello-pisces component="serving-xnz24-bindings-rabbitmq-in-tvnhk (bindings.rabbitmq/v1)" instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.contrib type=log ver=1.11.3
time="2024-01-17T07:20:26.413857867Z" level=info msg="successful init for input binding serving-xnz24-bindings-rabbitmq-in-tvnhk (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.413898719Z" level=info msg="Component loaded: serving-xnz24-bindings-rabbitmq-in-tvnhk (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.413933363Z" level=debug msg="Loading component: serving-xnz24-bindings-rabbitmq-out-hslmd (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.414023984Z" level=info msg="Waiting for all outstanding components to be processed" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.421084515Z" level=info msg="Connected to RabbitMQ" app_id=rabbitmq-python-hello-pisces component="serving-xnz24-bindings-rabbitmq-out-hslmd (bindings.rabbitmq/v1)" instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.contrib type=log ver=1.11.3
time="2024-01-17T07:20:26.421115905Z" level=info msg="successful init for output binding serving-xnz24-bindings-rabbitmq-out-hslmd (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.428187648Z" level=info msg="Connected to RabbitMQ" app_id=rabbitmq-python-hello-pisces component="serving-xnz24-bindings-rabbitmq-out-hslmd (bindings.rabbitmq/v1)" instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.contrib type=log ver=1.11.3
time="2024-01-17T07:20:26.428237596Z" level=info msg="successful init for input binding serving-xnz24-bindings-rabbitmq-out-hslmd (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.428279726Z" level=info msg="Component loaded: serving-xnz24-bindings-rabbitmq-out-hslmd (bindings.rabbitmq/v1)" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.428330168Z" level=info msg="All outstanding components processed" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.428374716Z" level=info msg="Loading endpoints" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.429711532Z" level=debug msg="No http endpoints found" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.httpendpoints type=log ver=1.11.3
time="2024-01-17T07:20:26.429757977Z" level=info msg="Waiting for all outstanding http endpoints to be processed" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.429781622Z" level=info msg="All outstanding http endpoints processed" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.429803785Z" level=info msg="gRPC proxy enabled" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.429905791Z" level=info msg="gRPC server listening on TCP address: [::]:50001" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.api type=log ver=1.11.3
time="2024-01-17T07:20:26.429984177Z" level=debug msg="Failed to listen for gRPC server on TCP address 0.0.0.0:50001 with error: listen tcp 0.0.0.0:50001: bind: address already in use" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.api type=log ver=1.11.3
time="2024-01-17T07:20:26.430014568Z" level=info msg="Enabled gRPC tracing middleware" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.api type=log ver=1.11.3
time="2024-01-17T07:20:26.430034611Z" level=info msg="Enabled gRPC metrics middleware" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.api type=log ver=1.11.3
time="2024-01-17T07:20:26.430182305Z" level=info msg="Registering workflow engine for gRPC endpoint: [::]:50001" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.api type=log ver=1.11.3
time="2024-01-17T07:20:26.430250864Z" level=info msg="API gRPC server is running on port 50001" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.431226713Z" level=info msg="enabled metrics http middleware" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.http type=log ver=1.11.3
time="2024-01-17T07:20:26.431259452Z" level=info msg="enabled tracing http middleware" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.http type=log ver=1.11.3
time="2024-01-17T07:20:26.431319995Z" level=info msg="HTTP server listening on TCP address: [::]:3500" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.http type=log ver=1.11.3
time="2024-01-17T07:20:26.431374599Z" level=debug msg="Failed to listen for HTTP server on TCP address 0.0.0.0:3500 with error: listen tcp 0.0.0.0:3500: bind: address already in use" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.http type=log ver=1.11.3
time="2024-01-17T07:20:26.43145482Z" level=info msg="enabled metrics http middleware" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.http type=log ver=1.11.3
time="2024-01-17T07:20:26.431474952Z" level=info msg="enabled tracing http middleware" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.http type=log ver=1.11.3
time="2024-01-17T07:20:26.431507212Z" level=info msg="http server is running on port 3500" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.431532628Z" level=info msg="The request body size parameter is: 4" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.431579507Z" level=info msg="gRPC server listening on TCP address: :50002" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.internal type=log ver=1.11.3
time="2024-01-17T07:20:26.431609339Z" level=info msg="Enabled gRPC tracing middleware" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.internal type=log ver=1.11.3
time="2024-01-17T07:20:26.431628036Z" level=info msg="Enabled gRPC metrics middleware" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.internal type=log ver=1.11.3
time="2024-01-17T07:20:26.431650382Z" level=info msg="sending workload csr request to sentry" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.internal type=log ver=1.11.3
time="2024-01-17T07:20:26.463839176Z" level=info msg="certificate signed successfully" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.internal type=log ver=1.11.3
time="2024-01-17T07:20:26.464131702Z" level=info msg="internal gRPC server is running on port 50002" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.464173842Z" level=info msg="application protocol: grpc. waiting on port 8080.  This will block until the app is listening on that port." app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.464172977Z" level=info msg="starting workload cert expiry watcher. current cert expires on: 2024-01-18 07:35:26 +0000 UTC" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.grpc.internal type=log ver=1.11.3
time="2024-01-17T07:20:26.464379664Z" level=info msg="application discovered on port 8080" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.464647421Z" level=info msg="actors: state store is not configured - this is okay for clients but services with hosted actors will fail to initialize!" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.464759787Z" level=info msg="actor runtime started. actor idle timeout: 1h0m0s. actor scan interval: 30s" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.actor type=log ver=1.11.3
time="2024-01-17T07:20:26.464760314Z" level=debug msg="try to connect to placement service: dns:///dapr-placement-server.dapr-system.svc.cluster.local:50005" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.actor.internal.placement type=log ver=1.11.3
time="2024-01-17T07:20:26.4647953Z" level=info msg="Configuring workflow engine with actors backend" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.wfengine type=log ver=1.11.3
time="2024-01-17T07:20:26.464831662Z" level=info msg="Registering component for dapr workflow engine..." app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:26.464906249Z" level=info msg="initializing Dapr workflow component" app_id=rabbitmq-python-hello-pisces component="dapr (workflow.dapr/v1)" instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.contrib type=log ver=1.11.3
time="2024-01-17T07:20:26.483172768Z" level=debug msg="established connection to placement service at dns:///dapr-placement-server.dapr-system.svc.cluster.local:50005" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.actor.internal.placement type=log ver=1.11.3
time="2024-01-17T07:20:26.484315929Z" level=debug msg="placement order received: lock" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.actor.internal.placement type=log ver=1.11.3
time="2024-01-17T07:20:26.484435949Z" level=debug msg="placement order received: update" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.actor.internal.placement type=log ver=1.11.3
time="2024-01-17T07:20:26.484474882Z" level=info msg="placement tables updated, version: 0" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.actor.internal.placement type=log ver=1.11.3
time="2024-01-17T07:20:26.484504681Z" level=debug msg="placement order received: unlock" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime.actor.internal.placement type=log ver=1.11.3
time="2024-01-17T07:20:27.700496001Z" level=info msg="app has not subscribed to binding serving-xnz24-bindings-rabbitmq-out-hslmd." app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:20:27.700571239Z" level=info msg="dapr initialized. Status: Running. Init Elapsed 1321ms" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:23:02.825091504Z" level=debug msg="error from app consumer for binding [serving-xnz24-bindings-rabbitmq-in-tvnhk]: error invoking app: rpc error: code = Unknown desc = error executing serving-xnz24-bindings-rabbitmq-in-tvnhk binding: No available endpoints" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:24:02.823533998Z" level=debug msg="error from app consumer for binding [serving-xnz24-bindings-rabbitmq-in-tvnhk]: error invoking app: rpc error: code = Unknown desc = error executing serving-xnz24-bindings-rabbitmq-in-tvnhk binding: No available endpoints" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:25:02.822628997Z" level=debug msg="error from app consumer for binding [serving-xnz24-bindings-rabbitmq-in-tvnhk]: error invoking app: rpc error: code = Unknown desc = error executing serving-xnz24-bindings-rabbitmq-in-tvnhk binding: No available endpoints" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3
time="2024-01-17T07:26:02.819717842Z" level=debug msg="error from app consumer for binding [serving-xnz24-bindings-rabbitmq-in-tvnhk]: error invoking app: rpc error: code = Unknown desc = error executing serving-xnz24-bindings-rabbitmq-in-tvnhk binding: No available endpoints" app_id=rabbitmq-python-hello-pisces instance=serving-xnz24-proxy-deployment-100-5bd6l-794cf5766c-wpxjj scope=dapr.runtime type=log ver=1.11.3

Screenshots
If applicable, add screenshots to help explain your problem.

Additional context
Add any other context about the problem here.
@GlobeFishNG GlobeFishNG added the bug Something isn't working label Jan 17, 2024
@wrongerror wrongerror self-assigned this Mar 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@wrongerror wrongerror

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@wrongerror @GlobeFishNG