Thanos multi-cluster setup

[HighWatersDev]

Hi @pavan-kumar-99 ,

I was following your tutorial for setting up Thanos with Sidecar. After I deploy thanos ingress on external k8s clusters with tls/port 443 and try to configure thanos stores on thanos cluster, it fails to connect.

I keep getting connection errors as such

level=warn ts=2022-01-05T20:40:33.268164041Z caller=endpointset.go:500 component=endpointset msg="update of node failed" err="getting metadata: fallback fetching info from thanos-1:443: rpc error: code = Internal desc = stream terminated by RST_STREAM with error code: FRAME_SIZE_ERROR" address=thanos-1:443
level=warn ts=2022-01-05T20:40:38.029698764Z caller=endpointset.go:500 component=endpointset msg="update of node failed" err="getting metadata: fallback fetching info from thanos-2:443: rpc error: code = DeadlineExceeded desc = context deadline exceeded" address=thanos-2:443

Have you experienced something similar?

Thanks in advance!

[pavan-kumar-99]

Hey, For some reason it seems to be timing out. Could you please provide more logs?
You can also try referring this Documentation in the meanwhile
https://github.com/pavan-kumar-99/medium-manifests/blob/thanos/GKE/Ingress/ing-ref.sh#L7

[scarecrow111]

Hi, @pavan-kumar-99 I don't see the provider block in the ec2 path.

[pavan-kumar-99]

Hi, @pavan-kumar-99 I don't see the provider block in the ec2 path.

Which EC2 Path are you referring to?