You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The metrics we are exporting are the default ones from https://github.com/kubernetes/ingress-nginx. This gives us the following error, about a few times per minute. This leads to no metrics being written to Stackdriver, while not giving a clear error.
Is there something we're missing when including metrics in that manner?
Thank you!
level=warn ts=2021-01-19T08:30:35.589Z caller=queue_manager.go:534 component=queue_manager msg="Unrecoverable error sending samples to remote storage" err="rpc error: co
de = InvalidArgument desc = Field timeSeries[36].points[0].distributionValue had an invalid value: Distribution |explicit_buckets.bounds| does not have at least one entr
y."
level=warn ts=2021-01-19T08:30:35.622Z caller=queue_manager.go:534 component=queue_manager msg="Unrecoverable error sending samples to remote storage" err="rpc error: co
de = InvalidArgument desc = Field timeSeries[7].points[0].distributionValue had an invalid value: Distribution |explicit_buckets.bounds| does not have at least one entry
."
level=warn ts=2021-01-19T08:30:35.651Z caller=queue_manager.go:534 component=queue_manager msg="Unrecoverable error sending samples to remote storage" err="rpc error: co
de = InvalidArgument desc = Field timeSeries[0].points[0].distributionValue had an invalid value: Distribution |explicit_buckets.bounds| does not have at least one entry
."
The text was updated successfully, but these errors were encountered:
I have a feeling it is caused by the bucket metrics, which have over 10 labels. Unsuccessful to filter them out using --include{__name__!~".+bucket", __name__=~"nginx_.+"}
We have a basic installation of the sidecar together with the Prometheus Operator, and have configured the sidecar with the following flags:
The metrics we are exporting are the default ones from https://github.com/kubernetes/ingress-nginx. This gives us the following error, about a few times per minute. This leads to no metrics being written to Stackdriver, while not giving a clear error.
Is there something we're missing when including metrics in that manner?
Thank you!
The text was updated successfully, but these errors were encountered: