mimir compactor: index contains 205 postings with out of order labels"

[shichanglin5]

Describe the bug

mimir version: 2.11
mimir compactor runs failed continusly, some log as follows:

ts=2024-04-10T06:17:47.948313678Z caller=index.go:287 level=warn component=compactor user=inf-redisproxy groupKey=0@17241709254077376921-merge--1712548800000-1712556000000 minTime="2024-04-08 04:00:00 +0000 UTC" maxTime="2024-04-08 06:00:00 +0000 UTC" msg="out-of-order label set: known bug in Prometheus 2.8.0 and below" labelset="{cmdb_env=\"product\", ident=\"10.204.95.20:7887\", job=\"redisproxy\", __name__=\"go_memstats_alloc_bytes\"}" series=105644
ts=2024-04-10T06:17:47.94832739Z caller=index.go:287 level=warn component=compactor user=inf-redisproxy groupKey=0@17241709254077376921-merge--1712548800000-1712556000000 minTime="2024-04-08 04:00:00 +0000 UTC" maxTime="2024-04-08 06:00:00 +0000 UTC" msg="out-of-order label set: known bug in Prometheus 2.8.0 and below" labelset="{cmdb_env=\"product\", ident=\"10.204.95.20:7887\", job=\"redisproxy\", __name__=\"process_cpu_seconds_total\"}" series=105647
ts=2024-04-10T06:17:47.948340385Z caller=index.go:287 level=warn component=compactor user=inf-redisproxy groupKey=0@17241709254077376921-merge--1712548800000-1712556000000 minTime="2024-04-08 04:00:00 +0000 UTC" maxTime="2024-04-08 06:00:00 +0000 UTC" msg="out-of-order label set: known bug in Prometheus 2.8.0 and below" labelset="{cmdb_env=\"product\", ident=\"10.204.95.20:7887\", job=\"redisproxy\", __name__=\"process_resident_memory_bytes\"}" series=105650
ts=2024-04-10T06:17:47.948516052Z caller=bucket_compactor.go:260 level=error component=compactor user=inf-redisproxy groupKey=0@17241709254077376921-merge--1712548800000-1712556000000 minTime="2024-04-08 04:00:00 +0000 UTC" maxTime="2024-04-08 06:00:00 +0000 UTC" msg="compaction job failed" duration=102.51438ms duration_ms=102 err="block id 01HTY9Q2NSMN5A8D1R60PTX91T: index contains 205 postings with out of order labels"
ts=2024-04-10T06:17:47.951494588Z caller=compactor.go:671 level=error component=compactor msg="failed to compact user blocks" user=inf-redisproxy err="compaction: group 0@17241709254077376921-merge--1712548800000-1712556000000: block id 01HTY9Q2NSMN5A8D1R60PTX91T: index contains 205 postings with out of order labels"

Is this problem unimportant? How should I deal with it to solve it?

[shichanglin5]

@aknuds1