-
-
Notifications
You must be signed in to change notification settings - Fork 9
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[uplink] Download failing for JavaSystemProperties
with error: missing chunk number 0 for toast value xx in pg_toast_xxx
#3883
Comments
Reproduced the error:
|
Triggered a |
Update:
TODO:
|
Update:
|
Update:
|
Update: still trying to find the corrupted table segment |
Update:
=> now to use dichotomy to locate the failing segment |
Update: dichotomy
|
Update:
Almost there! |
Update:
|
Finally!
|
Update:
|
Here we go again, let's fin the other corrupted records (same > select * from events order by id limit 78125 offset 30625000; # 30625000 -> 30703125
# WiP |
Deleted a few more (corrupted) records and ran a VACUUM: > delete from events where id = 30648885;
DELETE 1
> delete from events where id = 30648886;
DELETE 1
> delete from events where id = 30648887;
DELETE 1
> delete from events where id = 30648888;
DELETE 1
> VACUUM analyze events; => download goes further but still errors. Had to reboot the machine (and loose the |
FWIW this particular data collection is now (mostly) finished. It was how I got Since it's not just one record it might be interesting to find out what's happening here though, to prevent it from occurring in the future. |
Reseach for corrupted records still running |
Update:
|
Of course:
because Azure Flexible Server does NOT provide super user access. Gotta check https://learn.microsoft.com/en-us/azure/postgresql/flexible-server/how-to-perform-fullvacuum-pg-repack |
Service(s)
Uplink
Summary
As reported by @daniel-beck in IM discussion (ref. https://matrix.to/#/!JLUOInpEYmxJIYXlzs:matrix.org/$VlAjMDeZOPjLhMwkevPtM7P1zklTyH_wvJ9eXfpkHaE?via=g4v.dev&via=gitter.im&via=matrix.org):
Reproduction steps
publick8s
(kubectl -n uplink logs -l 'app.kubernetes.io/name=uplink' -f
)jenkins.telemetry.impl.JavaSystemProperties
type and the2023-12-24
to2023-12-25
time range and click "Export"The text was updated successfully, but these errors were encountered: