From 1f8719650a54b4f6e0fcaeba47c0932a070fd781 Mon Sep 17 00:00:00 2001 From: Blaine Gardner Date: Tue, 16 Nov 2021 16:22:39 -0700 Subject: [PATCH] docs: add OMAP quick fix warning to upgrade guide Ceph has recently reported that it may be unsafe to upgrade clusters from Nautilus/Octopus to Pacific v16.2.0 through v16.2.6. We are tracking this in Rook issue https://github.com/rook/rook/issues/9185. Add a warning to the upgrade doc about this. Signed-off-by: Blaine Gardner --- Documentation/ceph-upgrade.md | 43 +++++++++++++++++++++++++++++++++++ 1 file changed, 43 insertions(+) diff --git a/Documentation/ceph-upgrade.md b/Documentation/ceph-upgrade.md index f072b2900242..ec94245c3469 100644 --- a/Documentation/ceph-upgrade.md +++ b/Documentation/ceph-upgrade.md @@ -416,6 +416,49 @@ updated we wait for things to settle (monitors to be in a quorum, PGs to be clea MDSes, etc.), then only when the condition is met we move to the next daemon. We repeat this process until all the daemons have been updated. +### Disable `bluestore_fsck_quick_fix_on_mount` +> **WARNING: There is a notice from Ceph for users upgrading to Ceph Pacific v16.2.6 or lower from +> an earlier major version of Ceph. If you are upgrading to Ceph Pacific (v16), please upgrade to +> v16.2.7 or higher if possible.** + +If you must upgrade to a version lower than v16.2.7, ensure that all instances of +`bluestore_fsck_quick_fix_on_mount` in Rook-Ceph configs are removed. + +First, Ensure no references to `bluestore_fsck_quick_fix_on_mount` are present in the +`rook-config-override` [ConfigMap](ceph-advanced-configuration.md#custom-cephconf-settings). Remove +them if they exist. + +Finally, ensure no references to `bluestore_fsck_quick_fix_on_mount` are present in Ceph's internal +configuration. Run all commands below from the [toolbox](ceph-toolbox.md). + +In the example below, two instances of `bluestore_fsck_quick_fix_on_mount` are present and are +commented, and some output text has been removed for brevity. +```sh +ceph config-key dump +``` +``` +{ + "config/global/bluestore_fsck_quick_fix_on_mount": "false", # <-- FALSE + "config/global/osd_scrub_auto_repair": "true", + "config/mgr.a/mgr/dashboard/server_port": "7000", + "config/mgr/mgr/balancer/active": "true", + "config/osd/bluestore_fsck_quick_fix_on_mount": "true", # <-- TRUE +} +``` + +Remove the configs for both with the commands below. Note how the `config/...` paths correspond to +the output above. +```sh +ceph config-key rm config/global/bluestore_fsck_quick_fix_on_mount +ceph config-key rm config/osd/bluestore_fsck_quick_fix_on_mount +``` + +It's best to run `ceph config-key dump` again to verify references to +`bluestore_fsck_quick_fix_on_mount` are gone after this. + +See for more information, see here: https://github.com/rook/rook/issues/9185 + + ### **Ceph images** Official Ceph container images can be found on [Quay](https://quay.io/repository/ceph/ceph?tab=tags).