Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: add OMAP quick fix warning to upgrade guide #9187

Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
43 changes: 43 additions & 0 deletions Documentation/ceph-upgrade.md
Expand Up @@ -416,6 +416,49 @@ updated we wait for things to settle (monitors to be in a quorum, PGs to be clea
MDSes, etc.), then only when the condition is met we move to the next daemon. We repeat this process
until all the daemons have been updated.

### Disable `bluestore_fsck_quick_fix_on_mount`
> **WARNING: There is a notice from Ceph for users upgrading to Ceph Pacific v16.2.6 or lower from
> an earlier major version of Ceph. If you are upgrading to Ceph Pacific (v16), please upgrade to
travisn marked this conversation as resolved.
Show resolved Hide resolved
> v16.2.7 or higher if possible.**

If you must upgrade to a version lower than v16.2.7, ensure that all instances of
`bluestore_fsck_quick_fix_on_mount` in Rook-Ceph configs are removed.

First, Ensure no references to `bluestore_fsck_quick_fix_on_mount` are present in the
`rook-config-override` [ConfigMap](ceph-advanced-configuration.md#custom-cephconf-settings). Remove
them if they exist.

Finally, ensure no references to `bluestore_fsck_quick_fix_on_mount` are present in Ceph's internal
configuration. Run all commands below from the [toolbox](ceph-toolbox.md).

In the example below, two instances of `bluestore_fsck_quick_fix_on_mount` are present and are
commented, and some output text has been removed for brevity.
```sh
ceph config-key dump
```
```
{
"config/global/bluestore_fsck_quick_fix_on_mount": "false", # <-- FALSE
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For a simpler doc, how about we remove all the lines that are not the settings we are looking at?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can remove most of them, but I think it's useful to see a few examples of non-relevant lines for comparison.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Notably, I was a little confused by the osd_scrub_auto_repair setting, so I think it's good to show as an irrelevant example in the output. And a couple examples of other config paths (the mgr and mgr.a in this case).

"config/global/osd_scrub_auto_repair": "true",
"config/mgr.a/mgr/dashboard/server_port": "7000",
"config/mgr/mgr/balancer/active": "true",
"config/osd/bluestore_fsck_quick_fix_on_mount": "true", # <-- TRUE
}
```

Remove the configs for both with the commands below. Note how the `config/...` paths correspond to
the output above.
```sh
ceph config-key rm config/global/bluestore_fsck_quick_fix_on_mount
ceph config-key rm config/osd/bluestore_fsck_quick_fix_on_mount
```

It's best to run `ceph config-key dump` again to verify references to
`bluestore_fsck_quick_fix_on_mount` are gone after this.

See for more information, see here: https://github.com/rook/rook/issues/9185


### **Ceph images**

Official Ceph container images can be found on [Quay](https://quay.io/repository/ceph/ceph?tab=tags).
Expand Down