[v23.2.x] cloud_storage: correct list_object() request headers and parameters

[vbotbuildovich]

Backport #18193 to branch v23.2.x. Note that this issue was created as a placeholder, since the original PR's commit(s) could not be automatically cherry-picked.
Here are the commands to execute:

git checkout v23.2.x
git checkout -b vbotbuildovich/backport-18193-v23.2.x-894
git cherry-pick -x 39c48f42b1db70a6b0843d5d1f0c52e2c547d26a eae9f43eb277883ff3cf3148c32c48ff7ea97327 15e3ec635a913e418edffc8343cd4af7fcec1850 745eb7c33747f3d73614b54a4d85bab7b7624eff e6e595c269ab262799a3c21e1a31acc248ee8405 96961f79aa1540ad02a949f21a6e07d947b01398 13ecfd34c44eab079b6e8207e036552634963e8e 699176e8ad0ca18c24d2e310f15f006e60bd2bbf

git push origin vbotbuildovich/backport-18193-v23.2.x-894
gh pr create \
  --title "[v23.2.x] cloud_storage: correct `list_object()` request headers and parameters" \
  --base "v23.2.x" \
  --label "kind/backport" \
  --head "vbotbuildovich/backport-18193-v23.2.x-894" \
  --draft \
  --repo "redpanda-data/redpanda" \
  --milestone "v23.2.x-next" \
  --body "Backport of PR https://github.com/redpanda-data/redpanda/pull/18193 "

JIRA Link: [CORE-2921](https://redpandadata.atlassian.net/browse/CORE-2921)

[CORE-2921]: https://redpandadata.atlassian.net/browse/CORE-2921?atlOrigin=eyJpIjoiNWRkNTljNzYxNjVmNDY3MDlhMDU5Y2ZhYzA5YTRkZjUiLCJwIjoiZ2l0aHViLWNvbS1KU1cifQ