Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data Node Migration: remove unnecessary steps/big texts/unavailable paths #19312

Merged
merged 33 commits into from May 21, 2024

Conversation

gally47
Copy link
Contributor

@gally47 gally47 commented May 10, 2024

In this PR we:

  • removed unnecessary big texts
  • removed unavailable migration paths
  • removed steps that have no action
  • improved migration action button order and display
  • added some help texts
  • added confirmation dialog after clicking retry migrating existing data
  • sorted indices in migrating existing data

Motivation and Context

fixes #19229

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Refactoring (non-breaking change)
  • Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

  • My code follows the code style of this project.
  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.
  • I have read the CONTRIBUTING document.
  • I have added tests to cover my changes.

@gally47 gally47 self-assigned this May 10, 2024
@gally47 gally47 changed the title remove unnecessary steps/big texts/unavailable paths DataNode Migration: remove unnecessary steps/big texts/unavailable paths May 10, 2024
@gally47 gally47 changed the title DataNode Migration: remove unnecessary steps/big texts/unavailable paths Data Node Migration: remove unnecessary steps/big texts/unavailable paths May 10, 2024
@moesterheld moesterheld requested a review from todvora May 13, 2024 16:44
@gally47 gally47 requested a review from moesterheld May 15, 2024 11:30
@moesterheld
Copy link
Contributor

Tested both in-place and remote reindexing from OS and checked that migration selection is skipped for Elasticsearch (without migration). Here are my comments:
1.
image
Step 2 is not reachable anymore and can be removed.
Same goes for Step 3 in In-Place migration

  1. Hostname and allowlist are not pre-filled in remote-reindexing

</p>
<p>
Enable JWT authentication in <code>opensearch-security/config.yml</code> (section <code>jwt_auth_domain</code>, <code>http_enabled: true</code>, <code>transport_enabled: true</code>)
Add the signing key by converting the <code>GRAYLOG_PASSWORD_SECRET</code> to <code>base64</code> e.g. by doing <code>echo `&quot;`The password secret you chose`&quot;` | base64</code> and put it into the <code>signing_key</code> line
If you are running <code>ElasticSearch</code> as your search backend or want to selectively migrate data
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since we do not give the user a choice if he's running Elastic, we should maybe reword that here

@moesterheld
Copy link
Contributor

moesterheld commented May 17, 2024

  1. Hostname and allowlist are not pre-filled in remote-reindexing

@gally47 I have made a wrong assumption when providing the host/allowlist value. This will only be available with #19383 . I think we should ignore it for now and display it when we can provide the correct values.

@gally47 gally47 requested a review from moesterheld May 17, 2024 13:58
Copy link
Contributor

@ousmaneo ousmaneo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Frontend looks good !

@gally47 gally47 removed the request for review from moesterheld May 21, 2024 11:53
Copy link
Contributor

@todvora todvora left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tested locally, looks good to me! Thanks!

@todvora todvora requested a review from moesterheld May 21, 2024 12:43
@bernd bernd dismissed moesterheld’s stale review May 21, 2024 12:55

Dismissing review because reviewer is absent. Requested by @gally47.

@gally47 gally47 merged commit a897c16 into master May 21, 2024
6 checks passed
@gally47 gally47 deleted the fix-19229 branch May 21, 2024 12:56
ousmaneo pushed a commit that referenced this pull request May 24, 2024
…aths (#19312)

* remove unnecessary texts + rewording

* changelog

* remove Certificate provisioning overview step in in-place migration

* remove Provision Data Node with certificates step from remote reindexing migration

* remove unused MigrationStates

* add guard for disabling in-place migration for ElasticSearch

* add guard for disabling in-place migration for ElasticSearch

* sort indices for remote reindexing

* stop fetching CurrentMigrationStatus when error

* clear interval and cleanup logs when error

* RetryMigrateExistingData ConfirmDialog when no errors + reordered buttons position

* add default elasticsearch_hosts and allowlist to state machine response

* fix buttons order

* Sort Next Steps

* cleanup comments

* MigrateExistingData set initial values elasticsearch_hosts and allowlist_hosts

* filter migrationTypeOptions show only possible paths

* skip migration selection page when not compatible

* added JwtAuthenticationInfo

* remove prefilled host/allowlist values

* reword case ElasticSearch as search backend

* remove unreachable steps

* fix tests

---------

Co-authored-by: Matthias Oesterheld <33032967+moesterheld@users.noreply.github.com>
Co-authored-by: Matthias Oesterheld <matthias.oesterheld@graylog.com>
Co-authored-by: Tomas Dvorak <tomas.dvorak@graylog.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

remove unnecessary steps/big texts/unavailable paths
4 participants