Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add autoscaling support for Dataproc Metastore #17949

Open
brandon-m-hansen opened this issue Apr 24, 2024 · 0 comments 路 May be fixed by GoogleCloudPlatform/magic-modules#10522
Open

Add autoscaling support for Dataproc Metastore #17949

brandon-m-hansen opened this issue Apr 24, 2024 · 0 comments 路 May be fixed by GoogleCloudPlatform/magic-modules#10522

Comments

@brandon-m-hansen
Copy link

brandon-m-hansen commented Apr 24, 2024

Community Note

  • Please vote on this issue by adding a 馃憤 reaction to the original issue to help the community and maintainers prioritize this request.
  • Please do not leave +1 or me too comments, they generate extra noise for issue followers and do not help prioritize the request.
  • If you are interested in working on this issue or have submitted a pull request, please leave a comment.
  • If an issue is assigned to a user, that user is claiming responsibility for the issue.
  • Customers working with a Google Technical Account Manager or Customer Engineer can ask them to reach out internally to expedite investigation and resolution of this issue.

Description

Add autoscaling support for Dataproc Metastore (see https://cloud.google.com/dataproc-metastore/docs/scaling-factors)

New or Affected Resource(s)

  • google_dataproc_metastore_service

Potential Terraform Configuration

resource "google_dataproc_metastore_service" "default" {
  provider   = google-beta
  project    = "my-project"
  service_id = "my-service-id"
  location   = "us-east4"

  # DPMS 2 requires SPANNER database type.
  database_type = "SPANNER"

  hive_metastore_config {
    version           = "3.1.2"
    endpoint_protocol = "GRPC"
    config_overrides = {
      endpoint_protocol              = "GRPC"
      "hive.metastore.warehouse.dir" = var.hive_warehouse_dir
    }
  }
  
  scaling_config {
    autoscaling_config {
      autoscaling_enabled = true
      limit_config {
        min_scaling_factor = 0.1
        max_scaling_factor = 1.0
      }
    }
  }
}

References

No response

b/337873491

@github-actions github-actions bot added forward/review In review; remove label to forward service/metastore labels Apr 24, 2024
@rileykarson rileykarson added size/s and removed forward/review In review; remove label to forward labels Apr 29, 2024
@rileykarson rileykarson added this to the Goals milestone Apr 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants