Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feature request] add ability to configure projects/prefixes in yaml file #181

Open
WojciechKuk opened this issue Dec 27, 2022 · 3 comments

Comments

@WojciechKuk
Copy link

I have ~250 different GCP projects, with different needs. In some projects I just only need to scrape Composer metrics, in the other projects I need to scrape only BigQuery metrics, or only Compute metrics. Sometimes I need to scrape i.e. Composer+Bigquery, or Compute+Loadbalancing metrics.

I don't want to scrape all the metrics just to catch few metrics that I need in a particular projects. This is cost inefficient (pay per request) and results in throttling by GCP (by the way caused by uncontrollable parallelism).

My workaround is to run simultaneously many exporters with different command line parameters - but it's difficult to maintain.

Is it possible to add ability to configure stackdriver_exporter using .yml file? i.e.

project1-prod: 
  - composer.googleapis.com
project2-prod:
  - composer.googleapis.com
  - bigquery.googleapis.com
project3-prod:
  - bigquery.googleapis.com
  - compute.googleapis.com
@SuperQ
Copy link
Contributor

SuperQ commented Dec 27, 2022

This is unnecessary because the exporter supports selecting different data via the collect param. Similar to how node_exporter and other modular exporters work.

@WojciechKuk
Copy link
Author

AFAIK with collect param I can't achieve such setup with project+prefixes pairs.
collect is related only to prefixes - not to projects.

@WojciechKuk
Copy link
Author

WojciechKuk commented Jan 12, 2023

additionally, with such yaml file, will be simplier (in future) to i.e. add ability to use different SA/keys for different projects, using ONE stackdriver_exporter instance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants