Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide a way to dump the TF schema of a bridged provider #1982

Open
VenelinMartinov opened this issue May 16, 2024 · 7 comments
Open

Provide a way to dump the TF schema of a bridged provider #1982

VenelinMartinov opened this issue May 16, 2024 · 7 comments
Assignees
Labels
kind/enhancement Improvements or new features

Comments

@VenelinMartinov
Copy link
Contributor

Hello!

  • Vote on this issue by adding a 馃憤 reaction
  • If you want to implement this feature, comment to let us know (we'll work with you on design, scheduling, etc.)

Issue details

It'd be very useful if a provider binary had a flag to dump the TF schema. This would be invaluable for bug reports against dynamically bridged providers and could also be useful for using the TF schema for analytics purposes.

Affected area/feature

@VenelinMartinov VenelinMartinov added the kind/enhancement Improvements or new features label May 16, 2024
@t0yv0
Copy link
Member

t0yv0 commented May 23, 2024

Tabular form (stored in CSV or better parquet) could make it quite easy to ingest and cross-analyze. There's a tiny bit of design here to see how this mapping looks like.

@VenelinMartinov
Copy link
Contributor Author

Should the provider binary be responsible for that or should the binary dump some JSON blob which we can then post-process into whatever form we want?

@t0yv0
Copy link
Member

t0yv0 commented May 23, 2024

I have not thought this through don't have strong opinions. So long as we can query the end result. I've used a small tool before like https://github.com/pulumi/pulumi-trace-tool for processing some Pulumi program outputs as part of the CI->S3 pipe so there's precedent.

@t0yv0
Copy link
Member

t0yv0 commented May 23, 2024

There's MarshallableProviderInfo that has mapping information including, I think, TF schema, but it's worth double checking if it is missing anything interesting for us.

You can get it with a flag already:

	dumpInfo := flags.Bool("get-provider-info", false, "dump provider info as JSON to stdout")

For quick and dirty, TF schema itself has a gRPC representation (and every gRPC has associated JSON form). That could be used.

Decisions to be made how to tabularize this though can indeed affect usability for our query scenarios, but we can draw on Pablo's expertise possibly.

@VenelinMartinov
Copy link
Contributor Author

VenelinMartinov commented May 28, 2024

As @t0yv0, get-provider-info seems to do what we need already. It seems to have the schema and the mapping information.

pulumi-gitlab dump: https://gist.github.com/VenelinMartinov/315dd3da23e6975f6dc37c82255c6b76

I don't see anything interesting missing so I'll close this issue and continue the discussion on the other one.

@VenelinMartinov VenelinMartinov added the resolution/duplicate This issue is a duplicate of another issue label May 28, 2024
@VenelinMartinov VenelinMartinov removed the resolution/duplicate This issue is a duplicate of another issue label May 28, 2024
@VenelinMartinov
Copy link
Contributor Author

Taking it back: the provider info does not contain information about property constraints like ExactlyOneOf and ConflictsWith which would be useful for #1949

@VenelinMartinov
Copy link
Contributor Author

ConfigMode is also missing there, which would be useful for #2025

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/enhancement Improvements or new features
Projects
None yet
Development

No branches or pull requests

2 participants