Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Epic] Code generation quality #7804

Closed
2 tasks done
EvanBoyle opened this issue Aug 20, 2021 · 1 comment
Closed
2 tasks done

[Epic] Code generation quality #7804

EvanBoyle opened this issue Aug 20, 2021 · 1 comment
Assignees
Labels
area/codegen SDK-gen, program-gen, convert kind/engineering Work that is not visible to an external user kind/epic Large new features or investments resolution/fixed This issue was fixed
Milestone

Comments

@EvanBoyle
Copy link
Contributor

EvanBoyle commented Aug 20, 2021

Code generation quality spans (currently) four languages, SDK generation, and examples generation. We have substantial gaps in coverage that have led to some painful regressions in recent history. We have opportunities to make targeted testing infrastructure improvements to make it safer to make changes in this area, and to discover bugs sooner.

This becomes more important as we think about community and multi-language authors consuming this surface area, not just core pulumi team members.

While there are some advanced techniques we could use such as generative property testing, we have some low hanging fruit we should tackle first:

Adding an output compilation step in our tests will bring more confidence when making changes, and prevent future regressions. A campaign to bring more examples under the suite will simultaneously expand coverage and improve the quality of our documentation.

If we make it this far, we may want to consider closing the loop by running a preview on some of the generated programs. However, there is more complexity there (acquiring a provider binary, cloud credentials, etc) which is not well suited to the current pulumi/pulumi test infrastructure.

@EvanBoyle EvanBoyle added area/codegen SDK-gen, program-gen, convert kind/epic Large new features or investments kind/engineering Work that is not visible to an external user labels Aug 20, 2021
@t0yv0 t0yv0 mentioned this issue Sep 21, 2021
8 tasks
@emiliza emiliza added the resolution/fixed This issue was fixed label Oct 4, 2021
@emiliza emiliza closed this as completed Oct 4, 2021
@emiliza emiliza modified the milestones: 0.63, 0.62 Oct 4, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/codegen SDK-gen, program-gen, convert kind/engineering Work that is not visible to an external user kind/epic Large new features or investments resolution/fixed This issue was fixed
Projects
None yet
Development

No branches or pull requests

3 participants