Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support container builders for flat_map variants #27107

Merged
merged 5 commits into from
May 22, 2024

Conversation

antiguru
Copy link
Member

@antiguru antiguru commented May 15, 2024

This change adds support for specifying the container builder to the various variants of flat_map and adjusts the call sites. Most use the default capacity-based builder, but some switch to the consolidating variant. I selected places that apply scalar expressions to rows for the consolidating variant, which have the chance to change rows sufficiently that it enables further consolidation.

Best viewed with whitespace changes hidden!

Checklist

@antiguru antiguru requested review from a team as code owners May 15, 2024 17:26
This change adds support for specifying the container builder to the
various variants of `flat_map` and adjusts the call sites. Most use the
default capacity-based builder, but some switch to the consolidating
variant. I selected places that apply scalar expressions to rows for the
consolidating variant, which have the chance to change rows sufficiently
that it enables further consolidation.

Signed-off-by: Moritz Hoffmann <mh@materialize.com>
Signed-off-by: Moritz Hoffmann <mh@materialize.com>
Signed-off-by: Moritz Hoffmann <mh@materialize.com>
Signed-off-by: Moritz Hoffmann <mh@materialize.com>
Signed-off-by: Moritz Hoffmann <mh@materialize.com>
@antiguru antiguru force-pushed the flat_map_container_builder branch from b915663 to f38875a Compare May 15, 2024 19:30
Copy link
Contributor

@petrosagg petrosagg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Storage changes LGTM

@antiguru antiguru requested a review from teskje May 21, 2024 18:07
Copy link
Contributor

@teskje teskje left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@antiguru antiguru merged commit a0e1d5a into MaterializeInc:main May 22, 2024
73 checks passed
@antiguru antiguru deleted the flat_map_container_builder branch May 22, 2024 13:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants