Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Provide access to the table properties to the WriterFactory #15

Open
omalley opened this issue Mar 6, 2018 · 2 comments
Open

Provide access to the table properties to the WriterFactory #15

omalley opened this issue Mar 6, 2018 · 2 comments
Labels
good first issue

Comments

@omalley
Copy link
Contributor

omalley commented Mar 6, 2018

Currently, there isn't a way to get the table properties in the SparkOrcWriter via the WriterFactory.
@rdblue rdblue closed this as completed Mar 12, 2018
@rdblue rdblue reopened this Mar 12, 2018
@omalley
Copy link
Contributor Author

omalley commented Mar 12, 2018

The problem that I'm having is that I'd like the SparkOrcWriter to get the table properties without looking up the table again. In particular, it would be good to be able to set the compression, etc. via the table properties.

@rdblue
Copy link
Contributor

rdblue commented Mar 14, 2018

Agreed, we should plan on passing the table properties through so all of the write configuration happens there.

rdblue pushed a commit that referenced this issue Dec 4, 2018
@mccheah @rdblue
Allow custom FileSystem logic in HadoopTableOperations. (#15)
6bc2697
mccheah added a commit to mccheah/iceberg that referenced this issue Dec 5, 2018
@mccheah @rdblue
Allow custom FileSystem logic in HadoopTableOperations. (Netflix#15)
1cafa4b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
good first issue
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@rdblue @omalley