Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix path substitution for file:// URIs #1251

Merged
merged 1 commit into from
May 31, 2024

Conversation

nfzd
Copy link
Contributor

@nfzd nfzd commented Apr 22, 2024

Related Issue \ discussion

Fix for #1233. See also #1217.

Patch Description

Perform url canonization in StorageHelper.get_driver_direct_access(). It is performed in all relevant methods on StorageHelper: here and here and here and here and here and here and here.

Testing Instructions

Described in #1233.

Other Information

Test for dataset creation and loading. Loading works as expected. Creation works and will write the data to the path with substitution applied while the stored name will not have substitution applied (this is the expected behavior).

I could only test for file://. Could not check the effect on other uri types (e.g., AWS).

@nfzd
Copy link
Contributor Author

nfzd commented May 13, 2024

Is there anything missing / any way to speed this up?

@jkhenning jkhenning merged commit 7fcd315 into allegroai:master May 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants