Getting ComputeError: buffer's length is too small in mmap
when concatenating 100s of parquet files
#16227
Open
2 tasks done
Labels
bug
Something isn't working
incomplete
Incomplete issue: needs MWE
needs triage
Awaiting prioritization by a maintainer
python
Related to Python Polars
Checks
Reproducible example
My appologies that I don't have a minumum reproducable example, as the failure seems somewhat random.
Log output
Issue description
Calling that function results in successes for 20+ chunks (hundreds of files), and then encounters an error with no indication of what went wrong.
The error is:
ComputeError: buffer's length is too small in mmap
Expected behavior
Function should work.
Installed versions
The text was updated successfully, but these errors were encountered: