Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[SPARK-48248][PYTHON] Fix nested array to respect legacy conf of infe…
…rArrayTypeFromFirstElement This PR fixes a bug that does not respect `spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled` in nested arrays, introduced by #36545. To have a way to restore the original behaviour. Yes, it fixes the regression when `spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled` is set to `True`. Unittest added. No. Closes #46548 from HyukjinKwon/SPARK-48248. Authored-by: Hyukjin Kwon <gurwls223@apache.org> Signed-off-by: Hyukjin Kwon <gurwls223@apache.org> (cherry picked from commit b2140d0) Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
- Loading branch information