You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi team, I have build gluten(volex) with enable_hdfs=on on Arm server.
Generate data set on HDFS, and run TPC-DS benchmark, both steps are using tools/workload/tpcds included in Gluten repo.
But it show poor performance on Arm server when using Gluten.
I found that Gluten depends on libhdfs3, but it has been not updated for nearly 10 years.
So can I ask whether libhdfs3 downgrade the TPC-DS performance when Gluten running in Arm server and data located on HDFS?
Thanks.
The text was updated successfully, but these errors were encountered:
Description
Hi team, I have build gluten(volex) with enable_hdfs=on on Arm server.
Generate data set on HDFS, and run TPC-DS benchmark, both steps are using tools/workload/tpcds included in Gluten repo.
But it show poor performance on Arm server when using Gluten.
I found that Gluten depends on libhdfs3, but it has been not updated for nearly 10 years.
So can I ask whether libhdfs3 downgrade the TPC-DS performance when Gluten running in Arm server and data located on HDFS?
Thanks.
The text was updated successfully, but these errors were encountered: