Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update the version of spark in etl to 3.3.1 #1275

Merged
merged 9 commits into from
Dec 13, 2022

Conversation

wycccccc
Copy link
Collaborator

resolve #1261
jackson在2.13.4.1中gradle的配置有問題,這會影響到spark3.3.1版本。
FasterXML/jackson-databind#3627
螢幕快照 2022-12-13 22-09-54

預計其會在3.3.2版本中修復

@chia7712
Copy link
Contributor

預計其會在3.3.2版本中修復

可否分享來源連結

# this dockerfile is generated dynamically
FROM ghcr.io/skiptests/astraea/spark:3.1.2
this dockerfile is generated dynamically
FROM ghcr.io/skiptests/astraea/spark:3.3.1
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

這個檔案怎麼又跑出來了,刪掉喔

@wycccccc
Copy link
Collaborator Author

wycccccc commented Dec 13, 2022

apache/spark#38355
他已經被merge了,但是沒在3.3.1中,推測3.3.2

這個檔案怎麼又跑出來了,刪掉喔

怪怪的怎麼又出來了,已刪除

@chia7712
Copy link
Contributor

他已經被merge了,但是沒在3.3.1中,推測3.3.2

https://issues.apache.org/jira/browse/SPARK-40886

麻煩先把議題開好並且在TODO中說明

@wycccccc
Copy link
Collaborator Author

麻煩先把議題開好並且在TODO中說明

#1276 已在gradle中添加完善的相關說明

@chia7712
Copy link
Contributor

怪怪的怎麼又出來了,已刪除

蠻詭異的,以防萬一可否開另一隻PR?我擔心這隻branch 已經被污染了

@wycccccc
Copy link
Collaborator Author

蠻詭異的,以防萬一可否開另一隻PR?我擔心這隻branch 已經被污染了

沒事的學長,我找到原因了是我的自己的github倉庫被污染了,這支已經清除毒素了,可以merge。

@chia7712 chia7712 merged commit 265ceaf into skiptests:main Dec 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants