Getting NoSuchMethodError with scala 2.12.10 and spark 3.2.0

[ma6878]

json4s: 3.7.0-M11

scala: 2.12.10

spark: 3.2.0

jdk: 1.8

I am getting the following error coming from spark:
java.lang.NoSuchMethodError: org.json4s.JsonDSL$.pair2Assoc(Lscala/Tuple2;Lscala/Function1;)Lscala/Tuple2;
at org.apache.spark.sql.types.StructType.jsonValue(StructType.scala:413) ~[spark-catalyst_2.12-3.2.0.jar:3.2.0]
at org.apache.spark.sql.types.StructType.jsonValue(StructType.scala:102) ~[spark-catalyst_2.12-3.2.0.jar:3.2.0]

Any idea why that would be. This is working with spark 3.0.0 and json4s 3.6.6.

[veromos]

Hi,

I have similar issue after upgrading from :

• scala 2.11 -> 2.12
• spark 2.4 -> 3.1
• keeping json4s version 3.5.3

I have this error coming from spark :
"Exception in User Class: java.lang.NoSuchMethodError : org.json4s.JsonDSL$.seq2jvalue(Lscala/collection/Traversable;Lscala/Function1;)Lorg/json4s/JsonAST$JArray;"

After upgrading json4s 3.5.3 to 4.1.0-M2, I have the following new error :
Caused by: java.lang.ClassNotFoundException: org.json4s.JsonAST$JValue

Any idea if there are incompabilities between spark or scala and json4s ?

[vietvudanh]

Same problem, anyone have insight on why?