java.lang.NoSuchMethodError: org.apache.spark.sql.types.DecimalType$.Unlimited()Lorg/apache/spark/sql/types/DecimalType;

GitHub | schwartzmx | 5 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Deprecated method in Spark 2.0, being used in InferSchema

    GitHub | 5 months ago | schwartzmx
    java.lang.NoSuchMethodError: org.apache.spark.sql.types.DecimalType$.Unlimited()Lorg/apache/spark/sql/types/DecimalType;

    Root Cause Analysis

    1. java.lang.NoSuchMethodError

      org.apache.spark.sql.types.DecimalType$.Unlimited()Lorg/apache/spark/sql/types/DecimalType;

      at com.springml.spark.salesforce.InferSchema$.<init>()
    2. com.springml.spark
      DatasetRelation.schema
      1. com.springml.spark.salesforce.InferSchema$.<init>(InferSchema.scala:132)
      2. com.springml.spark.salesforce.InferSchema$.<clinit>(InferSchema.scala)
      3. com.springml.spark.salesforce.DatasetRelation.schema(DatasetRelation.scala:181)
      3 frames
    3. org.apache.spark
      LogicalRelation.<init>
      1. org.apache.spark.sql.execution.datasources.LogicalRelation.<init>(LogicalRelation.scala:40)
      1 frame
    4. Spark Project SQL
      DataFrameReader.load
      1. org.apache.spark.sql.SparkSession.baseRelationToDataFrame(SparkSession.scala:382)
      2. org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:143)
      3. org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:122)
      3 frames
    5. org.lucidhq.SFRedshiftETL
      SFObject.sfRead
      1. org.lucidhq.SFRedshiftETL.SFObject.sfRead(SFObject.scala:205)
      1 frame