org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 34.0 failed 1 times, most recent failure: Lost task 0.0 in stage 34.0 (TID 50, localhost): java.lang.UnsupportedOperationException: Cannot evaluate expression: PythonUDF#<lambda>(input[0, LongType])

Stack Overflow | user3063243 | 8 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    Weird error when selecting more than 100 spark udf columns

    Stack Overflow | 8 months ago | user3063243
    org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 34.0 failed 1 times, most recent failure: Lost task 0.0 in stage 34.0 (TID 50, localhost): java.lang.UnsupportedOperationException: Cannot evaluate expression: PythonUDF#<lambda>(input[0, LongType])

    Root Cause Analysis

    1. org.apache.spark.SparkException

      Job aborted due to stage failure: Task 0 in stage 34.0 failed 1 times, most recent failure: Lost task 0.0 in stage 34.0 (TID 50, localhost): java.lang.UnsupportedOperationException: Cannot evaluate expression: PythonUDF#<lambda>(input[0, LongType])

      at org.apache.spark.sql.catalyst.expressions.Unevaluable$class.genCode()
    2. Spark Project Catalyst
      Unevaluable$class.genCode
      1. org.apache.spark.sql.catalyst.expressions.Unevaluable$class.genCode(Expression.scala:239)
      1 frame
    3. Spark Project SQL
      PythonUDF.genCode
      1. org.apache.spark.sql.execution.PythonUDF.genCode(python.scala:44)
      1 frame
    4. Spark Project Catalyst
      Expression$$anonfun$gen$2.apply
      1. org.apache.spark.sql.catalyst.expressions.Expression$$anonfun$gen$2.apply(Expression.scala:104)
      1 frame