java.lang.UnsupportedOperationException: Cannot evaluate expression: PythonUDF#<lambda>(input[2, StringType])

Stack Overflow | user5147250 | 5 months ago
  1. 0

    Spark-Submit python file on cluster

    Stack Overflow | 5 months ago | user5147250
    org.apache.spark.api.python.PythonException: Traceback (most recent call last): File "/ephemeral/usr/hdp/2.3.4.33-1/spark/python/lib/pyspark.zip/pyspark/worker.py", line 98, in main command = pickleSer._read_with_length(infile) File "/ephemeral/usr/hdp/2.3.4.33-1/spark/python/lib/pyspark.zip/pyspark/serializers.py", line 156, in _read_with_length length = read_int(stream) File "/ephemeral/usr/hdp/2.3.4.33-1/spark/python/lib/pyspark.zip/pyspark/serializers.py", line 545, in read_int raise EOFError EOFError
  2. 0

    Spark-Submit python file on cluster

    Stack Overflow | 5 months ago | user5147250
    java.lang.UnsupportedOperationException: Cannot evaluate expression: PythonUDF#<lambda>(input[2, StringType])
  3. 0

    UnsupportedOperationException: Cannot evalute expression: .. when adding new column withColumn() and udf()

    Stack Overflow | 2 months ago | aks
    java.lang.UnsupportedOperationException: Cannot evaluate expression: parse_df_to_string(input[1, int, true], input[2, int, true], input[3, int, true], input[4, int, true], input[5, int, true])
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    python+pyspark: error on inner join with multiple column comparison in pyspark

    Stack Overflow | 2 months ago | Satya
    java.lang.UnsupportedOperationException: Cannot evaluate expression: count(1)
  6. 0

    getting the latest changes from apache/spark repo by skaarthik · Pull Request #1 · Microsoft/spark · GitHub

    github.com | 4 months ago
    java.lang.UnsupportedOperationException: Cannot evaluate expression: scalar-subquery#62 []

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.UnsupportedOperationException

      Cannot evaluate expression: PythonUDF#<lambda>(input[2, StringType])

      at org.apache.spark.sql.catalyst.expressions.Unevaluable$class.eval()
    2. Spark Project Catalyst
      Unevaluable$class.eval
      1. org.apache.spark.sql.catalyst.expressions.Unevaluable$class.eval(Expression.scala:188)
      1 frame
    3. Spark Project SQL
      PythonUDF.eval
      1. org.apache.spark.sql.execution.PythonUDF.eval(python.scala:44)
      1 frame
    4. Spark Project Catalyst
      InterpretedMutableProjection.apply
      1. org.apache.spark.sql.catalyst.expressions.InterpretedMutableProjection.apply(Projection.scala:82)
      2. org.apache.spark.sql.catalyst.expressions.InterpretedMutableProjection.apply(Projection.scala:61)
      2 frames
    5. Spark Project SQL
      BatchPythonEvaluation$$anonfun$doExecute$1$$anonfun$10$$anonfun$11.apply
      1. org.apache.spark.sql.execution.BatchPythonEvaluation$$anonfun$doExecute$1$$anonfun$10$$anonfun$11.apply(python.scala:379)
      2. org.apache.spark.sql.execution.BatchPythonEvaluation$$anonfun$doExecute$1$$anonfun$10$$anonfun$11.apply(python.scala:377)
      2 frames
    6. Scala
      AbstractTraversable.map
      1. scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
      2. scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
      3. scala.collection.immutable.List.foreach(List.scala:318)
      4. scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
      5. scala.collection.AbstractTraversable.map(Traversable.scala:105)
      5 frames
    7. Spark Project SQL
      BatchPythonEvaluation$$anonfun$doExecute$1$$anonfun$10.apply
      1. org.apache.spark.sql.execution.BatchPythonEvaluation$$anonfun$doExecute$1$$anonfun$10.apply(python.scala:377)
      2. org.apache.spark.sql.execution.BatchPythonEvaluation$$anonfun$doExecute$1$$anonfun$10.apply(python.scala:376)
      2 frames
    8. Scala
      AbstractIterator.foreach
      1. scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
      2. scala.collection.Iterator$class.foreach(Iterator.scala:727)
      3. scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
      3 frames
    9. Spark
      PythonRunner$WriterThread.run
      1. org.apache.spark.api.python.PythonRDD$.writeIteratorToStream(PythonRDD.scala:452)
      2. org.apache.spark.api.python.PythonRunner$WriterThread$$anonfun$run$3.apply(PythonRDD.scala:280)
      3. org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1699)
      4. org.apache.spark.api.python.PythonRunner$WriterThread.run(PythonRDD.scala:239)
      4 frames