java.lang.ArrayIndexOutOfBoundsException: 4

github.com | 6 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.

Root Cause Analysis

  1. java.lang.ArrayIndexOutOfBoundsException

    4

    at org.apache.spark.sql.catalyst.expressions.GenericRow.apply()
  2. Spark Project Catalyst
    BoundReference.eval
    1. org.apache.spark.sql.catalyst.expressions.GenericRow.apply(Row.scala:142)
    2. org.apache.spark.sql.catalyst.expressions.BoundReference.eval(BoundAttribute.scala:37)
    2 frames
  3. Spark Project SQL
    InMemoryRelation$$anonfun$computeSizeInBytes$1.apply
    1. org.apache.spark.sql.columnar.InMemoryRelation$$anonfun$computeSizeInBytes$1.apply(InMemoryColumnarTableScan.scala:66)
    2. org.apache.spark.sql.columnar.InMemoryRelation$$anonfun$computeSizeInBytes$1.apply(InMemoryColumnarTableScan.scala:66)
    2 frames
  4. Scala
    AbstractTraversable.map
    1. scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
    2. scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
    3. scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
    4. scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)
    5. scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
    6. scala.collection.AbstractTraversable.map(Traversable.scala:105)
    6 frames
  5. Spark Project SQL
    CacheManager$$anonfun$useCachedData$1$$anonfun$applyOrElse$1.apply
    1. org.apache.spark.sql.columnar.InMemoryRelation.computeSizeInBytes(InMemoryColumnarTableScan.scala:66)
    2. org.apache.spark.sql.columnar.InMemoryRelation.statistics(InMemoryColumnarTableScan.scala:87)
    3. org.apache.spark.sql.columnar.InMemoryRelation.statisticsToBePropagated(InMemoryColumnarTableScan.scala:73)
    4. org.apache.spark.sql.columnar.InMemoryRelation.withOutput(InMemoryColumnarTableScan.scala:147)
    5. org.apache.spark.sql.CacheManager$$anonfun$useCachedData$1$$anonfun$applyOrElse$1.apply(CacheManager.scala:122)
    6. org.apache.spark.sql.CacheManager$$anonfun$useCachedData$1$$anonfun$applyOrElse$1.apply(CacheManager.scala:122)
    6 frames