java.lang.OutOfMemoryError: Java heap space

Stack Overflow | Baktaawar | 6 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.

Root Cause Analysis

  1. java.lang.OutOfMemoryError

    Java heap space

    at org.apache.spark.sql.catalyst.expressions.GenericMutableRow.<init>()
  2. Spark Project Catalyst
    GenericMutableRow.<init>
    1. org.apache.spark.sql.catalyst.expressions.GenericMutableRow.<init>(rows.scala:252)
    1 frame
  3. org.apache.spark
    StatFunctions$$anonfun$4.apply
    1. org.apache.spark.sql.execution.stat.StatFunctions$$anonfun$4.apply(StatFunctions.scala:123)
    2. org.apache.spark.sql.execution.stat.StatFunctions$$anonfun$4.apply(StatFunctions.scala:122)
    2 frames
  4. Scala
    AbstractTraversable.map
    1. scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
    2. scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
    3. scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:224)
    4. scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:403)
    5. scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:403)
    6. scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:403)
    7. scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:403)
    8. scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
    9. scala.collection.AbstractTraversable.map(Traversable.scala:105)
    9 frames
  5. org.apache.spark
    StatFunctions$.crossTabulate
    1. org.apache.spark.sql.execution.stat.StatFunctions$.crossTabulate(StatFunctions.scala:122)
    1 frame
  6. Spark Project SQL
    DataFrameStatFunctions.crosstab
    1. org.apache.spark.sql.DataFrameStatFunctions.crosstab(DataFrameStatFunctions.scala:133)
    1 frame
  7. Java RT
    Method.invoke
    1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    4. java.lang.reflect.Method.invoke(Method.java:498)
    4 frames
  8. Py4J
    GatewayConnection.run
    1. py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:231)
    2. py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:381)
    3. py4j.Gateway.invoke(Gateway.java:259)
    4. py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:133)
    5. py4j.commands.CallCommand.execute(CallCommand.java:79)
    6. py4j.GatewayConnection.run(GatewayConnection.java:209)
    6 frames
  9. Java RT
    Thread.run
    1. java.lang.Thread.run(Thread.java:745)
    1 frame