java.lang.OutOfMemoryError: Java heap space

Stack Overflow | Baktaawar | 6 months ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.

Root Cause Analysis

  1. java.lang.OutOfMemoryError

    Java heap space

    at org.apache.spark.sql.catalyst.expressions.GenericMutableRow.<init>()
  2. Spark Project Catalyst
    GenericMutableRow.<init>
    1. org.apache.spark.sql.catalyst.expressions.GenericMutableRow.<init>(rows.scala:252)
    1 frame
  3. org.apache.spark
    StatFunctions$$anonfun$4.apply
    1. org.apache.spark.sql.execution.stat.StatFunctions$$anonfun$4.apply(StatFunctions.scala:123)
    2. org.apache.spark.sql.execution.stat.StatFunctions$$anonfun$4.apply(StatFunctions.scala:122)
    2 frames
  4. Scala
    AbstractTraversable.map
    1. scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
    2. scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
    3. scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:224)
    4. scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:403)
    5. scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:403)
    6. scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:403)
    7. scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:403)
    8. scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
    9. scala.collection.AbstractTraversable.map(Traversable.scala:105)
    9 frames
  5. org.apache.spark
    StatFunctions$.crossTabulate
    1. org.apache.spark.sql.execution.stat.StatFunctions$.crossTabulate(StatFunctions.scala:122)
    1 frame
  6. Spark Project SQL
    DataFrameStatFunctions.crosstab
    1. org.apache.spark.sql.DataFrameStatFunctions.crosstab(DataFrameStatFunctions.scala:133)
    1 frame
  7. Java RT
    Method.invoke
    1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    4. java.lang.reflect.Method.invoke(Method.java:498)
    4 frames
  8. Py4J
    GatewayConnection.run
    1. py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:231)
    2. py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:381)
    3. py4j.Gateway.invoke(Gateway.java:259)
    4. py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:133)
    5. py4j.commands.CallCommand.execute(CallCommand.java:79)
    6. py4j.GatewayConnection.run(GatewayConnection.java:209)
    6 frames
  9. Java RT
    Thread.run
    1. java.lang.Thread.run(Thread.java:745)
    1 frame