java.lang.OutOfMemoryError: GC overhead limit exceeded

Stack Overflow | theMadKing | 5 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Spark Streaming 2.0 GC Error (Shuffle Issue)

    Stack Overflow | 5 months ago | theMadKing
    java.lang.OutOfMemoryError: GC overhead limit exceeded

    Root Cause Analysis

    1. java.lang.OutOfMemoryError

      GC overhead limit exceeded

      at com.twitter.chill.Tuple4Serializer.read()
    2. chill-java
      Tuple4Serializer.read
      1. com.twitter.chill.Tuple4Serializer.read(TupleSerializers.scala:68)
      2. com.twitter.chill.Tuple4Serializer.read(TupleSerializers.scala:59)
      2 frames
    3. Kryo
      Kryo.readClassAndObject
      1. com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:708)
      2. com.esotericsoftware.kryo.serializers.DefaultArraySerializers$ObjectArraySerializer.read(DefaultArraySerializers.java:396)
      3. com.esotericsoftware.kryo.serializers.DefaultArraySerializers$ObjectArraySerializer.read(DefaultArraySerializers.java:307)
      4. com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:708)
      5. com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:125)
      6. com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:551)
      7. com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:790)
      7 frames
    4. Spark
      ExternalAppendOnlyMap$DiskMapIterator.hasNext
      1. org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:229)
      2. org.apache.spark.serializer.DeserializationStream.readValue(Serializer.scala:159)
      3. org.apache.spark.util.collection.ExternalAppendOnlyMap$DiskMapIterator.readNextItem(ExternalAppendOnlyMap.scala:515)
      4. org.apache.spark.util.collection.ExternalAppendOnlyMap$DiskMapIterator.hasNext(ExternalAppendOnlyMap.scala:535)
      4 frames
    5. Scala
      Iterator$$anon$1.hasNext
      1. scala.collection.Iterator$$anon$1.hasNext(Iterator.scala:1004)
      1 frame
    6. Spark
      ExternalAppendOnlyMap$ExternalIterator$$anonfun$5.apply
      1. org.apache.spark.util.collection.ExternalAppendOnlyMap$ExternalIterator.org$apache$spark$util$collection$ExternalAppendOnlyMap$ExternalIterator$$readNextHashCode(ExternalAppendOnlyMap.scala:332)
      2. org.apache.spark.util.collection.ExternalAppendOnlyMap$ExternalIterator$$anonfun$5.apply(ExternalAppendOnlyMap.scala:316)
      3. org.apache.spark.util.collection.ExternalAppendOnlyMap$ExternalIterator$$anonfun$5.apply(ExternalAppendOnlyMap.scala:314)
      3 frames
    7. Scala
      List.foreach
      1. scala.collection.immutable.List.foreach(List.scala:381)
      1 frame
    8. Spark
      Executor$TaskRunner.run
      1. org.apache.spark.util.collection.ExternalAppendOnlyMap$ExternalIterator.<init>(ExternalAppendOnlyMap.scala:314)
      2. org.apache.spark.util.collection.ExternalAppendOnlyMap.iterator(ExternalAppendOnlyMap.scala:288)
      3. org.apache.spark.Aggregator.combineValuesByKey(Aggregator.scala:43)
      4. org.apache.spark.shuffle.BlockStoreShuffleReader.read(BlockStoreShuffleReader.scala:91)
      5. org.apache.spark.rdd.ShuffledRDD.compute(ShuffledRDD.scala:109)
      6. org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:319)
      7. org.apache.spark.rdd.RDD.iterator(RDD.scala:283)
      8. org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70)
      9. org.apache.spark.scheduler.Task.run(Task.scala:85)
      10. org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274)
      10 frames
    9. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      3. java.lang.Thread.run(Thread.java:745)
      3 frames