java.lang.OutOfMemoryError: GC overhead limit exceeded

Stack Overflow | suiyuan2009 | 2 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    hadoop job throwing java.lang.OutOfMemoryError: GC overhead limit exceeded

    Stack Overflow | 2 months ago | suiyuan2009
    java.lang.OutOfMemoryError: GC overhead limit exceeded
  2. 0

    oozie java action issue

    hadoop-user | 1 year ago | Immanuel Fredrick
    java.nio.channels.ClosedChannelException
  3. 0

    oozie java action issue

    hadoop-common-user | 1 year ago | Immanuel Fredrick
    java.nio.channels.ClosedChannelException
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    oozie java action issue

    hadoop-hdfs-user | 1 year ago | Immanuel Fredrick
    java.nio.channels.ClosedChannelException

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.OutOfMemoryError

      GC overhead limit exceeded

      at org.apache.hadoop.hdfs.util.ByteArrayManager$NewByteArrayWithoutLimit.newByteArray()
    2. Apache Hadoop HDFS
      DFSOutputStream.writeChunk
      1. org.apache.hadoop.hdfs.util.ByteArrayManager$NewByteArrayWithoutLimit.newByteArray(ByteArrayManager.java:308)
      2. org.apache.hadoop.hdfs.DFSOutputStream.createPacket(DFSOutputStream.java:197)
      3. org.apache.hadoop.hdfs.DFSOutputStream.writeChunkImpl(DFSOutputStream.java:1835)
      4. org.apache.hadoop.hdfs.DFSOutputStream.writeChunk(DFSOutputStream.java:1813)
      4 frames
    3. Hadoop
      FSOutputSummer.flush
      1. org.apache.hadoop.fs.FSOutputSummer.writeChecksumChunks(FSOutputSummer.java:206)
      2. org.apache.hadoop.fs.FSOutputSummer.flushBuffer(FSOutputSummer.java:163)
      3. org.apache.hadoop.fs.FSOutputSummer.flush(FSOutputSummer.java:182)
      3 frames
    4. Java RT
      DataOutputStream.flush
      1. java.io.FilterOutputStream.flush(FilterOutputStream.java:140)
      2. java.io.DataOutputStream.flush(DataOutputStream.java:123)
      2 frames
    5. Jackson
      Utf8Generator.flush
      1. org.codehaus.jackson.impl.Utf8Generator.flush(Utf8Generator.java:1091)
      1 frame
    6. Apache Avro
      JsonEncoder.flush
      1. org.apache.avro.io.JsonEncoder.flush(JsonEncoder.java:67)
      1 frame
    7. Hadoop
      JobHistoryEventHandler$1.run
      1. org.apache.hadoop.mapreduce.jobhistory.EventWriter.write(EventWriter.java:67)
      2. org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler$MetaInfo.writeEvent(JobHistoryEventHandler.java:1248)
      3. org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.handleEvent(JobHistoryEventHandler.java:565)
      4. org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler$1.run(JobHistoryEventHandler.java:318)
      4 frames
    8. Java RT
      Thread.run
      1. java.lang.Thread.run(Thread.java:745)
      1 frame