java.lang.OutOfMemoryError: Java heap space

GitHub | HosiYuki | 2 months ago
  1. 0

    GitHub comment 1349#248795433

    GitHub | 2 months ago | HosiYuki
    java.lang.OutOfMemoryError: Java heap space
  2. 0

    I'm running teragen with 1T datasize, and suddenly the task hangs: 12/08/23 09:31:06 INFO mapred.JobClient: map 85% reduce 28% 12/08/23 09:32:50 INFO mapred.JobClient: map 86% reduce 28% 12/08/23 09:34:29 INFO mapred.JobClient: map 87% reduce 28% 12/08/23 09:40:15 INFO mapred.JobClient: map 87% reduce 29% And the web page also stops working.(http://192.168.1.99:50030/jobtracker.jsp) In jobtracker log, it shows, [root@192 hadoop]# more hadoop-hdfs-jobtracker-192.168.1.99.out Exception in thread "1170987530@qtp-1511627065-1" java.lang.OutOfMemoryError: Java heap space at org.apache.log4j.Category.forcedLog(Category.java:391) at org.apache.log4j.Category.log(Category.java:856) at org.slf4j.impl.Log4jLoggerAdapter.error(Log4jLoggerAdapter.java:485) at org.mortbay.log.Slf4jLog.warn(Slf4jLog.java:87) at org.mortbay.log.Log.warn(Log.java:204) at org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:724) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Exception in thread "pool-2-thread-1" java.lang.OutOfMemoryError: Java heap space at java.util.HashMap.addEntry(HashMap.java:753) at java.util.HashMap.put(HashMap.java:385) at java.util.HashSet.add(HashSet.java:200) at sun.nio.ch.EPollSelectorImpl.updateSelectedKeys(EPollSelectorImpl.java:104) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:70) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84) at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:333) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) The master VM has 4G memory. There are 10 historic jobs. It seems the jobtracker(and also the namenode) process is assigned 1000M memory statically. /usr/local/jdk/bin/java -Dproc_jobtracker -Xmx1000m ... Shall we increase them?

    SpringSource Issue Tracker | 4 years ago | Binbin Zhao
    java.lang.OutOfMemoryError: Java heap space
  3. 0

    I'm running teragen with 1T datasize, and suddenly the task hangs: 12/08/23 09:31:06 INFO mapred.JobClient: map 85% reduce 28% 12/08/23 09:32:50 INFO mapred.JobClient: map 86% reduce 28% 12/08/23 09:34:29 INFO mapred.JobClient: map 87% reduce 28% 12/08/23 09:40:15 INFO mapred.JobClient: map 87% reduce 29% And the web page also stops working.(http://192.168.1.99:50030/jobtracker.jsp) In jobtracker log, it shows, [root@192 hadoop]# more hadoop-hdfs-jobtracker-192.168.1.99.out Exception in thread "1170987530@qtp-1511627065-1" java.lang.OutOfMemoryError: Java heap space at org.apache.log4j.Category.forcedLog(Category.java:391) at org.apache.log4j.Category.log(Category.java:856) at org.slf4j.impl.Log4jLoggerAdapter.error(Log4jLoggerAdapter.java:485) at org.mortbay.log.Slf4jLog.warn(Slf4jLog.java:87) at org.mortbay.log.Log.warn(Log.java:204) at org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:724) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Exception in thread "pool-2-thread-1" java.lang.OutOfMemoryError: Java heap space at java.util.HashMap.addEntry(HashMap.java:753) at java.util.HashMap.put(HashMap.java:385) at java.util.HashSet.add(HashSet.java:200) at sun.nio.ch.EPollSelectorImpl.updateSelectedKeys(EPollSelectorImpl.java:104) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:70) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84) at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:333) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) The master VM has 4G memory. There are 10 historic jobs. It seems the jobtracker(and also the namenode) process is assigned 1000M memory statically. /usr/local/jdk/bin/java -Dproc_jobtracker -Xmx1000m ... Shall we increase them?

    SpringSource Issue Tracker | 4 years ago | Binbin Zhao
    java.lang.OutOfMemoryError: Java heap space
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Jeff Potts tutorial, OutOfMemoryError: PermGen space | Alfresco Forums

    alfresco.com | 4 months ago
    java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: PermGen space

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.OutOfMemoryError

      Java heap space

      at org.apache.log4j.Category.forcedLog()
    2. Apache Log4j
      Category.log
      1. org.apache.log4j.Category.forcedLog(Category.java:391)
      2. org.apache.log4j.Category.log(Category.java:856)
      2 frames
    3. SLF4J LOG4J-12 Binding
      Log4jLoggerAdapter.warn
      1. org.slf4j.impl.Log4jLoggerAdapter.warn(Log4jLoggerAdapter.java:478)
      1 frame
    4. Netty
      SingleThreadEventExecutor$2.run
      1. io.netty.util.internal.logging.Slf4JLogger.warn(Slf4JLogger.java:151)
      2. io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:367)
      3. io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
      3 frames
    5. Java RT
      Thread.run
      1. java.lang.Thread.run(Thread.java:745)
      1 frame