java.lang.OutOfMemoryError

There are no available Samebug tips for this exception. Do you have an idea how to solve this issue? A short tip would help users who saw this issue last week.

  • GitHub comment 1349#248795433
    via GitHub by HosiYuki
    ,
  • I'm running teragen with 1T datasize, and suddenly the task hangs: 12/08/23 09:31:06 INFO mapred.JobClient: map 85% reduce 28% 12/08/23 09:32:50 INFO mapred.JobClient: map 86% reduce 28% 12/08/23 09:34:29 INFO mapred.JobClient: map 87% reduce 28% 12/08/23 09:40:15 INFO mapred.JobClient: map 87% reduce 29% And the web page also stops working.(http://192.168.1.99:50030/jobtracker.jsp) In jobtracker log, it shows, [root@192 hadoop]# more hadoop-hdfs-jobtracker-192.168.1.99.out Exception in thread "1170987530@qtp-1511627065-1" java.lang.OutOfMemoryError: Java heap space at org.apache.log4j.Category.forcedLog(Category.java:391) at org.apache.log4j.Category.log(Category.java:856) at org.slf4j.impl.Log4jLoggerAdapter.error(Log4jLoggerAdapter.java:485) at org.mortbay.log.Slf4jLog.warn(Slf4jLog.java:87) at org.mortbay.log.Log.warn(Log.java:204) at org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:724) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Exception in thread "pool-2-thread-1" java.lang.OutOfMemoryError: Java heap space at java.util.HashMap.addEntry(HashMap.java:753) at java.util.HashMap.put(HashMap.java:385) at java.util.HashSet.add(HashSet.java:200) at sun.nio.ch.EPollSelectorImpl.updateSelectedKeys(EPollSelectorImpl.java:104) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:70) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84) at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:333) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) The master VM has 4G memory. There are 10 historic jobs. It seems the jobtracker(and also the namenode) process is assigned 1000M memory statically. /usr/local/jdk/bin/java -Dproc_jobtracker -Xmx1000m ... Shall we increase them?
    via by Binbin Zhao,
  • I'm running teragen with 1T datasize, and suddenly the task hangs: 12/08/23 09:31:06 INFO mapred.JobClient: map 85% reduce 28% 12/08/23 09:32:50 INFO mapred.JobClient: map 86% reduce 28% 12/08/23 09:34:29 INFO mapred.JobClient: map 87% reduce 28% 12/08/23 09:40:15 INFO mapred.JobClient: map 87% reduce 29% And the web page also stops working.(http://192.168.1.99:50030/jobtracker.jsp) In jobtracker log, it shows, [root@192 hadoop]# more hadoop-hdfs-jobtracker-192.168.1.99.out Exception in thread "1170987530@qtp-1511627065-1" java.lang.OutOfMemoryError: Java heap space at org.apache.log4j.Category.forcedLog(Category.java:391) at org.apache.log4j.Category.log(Category.java:856) at org.slf4j.impl.Log4jLoggerAdapter.error(Log4jLoggerAdapter.java:485) at org.mortbay.log.Slf4jLog.warn(Slf4jLog.java:87) at org.mortbay.log.Log.warn(Log.java:204) at org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:724) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Exception in thread "pool-2-thread-1" java.lang.OutOfMemoryError: Java heap space at java.util.HashMap.addEntry(HashMap.java:753) at java.util.HashMap.put(HashMap.java:385) at java.util.HashSet.add(HashSet.java:200) at sun.nio.ch.EPollSelectorImpl.updateSelectedKeys(EPollSelectorImpl.java:104) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:70) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:84) at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:333) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) The master VM has 4G memory. There are 10 historic jobs. It seems the jobtracker(and also the namenode) process is assigned 1000M memory statically. /usr/local/jdk/bin/java -Dproc_jobtracker -Xmx1000m ... Shall we increase them?
    via by Binbin Zhao,
    • java.lang.OutOfMemoryError: Java heap space at org.apache.log4j.Category.forcedLog(Category.java:391) at org.apache.log4j.Category.log(Category.java:856) at org.slf4j.impl.Log4jLoggerAdapter.warn(Log4jLoggerAdapter.java:478) at io.netty.util.internal.logging.Slf4JLogger.warn(Slf4JLogger.java:151) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:367) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116) at java.lang.Thread.run(Thread.java:745)
    No Bugmate found.