java.lang.OutOfMemoryError: Java heap space

GitHub | adrianocrestani | 10 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    GitHub comment 673#245847766

    GitHub | 8 months ago | attibalazs
    java.lang.OutOfMemoryError: Java heap space
  2. 0

    Hi, While indexing my document pool, I am having this issue. My document pool is huge, 2015 TREC CDS dataset (about 21gb). After running indexer for about 20+ hours, it reached to the limit I guess. I am attaching the error message below. Am I able to run indexer several times on the same document pool? continuing from where the indexer stopped previously? Or is there a way of "divide and conquer" and then merge the results at the end? === error message ==== java.lang.OutOfMemoryError: Java heap space java.lang.OutOfMemoryError: Java heap space at java.lang.AbstractStringBuilder.<init>(AbstractStringBuilder.java:68) at java.lang.StringBuilder.<init>(StringBuilder.java:101) at org.terrier.indexing.tokenisation.EnglishTokeniser$EnglishTokenStream.next(EnglishTokeniser.java:114) at org.terrier.indexing.tokenisation.EnglishTokeniser$EnglishTokenStream.next(EnglishTokeniser.java:77) at org.terrier.indexing.SimpleXMLCollection$XMLDocument.doText(SimpleXMLCollection.java:239) at org.terrier.indexing.SimpleXMLCollection$XMLDocument.doNode(SimpleXMLCollection.java:158) at org.terrier.indexing.SimpleXMLCollection$XMLDocument.doRecursive(SimpleXMLCollection.java:126) at org.terrier.indexing.SimpleXMLCollection$XMLDocument.doNode(SimpleXMLCollection.java:148) at org.terrier.indexing.SimpleXMLCollection$XMLDocument.doRecursive(SimpleXMLCollection.java:126) at org.terrier.indexing.SimpleXMLCollection$XMLDocument.<init>(SimpleXMLCollection.java:95) at org.terrier.indexing.SimpleXMLCollection.findDocumentElement(SimpleXMLCollection.java:529) at org.terrier.indexing.SimpleXMLCollection.findDocumentElement(SimpleXMLCollection.java:539) at org.terrier.indexing.SimpleXMLCollection.openNextFile(SimpleXMLCollection.java:609) at org.terrier.indexing.SimpleXMLCollection.nextDocument(SimpleXMLCollection.java:508) at org.terrier.structures.indexing.classical.BasicIndexer.createDirectIndex(BasicIndexer.java:241) at org.terrier.structures.indexing.Indexer.index(Indexer.java:348) at org.terrier.applications.TRECIndexing.index(TRECIndexing.java:154) at org.terrier.applications.TrecTerrier.run(TrecTerrier.java:389) at org.terrier.applications.TrecTerrier.applyOptions(TrecTerrier.java:584) at org.terrier.applications.TrecTerrier.main(TrecTerrier.java:229)

    JIRA | 3 months ago | Jiho Noh
    java.lang.OutOfMemoryError: Java heap space
  3. Speed up your debug routine!

    Automated exception search integrated into your IDE

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.OutOfMemoryError

      Java heap space

      at java.lang.AbstractStringBuilder.<init>()
    2. Java RT
      StringBuilder.<init>
      1. java.lang.AbstractStringBuilder.<init>(AbstractStringBuilder.java:68)
      2. java.lang.StringBuilder.<init>(StringBuilder.java:101)
      2 frames
    3. ElasticSearch
      NettyInternalESLogger.warn
      1. org.elasticsearch.common.logging.support.LoggerMessageFormat.format(LoggerMessageFormat.java:52)
      2. org.elasticsearch.common.logging.support.AbstractESLogger.warn(AbstractESLogger.java:109)
      3. org.elasticsearch.transport.netty.NettyInternalESLogger.warn(NettyInternalESLogger.java:83)
      3 frames
    4. Netty
      DeadLockProofWorker$1.run
      1. org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:340)
      2. org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42)
      3. org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
      4. org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
      4 frames
    5. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      3. java.lang.Thread.run(Thread.java:745)
      3 frames