java.lang.OutOfMemoryError

There are no available Samebug tips for this exception. Do you have an idea how to solve this issue? A short tip would help users who saw this issue last week.

  • GitHub comment 673#245847766
    via GitHub by attibalazs
    ,
  • Garbage Collection with the Gmail API
    via Stack Overflow by Sepoto
    ,
  • Hi, While indexing my document pool, I am having this issue. My document pool is huge, 2015 TREC CDS dataset (about 21gb). After running indexer for about 20+ hours, it reached to the limit I guess. I am attaching the error message below. Am I able to run indexer several times on the same document pool? continuing from where the indexer stopped previously? Or is there a way of "divide and conquer" and then merge the results at the end? === error message ==== java.lang.OutOfMemoryError: Java heap space java.lang.OutOfMemoryError: Java heap space at java.lang.AbstractStringBuilder.<init>(AbstractStringBuilder.java:68) at java.lang.StringBuilder.<init>(StringBuilder.java:101) at org.terrier.indexing.tokenisation.EnglishTokeniser$EnglishTokenStream.next(EnglishTokeniser.java:114) at org.terrier.indexing.tokenisation.EnglishTokeniser$EnglishTokenStream.next(EnglishTokeniser.java:77) at org.terrier.indexing.SimpleXMLCollection$XMLDocument.doText(SimpleXMLCollection.java:239) at org.terrier.indexing.SimpleXMLCollection$XMLDocument.doNode(SimpleXMLCollection.java:158) at org.terrier.indexing.SimpleXMLCollection$XMLDocument.doRecursive(SimpleXMLCollection.java:126) at org.terrier.indexing.SimpleXMLCollection$XMLDocument.doNode(SimpleXMLCollection.java:148) at org.terrier.indexing.SimpleXMLCollection$XMLDocument.doRecursive(SimpleXMLCollection.java:126) at org.terrier.indexing.SimpleXMLCollection$XMLDocument.<init>(SimpleXMLCollection.java:95) at org.terrier.indexing.SimpleXMLCollection.findDocumentElement(SimpleXMLCollection.java:529) at org.terrier.indexing.SimpleXMLCollection.findDocumentElement(SimpleXMLCollection.java:539) at org.terrier.indexing.SimpleXMLCollection.openNextFile(SimpleXMLCollection.java:609) at org.terrier.indexing.SimpleXMLCollection.nextDocument(SimpleXMLCollection.java:508) at org.terrier.structures.indexing.classical.BasicIndexer.createDirectIndex(BasicIndexer.java:241) at org.terrier.structures.indexing.Indexer.index(Indexer.java:348) at org.terrier.applications.TRECIndexing.index(TRECIndexing.java:154) at org.terrier.applications.TrecTerrier.run(TrecTerrier.java:389) at org.terrier.applications.TrecTerrier.applyOptions(TrecTerrier.java:584) at org.terrier.applications.TrecTerrier.main(TrecTerrier.java:229)
    via by Jiho Noh,
  • OOM with snapshot 2.2.0
    via GitHub by OkkeKlein
    ,
  • [appengine-java] OutOfMemoryError in appstats
    via by dmitrygusev,
  • Meera's Blog: Hudson + Sonar = A Perfect Match!
    via by Unknown author,
    • java.lang.OutOfMemoryError: Java heap space at java.lang.AbstractStringBuilder.<init>(AbstractStringBuilder.java:68) at java.lang.StringBuilder.<init>(StringBuilder.java:101) at com.fasterxml.jackson.core.util.TextBuffer.contentsAsString(TextBuffer.java:346) at com.fasterxml.jackson.core.json.UTF8StreamJsonParser._finishAndReturnString(UTF8StreamJsonParser.java:2415) at com.fasterxml.jackson.core.json.UTF8StreamJsonParser.getText(UTF8StreamJsonParser.java:285) at org.elasticsearch.common.xcontent.json.JsonXContentParser.text(JsonXContentParser.java:84) at org.elasticsearch.common.xcontent.support.AbstractXContentParser.readValue(AbstractXContentParser.java:299) at org.elasticsearch.common.xcontent.support.AbstractXContentParser.readMap(AbstractXContentParser.java:274) at org.elasticsearch.common.xcontent.support.AbstractXContentParser.readValue(AbstractXContentParser.java:314) at org.elasticsearch.common.xcontent.support.AbstractXContentParser.readMap(AbstractXContentParser.java:274) at org.elasticsearch.common.xcontent.support.AbstractXContentParser.readMap(AbstractXContentParser.java:245) at org.elasticsearch.common.xcontent.support.AbstractXContentParser.map(AbstractXContentParser.java:208) at org.elasticsearch.common.xcontent.XContentHelper.convertToMap(XContentHelper.java:83) at org.elasticsearch.search.lookup.SourceLookup.sourceAsMapAndType(SourceLookup.java:88) at org.elasticsearch.search.lookup.SourceLookup.sourceAsMap(SourceLookup.java:92) at org.elasticsearch.index.get.GetResult.sourceAsMap(GetResult.java:177) at org.elasticsearch.index.get.GetResult.getSource(GetResult.java:182) at org.elasticsearch.action.get.GetResponse.getSource(GetResponse.java:133) at org.codelibs.fess.crawler.service.impl.AbstractCrawlerService.get(AbstractCrawlerService.java:308) at org.codelibs.fess.crawler.service.impl.EsDataService.getAccessResult(EsDataService.java:76) at org.codelibs.fess.crawler.entity.EsAccessResult.getAccessResultData(EsAccessResult.java:77) at org.codelibs.fess.indexer.IndexUpdater.processAccessResults(IndexUpdater.java:346) at org.codelibs.fess.indexer.IndexUpdater.run(IndexUpdater.java:230)

    Users with the same issue

    Chandan JhaChandan Jha
    2 times, last one,