java.io.IOException: Map failed

JIRA | Gordon Mohr | 7 years ago
  1. 0

    Recent crawl from H1 trunk again got an error similar to that of [HER-1482]. From heritrix_out.log: 09/14/2009 18:29:28 +0000 SEVERE org.archive.crawler.extractor.ExtractorHTML extract Failed get of replay char sequence i n ToeThread #46: http://southsky.com.au/viewvc.cgi/MFB/trunk/bin/CCAM-T_SetUp/setup.exe?view=markup&pathrev=21 java.io.IOException: Map failed at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:758) at org.archive.io.GenericReplayCharSequence.getReadOnlyMemoryMappedBuffer(GenericReplayCharSequence.java:270) at org.archive.io.GenericReplayCharSequence.decodeToFile(GenericReplayCharSequence.java:205) at org.archive.io.GenericReplayCharSequence.<init>(GenericReplayCharSequence.java:158) at org.archive.io.RecordingOutputStream.getReplayCharSequence(RecordingOutputStream.java:559) at org.archive.io.RecordingOutputStream.getReplayCharSequence(RecordingOutputStream.java:515) at org.archive.io.RecordingInputStream.getReplayCharSequence(RecordingInputStream.java:314) at org.archive.util.HttpRecorder.getReplayCharSequence(HttpRecorder.java:295) at org.archive.crawler.extractor.ExtractorHTML.extract(ExtractorHTML.java:543) at org.archive.crawler.extractor.Extractor.innerProcess(Extractor.java:67) at org.archive.crawler.framework.Processor.process(Processor.java:112) at org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:302) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:151) Caused by: java.lang.OutOfMemoryError: Map failed at sun.nio.ch.FileChannelImpl.map0(Native Method) at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:755) ... 12 more And from the crawl.log, the resource in question was only ~157MB: 2009-09-14T18:30:51.112Z 200 157162603 http://southsky.com.au/viewvc.cgi/MFB/trunk/bin/CCAM-T_SetUp/setup.exe?view=markup&pathrev=21 LRLLL http://southsky.com.au/viewvc.cgi?view=rev&revision=21 text/html #046 20090914182520758+172580 sha1:WUG36LDQJSEQ4HK3QKUMDS6O7SLE7BZ2 - le:IOException@ExtractorHTML So, there may have been a transient condition where -- due to other same-time workload or slow finalization/freeing of previous native memory space -- there was insufficient address space for this file-mapping, and as a result this URI was not link-extracted. We may want to eliminate use of memory-mapped files: their need for so much address-space makes them flaky. Whatever performance gains they offer, if any, may not be worth the trouble.

    JIRA | 7 years ago | Gordon Mohr
    java.io.IOException: Map failed
  2. 0

    Recent crawl from H1 trunk again got an error similar to that of [HER-1482]. From heritrix_out.log: 09/14/2009 18:29:28 +0000 SEVERE org.archive.crawler.extractor.ExtractorHTML extract Failed get of replay char sequence i n ToeThread #46: http://southsky.com.au/viewvc.cgi/MFB/trunk/bin/CCAM-T_SetUp/setup.exe?view=markup&pathrev=21 java.io.IOException: Map failed at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:758) at org.archive.io.GenericReplayCharSequence.getReadOnlyMemoryMappedBuffer(GenericReplayCharSequence.java:270) at org.archive.io.GenericReplayCharSequence.decodeToFile(GenericReplayCharSequence.java:205) at org.archive.io.GenericReplayCharSequence.<init>(GenericReplayCharSequence.java:158) at org.archive.io.RecordingOutputStream.getReplayCharSequence(RecordingOutputStream.java:559) at org.archive.io.RecordingOutputStream.getReplayCharSequence(RecordingOutputStream.java:515) at org.archive.io.RecordingInputStream.getReplayCharSequence(RecordingInputStream.java:314) at org.archive.util.HttpRecorder.getReplayCharSequence(HttpRecorder.java:295) at org.archive.crawler.extractor.ExtractorHTML.extract(ExtractorHTML.java:543) at org.archive.crawler.extractor.Extractor.innerProcess(Extractor.java:67) at org.archive.crawler.framework.Processor.process(Processor.java:112) at org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:302) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:151) Caused by: java.lang.OutOfMemoryError: Map failed at sun.nio.ch.FileChannelImpl.map0(Native Method) at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:755) ... 12 more And from the crawl.log, the resource in question was only ~157MB: 2009-09-14T18:30:51.112Z 200 157162603 http://southsky.com.au/viewvc.cgi/MFB/trunk/bin/CCAM-T_SetUp/setup.exe?view=markup&pathrev=21 LRLLL http://southsky.com.au/viewvc.cgi?view=rev&revision=21 text/html #046 20090914182520758+172580 sha1:WUG36LDQJSEQ4HK3QKUMDS6O7SLE7BZ2 - le:IOException@ExtractorHTML So, there may have been a transient condition where -- due to other same-time workload or slow finalization/freeing of previous native memory space -- there was insufficient address space for this file-mapping, and as a result this URI was not link-extracted. We may want to eliminate use of memory-mapped files: their need for so much address-space makes them flaky. Whatever performance gains they offer, if any, may not be worth the trouble.

    JIRA | 7 years ago | Gordon Mohr
    java.io.IOException: Map failed
  3. 0

    Time: Feb. 28, 2008 07:13:46 GMT Level: SEVERE Message: Failed get of replay char sequence in ToeThread #45: http://www.prospect-magazine.co.uk/list.php?related_article=7111 (in thread 'ToeThread #45: http://www.prospect-magazine.co.uk/list.php?related_article=7111'; in processor 'ExtractorHTML') Exception: java.io.IOException: Map failed Cause: java.lang.OutOfMemoryError: Map failed at sun.nio.ch.FileChannelImpl.map0(Native Method) at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:758) at org.archive.io.MultiByteReplayCharSequence.getReadOnlyMemoryMappedBuffer(MultiByteReplayCharSequence.java:271) at org.archive.io.MultiByteReplayCharSequence.decodeToFile(MultiByteReplayCharSequence.java:213) at org.archive.io.MultiByteReplayCharSequence.(MultiByteReplayCharSequence.java:162) at org.archive.io.RecordingOutputStream.getReplayCharSequence(RecordingOutputStream.java:549) at org.archive.io.RecordingOutputStream.getReplayCharSequence(RecordingOutputStream.java:515) at org.archive.io.RecordingInputStream.getReplayCharSequence(RecordingInputStream.java:314) at org.archive.util.HttpRecorder.getReplayCharSequence(HttpRecorder.java:295) at org.archive.crawler.extractor.ExtractorHTML.extract(ExtractorHTML.java:539) at org.archive.crawler.extractor.Extractor.innerProcess(Extractor.java:67) at org.archive.crawler.framework.Processor.process(Processor.java:112) at org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:302) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:151) Stacktrace: java.io.IOException: Map failed at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:761) at org.archive.io.MultiByteReplayCharSequence.getReadOnlyMemoryMappedBuffer(MultiByteReplayCharSequence.java:271) at org.archive.io.MultiByteReplayCharSequence.decodeToFile(MultiByteReplayCharSequence.java:213) at org.archive.io.MultiByteReplayCharSequence.(MultiByteReplayCharSequence.java:162) at org.archive.io.RecordingOutputStream.getReplayCharSequence(RecordingOutputStream.java:549) at org.archive.io.RecordingOutputStream.getReplayCharSequence(RecordingOutputStream.java:515) at org.archive.io.RecordingInputStream.getReplayCharSequence(RecordingInputStream.java:314) at org.archive.util.HttpRecorder.getReplayCharSequence(HttpRecorder.java:295) at org.archive.crawler.extractor.ExtractorHTML.extract(ExtractorHTML.java:539) at org.archive.crawler.extractor.Extractor.innerProcess(Extractor.java:67) at org.archive.crawler.framework.Processor.process(Processor.java:112) at org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:302) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:151) Caused by: java.lang.OutOfMemoryError: Map failed at sun.nio.ch.FileChannelImpl.map0(Native Method) at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:758) ... 12 more

    JIRA | 9 years ago | Igor Ranitovic
    java.io.IOException: Map failed
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Time: Feb. 28, 2008 07:13:46 GMT Level: SEVERE Message: Failed get of replay char sequence in ToeThread #45: http://www.prospect-magazine.co.uk/list.php?related_article=7111 (in thread 'ToeThread #45: http://www.prospect-magazine.co.uk/list.php?related_article=7111'; in processor 'ExtractorHTML') Exception: java.io.IOException: Map failed Cause: java.lang.OutOfMemoryError: Map failed at sun.nio.ch.FileChannelImpl.map0(Native Method) at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:758) at org.archive.io.MultiByteReplayCharSequence.getReadOnlyMemoryMappedBuffer(MultiByteReplayCharSequence.java:271) at org.archive.io.MultiByteReplayCharSequence.decodeToFile(MultiByteReplayCharSequence.java:213) at org.archive.io.MultiByteReplayCharSequence.(MultiByteReplayCharSequence.java:162) at org.archive.io.RecordingOutputStream.getReplayCharSequence(RecordingOutputStream.java:549) at org.archive.io.RecordingOutputStream.getReplayCharSequence(RecordingOutputStream.java:515) at org.archive.io.RecordingInputStream.getReplayCharSequence(RecordingInputStream.java:314) at org.archive.util.HttpRecorder.getReplayCharSequence(HttpRecorder.java:295) at org.archive.crawler.extractor.ExtractorHTML.extract(ExtractorHTML.java:539) at org.archive.crawler.extractor.Extractor.innerProcess(Extractor.java:67) at org.archive.crawler.framework.Processor.process(Processor.java:112) at org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:302) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:151) Stacktrace: java.io.IOException: Map failed at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:761) at org.archive.io.MultiByteReplayCharSequence.getReadOnlyMemoryMappedBuffer(MultiByteReplayCharSequence.java:271) at org.archive.io.MultiByteReplayCharSequence.decodeToFile(MultiByteReplayCharSequence.java:213) at org.archive.io.MultiByteReplayCharSequence.(MultiByteReplayCharSequence.java:162) at org.archive.io.RecordingOutputStream.getReplayCharSequence(RecordingOutputStream.java:549) at org.archive.io.RecordingOutputStream.getReplayCharSequence(RecordingOutputStream.java:515) at org.archive.io.RecordingInputStream.getReplayCharSequence(RecordingInputStream.java:314) at org.archive.util.HttpRecorder.getReplayCharSequence(HttpRecorder.java:295) at org.archive.crawler.extractor.ExtractorHTML.extract(ExtractorHTML.java:539) at org.archive.crawler.extractor.Extractor.innerProcess(Extractor.java:67) at org.archive.crawler.framework.Processor.process(Processor.java:112) at org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:302) at org.archive.crawler.framework.ToeThread.run(ToeThread.java:151) Caused by: java.lang.OutOfMemoryError: Map failed at sun.nio.ch.FileChannelImpl.map0(Native Method) at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:758) ... 12 more

    JIRA | 9 years ago | Igor Ranitovic
    java.io.IOException: Map failed
  6. 0

    failed to flush after setting shard to inactive org.elasticsearch.index.engine.FlushFailedEngineException

    GitHub | 2 years ago | balibaba12
    org.elasticsearch.index.engine.FlushFailedEngineException: [bifs_index-2014-07-18][0] Flush failed

    3 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.OutOfMemoryError

      Map failed

      at sun.nio.ch.FileChannelImpl.map0()
    2. Java RT
      FileChannelImpl.map
      1. sun.nio.ch.FileChannelImpl.map0(Native Method)
      2. sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:755)
      2 frames
    3. webarchive-commons
      HttpRecorder.getReplayCharSequence
      1. org.archive.io.GenericReplayCharSequence.getReadOnlyMemoryMappedBuffer(GenericReplayCharSequence.java:270)
      2. org.archive.io.GenericReplayCharSequence.decodeToFile(GenericReplayCharSequence.java:205)
      3. org.archive.io.GenericReplayCharSequence.<init>(GenericReplayCharSequence.java:158)
      4. org.archive.io.RecordingOutputStream.getReplayCharSequence(RecordingOutputStream.java:559)
      5. org.archive.io.RecordingOutputStream.getReplayCharSequence(RecordingOutputStream.java:515)
      6. org.archive.io.RecordingInputStream.getReplayCharSequence(RecordingInputStream.java:314)
      7. org.archive.util.HttpRecorder.getReplayCharSequence(HttpRecorder.java:295)
      7 frames
    4. org.archive.crawler
      ToeThread.run
      1. org.archive.crawler.extractor.ExtractorHTML.extract(ExtractorHTML.java:543)
      2. org.archive.crawler.extractor.Extractor.innerProcess(Extractor.java:67)
      3. org.archive.crawler.framework.Processor.process(Processor.java:112)
      4. org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:302)
      5. org.archive.crawler.framework.ToeThread.run(ToeThread.java:151)
      5 frames