com.atlassian.bonnie.LuceneException: java.io.IOException: cannot read directory org.apache.lucene.store.FSDirectory@/home/confluence/data-3.1/temp/lucene2506686581554376744index: list() returned null

Atlassian JIRA | Sashidaran Jayaraman [Atlassian] | 6 years ago
  1. 0

    h5. Bug background The re-indexing process might take long time to complete especially when the instance is large. Due to this, many organisations schedule this process during off peak hours, usually after 12am. However, the process hangs at 99% completion with the following error in the logs: {code} 2010-09-22 08:18:52,832 ERROR [Indexer: 4] [confluence.search.lucene.DefaultObjectQueueWorker] indexCollection Error indexing document -- url: /admin/reindex.action | userName: admin | referer: http://support.cosinex.de/admin/search-indexes.action | action: reindex com.atlassian.bonnie.LuceneException: java.io.IOException: cannot read directory org.apache.lucene.store.FSDirectory@/home/confluence/data-3.1/temp/lucene2506686581554376744index: list() returned null at com.atlassian.confluence.search.lucene.TempIndexWriterStrategy.perform(TempIndexWriterStrategy.java:47) at com.atlassian.confluence.search.lucene.tasks.TempIndexBackedIndexTaskPerformer.perform(TempIndexBackedIndexTaskPerformer.java:21) at com.atlassian.confluence.search.lucene.DefaultObjectQueueWorker.indexCollection(DefaultObjectQueueWorker.java:79) at com.atlassian.confluence.search.lucene.DefaultObjectQueueWorker$1.doInTransactionWithoutResult(DefaultObjectQueueWorker.java:62) at org.springframework.transaction.support.TransactionCallbackWithoutResult.doInTransaction(TransactionCallbackWithoutResult.java:33) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:127) at com.atlassian.confluence.search.lucene.DefaultObjectQueueWorker.run(DefaultObjectQueueWorker.java:51) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:619) Caused by: java.io.IOException: cannot read directory org.apache.lucene.store.FSDirectory@/home/confluence/data-3.1/temp/lucene2506686581554376744index: list() returned null at org.apache.lucene.index.IndexFileDeleter.refresh(IndexFileDeleter.java:260) at org.apache.lucene.index.IndexWriter.mergeSegments(IndexWriter.java:1950) at org.apache.lucene.index.IndexWriter.flushRamSegments(IndexWriter.java:1741) at org.apache.lucene.index.IndexWriter.flushRamSegments(IndexWriter.java:1733) at org.apache.lucene.index.IndexWriter.maybeFlushRamSegments(IndexWriter.java:1727) at org.apache.lucene.index.IndexWriter.deleteDocuments(IndexWriter.java:1028) at com.atlassian.confluence.search.lucene.tasks.DeleteChangeDocumentsIndexTask.perform(DeleteChangeDocumentsIndexTask.java:70) at com.atlassian.confluence.search.lucene.tasks.RebuildChangeDocumentsIndexTask.perform(RebuildChangeDocumentsIndexTask.java:66) at com.atlassian.bonnie.index.TempIndexWriter.perform(TempIndexWriter.java:73) at com.atlassian.confluence.search.lucene.TempIndexWriterStrategy.perform(TempIndexWriterStrategy.java:43) ... 9 more {code} h5. Causes/Troubleshooting/Workaround # The first step to try is to ensure that the <confluence-home>/index and <confluence-home>/temp directories have the read/write permissions # Also, it's also worth to try to [re-index from scratch|http://confluence.atlassian.com/display/DOC/Rebuild+the+Content+Indices+from+scratch] # If the above suggestions doesn't work, it's probably a good idea to check what time the re-index process takes place as there's a [Quartz job|http://confluence.atlassian.com/display/DOC/Scheduled+Jobs] called cleanTempDirectoryJob that cleans the <confluenec-home>/temp directory everyday at 4am. This job might be clashing with the indexing process which is causing the indexing process to stop at 99% h5. Suggestions Perhaps, there should be locking mechanism that will stop other jobs that are using resources required by the indexing process

    Atlassian JIRA | 6 years ago | Sashidaran Jayaraman [Atlassian]
    com.atlassian.bonnie.LuceneException: java.io.IOException: cannot read directory org.apache.lucene.store.FSDirectory@/home/confluence/data-3.1/temp/lucene2506686581554376744index: list() returned null
  2. 0

    h5. Bug background The re-indexing process might take long time to complete especially when the instance is large. Due to this, many organisations schedule this process during off peak hours, usually after 12am. However, the process hangs at 99% completion with the following error in the logs: {code} 2010-09-22 08:18:52,832 ERROR [Indexer: 4] [confluence.search.lucene.DefaultObjectQueueWorker] indexCollection Error indexing document -- url: /admin/reindex.action | userName: admin | referer: http://support.cosinex.de/admin/search-indexes.action | action: reindex com.atlassian.bonnie.LuceneException: java.io.IOException: cannot read directory org.apache.lucene.store.FSDirectory@/home/confluence/data-3.1/temp/lucene2506686581554376744index: list() returned null at com.atlassian.confluence.search.lucene.TempIndexWriterStrategy.perform(TempIndexWriterStrategy.java:47) at com.atlassian.confluence.search.lucene.tasks.TempIndexBackedIndexTaskPerformer.perform(TempIndexBackedIndexTaskPerformer.java:21) at com.atlassian.confluence.search.lucene.DefaultObjectQueueWorker.indexCollection(DefaultObjectQueueWorker.java:79) at com.atlassian.confluence.search.lucene.DefaultObjectQueueWorker$1.doInTransactionWithoutResult(DefaultObjectQueueWorker.java:62) at org.springframework.transaction.support.TransactionCallbackWithoutResult.doInTransaction(TransactionCallbackWithoutResult.java:33) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:127) at com.atlassian.confluence.search.lucene.DefaultObjectQueueWorker.run(DefaultObjectQueueWorker.java:51) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:619) Caused by: java.io.IOException: cannot read directory org.apache.lucene.store.FSDirectory@/home/confluence/data-3.1/temp/lucene2506686581554376744index: list() returned null at org.apache.lucene.index.IndexFileDeleter.refresh(IndexFileDeleter.java:260) at org.apache.lucene.index.IndexWriter.mergeSegments(IndexWriter.java:1950) at org.apache.lucene.index.IndexWriter.flushRamSegments(IndexWriter.java:1741) at org.apache.lucene.index.IndexWriter.flushRamSegments(IndexWriter.java:1733) at org.apache.lucene.index.IndexWriter.maybeFlushRamSegments(IndexWriter.java:1727) at org.apache.lucene.index.IndexWriter.deleteDocuments(IndexWriter.java:1028) at com.atlassian.confluence.search.lucene.tasks.DeleteChangeDocumentsIndexTask.perform(DeleteChangeDocumentsIndexTask.java:70) at com.atlassian.confluence.search.lucene.tasks.RebuildChangeDocumentsIndexTask.perform(RebuildChangeDocumentsIndexTask.java:66) at com.atlassian.bonnie.index.TempIndexWriter.perform(TempIndexWriter.java:73) at com.atlassian.confluence.search.lucene.TempIndexWriterStrategy.perform(TempIndexWriterStrategy.java:43) ... 9 more {code} h5. Causes/Troubleshooting/Workaround # The first step to try is to ensure that the <confluence-home>/index and <confluence-home>/temp directories have the read/write permissions # Also, it's also worth to try to [re-index from scratch|http://confluence.atlassian.com/display/DOC/Rebuild+the+Content+Indices+from+scratch] # If the above suggestions doesn't work, it's probably a good idea to check what time the re-index process takes place as there's a [Quartz job|http://confluence.atlassian.com/display/DOC/Scheduled+Jobs] called cleanTempDirectoryJob that cleans the <confluenec-home>/temp directory everyday at 4am. This job might be clashing with the indexing process which is causing the indexing process to stop at 99% h5. Suggestions Perhaps, there should be locking mechanism that will stop other jobs that are using resources required by the indexing process

    Atlassian JIRA | 6 years ago | Sashidaran Jayaraman [Atlassian]
    com.atlassian.bonnie.LuceneException: java.io.IOException: cannot read directory org.apache.lucene.store.FSDirectory@/home/confluence/data-3.1/temp/lucene2506686581554376744index: list() returned null
  3. 0
    Download the winutils.exe for your Hadoop version: https://github.com/steveloughran/winutils . Save it to HADOOP_HOME/bin
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    I am trying to Integrate EBS-12.1.3 with Endeca on&nbsp; RHEL5-64 bit

    Oracle Community | 2 years ago | 2791315
    com.liferay.portal.kernel.search.SearchException: java.io.IOException: directory '/home/oracle/Ext/Oracle/Middleware/user_projects/domains/data/lucene/0' exists and is a directory, but cannot be listed: list() returned null
  6. 0

    ES failing with "marking and sending shard failed due to [failed recovery]"

    GitHub | 1 year ago | ashwgupt
    org.elasticsearch.indices.recovery.RecoveryFailedException: [.mw_kibana02][0]: Recovery failed from [fil_middleware_clus01_node01][cYhvLzXwT92_0EsM6IEvDg][ukx06621.uk.fid-intl.com][inet[/10.60.172 .71:9301]]{master=true} into [fil_middleware_clus01_node02][DVKSAI0dTyWk3u_nkcaVoA][ukx06622.uk.fid-intl.com][inet[/10.60.172.72:9302]]{master=true}

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.io.IOException

      cannot read directory org.apache.lucene.store.FSDirectory@/home/confluence/data-3.1/temp/lucene2506686581554376744index: list() returned null

      at org.apache.lucene.index.IndexFileDeleter.refresh()
    2. Lucene
      IndexWriter.deleteDocuments
      1. org.apache.lucene.index.IndexFileDeleter.refresh(IndexFileDeleter.java:260)
      2. org.apache.lucene.index.IndexWriter.mergeSegments(IndexWriter.java:1950)
      3. org.apache.lucene.index.IndexWriter.flushRamSegments(IndexWriter.java:1741)
      4. org.apache.lucene.index.IndexWriter.flushRamSegments(IndexWriter.java:1733)
      5. org.apache.lucene.index.IndexWriter.maybeFlushRamSegments(IndexWriter.java:1727)
      6. org.apache.lucene.index.IndexWriter.deleteDocuments(IndexWriter.java:1028)
      6 frames
    3. com.atlassian.confluence
      RebuildChangeDocumentsIndexTask.perform
      1. com.atlassian.confluence.search.lucene.tasks.DeleteChangeDocumentsIndexTask.perform(DeleteChangeDocumentsIndexTask.java:70)
      2. com.atlassian.confluence.search.lucene.tasks.RebuildChangeDocumentsIndexTask.perform(RebuildChangeDocumentsIndexTask.java:66)
      2 frames
    4. com.atlassian.bonnie
      TempIndexWriter.perform
      1. com.atlassian.bonnie.index.TempIndexWriter.perform(TempIndexWriter.java:73)
      1 frame
    5. com.atlassian.confluence
      DefaultObjectQueueWorker$1.doInTransactionWithoutResult
      1. com.atlassian.confluence.search.lucene.TempIndexWriterStrategy.perform(TempIndexWriterStrategy.java:43)
      2. com.atlassian.confluence.search.lucene.tasks.TempIndexBackedIndexTaskPerformer.perform(TempIndexBackedIndexTaskPerformer.java:21)
      3. com.atlassian.confluence.search.lucene.DefaultObjectQueueWorker.indexCollection(DefaultObjectQueueWorker.java:79)
      4. com.atlassian.confluence.search.lucene.DefaultObjectQueueWorker$1.doInTransactionWithoutResult(DefaultObjectQueueWorker.java:62)
      4 frames
    6. Spring Tx
      TransactionTemplate.execute
      1. org.springframework.transaction.support.TransactionCallbackWithoutResult.doInTransaction(TransactionCallbackWithoutResult.java:33)
      2. org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:127)
      2 frames
    7. com.atlassian.confluence
      DefaultObjectQueueWorker.run
      1. com.atlassian.confluence.search.lucene.DefaultObjectQueueWorker.run(DefaultObjectQueueWorker.java:51)
      1 frame
    8. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
      3. java.lang.Thread.run(Thread.java:619)
      3 frames