org.apache.lucene.store.NoSuchDirectoryException: directory '/opt/solr/cores/core_b/data/index' does not exist

Apache's JIRA Issue Tracker | Markus Jelsma | 4 years ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    With SOLR-4032 fixed we see other issues when randomly taking down nodes (nicely via tomcat restart) while indexing a few million web pages from Hadoop. We do make sure that at least one node is up for a shard but due to recovery issues it may not be live. One node seems to work but generates IO errors in the log and ZookeeperExeption in the GUI. In the GUI we only see: {code} SolrCore Initialization Failures openindex_f: org.apache.solr.common.cloud.ZooKeeperException:org.apache.solr.common.cloud.ZooKeeperException: Please check your logs for more information {code} and in the log we only see the following exception: {code} 2012-11-28 11:47:26,652 ERROR [solr.handler.ReplicationHandler] - [http-8080-exec-28] - : IO error while trying to get the size of the Directory:org.apache.lucene.store.NoSuchDirectoryException: directory '/opt/solr/cores/shard_f/data/index' does not exist at org.apache.lucene.store.FSDirectory.listAll(FSDirectory.java:217) at org.apache.lucene.store.FSDirectory.listAll(FSDirectory.java:240) at org.apache.lucene.store.NRTCachingDirectory.listAll(NRTCachingDirectory.java:132) at org.apache.solr.core.DirectoryFactory.sizeOfDirectory(DirectoryFactory.java:146) at org.apache.solr.handler.ReplicationHandler.getIndexSize(ReplicationHandler.java:472) at org.apache.solr.handler.ReplicationHandler.getReplicationDetails(ReplicationHandler.java:568) at org.apache.solr.handler.ReplicationHandler.handleRequestBody(ReplicationHandler.java:213) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144) at org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.handleRequest(RequestHandlers.java:240) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1830) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:476) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:276) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889) at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:744) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2274) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) {code}

    Apache's JIRA Issue Tracker | 4 years ago | Markus Jelsma
    org.apache.lucene.store.NoSuchDirectoryException: directory '/opt/solr/cores/core_b/data/index' does not exist
  2. 0

    With SOLR-4032 fixed we see other issues when randomly taking down nodes (nicely via tomcat restart) while indexing a few million web pages from Hadoop. We do make sure that at least one node is up for a shard but due to recovery issues it may not be live. One node seems to work but generates IO errors in the log and ZookeeperExeption in the GUI. In the GUI we only see: {code} SolrCore Initialization Failures openindex_f: org.apache.solr.common.cloud.ZooKeeperException:org.apache.solr.common.cloud.ZooKeeperException: Please check your logs for more information {code} and in the log we only see the following exception: {code} 2012-11-28 11:47:26,652 ERROR [solr.handler.ReplicationHandler] - [http-8080-exec-28] - : IO error while trying to get the size of the Directory:org.apache.lucene.store.NoSuchDirectoryException: directory '/opt/solr/cores/shard_f/data/index' does not exist at org.apache.lucene.store.FSDirectory.listAll(FSDirectory.java:217) at org.apache.lucene.store.FSDirectory.listAll(FSDirectory.java:240) at org.apache.lucene.store.NRTCachingDirectory.listAll(NRTCachingDirectory.java:132) at org.apache.solr.core.DirectoryFactory.sizeOfDirectory(DirectoryFactory.java:146) at org.apache.solr.handler.ReplicationHandler.getIndexSize(ReplicationHandler.java:472) at org.apache.solr.handler.ReplicationHandler.getReplicationDetails(ReplicationHandler.java:568) at org.apache.solr.handler.ReplicationHandler.handleRequestBody(ReplicationHandler.java:213) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144) at org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.handleRequest(RequestHandlers.java:240) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1830) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:476) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:276) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889) at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:744) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2274) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) {code}

    Apache's JIRA Issue Tracker | 4 years ago | Markus Jelsma
    org.apache.lucene.store.NoSuchDirectoryException: directory '/opt/solr/cores/core_b/data/index' does not exist

    Root Cause Analysis

    1. org.apache.lucene.store.NoSuchDirectoryException

      directory '/opt/solr/cores/core_b/data/index' does not exist

      at org.apache.lucene.store.FSDirectory.listAll()
    2. Lucene
      NRTCachingDirectory.listAll
      1. org.apache.lucene.store.FSDirectory.listAll(FSDirectory.java:217)
      2. org.apache.lucene.store.FSDirectory.listAll(FSDirectory.java:240)
      3. org.apache.lucene.store.NRTCachingDirectory.listAll(NRTCachingDirectory.java:132)
      3 frames
    3. Apache Solr Core
      SolrDispatchFilter.doFilter
      1. org.apache.solr.core.DirectoryFactory.sizeOfDirectory(DirectoryFactory.java:146)
      2. org.apache.solr.handler.admin.CoreAdminHandler.getIndexSize(CoreAdminHandler.java:1020)
      3. org.apache.solr.handler.admin.CoreAdminHandler.getCoreStatus(CoreAdminHandler.java:1000)
      4. org.apache.solr.handler.admin.CoreAdminHandler.handleStatusAction(CoreAdminHandler.java:711)
      5. org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:158)
      6. org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144)
      7. org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:372)
      8. org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:181)
      8 frames
    4. Glassfish Core
      CoyoteAdapter.service
      1. org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
      2. org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
      3. org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
      4. org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
      5. org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
      6. org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
      7. org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
      8. org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
      8 frames
    5. Grizzly HTTP
      NioEndpoint$SocketProcessor.run
      1. org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
      2. org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:744)
      3. org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2274)
      3 frames
    6. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
      3. java.lang.Thread.run(Thread.java:662)
      3 frames