java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: java.io.FileNotFoundException: No such file or directory 's3://data-platform-insights/data-platform/internal_test_automation/2016/09/21/18364/logs/validations/table_col_aggregate_validation_result/.hive-staging_hive_2016-09-21_11-57-58_703_5106478639780932144-1/_tmp.-ext-10000/000000_0.gz'

Stack Overflow | devsda | 3 months ago
  1. 0

    Why hdfs throwing LeaseExpiredException in Hadoop cluster (AWS EMR)

    Stack Overflow | 3 months ago | devsda
    java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: java.io.FileNotFoundException: No such file or directory 's3://data-platform-insights/data-platform/internal_test_automation/2016/09/21/18364/logs/validations/table_col_aggregate_validation_result/.hive-staging_hive_2016-09-21_11-57-58_703_5106478639780932144-1/_tmp.-ext-10000/000000_0.gz'
  2. 0

    During initialization of the AMQ Message Store you can see an error like this: {code} java.io.FileNotFoundException: activemq-data/activemq.iona/tmp_storage/lock (No such file or directory) java.lang.RuntimeException: java.lang.RuntimeException: java.io.FileNotFoundException: activemq-data/activemq.iona/tmp_storage/lock (No such file or directory) at org.apache.activemq.broker.region.cursors.FilePendingMessageCursor.addMessageLast(FilePendingMessageCursor.java:199) at org.apache.activemq.broker.region.TopicSubscription.add(TopicSubscription.java:93) at org.apache.activemq.broker.region.policy.StrictOrderDispatchPolicy.dispatch(StrictOrderDispatchPolicy.java:57) at org.apache.activemq.broker.region.Topic.dispatch(Topic.java:581) at org.apache.activemq.broker.region.Topic.doMessageSend(Topic.java:421) at org.apache.activemq.broker.region.Topic.send(Topic.java:363) at org.apache.activemq.broker.region.AbstractRegion.send(AbstractRegion.java:340) at org.apache.activemq.broker.region.RegionBroker.send(RegionBroker.java:445) at org.apache.activemq.broker.TransactionBroker.send(TransactionBroker.java:224) at org.apache.activemq.broker.BrokerFilter.send(BrokerFilter.java:125) at org.apache.activemq.broker.CompositeDestinationBroker.send(CompositeDestinationBroker.java:95) at org.apache.activemq.broker.MutableBrokerFilter.send(MutableBrokerFilter.java:132) at org.apache.activemq.broker.TransportConnection.processMessage(TransportConnection.java:438) at org.apache.activemq.command.ActiveMQMessage.visit(ActiveMQMessage.java:624) at org.apache.activemq.broker.TransportConnection.service(TransportConnection.java:293) at org.apache.activemq.broker.TransportConnection$1.onCommand(TransportConnection.java:181) at org.apache.activemq.transport.ResponseCorrelator.onCommand(ResponseCorrelator.java:104) at org.apache.activemq.transport.TransportFilter.onCommand(TransportFilter.java:68) at org.apache.activemq.transport.vm.VMTransport.iterate(VMTransport.java:205) at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122) at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) at java.lang.Thread.run(Thread.java:619) Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: activemq-data/activemq.iona/tmp_storage/lock (No such file or directory) at org.apache.activemq.broker.region.cursors.FilePendingMessageCursor.getDiskList(FilePendingMessageCursor.java:387) at org.apache.activemq.broker.region.cursors.FilePendingMessageCursor.addMessageLast(FilePendingMessageCursor.java:194) ... 23 more Caused by: java.io.FileNotFoundException: activemq-data/activemq.iona/tmp_storage/lock (No such file or directory) at java.io.RandomAccessFile.open(Native Method) at java.io.RandomAccessFile.<init>(RandomAccessFile.java:212) at org.apache.activemq.kaha.impl.KahaStore.initialize(KahaStore.java:476) at org.apache.activemq.kaha.impl.KahaStore.getListContainer(KahaStore.java:287) at org.apache.activemq.broker.region.cursors.FilePendingMessageCursor.getDiskList(FilePendingMessageCursor.java:383) ... 24 more {code} This is probably happening because the directory creation fails for some reason in the KahaStore constructor and then the attempt to create the lock file fails because its parent directory doesn't exist. The reason that is allowed to happen is that in the KahaStore constructor and in many other places in the code the method File.mkdirs() is used and the return value is never checked. The implementation of File.mkdirs() returns true if the directory was created, false if it already existed AND ... false if an IOException was thrown while attempting the operation including permission errors or anything like that. This causes the persistent store to be created in a potentially unknown state because the directory may or may not have been created and then the lock assumption when creating the lock file that its parent directory exists is not necessarily true. This enhancement is to tighten up the KahaStore mkdirs logic such that .. {code} public KahaStore(File directory, String mode, AtomicLong storeSize) throws IOException { this.mode = mode; this.storeSize = storeSize; this.directory = directory; this.directory.mkdirs(); } {code} might become .. {code} public KahaStore(File directory, String mode, AtomicLong storeSize) throws IOException { this.mode = mode; this.storeSize = storeSize; this.directory = directory; if( ! this.directory.exists() ) if ( ! this.directory.mkdirs() ) throw new IOException ("failed to create directory " + directory); } {code} We should also check this pattern of calling File.mkdirs() elsewhere in the code so that we handle the mkdir failure case.

    JBoss Issue Tracker | 9 years ago | Dave Stanley
    java.lang.RuntimeException: java.lang.RuntimeException: java.io.FileNotFoundException: activemq-data/activemq.iona/tmp_storage/lock (No such file or directory)
  3. 0

    Stanford NER Error: Loading distsim lexicon Failed

    Stack Overflow | 2 years ago | Evanescence
    java.lang.RuntimeException: java.io.FileNotFoundException: /u/nlp/data/pos_tags_are_useless/egw4-reut.512.clusters (No such file or directory)
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    FileNotFoundException during compaction

    Stack Overflow | 3 years ago | PJ.
    java.lang.RuntimeException: java.io.FileNotFoundException: /home/cassandra/data/mtg_keywords_v5/keyword_organic_results/mtg_keywords_v5-keyword_organic_results-jb-31111-Data.db (No such file or directory)
  6. 0

    QuickFIX/J Jira

    quickfixj.org | 6 months ago
    java.lang.RuntimeException: java.io.FileNotFoundException: output/data/server/FIX.4.2-test-exchange-test-sender.body (No such file or directory)

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.RuntimeException

      java.io.IOException: java.io.FileNotFoundException: No such file or directory 's3://data-platform-insights/data-platform/internal_test_automation/2016/09/21/18364/logs/validations/table_col_aggregate_validation_result/.hive-staging_hive_2016-09-21_11-57-58_703_5106478639780932144-1/_tmp.-ext-10000/000000_0.gz'

      at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader()
    2. org.apache.hadoop
      TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.next
      1. org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader(TezGroupedSplitsInputFormat.java:206)
      2. org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.next(TezGroupedSplitsInputFormat.java:152)
      2 frames
    3. org.apache.tez
      MRReaderMapred.next
      1. org.apache.tez.mapreduce.lib.MRReaderMapred.next(MRReaderMapred.java:116)
      1 frame
    4. Hive Query Language
      TezProcessor.run
      1. org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:62)
      2. org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:360)
      3. org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:172)
      4. org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:160)
      4 frames
    5. org.apache.tez
      TaskRunner2Callable$1.run
      1. org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
      2. org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
      3. org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
      3 frames
    6. Java RT
      Subject.doAs
      1. java.security.AccessController.doPrivileged(Native Method)
      2. javax.security.auth.Subject.doAs(Subject.java:422)
      2 frames
    7. Hadoop
      UserGroupInformation.doAs
      1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
      1 frame
    8. org.apache.tez
      CallableWithNdc.call
      1. org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
      2. org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
      3. org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
      3 frames
    9. Java RT
      Thread.run
      1. java.util.concurrent.FutureTask.run(FutureTask.java:266)
      2. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      3. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      4. java.lang.Thread.run(Thread.java:745)
      4 frames