java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: java.io.FileNotFoundException: No such file or directory 's3://data-platform-insights/data-platform/internal_test_automation/2016/09/21/18364/logs/validations/table_col_aggregate_validation_result/.hive-staging_hive_2016-09-21_11-57-58_703_5106478639780932144-1/_tmp.-ext-10000/000000_0.gz'

Stack Overflow | devsda | 5 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    Why hdfs throwing LeaseExpiredException in Hadoop cluster (AWS EMR)

    Stack Overflow | 5 months ago | devsda
    java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: java.io.FileNotFoundException: No such file or directory 's3://data-platform-insights/data-platform/internal_test_automation/2016/09/21/18364/logs/validations/table_col_aggregate_validation_result/.hive-staging_hive_2016-09-21_11-57-58_703_5106478639780932144-1/_tmp.-ext-10000/000000_0.gz'
  2. 0

    Why hdfs throwing LeaseExpiredException in Hadoop cluster (AWS EMR) - Hortonworks

    hortonworks.com | 6 days ago
    java.lang.RuntimeException: java.io.IOException: java.io.FileNotFoundException: No such file or directory 's3://data-platform-insights/data-platform/internal_test_automation/2016/09/21/18364/logs/validations/table_col_aggregate_validation_result/.hive-staging_hive_2016-09-21_11-57-58_703_5106478639780932144-1/_tmp.-ext-10000/000000_0.gz'

    Root Cause Analysis

    1. java.io.FileNotFoundException

      No such file or directory 's3://data-platform-insights/data-platform/internal_test_automation/2016/09/21/18364/logs/validations/table_col_aggregate_validation_result/.hive-staging_hive_2016-09-21_11-57-58_703_5106478639780932144-1/_tmp.-ext-10000/000000_0.gz'

      at com.amazon.ws.emr.hadoop.fs.s3n.S3NativeFileSystem.getFileStatus()
    2. com.amazon.ws
      S3NativeFileSystem.open
      1. com.amazon.ws.emr.hadoop.fs.s3n.S3NativeFileSystem.getFileStatus(S3NativeFileSystem.java:818)
      2. com.amazon.ws.emr.hadoop.fs.s3n.S3NativeFileSystem.open(S3NativeFileSystem.java:1193)
      2 frames
    3. Hadoop
      FileSystem.open
      1. org.apache.hadoop.fs.FileSystem.open(FileSystem.java:771)
      1 frame
    4. com.amazon.ws
      EmrFileSystem.open
      1. com.amazon.ws.emr.hadoop.fs.EmrFileSystem.open(EmrFileSystem.java:168)
      1 frame
    5. Hadoop
      TextInputFormat.getRecordReader
      1. org.apache.hadoop.mapred.LineRecordReader.<init>(LineRecordReader.java:109)
      2. org.apache.hadoop.mapred.TextInputFormat.getRecordReader(TextInputFormat.java:67)
      2 frames
    6. Hive Query Language
      HiveInputFormat.getRecordReader
      1. org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:297)
      1 frame
    7. org.apache.hadoop
      TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.next
      1. org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader(TezGroupedSplitsInputFormat.java:203)
      2. org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.next(TezGroupedSplitsInputFormat.java:152)
      2 frames
    8. org.apache.tez
      MRReaderMapred.next
      1. org.apache.tez.mapreduce.lib.MRReaderMapred.next(MRReaderMapred.java:116)
      1 frame
    9. Hive Query Language
      TezProcessor.run
      1. org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:62)
      2. org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:360)
      3. org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:172)
      4. org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:160)
      4 frames
    10. org.apache.tez
      TaskRunner2Callable$1.run
      1. org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
      2. org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
      3. org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
      3 frames
    11. Java RT
      Subject.doAs
      1. java.security.AccessController.doPrivileged(Native Method)
      2. javax.security.auth.Subject.doAs(Subject.java:422)
      2 frames
    12. Hadoop
      UserGroupInformation.doAs
      1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
      1 frame
    13. org.apache.tez
      CallableWithNdc.call
      1. org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
      2. org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
      3. org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
      3 frames
    14. Java RT
      Thread.run
      1. java.util.concurrent.FutureTask.run(FutureTask.java:266)
      2. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      3. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      4. java.lang.Thread.run(Thread.java:745)
      4 frames