java.io.FileNotFoundException: File hdfs://path/to/stuff/_temporary/0/task_201606281757_0048_m_000029/some_dir does not exist.

Stack Overflow | KFB | 8 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    How to Set spark.sql.parquet.output.committer.class in pyspark

    Stack Overflow | 8 months ago | KFB
    java.io.FileNotFoundException: File hdfs://path/to/stuff/_temporary/0/task_201606281757_0048_m_000029/some_dir does not exist.
  2. 0

    Hadoop-Mapreduce-trunk - Build # 2202 - Failure

    apache.org | 1 year ago
    java.io.FileNotFoundException: File /test/output does not exist.
  3. 0

    Hive shell throws Filenotfound exception while executing queries, inspite of adding jar files using "ADD JAR"

    Stack Overflow | 2 years ago | user3732077
    java.io.FileNotFoundException: File does not exist: hdfs://node1:9000/home/hduser/softwares/hive/hive-serdes-1.0-SNAPSHOT.jar
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Hive 2.0 + tez 0.8.3 + hadoop 2.6.0 hive sql startup fails, why?

    Stack Overflow | 9 months ago | user5107182
    java.io.FileNotFoundException: File does not exist: hdfs://bfdhadoop26/tmp/hive/hadoop/_tez_session_dir/649113f7-8645-4f47-a9f1-6353011dc42d/.tez/application_1463130576050_0094/tez.session.local-resources.pb
  6. 0

    FileNotFoundException sequence files Mahout

    Stack Overflow | 2 years ago
    java.io.FileNotFoundException: File does not exist: /home/haritz/Escritorio/work_dir/original

    5 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.io.FileNotFoundException

      File hdfs://path/to/stuff/_temporary/0/task_201606281757_0048_m_000029/some_dir does not exist.

      at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal()
    2. Apache Hadoop HDFS
      DistributedFileSystem$18.doCall
      1. org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:795)
      2. org.apache.hadoop.hdfs.DistributedFileSystem.access$700(DistributedFileSystem.java:106)
      3. org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:853)
      4. org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:849)
      4 frames
    3. Hadoop
      FileSystemLinkResolver.resolve
      1. org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
      1 frame
    4. Apache Hadoop HDFS
      DistributedFileSystem.listStatus
      1. org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:849)
      1 frame
    5. Hadoop
      FileOutputCommitter.commitJob
      1. org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.mergePaths(FileOutputCommitter.java:382)
      2. org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.mergePaths(FileOutputCommitter.java:384)
      3. org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.commitJob(FileOutputCommitter.java:326)
      3 frames
    6. org.apache.parquet
      ParquetOutputCommitter.commitJob
      1. org.apache.parquet.hadoop.ParquetOutputCommitter.commitJob(ParquetOutputCommitter.java:46)
      1 frame
    7. org.apache.spark
      InsertIntoHadoopFsRelation$$anonfun$run$1.apply$mcV$sp
      1. org.apache.spark.sql.execution.datasources.BaseWriterContainer.commitJob(WriterContainer.scala:230)
      2. org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelation$$anonfun$run$1.apply$mcV$sp(InsertIntoHadoopFsRelation.scala:151)
      2 frames