java.io.FileNotFoundException: File does not exist: hdfs://data1:8020/tmp/tachyon/data/49

JIRA | chenxu | 1 year ago
  1. 0

    I'm use tachyon with Spark 1.4.1 for Test, when I stop -> format -> start the master ,and lookup the webui, I can see the file that before restart loaded(copyFromLocal command) , But when I read or open it show me the error log {code:java} 015-08-05 18:21:48,984 ERROR MASTER_LOGGER (HdfsUnderFileSystem.java:getFileLocations) - Unable to get file location for hdfs://data1:8020/tmp/tachyon/data/49 java.io.FileNotFoundException: File does not exist: hdfs://data1:8020/tmp/tachyon/data/49 at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1128) at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1120) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1120) at tachyon.underfs.hdfs.HdfsUnderFileSystem.getFileLocations(HdfsUnderFileSystem.java:223) at tachyon.master.BlockInfo.getLocations(BlockInfo.java:171) at tachyon.master.BlockInfo.generateClientBlockInfo(BlockInfo.java:123) at tachyon.master.InodeFile.getClientBlockInfo(InodeFile.java:266) at tachyon.master.MasterInfo.getClientBlockInfo(MasterInfo.java:1205) at tachyon.master.MasterServiceHandler.user_getClientBlockInfo(MasterServiceHandler.java:183) at tachyon.thrift.MasterService$Processor$user_getClientBlockInfo.getResult(MasterService.java:2995) at tachyon.thrift.MasterService$Processor$user_getClientBlockInfo.getResult(MasterService.java:2979) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:225) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) {code}

    JIRA | 1 year ago | chenxu
    java.io.FileNotFoundException: File does not exist: hdfs://data1:8020/tmp/tachyon/data/49
  2. 0

    I'm use tachyon with Spark 1.4.1 for Test, when I stop -> format -> start the master ,and lookup the webui, I can see the file that before restart loaded(copyFromLocal command) , But when I read or open it show me the error log {code:java} 015-08-05 18:21:48,984 ERROR MASTER_LOGGER (HdfsUnderFileSystem.java:getFileLocations) - Unable to get file location for hdfs://data1:8020/tmp/tachyon/data/49 java.io.FileNotFoundException: File does not exist: hdfs://data1:8020/tmp/tachyon/data/49 at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1128) at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1120) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1120) at tachyon.underfs.hdfs.HdfsUnderFileSystem.getFileLocations(HdfsUnderFileSystem.java:223) at tachyon.master.BlockInfo.getLocations(BlockInfo.java:171) at tachyon.master.BlockInfo.generateClientBlockInfo(BlockInfo.java:123) at tachyon.master.InodeFile.getClientBlockInfo(InodeFile.java:266) at tachyon.master.MasterInfo.getClientBlockInfo(MasterInfo.java:1205) at tachyon.master.MasterServiceHandler.user_getClientBlockInfo(MasterServiceHandler.java:183) at tachyon.thrift.MasterService$Processor$user_getClientBlockInfo.getResult(MasterService.java:2995) at tachyon.thrift.MasterService$Processor$user_getClientBlockInfo.getResult(MasterService.java:2979) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:225) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) {code}

    JIRA | 1 year ago | chenxu
    java.io.FileNotFoundException: File does not exist: hdfs://data1:8020/tmp/tachyon/data/49
  3. 0

    Spark shell read file on Tachyon error

    Google Groups | 1 year ago | chenxu...@gmail.com
    java.io.FileNotFoundException: File does not exist: hdfs://data1:8020/tmp/tachyon/data/49 at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1128)
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    hbase mapreduce file not found exception

    Stack Overflow | 2 years ago | TheRoyal Llama
    java.io.FileNotFoundException: File does not exist: hdfs://pc1/opt/hbase-0.98.8-hadoop2/lib/hbase-server-0.98.8-hadoop2.jar
  6. 0

    kinesis to redshift via lzo s3 sink

    Google Groups | 1 year ago | Janika S
    java.lang.RuntimeException: Failed to get source file system

    1 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.io.FileNotFoundException

      File does not exist: hdfs://data1:8020/tmp/tachyon/data/49

      at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall()
    2. Apache Hadoop HDFS
      DistributedFileSystem$17.doCall
      1. org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1128)
      2. org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1120)
      2 frames
    3. Hadoop
      FileSystemLinkResolver.resolve
      1. org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
      1 frame
    4. Apache Hadoop HDFS
      DistributedFileSystem.getFileStatus
      1. org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1120)
      1 frame
    5. tachyon.underfs.hdfs
      HdfsUnderFileSystem.getFileLocations
      1. tachyon.underfs.hdfs.HdfsUnderFileSystem.getFileLocations(HdfsUnderFileSystem.java:223)
      1 frame
    6. Tachyon Project Core
      MasterService$Processor$user_getClientBlockInfo.getResult
      1. tachyon.master.BlockInfo.getLocations(BlockInfo.java:171)
      2. tachyon.master.BlockInfo.generateClientBlockInfo(BlockInfo.java:123)
      3. tachyon.master.InodeFile.getClientBlockInfo(InodeFile.java:266)
      4. tachyon.master.MasterInfo.getClientBlockInfo(MasterInfo.java:1205)
      5. tachyon.master.MasterServiceHandler.user_getClientBlockInfo(MasterServiceHandler.java:183)
      6. tachyon.thrift.MasterService$Processor$user_getClientBlockInfo.getResult(MasterService.java:2995)
      7. tachyon.thrift.MasterService$Processor$user_getClientBlockInfo.getResult(MasterService.java:2979)
      7 frames
    7. Apache Thrift
      TThreadPoolServer$WorkerProcess.run
      1. org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
      2. org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
      3. org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:225)
      3 frames
    8. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      3. java.lang.Thread.run(Thread.java:744)
      3 frames