org.apache.hadoop.fs.FileAlreadyExistsException: Failed to rename hdfs://10.0.1.227:8020/gobblin/task-output/productA/2016 to /gobblinlandingzone/productA/2016: dst already exists

Google Groups | Unknown author | 1 year ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    TimeBasedWriterPartitioner

    Google Groups | 1 year ago | Unknown author
    org.apache.hadoop.fs.FileAlreadyExistsException: Failed to rename hdfs://10.0.1.227:8020/gobblin/task-output/productA/2016 to /gobblinlandingzone/productA/2016: dst already exists

    Root Cause Analysis

    1. org.apache.hadoop.fs.FileAlreadyExistsException

      Failed to rename hdfs://10.0.1.227:8020/gobblin/task-output/productA/2016 to /gobblinlandingzone/productA/2016: dst already exists

      at gobblin.util.HadoopUtils.renamePath()
    2. gobblin.util
      ParallelRunner$6.call
      1. gobblin.util.HadoopUtils.renamePath(HadoopUtils.java:169)
      2. gobblin.util.HadoopUtils.renamePath(HadoopUtils.java:152)
      3. gobblin.util.HadoopUtils.movePath(HadoopUtils.java:213)
      4. gobblin.util.ParallelRunner$6.call(ParallelRunner.java:312)
      5. gobblin.util.ParallelRunner$6.call(ParallelRunner.java:305)
      5 frames
    3. Java RT
      Thread.run
      1. java.util.concurrent.FutureTask.run(FutureTask.java:262)
      2. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      3. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      4. java.lang.Thread.run(Thread.java:745)
      4 frames