org.apache.hadoop.fs.FileAlreadyExistsException: Failed to rename hdfs://10.0.1.227:8020/gobblin/task-output/productA/2016 to /gobblinlandingzone/productA/2016: dst already exists

There are no available Samebug tips for this exception. Do you have an idea how to solve this issue? A short tip would help users who saw this issue last week.

  • TimeBasedWriterPartitioner
    via by Unknown author,
    • org.apache.hadoop.fs.FileAlreadyExistsException: Failed to rename hdfs://10.0.1.227:8020/gobblin/task-output/productA/2016 to /gobblinlandingzone/productA/2016: dst already exists at gobblin.util.HadoopUtils.renamePath(HadoopUtils.java:169) at gobblin.util.HadoopUtils.renamePath(HadoopUtils.java:152) at gobblin.util.HadoopUtils.movePath(HadoopUtils.java:213) at gobblin.util.ParallelRunner$6.call(ParallelRunner.java:312) at gobblin.util.ParallelRunner$6.call(ParallelRunner.java:305) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745)
    No Bugmate found.