java.io.IOException: File copy failed: hdfs://surus/apps/hive/warehouse/fma2_v12_featuredata.db/eea_iperl/000000_0 --> s3n://sensus-device-analytics/HDFS_To_S3_Testing/distcp1/eea_iperl/000000_0

hortonworks.com | 4 months ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    Tips for optimizing export to S3(n) ? - Hortonworks

    hortonworks.com | 4 months ago
    java.io.IOException: File copy failed: hdfs://surus/apps/hive/warehouse/fma2_v12_featuredata.db/eea_iperl/000000_0 --> s3n://sensus-device-analytics/HDFS_To_S3_Testing/distcp1/eea_iperl/000000_0
  2. 0

    [jira] [Commented] (HDFS-3054) distcp -skipcrccheck has no effect

    apache.org | 2 years ago
    java.io.IOException: File copy failed: hftp://172.22.1.204:6001/a/xxxxxx --> hdfs://localhost:6000/b/a/xxxxxx
  3. 0

    Failed with exception copyFiles - Hortonworks

    hortonworks.com | 2 years ago
    java.io.IOException: File copy failed: hdfs://savid-bigdata1.tecteo.intra:8020/user/hive/tmp/hive/0e77f03a-f491-4f05-88e4-7788d3f91243/hive_2015-05-04_16-16-52_140_7224958539274766118-1/-ext-10000/date=20150421/000000_0 --> hdfs://<SERVER_URL>:8020/apps/hive/warehouse/seram_offload.db/ds_frequency/date=20150421/000000_0
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    catchdba | DistCp between two different versions of Hadoop

    catchdba.com | 1 year ago
    java.io.IOException: File copy failed: hftp://xx.xx.xx.xx:50070/tmp/TEMP.LOG–> hdfs://xx.xxx.xx.xx/tmp/
  6. 0

    fail to use Hadoop DistCp

    Google Groups | 1 year ago | 黃子恩
    java.io.IOException: File copy failed: tachyon://c02:19998/in --> hdfs://c03:39100/user/trey/out

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.io.IOException

      Couldn't run retriable-command: Copying hdfs://surus/apps/hive/warehouse/fma2_v12_featuredata.db/eea_iperl/000000_0 to s3n://sensus-device-analytics/HDFS_To_S3_Testing/distcp1/eea_iperl/000000_0

      at org.apache.hadoop.tools.util.RetriableCommand.execute()
    2. Apache Hadoop Distributed Copy
      CopyMapper.map
      1. org.apache.hadoop.tools.util.RetriableCommand.execute(RetriableCommand.java:101)
      2. org.apache.hadoop.tools.mapred.CopyMapper.copyFileWithRetry(CopyMapper.java:281)
      3. org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:253)
      4. org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:50)
      4 frames
    3. Hadoop
      YarnChild$2.run
      1. org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
      2. org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
      3. org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
      4. org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
      4 frames
    4. Java RT
      Subject.doAs
      1. java.security.AccessController.doPrivileged(Native Method)
      2. javax.security.auth.Subject.doAs(Subject.java:415)
      2 frames
    5. Hadoop
      UserGroupInformation.doAs
      1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709)
      1 frame
    6. Hadoop
      YarnChild.main
      1. org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
      1 frame