java.io.IOException: File copy failed: hdfs://surus/apps/hive/warehouse/fma2_v12_featuredata.db/eea_iperl/000000_0 --> s3n://sensus-device-analytics/HDFS_To_S3_Testing/distcp1/eea_iperl/000000_0

hortonworks.com | 2 months ago
  1. 0

    Tips for optimizing export to S3(n) ? - Hortonworks

    hortonworks.com | 2 months ago
    java.io.IOException: File copy failed: hdfs://surus/apps/hive/warehouse/fma2_v12_featuredata.db/eea_iperl/000000_0 --> s3n://sensus-device-analytics/HDFS_To_S3_Testing/distcp1/eea_iperl/000000_0
  2. 0

    [jira] [Commented] (HDFS-3054) distcp -skipcrccheck has no effect

    apache.org | 1 year ago
    java.io.IOException: File copy failed: hftp://172.22.1.204:6001/a/xxxxxx --> hdfs://localhost:6000/b/a/xxxxxx
  3. 0

    Failed with exception copyFiles - Hortonworks

    hortonworks.com | 1 year ago
    java.io.IOException: File copy failed: hdfs://savid-bigdata1.tecteo.intra:8020/user/hive/tmp/hive/0e77f03a-f491-4f05-88e4-7788d3f91243/hive_2015-05-04_16-16-52_140_7224958539274766118-1/-ext-10000/date=20150421/000000_0 --> hdfs://<SERVER_URL>:8020/apps/hive/warehouse/seram_offload.db/ds_frequency/date=20150421/000000_0
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    catchdba | DistCp between two different versions of Hadoop

    catchdba.com | 1 year ago
    java.io.IOException: File copy failed: hftp://xx.xx.xx.xx:50070/tmp/TEMP.LOG–> hdfs://xx.xxx.xx.xx/tmp/
  6. 0

    fail to use Hadoop DistCp

    Google Groups | 1 year ago | 黃子恩
    java.io.IOException: File copy failed: tachyon://c02:19998/in --> hdfs://c03:39100/user/trey/out

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.io.IOException

      Couldn't run retriable-command: Copying hdfs://surus/apps/hive/warehouse/fma2_v12_featuredata.db/eea_iperl/000000_0 to s3n://sensus-device-analytics/HDFS_To_S3_Testing/distcp1/eea_iperl/000000_0

      at org.apache.hadoop.tools.util.RetriableCommand.execute()
    2. Apache Hadoop Distributed Copy
      CopyMapper.map
      1. org.apache.hadoop.tools.util.RetriableCommand.execute(RetriableCommand.java:101)
      2. org.apache.hadoop.tools.mapred.CopyMapper.copyFileWithRetry(CopyMapper.java:281)
      3. org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:253)
      4. org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:50)
      4 frames
    3. Hadoop
      YarnChild$2.run
      1. org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
      2. org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
      3. org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
      4. org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
      4 frames
    4. Java RT
      Subject.doAs
      1. java.security.AccessController.doPrivileged(Native Method)
      2. javax.security.auth.Subject.doAs(Subject.java:415)
      2 frames
    5. Hadoop
      UserGroupInformation.doAs
      1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709)
      1 frame
    6. Hadoop
      YarnChild.main
      1. org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
      1 frame