Apache's JIRA Issue Tracker | Jenny Dong | 6 months ago
  1. 0

    While trying to do a distcp from our native HDFS cluster to S3, we get the following error/stacktrace : We are using hadoop-aws.jar version 2.7.1. We are using aws-java-sdk.jar version 1.10.69 (we bumped this up from 2.7.4 because we were getting errors seen in HADOOP-12420 + other authentication errors). Exception in thread "main" java.lang.NoSuchMethodError:<init>(Lcom/amazonaws/services/s3/AmazonS3;Ljava/util/concurrent/ThreadPoolExecutor;)V at org.apache.hadoop.fs.s3a.S3AFileSystem.initialize( at org.apache.hadoop.fs.FileSystem.createFileSystem( at org.apache.hadoop.fs.FileSystem.access$200( at org.apache.hadoop.fs.FileSystem$Cache.getInternal( at org.apache.hadoop.fs.FileSystem$Cache.get( at org.apache.hadoop.fs.FileSystem.get( at org.apache.hadoop.fs.Path.getFileSystem( at at at at I dug into both classes & org.apache.hadoop.fs.s3a.S3AFileSystem. The only difference is S3AFileSystem created a ThreadPoolExecutor (which implements AbstractExecutorService which implements ExecutorService). I also checked on the classpath to make sure the version of the jars being picked up is what I expected. Help would be much appreciated.

    Apache's JIRA Issue Tracker | 6 months ago | Jenny Dong
  2. 0

    GitHub comment 232#235795657

    GitHub | 3 months ago | llamahunter
    java.lang.RuntimeException: Failed to apply upload policy
  3. 0

    GitHub comment 232#235802943

    GitHub | 3 months ago | HenryCaiHaiying
    java.lang.RuntimeException: Failed to apply upload policy
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    GitHub comment 160#197607132

    GitHub | 7 months ago | skanda83
    java.lang.RuntimeException: Failed to apply upload policy
  6. 0

    GitHub comment 158#215507174

    GitHub | 6 months ago | AndriyLytvynskyy

    3 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.NoSuchMethodError<init>(Lcom/amazonaws/services/s3/AmazonS3;Ljava/util/concurrent/ThreadPoolExecutor;)V

      at org.apache.hadoop.fs.s3a.S3AFileSystem.initialize()
    2. Apache Hadoop Amazon Web Services support
      1. org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(
      1 frame
    3. Hadoop
      1. org.apache.hadoop.fs.FileSystem.createFileSystem(
      2. org.apache.hadoop.fs.FileSystem.access$200(
      3. org.apache.hadoop.fs.FileSystem$Cache.getInternal(
      4. org.apache.hadoop.fs.FileSystem$Cache.get(
      5. org.apache.hadoop.fs.FileSystem.get(
      6. org.apache.hadoop.fs.Path.getFileSystem(
      10 frames