java.lang.IllegalArgumentException: Wrong FS: s3n://<my-bucket>/test.bam, expected: hdfs:// ec2-blah.blah.blah.compute-1.amazonaws.com:9000

Google Groups | Sergei Iakhnin | 1 year ago
  1. 0

    exception when transforming from HDFS BAM to HDFS Adam

    Google Groups | 1 year ago | Sergei Iakhnin
    java.lang.IllegalArgumentException: Wrong FS: s3n://<my-bucket>/test.bam, expected: hdfs:// ec2-blah.blah.blah.compute-1.amazonaws.com:9000
  2. 0

    Crunch with Elastic MapReduce

    incubator-crunch-user | 4 years ago | Shawn Smith
    java.lang.IllegalArgumentException: This file system object (hdfs://10.114.37.65:9000) does not support access to the request path 's3://test-bucket/test/Input.avro' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
  3. 0

    Re: Crunch with Elastic MapReduce

    incubator-crunch-user | 4 years ago | Daithi O Crualaoich
    java.lang.IllegalArgumentException: This file system object (hdfs://10.114.37.65:9000) does not support access to the request path 's3://test-bucket/test/Input.avro' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Crunch with Elastic MapReduce

    incubator-crunch-user | 4 years ago | Shawn Smith
    java.lang.IllegalArgumentException: This file system object (hdfs://10.114.37.65:9000) does not support access to the request path 's3://test-bucket/test/Input.avro' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
  6. 0

    Re: Crunch with Elastic MapReduce

    incubator-crunch-user | 4 years ago | Daithi O Crualaoich
    java.lang.IllegalArgumentException: This file system object (hdfs://10.114.37.65:9000) does not support access to the request path 's3://test-bucket/test/Input.avro' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.

    2 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.IllegalArgumentException

      Wrong FS: s3n://<my-bucket>/test.bam, expected: hdfs:// ec2-blah.blah.blah.compute-1.amazonaws.com:9000

      at org.apache.hadoop.fs.FileSystem.checkPath()
    2. Hadoop
      FileSystem.checkPath
      1. org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:381)
      1 frame
    3. Apache Hadoop HDFS
      DistributedFileSystem.getFileStatus
      1. org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:129)
      2. org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:513)
      2 frames
    4. Hadoop
      FileSystem.isDirectory
      1. org.apache.hadoop.fs.FileSystem.isDirectory(FileSystem.java:778)
      1 frame
    5. org.bdgenomics.adam
      ADAMContext$$anonfun$loadAlignments$1.apply
      1. org.bdgenomics.adam.rdd.ADAMContext.loadBam(ADAMContext.scala:237)
      2. org.bdgenomics.adam.rdd.ADAMContext$$anonfun$loadAlignments$1.apply(ADAMContext.scala:516)
      3. org.bdgenomics.adam.rdd.ADAMContext$$anonfun$loadAlignments$1.apply(ADAMContext.scala:513)
      3 frames
    6. Spark
      Timer.time
      1. org.apache.spark.rdd.Timer.time(Timer.scala:57)
      1 frame
    7. org.bdgenomics.adam
      Transform.run
      1. org.bdgenomics.adam.rdd.ADAMContext.loadAlignments(ADAMContext.scala:511)
      2. org.bdgenomics.adam.cli.Transform.run(Transform.scala:148)
      2 frames
    8. org.bdgenomics.utils
      BDGSparkCommand$class.run
      1. org.bdgenomics.utils.cli.BDGSparkCommand$class.run(BDGCommand.scala:53)
      1 frame
    9. org.bdgenomics.adam
      ADAMMain.main
      1. org.bdgenomics.adam.cli.Transform.run(Transform.scala:85)
      2. org.bdgenomics.adam.cli.ADAMMain$.main(ADAMMain.scala:105)
      3. org.bdgenomics.adam.cli.ADAMMain.main(ADAMMain.scala)
      3 frames
    10. Java RT
      Method.invoke
      1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      4. java.lang.reflect.Method.invoke(Method.java:606)
      4 frames
    11. Spark
      SparkSubmit.main
      1. org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:569)
      2. org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:166)
      3. org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:189)
      4. org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:110)
      5. org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
      5 frames