java.lang.IllegalArgumentException: Wrong FS: s3n://<my-bucket>/test.bam, expected: hdfs:// ec2-blah.blah.blah.compute-1.amazonaws.com:9000

Google Groups | Sergei Iakhnin | 2 years ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    exception when transforming from HDFS BAM to HDFS Adam

    Google Groups | 2 years ago | Sergei Iakhnin
    java.lang.IllegalArgumentException: Wrong FS: s3n://<my-bucket>/test.bam, expected: hdfs:// ec2-blah.blah.blah.compute-1.amazonaws.com:9000
  2. 0

    Crunch with Elastic MapReduce

    incubator-crunch-user | 5 years ago | Shawn Smith
    java.lang.IllegalArgumentException: This file system object (hdfs://10.114.37.65:9000) does not support access to the request path 's3://test-bucket/test/Input.avro' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
  3. 0

    Re: Crunch with Elastic MapReduce

    incubator-crunch-user | 4 years ago | Daithi O Crualaoich
    java.lang.IllegalArgumentException: This file system object (hdfs://10.114.37.65:9000) does not support access to the request path 's3://test-bucket/test/Input.avro' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Crunch with Elastic MapReduce

    incubator-crunch-user | 5 years ago | Shawn Smith
    java.lang.IllegalArgumentException: This file system object (hdfs://10.114.37.65:9000) does not support access to the request path 's3://test-bucket/test/Input.avro' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
  6. 0

    Re: Crunch with Elastic MapReduce

    incubator-crunch-user | 4 years ago | Daithi O Crualaoich
    java.lang.IllegalArgumentException: This file system object (hdfs://10.114.37.65:9000) does not support access to the request path 's3://test-bucket/test/Input.avro' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.

    2 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.IllegalArgumentException

      Wrong FS: s3n://<my-bucket>/test.bam, expected: hdfs:// ec2-blah.blah.blah.compute-1.amazonaws.com:9000

      at org.apache.hadoop.fs.FileSystem.checkPath()
    2. Hadoop
      FileSystem.checkPath
      1. org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:381)
      1 frame
    3. Apache Hadoop HDFS
      DistributedFileSystem.getFileStatus
      1. org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:129)
      2. org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:513)
      2 frames
    4. Hadoop
      FileSystem.isDirectory
      1. org.apache.hadoop.fs.FileSystem.isDirectory(FileSystem.java:778)
      1 frame
    5. org.bdgenomics.adam
      ADAMContext$$anonfun$loadAlignments$1.apply
      1. org.bdgenomics.adam.rdd.ADAMContext.loadBam(ADAMContext.scala:237)
      2. org.bdgenomics.adam.rdd.ADAMContext$$anonfun$loadAlignments$1.apply(ADAMContext.scala:516)
      3. org.bdgenomics.adam.rdd.ADAMContext$$anonfun$loadAlignments$1.apply(ADAMContext.scala:513)
      3 frames
    6. Spark
      Timer.time
      1. org.apache.spark.rdd.Timer.time(Timer.scala:57)
      1 frame
    7. org.bdgenomics.adam
      Transform.run
      1. org.bdgenomics.adam.rdd.ADAMContext.loadAlignments(ADAMContext.scala:511)
      2. org.bdgenomics.adam.cli.Transform.run(Transform.scala:148)
      2 frames
    8. org.bdgenomics.utils
      BDGSparkCommand$class.run
      1. org.bdgenomics.utils.cli.BDGSparkCommand$class.run(BDGCommand.scala:53)
      1 frame
    9. org.bdgenomics.adam
      ADAMMain.main
      1. org.bdgenomics.adam.cli.Transform.run(Transform.scala:85)
      2. org.bdgenomics.adam.cli.ADAMMain$.main(ADAMMain.scala:105)
      3. org.bdgenomics.adam.cli.ADAMMain.main(ADAMMain.scala)
      3 frames
    10. Java RT
      Method.invoke
      1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      4. java.lang.reflect.Method.invoke(Method.java:606)
      4 frames
    11. Spark
      SparkSubmit.main
      1. org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:569)
      2. org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:166)
      3. org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:189)
      4. org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:110)
      5. org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
      5 frames