java.lang.IllegalArgumentException

There are no available Samebug tips for this exception. Do you have an idea how to solve this issue? A short tip would help users who saw this issue last week.

  • MapReduce Error
    via by Unknown author,
  • Hive will not write to aws s3
    via Stack Overflow by NW0428
    ,
  • In HA HDFS from uploading a file to streams (order of few MBs) and reading the stream back gives the following exception: {code} java.lang.IllegalArgumentException: Wrong FS: hdfs://prodnameservice1:8020/<PATH>, expected: hdfs://prodnameservice1 at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:645) ~[hadoop-common-2.5.0-cdh5.3.2.jar:na] at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:192) ~[hadoop-hdfs.jar:na] at org.apache.hadoop.hdfs.DistributedFileSystem.access$000(DistributedFileSystem.java:104) ~[hadoop-hdfs.jar:na] at org.apache.hadoop.hdfs.DistributedFileSystem$32.doCall(DistributedFileSystem.java:1569) ~[hadoop-hdfs.jar:na] at org.apache.hadoop.hdfs.DistributedFileSystem$32.doCall(DistributedFileSystem.java:1565) ~[hadoop-hdfs.jar:na] at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) ~[hadoop-common-2.5.0-cdh5.3.2.jar:na] at org.apache.hadoop.hdfs.DistributedFileSystem.isFileClosed(DistributedFileSystem.java:1565) ~[hadoop-hdfs.jar:na] at co.cask.cdap.common.io.Locations$9.size(Locations.java:365) ~[co.cask.cdap.cdap-common-3.2.1.jar:na] at co.cask.cdap.common.io.Locations$11.size(Locations.java:406) ~[co.cask.cdap.cdap-common-3.2.1.jar:na] at co.cask.cdap.common.io.DFSSeekableInputStream.size(DFSSeekableInputStream.java:51) ~[co.cask.cdap.cdap-common-3.2.1.jar:na] at co.cask.cdap.data.stream.StreamDataFileReader.createEventTemplate(StreamDataFileReader.java:344) ~[co.cask.cdap.cdap-data-fabric-3.2.1.jar :na] at co.cask.cdap.data.stream.StreamDataFileReader.readHeader(StreamDataFileReader.java:305) ~[co.cask.cdap.cdap-data-fabric-3.2.1.jar:na] at co.cask.cdap.data.stream.StreamDataFileReader.init(StreamDataFileReader.java:280) ~[co.cask.cdap.cdap-data-fabric-3.2.1.jar:na] at co.cask.cdap.data.stream.StreamDataFileReader.doOpen(StreamDataFileReader.java:252) ~[co.cask.cdap.cdap-data-fabric-3.2.1.jar:na] at co.cask.cdap.data.stream.StreamDataFileReader.initialize(StreamDataFileReader.java:139) ~[co.cask.cdap.cdap-data-fabric-3.2.1.jar:na] at co.cask.cdap.data.stream.LiveStreamFileReader$StreamPositionTransformFileReader.initialize(LiveStreamFileReader.java:169) ~[co.cask.cdap.c dap-data-fabric-3.2.1.jar:na] at co.cask.cdap.data.stream.LiveStreamFileReader.renewReader(LiveStreamFileReader.java:81) ~[co.cask.cdap.cdap-data-fabric-3.2.1.jar:na] at co.cask.cdap.data.file.LiveFileReader.initialize(LiveFileReader.java:42) ~[co.cask.cdap.cdap-data-fabric-3.2.1.jar:na] at co.cask.cdap.data.stream.MultiLiveStreamFileReader$StreamEventSource.initialize(MultiLiveStreamFileReader.java:175) ~[co.cask.cdap.cdap-da ta-fabric-3.2.1.jar:na] at co.cask.cdap.data.stream.MultiLiveStreamFileReader.initialize(MultiLiveStreamFileReader.java:72) ~[co.cask.cdap.cdap-data-fabric-3.2.1.jar :na] at co.cask.cdap.data.stream.service.StreamFetchHandler.createReader(StreamFetchHandler.java:286) ~[co.cask.cdap.cdap-data-fabric-3.2.1.jar:na ] at co.cask.cdap.data.stream.service.StreamFetchHandler.fetch(StreamFetchHandler.java:124) ~[co.cask.cdap.cdap-data-fabric-3.2.1.jar:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.7.0_67] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[na:1.7.0_67] {code} This happens because in HA mode the URI returned from org.apache.hadoop.fs.FileContext is not compatible with the one expected by org.apache.hadoop.dfs.DistributedFileSystem. FileContext is not HA aware and always appends the port which DistributedFilesystem uses the logical name. Related HDFS JIRA: https://issues.apache.org/jira/browse/HADOOP-9617 Until the HDFS JIRA is fixed we need a workaround in CDAP to strip out the port if used in HA mode.
    via by Sreevatsan Raman,
  • Hadoop Yarn job: Wrong FS
    via Stack Overflow by delthom
    ,
  • Oryx – Docs: Admin
    via by Unknown author,
    • java.lang.IllegalArgumentException: Wrong FS: alluxio://172.19.121.51:19998/data/01, expected: hdfs://hstore at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:645) at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:193) at org.apache.hadoop.hdfs.DistributedFileSystem.access$000(DistributedFileSystem.java:105) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:1136) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:1132) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1132) at org.apache.hadoop.fs.FileSystem.isFile(FileSystem.java:1449) at com.antfact.hstore.batch.mr.input.InputPathFilter.accept(InputPathFilter.java:57) at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$FileGenerator.callInternal(OrcInputFormat.java:1015) at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$FileGenerator.access$1300(OrcInputFormat.java:965) at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$FileGenerator$1.run(OrcInputFormat.java:990) at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$FileGenerator$1.run(OrcInputFormat.java:987) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$FileGenerator.call(OrcInputFormat.java:987) at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$FileGenerator.call(OrcInputFormat.java:965) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744)

    Users with the same issue

    Unknown visitor1 times, last one,
    Unknown visitor1 times, last one,
    Unknown visitor1 times, last one,
    Unknown visitor1 times, last one,
    Unknown visitor1 times, last one,
    1 more bugmates