java.io.IOException

There are no available Samebug tips for this exception. Do you have an idea how to solve this issue? A short tip would help users who saw this issue last week.

  • Two symptoms are observed: 1. From command line: tachyon loadufs tachyon://n1:19998/file hdfs://n1:9000/file, where "file" is a file at the root of HDFS leads to error message: java.io.IOException: Uri is invalid: URI must be absolute at tachyon.client.TachyonFS.validateUri(TachyonFS.java:1010) at tachyon.client.TachyonFS.getFileStatus(TachyonFS.java:611) at tachyon.client.TachyonFS.exist(TachyonFS.java:407) at tachyon.client.UfsUtils.loadUnderFs(UfsUtils.java:160) at tachyon.client.UfsUtils.loadUfs(UfsUtils.java:79) at tachyon.client.UfsUtils.main(UfsUtils.java:221) Usage: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils <TachyonPath> <UfsPath> [<Optional ExcludePathPrefix, separated by ;>] Example: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils tachyon://127.0.0.1:19998/a hdfs://localhost:9000/b c Example: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils tachyon://127.0.0.1:19998/a file:///b c Example: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils tachyon://127.0.0.1:19998/a /b c In the TFS, all files under local FS /b will be registered under /a, except for those with prefix c 2. From spark-shell (where Tachyon is set up with HDFS as its UnderFS in tachyon-env.sh): val input = sc.textFile("tachyon://n1:19998/file") Any actions performed on the "input" RDD will lead to a similar error: java.io.IOException: Uri is invalid: URI must be absolute at tachyon.client.TachyonFS.validateUri(TachyonFS.java:1010) at tachyon.client.TachyonFS.getFileStatus(TachyonFS.java:611) at tachyon.client.TachyonFS.exist(TachyonFS.java:407) at tachyon.client.UfsUtils.loadUnderFs(UfsUtils.java:160) .... Current known workaround: the "file" cannot be located at the root of HDFS. There appears to be a bug related to parsing of filepath only at the root of HDFS.
    via by Lei Fan,
  • OutOfMemoryError with Spark
    via by Lei Fan,
  • Two symptoms are observed: 1. From command line: tachyon loadufs tachyon://n1:19998/file hdfs://n1:9000/file, where "file" is a file at the root of HDFS leads to error message: java.io.IOException: Uri is invalid: URI must be absolute at tachyon.client.TachyonFS.validateUri(TachyonFS.java:1010) at tachyon.client.TachyonFS.getFileStatus(TachyonFS.java:611) at tachyon.client.TachyonFS.exist(TachyonFS.java:407) at tachyon.client.UfsUtils.loadUnderFs(UfsUtils.java:160) at tachyon.client.UfsUtils.loadUfs(UfsUtils.java:79) at tachyon.client.UfsUtils.main(UfsUtils.java:221) Usage: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils <TachyonPath> <UfsPath> [<Optional ExcludePathPrefix, separated by ;>] Example: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils tachyon://127.0.0.1:19998/a hdfs://localhost:9000/b c Example: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils tachyon://127.0.0.1:19998/a file:///b c Example: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils tachyon://127.0.0.1:19998/a /b c In the TFS, all files under local FS /b will be registered under /a, except for those with prefix c 2. From spark-shell (where Tachyon is set up with HDFS as its UnderFS in tachyon-env.sh): val input = sc.textFile("tachyon://n1:19998/file") Any actions performed on the "input" RDD will lead to a similar error: java.io.IOException: Uri is invalid: URI must be absolute at tachyon.client.TachyonFS.validateUri(TachyonFS.java:1010) at tachyon.client.TachyonFS.getFileStatus(TachyonFS.java:611) at tachyon.client.TachyonFS.exist(TachyonFS.java:407) at tachyon.client.UfsUtils.loadUnderFs(UfsUtils.java:160) .... Current known workaround: the "file" cannot be located at the root of HDFS. There appears to be a bug related to parsing of filepath only at the root of HDFS.
    via by Lei Fan,
    • java.io.IOException: Uri is invalid: URI must be absolute at tachyon.client.TachyonFS.validateUri(TachyonFS.java:1010) at tachyon.client.TachyonFS.getFileStatus(TachyonFS.java:611) at tachyon.client.TachyonFS.exist(TachyonFS.java:407) at tachyon.client.UfsUtils.loadUnderFs(UfsUtils.java:160) at tachyon.client.UfsUtils.loadUfs(UfsUtils.java:79) at tachyon.client.UfsUtils.main(UfsUtils.java:221)
    No Bugmate found.