java.io.IOException: Uri is invalid: URI must be absolute

JIRA | Lei Fan | 1 year ago
  1. 0

    Two symptoms are observed: 1. From command line: tachyon loadufs tachyon://n1:19998/file hdfs://n1:9000/file, where "file" is a file at the root of HDFS leads to error message: java.io.IOException: Uri is invalid: URI must be absolute at tachyon.client.TachyonFS.validateUri(TachyonFS.java:1010) at tachyon.client.TachyonFS.getFileStatus(TachyonFS.java:611) at tachyon.client.TachyonFS.exist(TachyonFS.java:407) at tachyon.client.UfsUtils.loadUnderFs(UfsUtils.java:160) at tachyon.client.UfsUtils.loadUfs(UfsUtils.java:79) at tachyon.client.UfsUtils.main(UfsUtils.java:221) Usage: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils <TachyonPath> <UfsPath> [<Optional ExcludePathPrefix, separated by ;>] Example: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils tachyon://127.0.0.1:19998/a hdfs://localhost:9000/b c Example: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils tachyon://127.0.0.1:19998/a file:///b c Example: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils tachyon://127.0.0.1:19998/a /b c In the TFS, all files under local FS /b will be registered under /a, except for those with prefix c 2. From spark-shell (where Tachyon is set up with HDFS as its UnderFS in tachyon-env.sh): val input = sc.textFile("tachyon://n1:19998/file") Any actions performed on the "input" RDD will lead to a similar error: java.io.IOException: Uri is invalid: URI must be absolute at tachyon.client.TachyonFS.validateUri(TachyonFS.java:1010) at tachyon.client.TachyonFS.getFileStatus(TachyonFS.java:611) at tachyon.client.TachyonFS.exist(TachyonFS.java:407) at tachyon.client.UfsUtils.loadUnderFs(UfsUtils.java:160) .... Current known workaround: the "file" cannot be located at the root of HDFS. There appears to be a bug related to parsing of filepath only at the root of HDFS.

    JIRA | 1 year ago | Lei Fan
    java.io.IOException: Uri is invalid: URI must be absolute
  2. 0

    Two symptoms are observed: 1. From command line: tachyon loadufs tachyon://n1:19998/file hdfs://n1:9000/file, where "file" is a file at the root of HDFS leads to error message: java.io.IOException: Uri is invalid: URI must be absolute at tachyon.client.TachyonFS.validateUri(TachyonFS.java:1010) at tachyon.client.TachyonFS.getFileStatus(TachyonFS.java:611) at tachyon.client.TachyonFS.exist(TachyonFS.java:407) at tachyon.client.UfsUtils.loadUnderFs(UfsUtils.java:160) at tachyon.client.UfsUtils.loadUfs(UfsUtils.java:79) at tachyon.client.UfsUtils.main(UfsUtils.java:221) Usage: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils <TachyonPath> <UfsPath> [<Optional ExcludePathPrefix, separated by ;>] Example: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils tachyon://127.0.0.1:19998/a hdfs://localhost:9000/b c Example: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils tachyon://127.0.0.1:19998/a file:///b c Example: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils tachyon://127.0.0.1:19998/a /b c In the TFS, all files under local FS /b will be registered under /a, except for those with prefix c 2. From spark-shell (where Tachyon is set up with HDFS as its UnderFS in tachyon-env.sh): val input = sc.textFile("tachyon://n1:19998/file") Any actions performed on the "input" RDD will lead to a similar error: java.io.IOException: Uri is invalid: URI must be absolute at tachyon.client.TachyonFS.validateUri(TachyonFS.java:1010) at tachyon.client.TachyonFS.getFileStatus(TachyonFS.java:611) at tachyon.client.TachyonFS.exist(TachyonFS.java:407) at tachyon.client.UfsUtils.loadUnderFs(UfsUtils.java:160) .... Current known workaround: the "file" cannot be located at the root of HDFS. There appears to be a bug related to parsing of filepath only at the root of HDFS.

    JIRA | 1 year ago | Lei Fan
    java.io.IOException: Uri is invalid: URI must be absolute
  3. 0

    OutOfMemoryError with Spark

    Google Groups | 1 year ago | Lei Fan
    java.io.IOException: Uri is invalid: URI must be absolute
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Spark on Tachyon - Uri is invalid: URI must be absolute

    Google Groups | 12 months ago | Naga Vijay
    java.io.IOException: Uri is invalid: URI must be absolute
  6. 0

    Two symptoms are observed: 1. From command line: tachyon loadufs tachyon://n1:19998/file hdfs://n1:9000/file, where "file" is a file at the root of HDFS leads to error message: java.io.IOException: Uri is invalid: URI must be absolute at tachyon.client.TachyonFS.validateUri(TachyonFS.java:1010) at tachyon.client.TachyonFS.getFileStatus(TachyonFS.java:611) at tachyon.client.TachyonFS.exist(TachyonFS.java:407) at tachyon.client.UfsUtils.loadUnderFs(UfsUtils.java:160) at tachyon.client.UfsUtils.loadUfs(UfsUtils.java:79) at tachyon.client.UfsUtils.main(UfsUtils.java:221) Usage: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils <TachyonPath> <UfsPath> [<Optional ExcludePathPrefix, separated by ;>] Example: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils tachyon://127.0.0.1:19998/a hdfs://localhost:9000/b c Example: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils tachyon://127.0.0.1:19998/a file:///b c Example: java -cp target/tachyon-0.7.1-jar-with-dependencies.jar tachyon.client.UfsUtils tachyon://127.0.0.1:19998/a /b c In the TFS, all files under local FS /b will be registered under /a, except for those with prefix c 2. From spark-shell (where Tachyon is set up with HDFS as its UnderFS in tachyon-env.sh): val input = sc.textFile("tachyon://n1:19998/file") Any actions performed on the "input" RDD will lead to a similar error: java.io.IOException: Uri is invalid: URI must be absolute at tachyon.client.TachyonFS.validateUri(TachyonFS.java:1010) at tachyon.client.TachyonFS.getFileStatus(TachyonFS.java:611) at tachyon.client.TachyonFS.exist(TachyonFS.java:407) at tachyon.client.UfsUtils.loadUnderFs(UfsUtils.java:160) .... Current known workaround: the "file" cannot be located at the root of HDFS. There appears to be a bug related to parsing of filepath only at the root of HDFS.

    JIRA | 1 year ago | Lei Fan
    java.io.IOException: Uri is invalid: URI must be absolute

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.io.IOException

      Uri is invalid: URI must be absolute

      at tachyon.client.TachyonFS.validateUri()
    2. Tachyon Project Core
      UfsUtils.loadUnderFs
      1. tachyon.client.TachyonFS.validateUri(TachyonFS.java:1010)
      2. tachyon.client.TachyonFS.getFileStatus(TachyonFS.java:611)
      3. tachyon.client.TachyonFS.exist(TachyonFS.java:407)
      4. tachyon.client.UfsUtils.loadUnderFs(UfsUtils.java:160)
      4 frames