org.apache.spark.api.r.RBackendHandler: loadDF on org.apache.spark.sql.api.r.SQLUtils faile d Error in invokeJava(isStatic = TRUE, className, methodName, ...) : org.apache.spark.sql.AnalysisException: **Path does not exist: gs://dev.appspot.com/myData/2014/ 20*,gs://dev.appspot.com/myData/2015/20***;

Stack Overflow | narik | 2 months ago
  1. 0

    sparkr 2.0 read.df throws path does not exist error

    Stack Overflow | 2 months ago | narik
    org.apache.spark.api.r.RBackendHandler: loadDF on org.apache.spark.sql.api.r.SQLUtils faile d Error in invokeJava(isStatic = TRUE, className, methodName, ...) : org.apache.spark.sql.AnalysisException: **Path does not exist: gs://dev.appspot.com/myData/2014/ 20*,gs://dev.appspot.com/myData/2015/20***;

    Root Cause Analysis

    1. org.apache.spark.api.r.RBackendHandler

      loadDF on org.apache.spark.sql.api.r.SQLUtils faile d Error in invokeJava(isStatic = TRUE, className, methodName, ...) : org.apache.spark.sql.AnalysisException: **Path does not exist: gs://dev.appspot.com/myData/2014/ 20*,gs://dev.appspot.com/myData/2015/20***;

      at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$12.apply()
    2. org.apache.spark
      DataSource$$anonfun$12.apply
      1. org.apache.spark.sql.execution.datasources.DataSource$$anonfun$12.apply(DataSource.scala:357)
      2. org.apache.spark.sql.execution.datasources.DataSource$$anonfun$12.apply(DataSource.scala:350)
      2 frames
    3. Scala
      List.flatMap
      1. scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241)
      2. scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241)
      3. scala.collection.immutable.List.foreach(List.scala:381)
      4. scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:241)
      5. scala.collection.immutable.List.flatMap(List.scala:344)
      5 frames
    4. org.apache.spark
      DataSource.resolveRelation
      1. org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:350)
      1 frame
    5. Spark Project SQL
      DataFrameReader.load
      1. org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:149)
      1 frame