java.lang.NoSuchMethodError: org.apache.spark.sql.DataFrame.map(Lscala/Function1;Lscala/reflect/ClassTag;)Lorg/apache/spark/rdd/RDD;

GitHub | napsternxg | 9 months ago
  1. 0

    Py4JJavaError: An error occurred while calling o57.find.

    GitHub | 9 months ago | napsternxg
    java.lang.NoSuchMethodError: org.apache.spark.sql.DataFrame.map(Lscala/Function1;Lscala/reflect/ClassTag;)Lorg/apache/spark/rdd/RDD;
  2. 0

    GitHub comment 5#252740059

    GitHub | 2 months ago | Georgehe4
    java.lang.NoSuchMethodError: org.apache.spark.SparkContext.emptyRDD(Lscala/reflect/ClassTag;)Lorg/apache/spark/rdd/EmptyRDD;
  3. 0

    GitHub comment 5#252740059

    GitHub | 2 months ago | Georgehe4
    java.lang.NoSuchMethodError: org.apache.spark.SparkContext.emptyRDD(Lscala/reflect/ClassTag;)Lorg/apache/spark/rdd/EmptyRDD;
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    GitHub comment 29#51139192

    GitHub | 2 years ago | ryleg
    java.lang.NoSuchMethodError: org.apache.spark.SparkContext$.rddToPairRDDFunctions(Lorg/apache/spark/rdd/RDD;Lscala/reflect/ClassTag;Lscala/reflect/ClassTag;Lscala/math/Ordering;)Lorg/apache/spark/rdd/PairRDDFunctions;
  6. 0

    Apache Spark: java.lang.NoSuchMethodError .rddToPairRDDFunctions

    Stack Overflow | 1 month ago | BlackSheep
    java.lang.NoSuchMethodError: org.apache.spark.SparkContext$.rddToPairRDDFunctions(Lorg/apache/spark/rdd/RDD;Lscala/reflect/ClassTag;Lscala/reflect/ClassTag;Lscala/math/Ordering;)Lorg/apache/spark/rdd/PairRDDFunctions;

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.NoSuchMethodError

      org.apache.spark.sql.DataFrame.map(Lscala/Function1;Lscala/reflect/ClassTag;)Lorg/apache/spark/rdd/RDD;

      at org.graphframes.GraphFrame.toGraphX()
    2. org.graphframes
      GraphFrame.cachedTopologyGraphX
      1. org.graphframes.GraphFrame.toGraphX(GraphFrame.scala:136)
      2. org.graphframes.GraphFrame.cachedGraphX$lzycompute(GraphFrame.scala:438)
      3. org.graphframes.GraphFrame.cachedGraphX(GraphFrame.scala:438)
      4. org.graphframes.GraphFrame.cachedTopologyGraphX$lzycompute(GraphFrame.scala:432)
      5. org.graphframes.GraphFrame.cachedTopologyGraphX(GraphFrame.scala:431)
      5 frames
    3. org.graphframes.lib
      PageRank.run
      1. org.graphframes.lib.PageRank$.runUntilConvergence(PageRank.scala:153)
      2. org.graphframes.lib.PageRank.run(PageRank.scala:102)
      2 frames
    4. Java RT
      Method.invoke
      1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      4. java.lang.reflect.Method.invoke(Method.java:606)
      4 frames
    5. Py4J
      GatewayConnection.run
      1. py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:231)
      2. py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:381)
      3. py4j.Gateway.invoke(Gateway.java:290)
      4. py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:133)
      5. py4j.commands.CallCommand.execute(CallCommand.java:79)
      6. py4j.GatewayConnection.run(GatewayConnection.java:209)
      6 frames
    6. Java RT
      Thread.run
      1. java.lang.Thread.run(Thread.java:745)
      1 frame