py4j.Py4JException: Method asDataFrame([class water.fvec.H2OFrame, class org.apache.spark.sql.SQLContext]) does not exist

JIRA | Michal Malohlava | 7 months ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    I change H2OContext - the method asDataFrame and added optional parameter `copyMetadata` However, when I run `./gradlew :sparkling-water-py:check` the run finishes with `BUILD SUCCESSFUL` status, however, it also prints: {noformat} ====================================================================== ERROR: test_h2o_frame_2_data_frame_2 (__main__.FrameTransformationsTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "tests/tests_unit.py", line 130, in test_h2o_frame_2_data_frame_2 df = hc.as_spark_frame(h2o_frame) File "build/bdist.macosx-10.10-x86_64/egg/pysparkling/context.py", line 158, in as_spark_frame jdf = self._jhc.asDataFrame(j_h2o_frame, self._jsqlContext) File "/Users/michal/Bin/spark/spark-1.6.1-bin-hadoop2.6/python/lib/py4j-0.9-src.zip/py4j/java_gateway.py", line 813, in __call__ answer, self.gateway_client, self.target_id, self.name) File "/Users/michal/Bin/spark/spark-1.6.1-bin-hadoop2.6/python/pyspark/sql/utils.py", line 45, in deco return f(*a, **kw) File "/Users/michal/Bin/spark/spark-1.6.1-bin-hadoop2.6/python/lib/py4j-0.9-src.zip/py4j/protocol.py", line 312, in get_return_value format(target_id, ".", name, value)) Py4JError: An error occurred while calling o41.asDataFrame. Trace: py4j.Py4JException: Method asDataFrame([class water.fvec.H2OFrame, class org.apache.spark.sql.SQLContext]) does not exist at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:335) at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:344) at py4j.Gateway.invoke(Gateway.java:252) at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:133) at py4j.commands.CallCommand.execute(CallCommand.java:79) at py4j.GatewayConnection.run(GatewayConnection.java:209) at java.lang.Thread.run(Thread.java:745) ====================================================================== ERROR: test_h2o_frame_2_data_frame_new (__main__.FrameTransformationsTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "tests/tests_unit.py", line 119, in test_h2o_frame_2_data_frame_new df = hc.as_spark_frame(h2o_frame) File "build/bdist.macosx-10.10-x86_64/egg/pysparkling/context.py", line 158, in as_spark_frame jdf = self._jhc.asDataFrame(j_h2o_frame, self._jsqlContext) File "/Users/michal/Bin/spark/spark-1.6.1-bin-hadoop2.6/python/lib/py4j-0.9-src.zip/py4j/java_gateway.py", line 813, in __call__ answer, self.gateway_client, self.target_id, self.name) File "/Users/michal/Bin/spark/spark-1.6.1-bin-hadoop2.6/python/pyspark/sql/utils.py", line 45, in deco return f(*a, **kw) File "/Users/michal/Bin/spark/spark-1.6.1-bin-hadoop2.6/python/lib/py4j-0.9-src.zip/py4j/protocol.py", line 312, in get_return_value format(target_id, ".", name, value)) Py4JError: An error occurred while calling o41.asDataFrame. Trace: py4j.Py4JException: Method asDataFrame([class water.fvec.H2OFrame, class org.apache.spark.sql.SQLContext]) does not exist at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:335) at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:344) at py4j.Gateway.invoke(Gateway.java:252) at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:133) at py4j.commands.CallCommand.execute(CallCommand.java:79) at py4j.GatewayConnection.run(GatewayConnection.java:209) at java.lang.Thread.run(Thread.java:745) ---------------------------------------------------------------------- Ran 9 tests in 37.617s FAILED (errors=2) H2O session _sid_9599 closed. :sparkling-water-py:test :sparkling-water-py:check {noformat}

    JIRA | 7 months ago | Michal Malohlava
    py4j.Py4JException: Method asDataFrame([class water.fvec.H2OFrame, class org.apache.spark.sql.SQLContext]) does not exist
  2. 0

    Implement a java UDF and call it from pyspark

    Stack Overflow | 1 year ago | Assaf Mendelson
    py4j.Py4JException: Method __getnewargs__([]) does not exist
  3. 0

    How should I structure this execution flow in Spark?

    Stack Overflow | 11 months ago | ThatDataGuy
    py4j.Py4JException: Method __getstate__([]) does not exist
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    how to map RDD of strings to columns of a Dataframe in pyspark

    Stack Overflow | 7 months ago | H.Z.
    py4j.Py4JException: Method __getnewargs__([]) does not exist

    5 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. py4j.Py4JException

      Method asDataFrame([class water.fvec.H2OFrame, class org.apache.spark.sql.SQLContext]) does not exist

      at py4j.reflection.ReflectionEngine.getMethod()
    2. Py4J
      GatewayConnection.run
      1. py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:335)
      2. py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:344)
      3. py4j.Gateway.invoke(Gateway.java:252)
      4. py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:133)
      5. py4j.commands.CallCommand.execute(CallCommand.java:79)
      6. py4j.GatewayConnection.run(GatewayConnection.java:209)
      6 frames
    3. Java RT
      Thread.run
      1. java.lang.Thread.run(Thread.java:745)
      1 frame