java.lang.NoSuchMethodError: org.apache.spark.sql.Column.as(Ljava/lang/String;Lorg/apache/spark/sql/types/Metadata;)Lorg/apache/spark/sql/Column;

codegur.website | 8 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Get topic distribution over documents using LDA provided by Spark

    codegur.website | 8 months ago
    java.lang.NoSuchMethodError: org.apache.spark.sql.Column.as(Ljava/lang/String;Lorg/apache/spark/sql/types/Metadata;)Lorg/apache/spark/sql/Column;

    Root Cause Analysis

    1. java.lang.NoSuchMethodError

      org.apache.spark.sql.Column.as(Ljava/lang/String;Lorg/apache/spark/sql/types/Metadata;)Lorg/apache/spark/sql/Column;

      at org.apache.spark.ml.feature.StopWordsRemover.transform()
    2. Spark Project ML Library
      StopWordsRemover.transform
      1. org.apache.spark.ml.feature.StopWordsRemover.transform(StopWordsRemover.scala:144)
      1 frame