org.apache.spark.SparkException

There are no available Samebug tips for this exception. Do you have an idea how to solve this issue? A short tip would help users who saw this issue last week.

  • Dimension mismatch error in Spark ML
    via Stack Overflow by piotrm50
    ,
  • GitHub comment 1988#201105812
    via GitHub by clockfly
    ,
  • replaceWithContext troubles
    via GitHub by gebner
    ,
  • GitHub comment 20209#205896543
    via GitHub by hochgi
    ,
  • GitHub comment 20642#222111584
    via GitHub by kstokoz
    ,
  • GitHub comment 20642#223772154
    via GitHub by abrighton
    ,
  • GitHub comment 2#222986551
    via GitHub by ovidiubuligan
    ,
    • org.apache.spark.SparkException: Failed to execute user defined function($anonfun$1: (vector) => double) at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIterator.processNext(Unknown Source) at org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43) at org.apache.spark.sql.execution.WholeStageCodegenExec$$anonfun$8$$anon$1.hasNext(WholeStageCodegenExec.scala:370) at org.apache.spark.sql.execution.SparkPlan$$anonfun$4.apply(SparkPlan.scala:246) at org.apache.spark.sql.execution.SparkPlan$$anonfun$4.apply(SparkPlan.scala:240) at org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$24.apply(RDD.scala:803) at org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$24.apply(RDD.scala:803) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:319) at org.apache.spark.rdd.RDD.iterator(RDD.scala:283) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70) at org.apache.spark.scheduler.Task.run(Task.scala:86) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.IllegalArgumentException: requirement failed: A & B Dimension mismatch! at scala.Predef$.require(Predef.scala:224) at org.apache.spark.ml.ann.BreezeUtil$.dgemm(BreezeUtil.scala:41) at org.apache.spark.ml.ann.AffineLayerModel.eval(Layer.scala:164) at org.apache.spark.ml.ann.FeedForwardModel.forward(Layer.scala:483) at org.apache.spark.ml.ann.FeedForwardModel.predict(Layer.scala:530) at org.apache.spark.ml.classification.MultilayerPerceptronClassificationModel.predict(MultilayerPerceptronClassifier.scala:322) at org.apache.spark.ml.classification.MultilayerPerceptronClassificationModel.predict(MultilayerPerceptronClassifier.scala:296) at org.apache.spark.ml.PredictionModel$$anonfun$1.apply(Predictor.scala:187) at org.apache.spark.ml.PredictionModel$$anonfun$1.apply(Predictor.scala:186) ... 16 more

    Users with the same issue

    tyson925
    16 times, last one,
    gehel
    2 times, last one,
    melezov
    2 times, last one,
    Unknown visitor1 times, last one,
    Unknown visitor1 times, last one,
    43 more bugmates