org.apache.spark.SparkException

Failed to execute user defined function($anonfun$1: (vector) => double)


Solutions on the web1862

Solution icon of stackoverflow
Failed to execute user defined function($anonfun$1: (vector) => double)

Solution icon of github
via GitHub by yarrick19
, 7 months ago
Failed to execute user defined function($anonfun$4: (vector) => double)

Solution icon of github
via GitHub by yarrick19
, 7 months ago
Failed to execute user defined function($anonfun$4: (vector) => double)

Solution icon of stackoverflow
Failed to execute user defined function($anonfun$1: (vector) => vector)

Solution icon of stackoverflow
Failed to execute user defined function($anonfun$2: (vector) => int)

Solution icon of stackoverflow
Failed to execute user defined function($anonfun$4: (string) => double)

Solution icon of stackoverflow
via Stack Overflow by Steven Sheffey
, 1 month ago
Failed to execute user defined function($anonfun$1: (array<struct<b:int,c:int>>) => double)

Solution icon of stackoverflow
Failed to execute user defined function($anonfun$3: (struct<c9003_double_vecAssembler_41f4486b7bab:double,c0022_double_vecAssembler_41f4486b7bab:double,c9014_double_vecAssembler_41f4486b7bab:double,c9008_double_vecAssembler_41f4486b7bab:double

Solution icon of stackoverflow
Failed to execute user defined function(anonfun$loginUDF$1$1: (string, string) => string)

Solution icon of github
via GitHub by jon-morra-zefr
, 8 months ago
Failed to execute user defined function(anonfun$2: (string) => zefr__commons__proto__dimension)

Stack trace

  • org.apache.spark.SparkException: Failed to execute user defined function($anonfun$1: (vector) => double) at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIterator.processNext(Unknown Source) at org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43) at org.apache.spark.sql.execution.WholeStageCodegenExec$$anonfun$8$$anon$1.hasNext(WholeStageCodegenExec.scala:370) at org.apache.spark.sql.execution.SparkPlan$$anonfun$4.apply(SparkPlan.scala:246) at org.apache.spark.sql.execution.SparkPlan$$anonfun$4.apply(SparkPlan.scala:240) at org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$24.apply(RDD.scala:803) at org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$24.apply(RDD.scala:803) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:319) at org.apache.spark.rdd.RDD.iterator(RDD.scala:283) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70) at org.apache.spark.scheduler.Task.run(Task.scala:86) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.IllegalArgumentException: requirement failed: A & B Dimension mismatch! at scala.Predef$.require(Predef.scala:224) at org.apache.spark.ml.ann.BreezeUtil$.dgemm(BreezeUtil.scala:41) at org.apache.spark.ml.ann.AffineLayerModel.eval(Layer.scala:164) at org.apache.spark.ml.ann.FeedForwardModel.forward(Layer.scala:483) at org.apache.spark.ml.ann.FeedForwardModel.predict(Layer.scala:530) at org.apache.spark.ml.classification.MultilayerPerceptronClassificationModel.predict(MultilayerPerceptronClassifier.scala:322) at org.apache.spark.ml.classification.MultilayerPerceptronClassificationModel.predict(MultilayerPerceptronClassifier.scala:296) at org.apache.spark.ml.PredictionModel$$anonfun$1.apply(Predictor.scala:187) at org.apache.spark.ml.PredictionModel$$anonfun$1.apply(Predictor.scala:186) ... 16 more

Write tip

You have a different solution? A short tip here would help you and many other users who saw this issue last week.

Users with the same issue

Once, 1 day ago
Once, 1 month ago
16 times, 4 months ago
2 times, 9 months ago
2 times, 11 months ago
44 more bugmates