org.apache.spark.SparkException: Checkpoint RDD ReliableCheckpointRDD[232] at aggregate at ALS.scala:1182(0) has different number of partitions from original RDD itemFactors-10 MapPartitionsRDD[230] at mapValues at ALS.scala:1131(18)

Searched on Google with the first line of a JAVA stack trace?

We can recommend more relevant solutions and speed up debugging when you paste your entire stack trace with the exception message. Try a sample exception.

Recommended solutions based on your search

Solutions on the web

via Stack Overflow by Hsiang
, 1 year ago
Checkpoint RDD ReliableCheckpointRDD[232] at aggregate at ALS.scala:1182(0) has different number of partitions from original RDD itemFactors-10 MapPartitionsRDD[230] at mapValues at ALS.scala:1131(18)
via Stack Overflow by Soumitra
, 2 years ago
Checkpoint RDD ReliableCheckpointRDD[11] at print at StatefulNetworkWordCount.scala:78(1) has different number of partitions from original RDD MapPartitionsRDD[10] at updateStateByKey at StatefulNetworkWordCount.scala:76(2)
org.apache.spark.SparkException: Checkpoint RDD ReliableCheckpointRDD[232] at aggregate at ALS.scala:1182(0) has different number of partitions from original RDD itemFactors-10 MapPartitionsRDD[230] at mapValues at ALS.scala:1131(18)
at org.apache.spark.rdd.ReliableRDDCheckpointData.doCheckpoint(ReliableRDDCheckpointData.scala:73)
at org.apache.spark.rdd.RDDCheckpointData.checkpoint(RDDCheckpointData.scala:74)
at org.apache.spark.rdd.RDD$$anonfun$doCheckpoint$1.apply$mcV$sp(RDD.scala:1655)

Users with the same issue

You are the first who have seen this exception.

Write tip

Know the solutions? Share your knowledge to help other developers to debug faster.