org.apache.spark.SparkException

Checkpoint RDD ReliableCheckpointRDD[232] at aggregate at ALS.scala:1182(0) has different number of partitions from original RDD itemFactors-10 MapPartitionsRDD[230] at mapValues at ALS.scala:1131(18)

Samebug tips0

There are no available Samebug tips for this exception. If you know how to solve this issue, help other users by writing a short tip.

Don't give up yet. Paste your full stack trace to get a solution.

Solutions on the web1296

  • via Stack Overflow by Hsiang
    , 10 months ago
    Checkpoint RDD ReliableCheckpointRDD[232] at aggregate at ALS.scala:1182(0) has different number of partitions from original RDD itemFactors-10 MapPartitionsRDD[230] at mapValues at ALS.scala:1131(18)
  • Checkpoint RDD ReliableCheckpointRDD[11] at print at StatefulNetworkWordCount.scala:78(1) has different number of partitions from original RDD MapPartitionsRDD[10] at updateStateByKey at StatefulNetworkWordCount.scala:76(2)
  • via Google Groups by Dibyendu Bhattacharya, 1 month ago
    *Could not read data from write ahead log record FileBasedWriteAheadLogSegment(tachyon-ft://10.252.5.113:19998/tachyon/checkpoint/receivedData/2/log-1431341091711-1431341151711,645603894,10891919)* at
  • Stack trace

    • org.apache.spark.SparkException: Checkpoint RDD ReliableCheckpointRDD[232] at aggregate at ALS.scala:1182(0) has different number of partitions from original RDD itemFactors-10 MapPartitionsRDD[230] at mapValues at ALS.scala:1131(18) at org.apache.spark.rdd.ReliableRDDCheckpointData.doCheckpoint(ReliableRDDCheckpointData.scala:73) at org.apache.spark.rdd.RDDCheckpointData.checkpoint(RDDCheckpointData.scala:74) at org.apache.spark.rdd.RDD$$anonfun$doCheckpoint$1.apply$mcV$sp(RDD.scala:1655) at org.apache.spark.rdd.RDD$$anonfun$doCheckpoint$1.apply(RDD.scala:1652)

    Write tip

    You have a different solution? A short tip here would help you and many other users who saw this issue last week.

    Users with the same issue

    You’re the first here who have seen this exception.