java.lang.IllegalStateException: Adding new inputs, transformations, and output operations after stopping a context is not supported

nabble.com | 7 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Apache Spark User List - java.lang.IllegalArgumentException: requirement failed: No output operations registered, so nothing to execute

    nabble.com | 7 months ago
    java.lang.IllegalStateException: Adding new inputs, transformations, and output operations after stopping a context is not supported

    Root Cause Analysis

    1. java.lang.IllegalStateException

      Adding new inputs, transformations, and output operations after stopping a context is not supported

      at org.apache.spark.streaming.dstream.DStream.validateAtInit()
    2. Spark Project Streaming
      DStream$$anonfun$foreachRDD$2.apply
      1. org.apache.spark.streaming.dstream.DStream.validateAtInit(DStream.scala:224)
      2. org.apache.spark.streaming.dstream.DStream.<init>(DStream.scala:64)
      3. org.apache.spark.streaming.dstream.ForEachDStream.<init>(ForEachDStream.scala:26)
      4. org.apache.spark.streaming.dstream.DStream$$anonfun$foreachRDD$2.apply(DStream.scala:642)
      5. org.apache.spark.streaming.dstream.DStream$$anonfun$foreachRDD$2.apply(DStream.scala:642)
      5 frames
    3. Spark
      SparkContext.withScope
      1. org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:148)
      2. org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:109)
      3. org.apache.spark.SparkContext.withScope(SparkContext.scala:681)
      3 frames
    4. Spark Project Streaming
      DStream$$anonfun$foreachRDD$1.apply
      1. org.apache.spark.streaming.StreamingContext.withScope(StreamingContext.scala:258)
      2. org.apache.spark.streaming.dstream.DStream.foreachRDD(DStream.scala:638)
      3. org.apache.spark.streaming.dstream.DStream$$anonfun$foreachRDD$1.apply$mcV$sp(DStream.scala:631)
      4. org.apache.spark.streaming.dstream.DStream$$anonfun$foreachRDD$1.apply(DStream.scala:629)
      5. org.apache.spark.streaming.dstream.DStream$$anonfun$foreachRDD$1.apply(DStream.scala:629)
      5 frames
    5. Spark
      SparkContext.withScope
      1. org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:148)
      2. org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:109)
      3. org.apache.spark.SparkContext.withScope(SparkContext.scala:681)
      3 frames
    6. Spark Project Streaming
      AbstractJavaDStreamLike.foreachRDD
      1. org.apache.spark.streaming.StreamingContext.withScope(StreamingContext.scala:258)
      2. org.apache.spark.streaming.dstream.DStream.foreachRDD(DStream.scala:629)
      3. org.apache.spark.streaming.api.java.JavaDStreamLike$class.foreachRDD(JavaDStreamLike.scala:315)
      4. org.apache.spark.streaming.api.java.AbstractJavaDStreamLike.foreachRDD(JavaDStreamLike.scala:43)
      4 frames
    7. com.til.ibeat
      AggregateDashboardDataKafka$5.run
      1. com.til.ibeat.script.AggregateDashboardDataKafka$5.run(AggregateDashboardDataKafka.java:210)
      1 frame