java.lang.IllegalStateException: RpcEnv already stopped.

Apache's JIRA Issue Tracker | Nishkam Ravi | 1 year ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    This happens frequently and can be confusing: 16/01/22 13:07:34 INFO ShutdownHookManager: Shutdown hook called 16/01/22 13:07:34 WARN Dispatcher: Message RemoteProcessDisconnected(c1706.halxg.cloudera.com:52665) dropped. java.lang.IllegalStateException: RpcEnv already stopped. at org.apache.spark.rpc.netty.Dispatcher.postMessage(Dispatcher.scala:165) at org.apache.spark.rpc.netty.Dispatcher.postToAll(Dispatcher.scala:110) at org.apache.spark.rpc.netty.NettyRpcHandler.channelInactive(NettyRpcEnv.scala:618) at org.apache.spark.network.server.TransportRequestHandler.channelInactive(TransportRequestHandler.java:99) at org.apache.spark.network.server.TransportChannelHandler.channelInactive(TransportChannelHandler.java:104) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:208) at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:194) at io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75) at io.netty.handler.timeout.IdleStateHandler.channelInactive(IdleStateHandler.java:257) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:208) at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:194) at io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:208) at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:194) at io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75) at org.apache.spark.network.util.TransportFrameDecoder.channelInactive(TransportFrameDecoder.java:183) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:208) at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:194) at io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:828) at io.netty.channel.AbstractChannel$AbstractUnsafe$7.run(AbstractChannel.java:621) at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:328) at io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:627) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:362) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) at java.lang.Thread.run(Thread.java:745)

    Apache's JIRA Issue Tracker | 1 year ago | Nishkam Ravi
    java.lang.IllegalStateException: RpcEnv already stopped.
  2. 0

    [jira] [Assigned] (SPARK-12967) NettyRPC races with SparkContext.stop() and throws exception

    spark-issues | 1 year ago | Apache Spark (JIRA)
    java.lang.IllegalStateException: RpcEnv already stopped.
  3. 0

    GitHub comment 37#166445882

    GitHub | 1 year ago | skonto
    java.lang.IllegalStateException: RpcEnv already stopped.
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.IllegalStateException

      RpcEnv already stopped.

      at org.apache.spark.rpc.netty.Dispatcher.postMessage()
    2. org.apache.spark
      NettyRpcHandler.channelInactive
      1. org.apache.spark.rpc.netty.Dispatcher.postMessage(Dispatcher.scala:165)
      2. org.apache.spark.rpc.netty.Dispatcher.postToAll(Dispatcher.scala:110)
      3. org.apache.spark.rpc.netty.NettyRpcHandler.channelInactive(NettyRpcEnv.scala:618)
      3 frames
    3. Spark
      TransportChannelHandler.channelInactive
      1. org.apache.spark.network.server.TransportRequestHandler.channelInactive(TransportRequestHandler.java:99)
      2. org.apache.spark.network.server.TransportChannelHandler.channelInactive(TransportChannelHandler.java:104)
      2 frames
    4. Netty
      ChannelInboundHandlerAdapter.channelInactive
      1. io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:208)
      2. io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:194)
      3. io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75)
      4. io.netty.handler.timeout.IdleStateHandler.channelInactive(IdleStateHandler.java:257)
      5. io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:208)
      6. io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:194)
      7. io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75)
      8. io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:208)
      9. io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:194)
      10. io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75)
      10 frames
    5. Spark
      TransportFrameDecoder.channelInactive
      1. org.apache.spark.network.util.TransportFrameDecoder.channelInactive(TransportFrameDecoder.java:183)
      1 frame
    6. Netty
      SingleThreadEventExecutor$2.run
      1. io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:208)
      2. io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:194)
      3. io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:828)
      4. io.netty.channel.AbstractChannel$AbstractUnsafe$7.run(AbstractChannel.java:621)
      5. io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:328)
      6. io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:627)
      7. io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:362)
      8. io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
      8 frames
    7. Java RT
      Thread.run
      1. java.lang.Thread.run(Thread.java:745)
      1 frame