org.apache.spark.SparkException: Job aborted due to stage failure: ShuffleMapStage 3 (map at <console>:130) has failed the maximum allowable number of times: 4. Most recent failure reason: org.apache.spark.shuffle.FetchFailedException: Connection from ip-172-31-10-34.ec2.internal/172.31.10.34:7337 closed

Stack Overflow | Newbie | 2 months ago
  1. 0

    Spark : spark.shuffle.FetchFailedException - ShuffleMapStage

    Stack Overflow | 2 months ago | Newbie
    org.apache.spark.SparkException: Job aborted due to stage failure: ShuffleMapStage 3 (map at <console>:130) has failed the maximum allowable number of times: 4. Most recent failure reason: org.apache.spark.shuffle.FetchFailedException: Connection from ip-172-31-10-34.ec2.internal/172.31.10.34:7337 closed
  2. 0

    Is it necessary to submit spark application jar?

    Stack Overflow | 10 months ago | Marcin Lagowski
    java.io.IOException: Connection from *.*.*.*/*.*.*.*:7077 closed
  3. 0

    Spark streaming 1.6.0 - Executors bouncing

    Stack Overflow | 9 months ago | visitor
    java.io.IOException: Connection from ip-***-22.ec2.internal/N.N.N.22:40791 closed
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Connection Closed error is coming while trying to connect with remote Spark master node

    Stack Overflow | 5 months ago | Dhanushka Gayashan
    java.io.IOException: Connection from xxx.xxx.xx.xxx/xxx.xxx.xx.xxx:7077 closed
  6. 0

    Spark streaming receiver Out of Memory (OOM)

    Stack Overflow | 5 months ago | X.Bin
    java.io.IOException: Connection from nmg01-taihang-d10207.nmg01.baidu.com/10.76.48.22:30456 closed

    3 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.io.IOException

      Connection from ip-172-31-10-34.ec2.internal/172.31.10.34:7337 closed

      at org.apache.spark.network.client.TransportResponseHandler.channelUnregistered()
    2. Spark
      TransportChannelHandler.channelUnregistered
      1. org.apache.spark.network.client.TransportResponseHandler.channelUnregistered(TransportResponseHandler.java:124)
      2. org.apache.spark.network.server.TransportChannelHandler.channelUnregistered(TransportChannelHandler.java:94)
      2 frames
    3. Netty
      SingleThreadEventExecutor$2.run
      1. io.netty.channel.AbstractChannelHandlerContext.invokeChannelUnregistered(AbstractChannelHandlerContext.java:158)
      2. io.netty.channel.AbstractChannelHandlerContext.fireChannelUnregistered(AbstractChannelHandlerContext.java:144)
      3. io.netty.channel.ChannelInboundHandlerAdapter.channelUnregistered(ChannelInboundHandlerAdapter.java:53)
      4. io.netty.channel.AbstractChannelHandlerContext.invokeChannelUnregistered(AbstractChannelHandlerContext.java:158)
      5. io.netty.channel.AbstractChannelHandlerContext.fireChannelUnregistered(AbstractChannelHandlerContext.java:144)
      6. io.netty.channel.ChannelInboundHandlerAdapter.channelUnregistered(ChannelInboundHandlerAdapter.java:53)
      7. io.netty.channel.AbstractChannelHandlerContext.invokeChannelUnregistered(AbstractChannelHandlerContext.java:158)
      8. io.netty.channel.AbstractChannelHandlerContext.fireChannelUnregistered(AbstractChannelHandlerContext.java:144)
      9. io.netty.channel.ChannelInboundHandlerAdapter.channelUnregistered(ChannelInboundHandlerAdapter.java:53)
      10. io.netty.channel.AbstractChannelHandlerContext.invokeChannelUnregistered(AbstractChannelHandlerContext.java:158)
      11. io.netty.channel.AbstractChannelHandlerContext.fireChannelUnregistered(AbstractChannelHandlerContext.java:144)
      12. io.netty.channel.DefaultChannelPipeline.fireChannelUnregistered(DefaultChannelPipeline.java:739)
      13. io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:659)
      14. io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
      15. io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
      16. io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
      16 frames
    4. Java RT
      Thread.run
      1. java.lang.Thread.run(Thread.java:745)
      1 frame