org.apache.spark.SparkException: Job aborted due to stage failure: Task 3 in stage 29.0 failed 4 times, most recent failure: Lost task 3.3 in stage 29.0 (TID 24, ip-172-16-15-0.us-west-2.compute.internal): java.lang.RuntimeException: Stream '/jars/' was not found.

Apache's JIRA Issue Tracker | Kevin Hogeland | 11 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0
  2. 0

    Pyspark Kafka Streaming

    Stack Overflow | 3 months ago | phelpsiv
    org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure: Lost task 0.3 in stage 0.0 (TID 3, 10.95.96.142): java.lang.RuntimeException: Stream '/jars/spark-streaming-kafka-0-8-assembly_2.11-2.0.1.jar' was not found.

    Root Cause Analysis

    1. org.apache.spark.SparkException

      Job aborted due to stage failure: Task 3 in stage 29.0 failed 4 times, most recent failure: Lost task 3.3 in stage 29.0 (TID 24, ip-172-16-15-0.us-west-2.compute.internal): java.lang.RuntimeException: Stream '/jars/' was not found.

      at org.apache.spark.network.client.TransportResponseHandler.handle()
    2. Spark
      TransportChannelHandler.channelRead0
      1. org.apache.spark.network.client.TransportResponseHandler.handle(TransportResponseHandler.java:223)
      2. org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:121)
      3. org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:51)
      3 frames
    3. Netty
      AbstractChannelHandlerContext.fireChannelRead
      1. io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
      2. io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:308)
      3. io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:294)
      4. io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:266)
      5. io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:308)
      6. io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:294)
      7. io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
      8. io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:308)
      9. io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:294)
      9 frames
    4. Spark
      TransportFrameDecoder.channelRead
      1. org.apache.spark.network.util.TransportFrameDecoder.channelRead(TransportFrameDecoder.java:85)
      1 frame
    5. Netty
      SingleThreadEventExecutor$2.run
      1. io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:308)
      2. io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:294)
      3. io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:846)
      4. io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131)
      5. io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:511)
      6. io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
      7. io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
      8. io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
      9. io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
      9 frames
    6. Java RT
      Thread.run
      1. java.lang.Thread.run(Thread.java:745)
      1 frame