org.apache.spark.SparkException: Yarn application has already ended! It might have been killed or unable to launch application master.

GitHub | mbuccini | 3 months ago
  1. 0

    SparkException when trying to create a context with a non-existing or unauthorized queue

    GitHub | 3 months ago | mbuccini
    org.apache.spark.SparkException: Yarn application has already ended! It might have been killed or unable to launch application master.
  2. 0

    Running spark job on yarn using remote SparkContext: Yarn application has already ended

    Stack Overflow | 9 months ago | iboss
    org.apache.spark.SparkException: Yarn application has already ended! It might have been killed or unable to launch application master.
  3. 0

    Spark Config Files

    Stack Overflow | 8 months ago | Ashesh Nair
    org.apache.spark.SparkException: Yarn application has already ended! It might have been killed or unable to launch application master.
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Running spark application from eclipse/IntelliJ as yarn-client without building the actual Jar

    Stack Overflow | 4 months ago | Sai Krishna
    org.apache.spark.SparkException: Yarn application has already ended! It might have been killed or unable to launch application master.
  6. 0

    spark-submit yarn-client run failed

    Stack Overflow | 2 years ago
    org.apache.spark.SparkException: Yarn application has already ended! It might have been killed or unable to launch application master.

  1. muffinmannen 6 times, last 5 months ago
  2. zokni 1 times, last 7 months ago
  3. harshg 4 times, last 8 months ago
13 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. org.apache.spark.SparkException

    Yarn application has already ended! It might have been killed or unable to launch application master.

    at org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.waitForApplication()
  2. Spark
    SparkContext.<init>
    1. org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.waitForApplication(YarnClientSchedulerBackend.scala:124)
    2. org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.start(YarnClientSchedulerBackend.scala:64)
    3. org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:144)
    4. org.apache.spark.SparkContext.<init>(SparkContext.scala:530)
    4 frames
  3. Spark Project Streaming
    StreamingContext.<init>
    1. org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:874)
    2. org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:81)
    2 frames
  4. spark.jobserver.context
    StreamingContextFactory.makeContext
    1. spark.jobserver.context.StreamingContextFactory$$anon$1.<init>(StreamingContextFactory.scala:16)
    2. spark.jobserver.context.StreamingContextFactory.makeContext(StreamingContextFactory.scala:16)
    3. spark.jobserver.context.StreamingContextFactory.makeContext(StreamingContextFactory.scala:8)
    4. spark.jobserver.context.SparkContextFactory$class.makeContext(SparkContextFactory.scala:37)
    5. spark.jobserver.context.StreamingContextFactory.makeContext(StreamingContextFactory.scala:8)
    5 frames
  5. spark.jobserver
    JobManagerActor$$anonfun$wrappedReceive$1.applyOrElse
    1. spark.jobserver.JobManagerActor.createContextFromConfig(JobManagerActor.scala:378)
    2. spark.jobserver.JobManagerActor$$anonfun$wrappedReceive$1.applyOrElse(JobManagerActor.scala:122)
    2 frames
  6. Scala
    AbstractPartialFunction$mcVL$sp.apply
    1. scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33)
    2. scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33)
    3. scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25)
    3 frames
  7. ooyala.common.akka
    ActorStack$$anonfun$receive$1.applyOrElse
    1. ooyala.common.akka.ActorStack$$anonfun$receive$1.applyOrElse(ActorStack.scala:33)
    1 frame
  8. Scala
    AbstractPartialFunction$mcVL$sp.apply
    1. scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33)
    2. scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33)
    3. scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25)
    3 frames
  9. ooyala.common.akka
    Slf4jLogging$$anonfun$receive$1.applyOrElse
    1. ooyala.common.akka.Slf4jLogging$$anonfun$receive$1$$anonfun$applyOrElse$1.apply$mcV$sp(Slf4jLogging.scala:26)
    2. ooyala.common.akka.Slf4jLogging$class.ooyala$common$akka$Slf4jLogging$$withAkkaSourceLogging(Slf4jLogging.scala:35)
    3. ooyala.common.akka.Slf4jLogging$$anonfun$receive$1.applyOrElse(Slf4jLogging.scala:25)
    3 frames
  10. Scala
    AbstractPartialFunction$mcVL$sp.apply
    1. scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33)
    2. scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33)
    3. scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25)
    3 frames
  11. ooyala.common.akka
    ActorMetrics$$anonfun$receive$1.applyOrElse
    1. ooyala.common.akka.ActorMetrics$$anonfun$receive$1.applyOrElse(ActorMetrics.scala:24)
    1 frame
  12. Akka Actor
    Actor$class.aroundReceive
    1. akka.actor.Actor$class.aroundReceive(Actor.scala:467)
    1 frame
  13. ooyala.common.akka
    InstrumentedActor.aroundReceive
    1. ooyala.common.akka.InstrumentedActor.aroundReceive(InstrumentedActor.scala:8)
    1 frame
  14. Akka Actor
    ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec
    1. akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
    2. akka.actor.ActorCell.invoke(ActorCell.scala:487)
    3. akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
    4. akka.dispatch.Mailbox.run(Mailbox.scala:220)
    5. akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
    5 frames
  15. Scala
    ForkJoinWorkerThread.run
    1. scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
    2. scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
    3. scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
    4. scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
    4 frames