java.lang.IllegalArgumentException: requirement failed: pyspark.zip not found; cannot run pyspark application in YARN mode.

There are no available Samebug tips for this exception. Do you have an idea how to solve this issue? A short tip would help users who saw this issue last week.

  • PySpark job fails in AWS EMR cluster
    via Stack Overflow by Pari Margu
    ,
  • Save object in cassandra using spark and java
    via Stack Overflow by chris
    ,
  • Package import error
    via by Amar Pawar,
  • Error parsing Set-Cookie header
    via GitHub by doxxx
    ,
    • java.lang.IllegalArgumentException: requirement failed: pyspark.zip not found; cannot run pyspark application in YARN mode. at scala.Predef$.require(Predef.scala:233) at org.apache.spark.deploy.yarn.Client$$anonfun$findPySparkArchives$2.apply(Client.scala:1052) at org.apache.spark.deploy.yarn.Client$$anonfun$findPySparkArchives$2.apply(Client.scala:1049) at scala.Option.getOrElse(Option.scala:120) at org.apache.spark.deploy.yarn.Client.findPySparkArchives(Client.scala:1049) at org.apache.spark.deploy.yarn.Client.createContainerLaunchContext(Client.scala:722) at org.apache.spark.deploy.yarn.Client.submitApplication(Client.scala:142) at org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.start(YarnClientSchedulerBackend.scala:57) at org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:144) at org.apache.spark.SparkContext.<init>(SparkContext.scala:530) at org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:59) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:234) at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:381) at py4j.Gateway.invoke(Gateway.java:214) at py4j.commands.ConstructorCommand.invokeConstructor(ConstructorCommand.java:79) at py4j.commands.ConstructorCommand.execute(ConstructorCommand.java:68) at py4j.GatewayConnection.run(GatewayConnection.java:209) at java.lang.Thread.run(Thread.java:745)

    Users with the same issue

    Handemelindo
    Handemelindo3 times, last one,
    rp
    rp61 times, last one,
    poroszd
    poroszd15 times, last one,
    richard77
    richard779 times, last one,
    Unknown visitor1 times, last one,
    43 more bugmates