java.lang.IllegalArgumentException: requirement failed: pyspark.zip not found; cannot run pyspark application in YARN mode.

Searched on Google with the first line of a JAVA stack trace?

We can recommend more relevant solutions and speed up debugging when you paste your entire stack trace with the exception message. Try a sample exception.

Recommended solutions based on your search

Samebug tips

,

Delete the corrupted index files and on startup, Kafka server will rebuild it.

Solutions on the web

via Stack Overflow by Pari Margu
, 1 year ago
requirement failed: pyspark.zip not found; cannot run pyspark application in YARN mode.
via Google Groups by Harsha Reddy, 1 year ago
requirement failed: users in PreparedData cannot be empty. Please check if DataSource generates TrainingData and Preprator generates PreparedData correctly.
via blogspot.com by Unknown author, 2 years ago
via Google Groups by Pat Ferrel, 1 year ago
requirement failed: users in PreparedData cannot be empty. Please check if DataSource generates TrainingData and Preprator generates PreparedData correctly.
java.lang.IllegalArgumentException: requirement failed: pyspark.zip not found; cannot run pyspark application in YARN mode.
at scala.Predef$.require(Predef.scala:233)
at org.apache.spark.deploy.yarn.Client$$anonfun$findPySparkArchives$2.apply(Client.scala:1052)
at scala.Option.getOrElse(Option.scala:120)
at org.apache.spark.deploy.yarn.Client.findPySparkArchives(Client.scala:1049)
at org.apache.spark.deploy.yarn.Client.createContainerLaunchContext(Client.scala:722)
at org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.start(YarnClientSchedulerBackend.scala:57)
at org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:144)
at org.apache.spark.SparkContext.(SparkContext.scala:530)
at org.apache.spark.api.java.JavaSparkContext.(JavaSparkContext.scala:59)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:234)
at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:381)
at py4j.Gateway.invoke(Gateway.java:214)
at py4j.commands.ConstructorCommand.invokeConstructor(ConstructorCommand.java:79)
at py4j.commands.ConstructorCommand.execute(ConstructorCommand.java:68)
at py4j.GatewayConnection.run(GatewayConnection.java:209)
at java.lang.Thread.run(Thread.java:745)

Users with the same issue

Samebug visitor profile picture
Unknown user
Once, 1 year ago
Samebug visitor profile picture
Unknown user
Once, 1 year ago
Samebug visitor profile picture
Unknown user
Once, 1 year ago
40 times, 1 year ago
Samebug visitor profile picture
Unknown user
Once, 1 year ago

Write tip

Know the solutions? Share your knowledge to help other developers to debug faster.