java.lang.IllegalStateException: Library directory '/Users/marjanasgari/Desktop/MyThesis/EclipseIDE_Spark/First_Samples/Spark_MLlib/MyProject/assembly/target/scala-2.11/jars' does not exist; make sure Spark is built.

Stack Overflow | marjan | 4 months ago
  1. 0

    Submitting Spark application on YARN from Eclipse IDE

    Stack Overflow | 4 months ago | marjan
    java.lang.IllegalStateException: Library directory '/Users/marjanasgari/Desktop/MyThesis/EclipseIDE_Spark/First_Samples/Spark_MLlib/MyProject/assembly/target/scala-2.11/jars' does not exist; make sure Spark is built.
  2. 0

    Exception in thread "main" java.lang.IllegalStateException: Library directory '/Users/dbl/spark/lib_managed/jars' does not exist

    Stack Overflow | 1 year ago | dbl001
    java.lang.IllegalStateException: Library directory '/Users/davidlaxer/spark/lib_managed/jars' does not exist.
  3. Speed up your debug routine!

    Automated exception search integrated into your IDE

  4. 0
    You expected a file in the SD card or internal memory, but you have to deal with a file from Google drive.
    via GitHub by forouher
  5. 0
    In all ActiveAndroid tables there should be a primary key field with the name "Id" (with a capital "I").

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.IllegalStateException

      Library directory '/Users/marjanasgari/Desktop/MyThesis/EclipseIDE_Spark/First_Samples/Spark_MLlib/MyProject/assembly/target/scala-2.11/jars' does not exist; make sure Spark is built.

      at org.apache.spark.launcher.CommandBuilderUtils.checkState()
    2. org.apache.spark
      YarnCommandBuilderUtils$.findJarsDir
      1. org.apache.spark.launcher.CommandBuilderUtils.checkState(CommandBuilderUtils.java:248)
      2. org.apache.spark.launcher.CommandBuilderUtils.findJarsDir(CommandBuilderUtils.java:368)
      3. org.apache.spark.launcher.YarnCommandBuilderUtils$.findJarsDir(YarnCommandBuilderUtils.scala:38)
      3 frames
    3. Spark Project YARN Stable API
      Client.submitApplication
      1. org.apache.spark.deploy.yarn.Client.prepareLocalResources(Client.scala:500)
      2. org.apache.spark.deploy.yarn.Client.createContainerLaunchContext(Client.scala:834)
      3. org.apache.spark.deploy.yarn.Client.submitApplication(Client.scala:167)
      3 frames
    4. Spark
      SparkContext.<init>
      1. org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.start(YarnClientSchedulerBackend.scala:56)
      2. org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:149)
      3. org.apache.spark.SparkContext.<init>(SparkContext.scala:500)
      3 frames
    5. Unknown
      SVM.main
      1. SVM.main(SVM.java:21)
      1 frame