java.lang.IllegalStateException: can't find Spark conf; please set SPARK_HOME or SPARK_CONF_DIR

GitHub | santoshhdandin | 1 month ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    Sprak Job( master yarn-culster ) is not visible in Dr.Elephant UI

    GitHub | 1 month ago | santoshhdandin
    java.lang.IllegalStateException: can't find Spark conf; please set SPARK_HOME or SPARK_CONF_DIR
  2. 0

    GitHub comment 192#274839747

    GitHub | 1 month ago | santoshhdandin
    java.lang.IllegalArgumentException: requirement failed
  3. 0

    GitHub comment 192#275743461

    GitHub | 1 month ago | santoshhdandin
    javax.ws.rs.NotFoundException: HTTP 404 Not Found
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    GitHub comment 192#275827403

    GitHub | 1 month ago | santoshhdandin
    java.lang.IllegalArgumentException: spark.eventLog.dir must be provided as webhdfs:// or hdfs://; if hdfs, dfs.namenode.http-address must also be provided for port

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.IllegalStateException

      can't find Spark conf; please set SPARK_HOME or SPARK_CONF_DIR

      at com.linkedin.drelephant.spark.fetchers.SparkFetcher.sparkConf$lzycompute()
    2. com.linkedin.drelephant
      ElephantRunner$ExecutorJob.run
      1. com.linkedin.drelephant.spark.fetchers.SparkFetcher.sparkConf$lzycompute(SparkFetcher.scala:52)
      2. com.linkedin.drelephant.spark.fetchers.SparkFetcher.sparkConf(SparkFetcher.scala:48)
      3. com.linkedin.drelephant.spark.fetchers.SparkFetcher.sparkRestClient$lzycompute(SparkFetcher.scala:57)
      4. com.linkedin.drelephant.spark.fetchers.SparkFetcher.sparkRestClient(SparkFetcher.scala:57)
      5. com.linkedin.drelephant.spark.fetchers.SparkFetcher.fetchData(SparkFetcher.scala:68)
      6. com.linkedin.drelephant.spark.fetchers.SparkFetcher.fetchData(SparkFetcher.scala:37)
      7. com.linkedin.drelephant.analysis.AnalyticJob.getAnalysis(AnalyticJob.java:233)
      8. com.linkedin.drelephant.ElephantRunner$ExecutorJob.run(ElephantRunner.java:177)
      8 frames
    3. Java RT
      Thread.run
      1. java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      2. java.util.concurrent.FutureTask.run(FutureTask.java:266)
      3. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      4. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      5. java.lang.Thread.run(Thread.java:745)
      5 frames