java.lang.IllegalStateException: can't find Spark conf; please set SPARK_HOME or SPARK_CONF_DIR

GitHub | santoshhdandin | 3 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    Sprak Job( master yarn-culster ) is not visible in Dr.Elephant UI

    GitHub | 3 months ago | santoshhdandin
    java.lang.IllegalStateException: can't find Spark conf; please set SPARK_HOME or SPARK_CONF_DIR
  2. 0

    GitHub comment 192#274839747

    GitHub | 3 months ago | santoshhdandin
    java.lang.IllegalArgumentException: requirement failed
  3. 0

    GitHub comment 192#275743461

    GitHub | 3 months ago | santoshhdandin
    javax.ws.rs.NotFoundException: HTTP 404 Not Found
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    GitHub comment 192#275827403

    GitHub | 3 months ago | santoshhdandin
    java.lang.IllegalArgumentException: spark.eventLog.dir must be provided as webhdfs:// or hdfs://; if hdfs, dfs.namenode.http-address must also be provided for port

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.IllegalStateException

      can't find Spark conf; please set SPARK_HOME or SPARK_CONF_DIR

      at com.linkedin.drelephant.spark.fetchers.SparkFetcher.sparkConf$lzycompute()
    2. com.linkedin.drelephant
      ElephantRunner$ExecutorJob.run
      1. com.linkedin.drelephant.spark.fetchers.SparkFetcher.sparkConf$lzycompute(SparkFetcher.scala:52)
      2. com.linkedin.drelephant.spark.fetchers.SparkFetcher.sparkConf(SparkFetcher.scala:48)
      3. com.linkedin.drelephant.spark.fetchers.SparkFetcher.sparkRestClient$lzycompute(SparkFetcher.scala:57)
      4. com.linkedin.drelephant.spark.fetchers.SparkFetcher.sparkRestClient(SparkFetcher.scala:57)
      5. com.linkedin.drelephant.spark.fetchers.SparkFetcher.fetchData(SparkFetcher.scala:68)
      6. com.linkedin.drelephant.spark.fetchers.SparkFetcher.fetchData(SparkFetcher.scala:37)
      7. com.linkedin.drelephant.analysis.AnalyticJob.getAnalysis(AnalyticJob.java:233)
      8. com.linkedin.drelephant.ElephantRunner$ExecutorJob.run(ElephantRunner.java:177)
      8 frames
    3. Java RT
      Thread.run
      1. java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      2. java.util.concurrent.FutureTask.run(FutureTask.java:266)
      3. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      4. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      5. java.lang.Thread.run(Thread.java:745)
      5 frames