java.lang.IllegalArgumentException: spark.eventLog.dir must be provided as webhdfs:// or hdfs://; if hdfs, dfs.namenode.http-address must also be provided for port

GitHub | santoshhdandin | 3 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    GitHub comment 192#275827403

    GitHub | 3 months ago | santoshhdandin
    java.lang.IllegalArgumentException: spark.eventLog.dir must be provided as webhdfs:// or hdfs://; if hdfs, dfs.namenode.http-address must also be provided for port
  2. 0

    Sprak Job( master yarn-culster ) is not visible in Dr.Elephant UI

    GitHub | 3 months ago | santoshhdandin
    java.lang.IllegalStateException: can't find Spark conf; please set SPARK_HOME or SPARK_CONF_DIR
  3. 0

    GitHub comment 192#274839747

    GitHub | 3 months ago | santoshhdandin
    java.lang.IllegalArgumentException: requirement failed
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    GitHub comment 192#275743461

    GitHub | 3 months ago | santoshhdandin
    javax.ws.rs.NotFoundException: HTTP 404 Not Found

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.IllegalArgumentException

      spark.eventLog.dir must be provided as webhdfs:// or hdfs://; if hdfs, dfs.namenode.http-address must also be provided for port

      at com.linkedin.drelephant.spark.fetchers.SparkLogClient.<init>()
    2. com.linkedin.drelephant
      SparkFetcher.sparkLogClient$lzycompute
      1. com.linkedin.drelephant.spark.fetchers.SparkLogClient.<init>(SparkLogClient.scala:62)
      2. com.linkedin.drelephant.spark.fetchers.SparkFetcher.sparkLogClient$lzycompute(SparkFetcher.scala:61)
      2 frames