java.lang.IllegalArgumentException: spark.eventLog.dir must be provided as webhdfs:// or hdfs://; if hdfs, dfs.namenode.http-address must also be provided for port


Solutions on the web1

Solution icon of github
via GitHub by santoshhdandin
, 8 months ago
spark.eventLog.dir must be provided as webhdfs:// or hdfs://; if hdfs, dfs.namenode.http-address must also be provided for port

Stack trace

java.lang.IllegalArgumentException: spark.eventLog.dir must be provided as webhdfs:// or hdfs://; if hdfs, dfs.namenode.http-address must also be provided for port
	at com.linkedin.drelephant.spark.fetchers.SparkLogClient.<init>(SparkLogClient.scala:62)
	at com.linkedin.drelephant.spark.fetchers.SparkFetcher.sparkLogClient$lzycompute(SparkFetcher.scala:61)

Write tip

You have a different solution? A short tip here would help you and many other users who saw this issue last week.

Users with the same issue

You are the first who have seen this exception. Write a tip to help other users and build your expert profile.