java.lang.IllegalArgumentException: Unknown/unsupported param List(--executor-memory, 0.5g, --executor-cores, 2, --primary-py-file, s3://<mybucketname>/mypythonfile.py, --class, org.apache.spark.deploy.PythonRunner) Usage: org.apache.spark.deploy.yarn.Client [options] Options: --jar JAR_PATH Path to your application's JAR file (required in yarn-cluster mode) . . .

Stack Overflow | Gopala | 8 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    amazon emr spark submission from S3 not working

    Stack Overflow | 8 months ago | Gopala
    java.lang.IllegalArgumentException: Unknown/unsupported param List(--executor-memory, 0.5g, --executor-cores, 2, --primary-py-file, s3://<mybucketname>/mypythonfile.py, --class, org.apache.spark.deploy.PythonRunner) Usage: org.apache.spark.deploy.yarn.Client [options] Options: --jar JAR_PATH Path to your application's JAR file (required in yarn-cluster mode) . . .
  2. 0

    How to specify multiple dependencies using --packages for spark-submit?

    Stack Overflow | 1 year ago | davidpricedev
    java.lang.IllegalArgumentException: Given path is malformed: org.apache.hbase:hbase-common:1.0.0

    Root Cause Analysis

    1. java.lang.IllegalArgumentException

      Unknown/unsupported param List(--executor-memory, 0.5g, --executor-cores, 2, --primary-py-file, s3://<mybucketname>/mypythonfile.py, --class, org.apache.spark.deploy.PythonRunner) Usage: org.apache.spark.deploy.yarn.Client [options] Options: --jar JAR_PATH Path to your application's JAR file (required in yarn-cluster mode) . . .

      at org.apache.spark.deploy.SparkSubmit$.main()
    2. Spark
      SparkSubmit.main
      1. org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
      2. org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
      2 frames