java.lang.ClassNotFoundException: mongo.job.input.format=com.mongodb.hadoop.BSONFileInputFormat

JIRA | KenRoy Regester | 3 years ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Can someone verify that the enron Amazon Elastic MapReduce example still works? It appears that the way to pass arguments to a custom jar step in an Amazon ElasticMap Reduce Job Flow Step has changed. When using the bson enron example, when the custom jar step is submitted and ran in the Amazon ElasticMap Reduce service as documented, it seems that the jar step is trying to use the '-D' as a class name, and returns a 'ClassNotFoundException: -D' error as seen below: Exception in thread "main" java.lang.ClassNotFoundException: -D at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:270) at org.apache.hadoop.util.RunJar.main(RunJar.java:180) Even after removing the '-D' in the run_emr_job.sh script to see if that will allow the arguments to be passed to the jar it seems to treat the key/value pairs as an actual class, as seen below: Exception in thread "main" java.lang.ClassNotFoundException: mongo.job.input.format=com.mongodb.hadoop.BSONFileInputFormat at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:270) at org.apache.hadoop.util.RunJar.main(RunJar.java:180)

    JIRA | 3 years ago | KenRoy Regester
    java.lang.ClassNotFoundException: mongo.job.input.format=com.mongodb.hadoop.BSONFileInputFormat
  2. 0

    Can someone verify that the enron Amazon Elastic MapReduce example still works? It appears that the way to pass arguments to a custom jar step in an Amazon ElasticMap Reduce Job Flow Step has changed. When using the bson enron example, when the custom jar step is submitted and ran in the Amazon ElasticMap Reduce service as documented, it seems that the jar step is trying to use the '-D' as a class name, and returns a 'ClassNotFoundException: -D' error as seen below: Exception in thread "main" java.lang.ClassNotFoundException: -D at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:270) at org.apache.hadoop.util.RunJar.main(RunJar.java:180) Even after removing the '-D' in the run_emr_job.sh script to see if that will allow the arguments to be passed to the jar it seems to treat the key/value pairs as an actual class, as seen below: Exception in thread "main" java.lang.ClassNotFoundException: mongo.job.input.format=com.mongodb.hadoop.BSONFileInputFormat at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:270) at org.apache.hadoop.util.RunJar.main(RunJar.java:180)

    JIRA | 3 years ago | KenRoy Regester
    java.lang.ClassNotFoundException: mongo.job.input.format=com.mongodb.hadoop.BSONFileInputFormat
  3. 0

    HADOOP :: java.lang.ClassNotFoundException: WordCount

    Stack Overflow | 4 years ago | Ronin
    java.lang.ClassNotFoundException: WordCount
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    How to run WordCount in Amazon EMR?

    Stack Overflow | 2 years ago | kylas
    java.lang.ClassNotFoundException: s3://wordcountbuckett/
  6. 0

    HiveServer Class Not Found Exception

    Stack Overflow | 2 years ago | Gazal Begum
    java.lang.ClassNotFoundException: org.apache.hadoop.hive.service.HiveServer

  1. osvzs 1 times, last 6 days ago
  2. jf-ast 3 times, last 2 weeks ago
  3. jokester 3 times, last 2 weeks ago
  4. jstrayer 3 times, last 3 weeks ago
  5. Andreas Häber 1 times, last 4 weeks ago
66 more registered users
29 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.lang.ClassNotFoundException

    mongo.job.input.format=com.mongodb.hadoop.BSONFileInputFormat

    at java.net.URLClassLoader$1.run()
  2. Java RT
    Class.forName
    1. java.net.URLClassLoader$1.run(URLClassLoader.java:366)
    2. java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    3. java.security.AccessController.doPrivileged(Native Method)
    4. java.net.URLClassLoader.findClass(URLClassLoader.java:354)
    5. java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    6. java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    7. java.lang.Class.forName0(Native Method)
    8. java.lang.Class.forName(Class.java:270)
    8 frames
  3. Hadoop
    RunJar.main
    1. org.apache.hadoop.util.RunJar.main(RunJar.java:180)
    1 frame