java.lang.ClassNotFoundException: mongo.job.input.format=com.mongodb.hadoop.BSONFileInputFormat

JIRA | KenRoy Regester | 2 years ago
  1. 0

    Can someone verify that the enron Amazon Elastic MapReduce example still works? It appears that the way to pass arguments to a custom jar step in an Amazon ElasticMap Reduce Job Flow Step has changed. When using the bson enron example, when the custom jar step is submitted and ran in the Amazon ElasticMap Reduce service as documented, it seems that the jar step is trying to use the '-D' as a class name, and returns a 'ClassNotFoundException: -D' error as seen below: Exception in thread "main" java.lang.ClassNotFoundException: -D at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:270) at org.apache.hadoop.util.RunJar.main(RunJar.java:180) Even after removing the '-D' in the run_emr_job.sh script to see if that will allow the arguments to be passed to the jar it seems to treat the key/value pairs as an actual class, as seen below: Exception in thread "main" java.lang.ClassNotFoundException: mongo.job.input.format=com.mongodb.hadoop.BSONFileInputFormat at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:270) at org.apache.hadoop.util.RunJar.main(RunJar.java:180)

    JIRA | 2 years ago | KenRoy Regester
    java.lang.ClassNotFoundException: mongo.job.input.format=com.mongodb.hadoop.BSONFileInputFormat
  2. 0

    Can someone verify that the enron Amazon Elastic MapReduce example still works? It appears that the way to pass arguments to a custom jar step in an Amazon ElasticMap Reduce Job Flow Step has changed. When using the bson enron example, when the custom jar step is submitted and ran in the Amazon ElasticMap Reduce service as documented, it seems that the jar step is trying to use the '-D' as a class name, and returns a 'ClassNotFoundException: -D' error as seen below: Exception in thread "main" java.lang.ClassNotFoundException: -D at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:270) at org.apache.hadoop.util.RunJar.main(RunJar.java:180) Even after removing the '-D' in the run_emr_job.sh script to see if that will allow the arguments to be passed to the jar it seems to treat the key/value pairs as an actual class, as seen below: Exception in thread "main" java.lang.ClassNotFoundException: mongo.job.input.format=com.mongodb.hadoop.BSONFileInputFormat at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:270) at org.apache.hadoop.util.RunJar.main(RunJar.java:180)

    JIRA | 2 years ago | KenRoy Regester
    java.lang.ClassNotFoundException: mongo.job.input.format=com.mongodb.hadoop.BSONFileInputFormat
  3. 0

    HiveServer Class Not Found Exception

    Stack Overflow | 2 years ago | Gazal Begum
    java.lang.ClassNotFoundException: org.apache.hadoop.hive.service.HiveServer
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    command line interface is failing when i tried to load 1gb file. I tried to increase the memory using command line I am getting fallowing error. can you please advice how i can work around it? [root@bda1node03 forecast]# flags="-Xmx2048m" kite-dataset csv-import AccuWeatherForecast11222015.csv ctest1 Exception in thread "main" java.lang.ClassNotFoundException: -Xmx2048m at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.hadoop.util.RunJar.run(RunJar.java:214) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) ---------------------------------------------------------------------------- Exception in thread "main" java.lang.OutOfMemoryError: Java heap space: failed reallocation of scalar replaced objects at java.util.Arrays.copyOfRange(Arrays.java:3664) at java.lang.String.<init>(String.java:201) at java.lang.StringBuilder.toString(StringBuilder.java:407) at au.com.bytecode.opencsv.CSVParser.parseLine(CSVParser.java:250) at au.com.bytecode.opencsv.CSVParser.parseLineMulti(CSVParser.java:174) at au.com.bytecode.opencsv.CSVReader.readNext(CSVReader.java:237) at org.kitesdk.data.spi.filesystem.CSVFileReader.advance(CSVFileReader.java:174) at org.kitesdk.data.spi.filesystem.CSVFileReader.next(CSVFileReader.java:168) at org.kitesdk.shaded.com.google.common.collect.Iterators$7.computeNext(Iterators.java:648) at org.kitesdk.shaded.com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) at org.kitesdk.shaded.com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) at org.kitesdk.data.spi.filesystem.MultiFileDatasetReader.hasNext(MultiFileDatasetReader.java:125) at com.google.common.collect.Lists.newArrayList(Lists.java:138) at com.google.common.collect.ImmutableList.copyOf(ImmutableList.java:256) at com.google.common.collect.ImmutableList.copyOf(ImmutableList.java:217) at org.apache.crunch.impl.mem.collect.MemCollection.<init>(MemCollection.java:79) at org.apache.crunch.impl.mem.MemPipeline.read(MemPipeline.java:166) at org.apache.crunch.impl.mem.MemPipeline.read(MemPipeline.java:157) at org.kitesdk.tools.TransformTask.run(TransformTask.java:135) at org.kitesdk.cli.commands.CSVImportCommand.run(CSVImportCommand.java:186) at org.kitesdk.cli.Main.run(Main.java:178) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.kitesdk.cli.Main.main(Main.java:256) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) [root@bda1node03 forecast]# vi test6.csv

    Cloudera Open Source | 12 months ago | chandra s koripella
    java.lang.ClassNotFoundException: -Xmx2048m
  6. 0

    Exception in thread "main" java.lang.ClassNotFoundException

    GitHub | 2 years ago | hetong007
    java.lang.ClassNotFoundException: loadtb

  1. gehel 1 times, last 6 days ago
  2. davidvanlaatum 3 times, last 7 days ago
  3. danleyb2Interintel 1 times, last 1 week ago
  4. malhobayyeb 3 times, last 2 weeks ago
  5. Kialandei 1 times, last 2 weeks ago
49 more registered users
46 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.lang.ClassNotFoundException

    mongo.job.input.format=com.mongodb.hadoop.BSONFileInputFormat

    at java.net.URLClassLoader$1.run()
  2. Java RT
    Class.forName
    1. java.net.URLClassLoader$1.run(URLClassLoader.java:366)
    2. java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    3. java.security.AccessController.doPrivileged(Native Method)
    4. java.net.URLClassLoader.findClass(URLClassLoader.java:354)
    5. java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    6. java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    7. java.lang.Class.forName0(Native Method)
    8. java.lang.Class.forName(Class.java:270)
    8 frames
  3. Hadoop
    RunJar.main
    1. org.apache.hadoop.util.RunJar.main(RunJar.java:180)
    1 frame