java.lang.reflect.InvocationTargetException

tip

This might be an issue with the file location in the Spark submit command. Try it with "spark-submit --master spark://master:7077 hello_world_from_pyspark.py {file location}"

tip

Check if you've set a name in Application -> Run. If you didn't, the generated XML is gonna have missing information and then this exception will be thrown.

tip

A few things cause this exception: 1) Check if you have all jars and if they're in the correct path when running. 2) Your classpath might be broken, you can define it in the command line with "java -cp yourClassPath" or at your IDE if you're using one.

tip

Needs to add netty-transport-native-epoll with a OS classifier to the classpath, it's not included in netty-all

You have a different solution? A short tip here would help you and many other users who saw this issue last week.

  • Gatling Jenkins integration gives error
    via by Krishna Kumar C,
  • Running scala-library in the IDE
    via by Simon Schäfer,
  • Error in spark-submit but not in pyspark
    via Stack Overflow by nanounanue
    ,
  • GitHub comment 2886#275626070
    via GitHub by jheijkoop
    ,
  • Scala 2.11 support?
    via GitHub by Hydrotoast
    ,
  • command line interface is failing when i tried to load 1gb file. I tried to increase the memory using command line I am getting fallowing error. can you please advice how i can work around it? [root@bda1node03 forecast]# flags="-Xmx2048m" kite-dataset csv-import AccuWeatherForecast11222015.csv ctest1 Exception in thread "main" java.lang.ClassNotFoundException: -Xmx2048m at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.hadoop.util.RunJar.run(RunJar.java:214) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) ---------------------------------------------------------------------------- Exception in thread "main" java.lang.OutOfMemoryError: Java heap space: failed reallocation of scalar replaced objects at java.util.Arrays.copyOfRange(Arrays.java:3664) at java.lang.String.<init>(String.java:201) at java.lang.StringBuilder.toString(StringBuilder.java:407) at au.com.bytecode.opencsv.CSVParser.parseLine(CSVParser.java:250) at au.com.bytecode.opencsv.CSVParser.parseLineMulti(CSVParser.java:174) at au.com.bytecode.opencsv.CSVReader.readNext(CSVReader.java:237) at org.kitesdk.data.spi.filesystem.CSVFileReader.advance(CSVFileReader.java:174) at org.kitesdk.data.spi.filesystem.CSVFileReader.next(CSVFileReader.java:168) at org.kitesdk.shaded.com.google.common.collect.Iterators$7.computeNext(Iterators.java:648) at org.kitesdk.shaded.com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) at org.kitesdk.shaded.com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) at org.kitesdk.data.spi.filesystem.MultiFileDatasetReader.hasNext(MultiFileDatasetReader.java:125) at com.google.common.collect.Lists.newArrayList(Lists.java:138) at com.google.common.collect.ImmutableList.copyOf(ImmutableList.java:256) at com.google.common.collect.ImmutableList.copyOf(ImmutableList.java:217) at org.apache.crunch.impl.mem.collect.MemCollection.<init>(MemCollection.java:79) at org.apache.crunch.impl.mem.MemPipeline.read(MemPipeline.java:166) at org.apache.crunch.impl.mem.MemPipeline.read(MemPipeline.java:157) at org.kitesdk.tools.TransformTask.run(TransformTask.java:135) at org.kitesdk.cli.commands.CSVImportCommand.run(CSVImportCommand.java:186) at org.kitesdk.cli.Main.run(Main.java:178) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.kitesdk.cli.Main.main(Main.java:256) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) [root@bda1node03 forecast]# vi test6.csv
    via by chandra s koripella,
    • java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at io.gatling.mojo.MainWithArgsInFile.runMain(MainWithArgsInFile.java:50) at io.gatling.mojo.MainWithArgsInFile.main(MainWithArgsInFile.java:33) Caused by: sbt.InvalidScalaInstance: Scala instance doesn't exist or is invalid: version unknown, library jar: /java2/maven-repo/org/scala-lang/scala-library/2.11.8/scala-library-2.11.8.jar, compiler jar: /java2/maven-repo/org/scala-lang/scala-compiler/2.11.8/scala-compiler-2.11.8.jar at sbt.ScalaInstance$.slowActualVersion(ScalaInstance.scala:125) at sbt.ScalaInstance$.sbt$ScalaInstance$$actualVersion(ScalaInstance.scala:122) at sbt.ScalaInstance$$anonfun$actualVersion$1.apply(ScalaInstance.scala:36) at sbt.ScalaInstance$$anonfun$actualVersion$1.apply(ScalaInstance.scala:36) at scala.Option.getOrElse(Option.scala:120) at sbt.ScalaInstance.actualVersion$lzycompute(ScalaInstance.scala:36) at sbt.ScalaInstance.actualVersion(ScalaInstance.scala:36) at com.typesafe.zinc.Compiler$.compilerInterface(Compiler.scala:144) at com.typesafe.zinc.Compiler$.create(Compiler.scala:53) at io.gatling.compiler.ZincCompiler$delayedInit$body.apply(ZincCompiler.scala:148) at scala.Function0$class.apply$mcV$sp(Function0.scala:40) at scala.runtime.AbstractFunction0.apply$mcV$sp(AbstractFunction0.scala:12) at scala.App$$anonfun$main$1.apply(App.scala:71) at scala.App$$anonfun$main$1.apply(App.scala:71) at scala.collection.immutable.List.foreach(List.scala:318) at scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:32) at scala.App$class.main(App.scala:71) at io.gatling.compiler.ZincCompiler$.main(ZincCompiler.scala:36) at io.gatling.compiler.ZincCompiler.main(ZincCompiler.scala) ... 6 more Caused by: java.lang.ClassNotFoundException: scala.tools.nsc.Properties at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348)

    Users with the same issue

    jokester
    1 times, last one,
    olle.hallin
    1 times, last one,
    poroszd
    1 times, last one,
    Unknown visitor1 times, last one,
    Unknown visitor1 times, last one,
    1579 more bugmates