java.lang.NoClassDefFoundError: org/apache/spark/streaming/twitter/TwitterUtils$

Stack Overflow | Ahmad S | 3 months ago
  1. 0

    Spark SBT compilation issue

    Stack Overflow | 3 months ago | Ahmad S
    java.lang.NoClassDefFoundError: org/apache/spark/streaming/twitter/TwitterUtils$
  2. 0

    At runtime following error appears: {code} java.lang.NoClassDefFoundError: org/apache/spark/streaming/Duration at java.lang.Class.getDeclaredMethods0(Native Method) at java.lang.Class.privateGetDeclaredMethods(Class.java:2531) at java.lang.Class.getDeclaredMethod(Class.java:2002) at java.io.ObjectStreamClass.getPrivateMethod(ObjectStreamClass.java:1431) at java.io.ObjectStreamClass.access$1700(ObjectStreamClass.java:72) at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:494) at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:468) at java.security.AccessController.doPrivileged(Native Method) at java.io.ObjectStreamClass.<init>(ObjectStreamClass.java:468) at java.io.ObjectStreamClass.lookup(ObjectStreamClass.java:365) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1133) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:347) at org.apache.spark.serializer.JavaSerializationStream.writeObject(JavaSerializer.scala:42) at org.apache.spark.serializer.JavaSerializerInstance.serialize(JavaSerializer.scala:73) at org.apache.spark.util.ClosureCleaner$.ensureSerializable(ClosureCleaner.scala:164) at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:158) at org.apache.spark.SparkContext.clean(SparkContext.scala:1478) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1319) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1339) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1360) at com.datastax.spark.connector.RDDFunctions.saveToCassandra(RDDFunctions.scala:36) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3$$anonfun$apply$2.apply$mcV$sp(ThingsEventsJob.scala:86) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3$$anonfun$apply$2.apply(ThingsEventsJob.scala:85) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3$$anonfun$apply$2.apply(ThingsEventsJob.scala:85) at scala.util.Try$.apply(Try.scala:161) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3.apply(ThingsEventsJob.scala:85) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3.apply(ThingsEventsJob.scala:79) at scala.collection.immutable.Set$Set1.foreach(Set.scala:74) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob.<init>(ThingsEventsJob.scala:79) at com.virdata.core.compute.jobs.thingsevents.Main$delayedInit$body.apply(Main.scala:69) at scala.Function0$class.apply$mcV$sp(Function0.scala:40) at scala.runtime.AbstractFunction0.apply$mcV$sp(AbstractFunction0.scala:12) at scala.App$$anonfun$main$1.apply(App.scala:71) at scala.App$$anonfun$main$1.apply(App.scala:71) at scala.collection.immutable.List.foreach(List.scala:318) at scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:32) at scala.App$class.main(App.scala:71) at com.virdata.core.compute.jobs.thingsevents.Main$.main(Main.scala:9) at com.virdata.devops.common.cukes.base.GenericSteps$$anonfun$15.apply(GenericSteps.scala:134) at com.virdata.devops.common.cukes.base.GenericSteps$$anonfun$15.apply(GenericSteps.scala:113) at cucumber.api.scala.ScalaDsl$StepBody$$anonfun$apply$3.applyOrElse(ScalaDsl.scala:103) at cucumber.api.scala.ScalaDsl$StepBody$$anonfun$apply$3.applyOrElse(ScalaDsl.scala:101) at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:33) at cucumber.runtime.scala.ScalaStepDefinition.execute(ScalaStepDefinition.scala:71) at cucumber.runtime.StepDefinitionMatch.runStep(StepDefinitionMatch.java:38) at cucumber.runtime.Runtime.runStep(Runtime.java:289) at cucumber.runtime.model.StepContainer.runStep(StepContainer.java:44) at cucumber.runtime.model.StepContainer.runSteps(StepContainer.java:39) at cucumber.runtime.model.CucumberScenario.run(CucumberScenario.java:40) at cucumber.runtime.junit.ExecutionUnitRunner.run(ExecutionUnitRunner.java:83) at cucumber.runtime.junit.FeatureRunner.runChild(FeatureRunner.java:63) at cucumber.runtime.junit.FeatureRunner.runChild(FeatureRunner.java:18) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at cucumber.runtime.junit.FeatureRunner.run(FeatureRunner.java:70) at cucumber.api.junit.Cucumber.runChild(Cucumber.java:82) at cucumber.api.junit.Cucumber.runChild(Cucumber.java:41) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at cucumber.api.junit.Cucumber.run(Cucumber.java:87) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) at ?.When an App 'com.virdata.core.compute.jobs.thingsevents.Main' with arguments:(features/devcluster.feature:29) Caused by: java.lang.ClassNotFoundException: org.apache.spark.streaming.Duration at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at java.lang.Class.getDeclaredMethods0(Native Method) at java.lang.Class.privateGetDeclaredMethods(Class.java:2531) at java.lang.Class.getDeclaredMethod(Class.java:2002) at java.io.ObjectStreamClass.getPrivateMethod(ObjectStreamClass.java:1431) at java.io.ObjectStreamClass.access$1700(ObjectStreamClass.java:72) at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:494) at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:468) at java.security.AccessController.doPrivileged(Native Method) at java.io.ObjectStreamClass.<init>(ObjectStreamClass.java:468) at java.io.ObjectStreamClass.lookup(ObjectStreamClass.java:365) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1133) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:347) at org.apache.spark.serializer.JavaSerializationStream.writeObject(JavaSerializer.scala:42) at org.apache.spark.serializer.JavaSerializerInstance.serialize(JavaSerializer.scala:73) at org.apache.spark.util.ClosureCleaner$.ensureSerializable(ClosureCleaner.scala:164) at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:158) at org.apache.spark.SparkContext.clean(SparkContext.scala:1478) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1319) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1339) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1360) at com.datastax.spark.connector.RDDFunctions.saveToCassandra(RDDFunctions.scala:36) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3$$anonfun$apply$2.apply$mcV$sp(ThingsEventsJob.scala:86) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3$$anonfun$apply$2.apply(ThingsEventsJob.scala:85) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3$$anonfun$apply$2.apply(ThingsEventsJob.scala:85) at scala.util.Try$.apply(Try.scala:161) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3.apply(ThingsEventsJob.scala:85) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3.apply(ThingsEventsJob.scala:79) at scala.collection.immutable.Set$Set1.foreach(Set.scala:74) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob.<init>(ThingsEventsJob.scala:79) at com.virdata.core.compute.jobs.thingsevents.Main$delayedInit$body.apply(Main.scala:69) at scala.Function0$class.apply$mcV$sp(Function0.scala:40) at scala.runtime.AbstractFunction0.apply$mcV$sp(AbstractFunction0.scala:12) at scala.App$$anonfun$main$1.apply(App.scala:71) at scala.App$$anonfun$main$1.apply(App.scala:71) at scala.collection.immutable.List.foreach(List.scala:318) at scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:32) at scala.App$class.main(App.scala:71) at com.virdata.core.compute.jobs.thingsevents.Main$.main(Main.scala:9) at com.virdata.devops.common.cukes.base.GenericSteps$$anonfun$15.apply(GenericSteps.scala:134) at com.virdata.devops.common.cukes.base.GenericSteps$$anonfun$15.apply(GenericSteps.scala:113) at cucumber.api.scala.ScalaDsl$StepBody$$anonfun$apply$3.applyOrElse(ScalaDsl.scala:103) at cucumber.api.scala.ScalaDsl$StepBody$$anonfun$apply$3.applyOrElse(ScalaDsl.scala:101) at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:33) at cucumber.runtime.scala.ScalaStepDefinition.execute(ScalaStepDefinition.scala:71) at cucumber.runtime.StepDefinitionMatch.runStep(StepDefinitionMatch.java:38) at cucumber.runtime.Runtime.runStep(Runtime.java:289) at cucumber.runtime.model.StepContainer.runStep(StepContainer.java:44) at cucumber.runtime.model.StepContainer.runSteps(StepContainer.java:39) at cucumber.runtime.model.CucumberScenario.run(CucumberScenario.java:40) at cucumber.runtime.junit.ExecutionUnitRunner.run(ExecutionUnitRunner.java:83) at cucumber.runtime.junit.FeatureRunner.runChild(FeatureRunner.java:63) at cucumber.runtime.junit.FeatureRunner.runChild(FeatureRunner.java:18) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at cucumber.runtime.junit.FeatureRunner.run(FeatureRunner.java:70) at cucumber.api.junit.Cucumber.runChild(Cucumber.java:82) at cucumber.api.junit.Cucumber.runChild(Cucumber.java:41) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at cucumber.api.junit.Cucumber.run(Cucumber.java:87) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) {code}

    DataStax JIRA | 2 years ago | Nathan Bijnens
    java.lang.NoClassDefFoundError: org/apache/spark/streaming/Duration
  3. 0

    At runtime following error appears: {code} java.lang.NoClassDefFoundError: org/apache/spark/streaming/Duration at java.lang.Class.getDeclaredMethods0(Native Method) at java.lang.Class.privateGetDeclaredMethods(Class.java:2531) at java.lang.Class.getDeclaredMethod(Class.java:2002) at java.io.ObjectStreamClass.getPrivateMethod(ObjectStreamClass.java:1431) at java.io.ObjectStreamClass.access$1700(ObjectStreamClass.java:72) at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:494) at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:468) at java.security.AccessController.doPrivileged(Native Method) at java.io.ObjectStreamClass.<init>(ObjectStreamClass.java:468) at java.io.ObjectStreamClass.lookup(ObjectStreamClass.java:365) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1133) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:347) at org.apache.spark.serializer.JavaSerializationStream.writeObject(JavaSerializer.scala:42) at org.apache.spark.serializer.JavaSerializerInstance.serialize(JavaSerializer.scala:73) at org.apache.spark.util.ClosureCleaner$.ensureSerializable(ClosureCleaner.scala:164) at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:158) at org.apache.spark.SparkContext.clean(SparkContext.scala:1478) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1319) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1339) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1360) at com.datastax.spark.connector.RDDFunctions.saveToCassandra(RDDFunctions.scala:36) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3$$anonfun$apply$2.apply$mcV$sp(ThingsEventsJob.scala:86) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3$$anonfun$apply$2.apply(ThingsEventsJob.scala:85) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3$$anonfun$apply$2.apply(ThingsEventsJob.scala:85) at scala.util.Try$.apply(Try.scala:161) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3.apply(ThingsEventsJob.scala:85) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3.apply(ThingsEventsJob.scala:79) at scala.collection.immutable.Set$Set1.foreach(Set.scala:74) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob.<init>(ThingsEventsJob.scala:79) at com.virdata.core.compute.jobs.thingsevents.Main$delayedInit$body.apply(Main.scala:69) at scala.Function0$class.apply$mcV$sp(Function0.scala:40) at scala.runtime.AbstractFunction0.apply$mcV$sp(AbstractFunction0.scala:12) at scala.App$$anonfun$main$1.apply(App.scala:71) at scala.App$$anonfun$main$1.apply(App.scala:71) at scala.collection.immutable.List.foreach(List.scala:318) at scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:32) at scala.App$class.main(App.scala:71) at com.virdata.core.compute.jobs.thingsevents.Main$.main(Main.scala:9) at com.virdata.devops.common.cukes.base.GenericSteps$$anonfun$15.apply(GenericSteps.scala:134) at com.virdata.devops.common.cukes.base.GenericSteps$$anonfun$15.apply(GenericSteps.scala:113) at cucumber.api.scala.ScalaDsl$StepBody$$anonfun$apply$3.applyOrElse(ScalaDsl.scala:103) at cucumber.api.scala.ScalaDsl$StepBody$$anonfun$apply$3.applyOrElse(ScalaDsl.scala:101) at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:33) at cucumber.runtime.scala.ScalaStepDefinition.execute(ScalaStepDefinition.scala:71) at cucumber.runtime.StepDefinitionMatch.runStep(StepDefinitionMatch.java:38) at cucumber.runtime.Runtime.runStep(Runtime.java:289) at cucumber.runtime.model.StepContainer.runStep(StepContainer.java:44) at cucumber.runtime.model.StepContainer.runSteps(StepContainer.java:39) at cucumber.runtime.model.CucumberScenario.run(CucumberScenario.java:40) at cucumber.runtime.junit.ExecutionUnitRunner.run(ExecutionUnitRunner.java:83) at cucumber.runtime.junit.FeatureRunner.runChild(FeatureRunner.java:63) at cucumber.runtime.junit.FeatureRunner.runChild(FeatureRunner.java:18) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at cucumber.runtime.junit.FeatureRunner.run(FeatureRunner.java:70) at cucumber.api.junit.Cucumber.runChild(Cucumber.java:82) at cucumber.api.junit.Cucumber.runChild(Cucumber.java:41) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at cucumber.api.junit.Cucumber.run(Cucumber.java:87) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) at ?.When an App 'com.virdata.core.compute.jobs.thingsevents.Main' with arguments:(features/devcluster.feature:29) Caused by: java.lang.ClassNotFoundException: org.apache.spark.streaming.Duration at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at java.lang.Class.getDeclaredMethods0(Native Method) at java.lang.Class.privateGetDeclaredMethods(Class.java:2531) at java.lang.Class.getDeclaredMethod(Class.java:2002) at java.io.ObjectStreamClass.getPrivateMethod(ObjectStreamClass.java:1431) at java.io.ObjectStreamClass.access$1700(ObjectStreamClass.java:72) at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:494) at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:468) at java.security.AccessController.doPrivileged(Native Method) at java.io.ObjectStreamClass.<init>(ObjectStreamClass.java:468) at java.io.ObjectStreamClass.lookup(ObjectStreamClass.java:365) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1133) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:347) at org.apache.spark.serializer.JavaSerializationStream.writeObject(JavaSerializer.scala:42) at org.apache.spark.serializer.JavaSerializerInstance.serialize(JavaSerializer.scala:73) at org.apache.spark.util.ClosureCleaner$.ensureSerializable(ClosureCleaner.scala:164) at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:158) at org.apache.spark.SparkContext.clean(SparkContext.scala:1478) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1319) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1339) at org.apache.spark.SparkContext.runJob(SparkContext.scala:1360) at com.datastax.spark.connector.RDDFunctions.saveToCassandra(RDDFunctions.scala:36) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3$$anonfun$apply$2.apply$mcV$sp(ThingsEventsJob.scala:86) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3$$anonfun$apply$2.apply(ThingsEventsJob.scala:85) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3$$anonfun$apply$2.apply(ThingsEventsJob.scala:85) at scala.util.Try$.apply(Try.scala:161) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3.apply(ThingsEventsJob.scala:85) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob$$anonfun$3.apply(ThingsEventsJob.scala:79) at scala.collection.immutable.Set$Set1.foreach(Set.scala:74) at com.virdata.core.compute.jobs.thingsevents.ThingsEventsJob.<init>(ThingsEventsJob.scala:79) at com.virdata.core.compute.jobs.thingsevents.Main$delayedInit$body.apply(Main.scala:69) at scala.Function0$class.apply$mcV$sp(Function0.scala:40) at scala.runtime.AbstractFunction0.apply$mcV$sp(AbstractFunction0.scala:12) at scala.App$$anonfun$main$1.apply(App.scala:71) at scala.App$$anonfun$main$1.apply(App.scala:71) at scala.collection.immutable.List.foreach(List.scala:318) at scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:32) at scala.App$class.main(App.scala:71) at com.virdata.core.compute.jobs.thingsevents.Main$.main(Main.scala:9) at com.virdata.devops.common.cukes.base.GenericSteps$$anonfun$15.apply(GenericSteps.scala:134) at com.virdata.devops.common.cukes.base.GenericSteps$$anonfun$15.apply(GenericSteps.scala:113) at cucumber.api.scala.ScalaDsl$StepBody$$anonfun$apply$3.applyOrElse(ScalaDsl.scala:103) at cucumber.api.scala.ScalaDsl$StepBody$$anonfun$apply$3.applyOrElse(ScalaDsl.scala:101) at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:33) at cucumber.runtime.scala.ScalaStepDefinition.execute(ScalaStepDefinition.scala:71) at cucumber.runtime.StepDefinitionMatch.runStep(StepDefinitionMatch.java:38) at cucumber.runtime.Runtime.runStep(Runtime.java:289) at cucumber.runtime.model.StepContainer.runStep(StepContainer.java:44) at cucumber.runtime.model.StepContainer.runSteps(StepContainer.java:39) at cucumber.runtime.model.CucumberScenario.run(CucumberScenario.java:40) at cucumber.runtime.junit.ExecutionUnitRunner.run(ExecutionUnitRunner.java:83) at cucumber.runtime.junit.FeatureRunner.runChild(FeatureRunner.java:63) at cucumber.runtime.junit.FeatureRunner.runChild(FeatureRunner.java:18) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at cucumber.runtime.junit.FeatureRunner.run(FeatureRunner.java:70) at cucumber.api.junit.Cucumber.runChild(Cucumber.java:82) at cucumber.api.junit.Cucumber.runChild(Cucumber.java:41) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at cucumber.api.junit.Cucumber.run(Cucumber.java:87) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) {code}

    DataStax JIRA | 2 years ago | Nathan Bijnens
    java.lang.NoClassDefFoundError: org/apache/spark/streaming/Duration
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    org.apache.spark.examples.streaming.JavaKafkaWordC... - Cloudera Community

    cloudera.com | 1 year ago
    java.lang.NoClassDefFoundError: org/apache/spark/streaming/kafka/KafkaUtils
  6. 0

    org.apache.spark.examples.streaming.JavaKafkaWordC... - Cloudera Community

    cloudera.com | 1 year ago
    java.lang.NoClassDefFoundError: org/apache/spark/streaming/kafka/KafkaUtils

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.NoClassDefFoundError

      org/apache/spark/streaming/twitter/TwitterUtils$

      at dot.state.fl.us.PrintTweets$.main()
    2. dot.state.fl
      PrintTweets.main
      1. dot.state.fl.us.PrintTweets$.main(PrintTweets.scala:29)
      2. dot.state.fl.us.PrintTweets.main(PrintTweets.scala)
      2 frames