java.lang.NoClassDefFoundError: scala/collection/Iterable

Stack Overflow | ayin | 5 months ago
  1. 0

    hive spark Child process exited before connecting back

    Stack Overflow | 7 months ago | Ali Basiri
    java.util.concurrent.ExecutionException: java.lang.RuntimeException: Cancel client '8ffe7ea3-aaf4-456c-ae18-23c572a766c5'. Error: Child process exited before connecting back at io.netty.util.concurrent.AbstractFuture.get(AbstractFuture.java:37) ~[netty-all-4.0.23.Final.jar:4.0.23.Final] at org.apache.hive.spark.client.SparkClientImpl.(SparkClientImpl.java:101) [hive-exec-2.0.0.jar:2.0.0] at org.apache.hive.spark.client.SparkClientFactory.createClient(SparkClientFactory.java:80) [hive-exec-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient.createRemoteClient(RemoteHiveSparkClient.java:98) [hive-exec-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient.(RemoteHiveSparkClient.java:94) [hive-exec-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.ql.exec.spark.HiveSparkClientFactory.createHiveSparkClient(HiveSparkClientFactory.java:63) [hive-exec-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.ql.exec.spark.session.SparkSessionImpl.open(SparkSessionImpl.java:55) [hive-exec-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.ql.exec.spark.session.SparkSessionManagerImpl.getSession(SparkSessionManagerImpl.java:114) [hive-exec-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.ql.exec.spark.SparkUtilities.getSparkSession(SparkUtilities.java:131) [hive-exec-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.ql.exec.spark.SparkTask.execute(SparkTask.java:106) [hive-exec-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:158) [hive-exec-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:101) [hive-exec-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1840) [hive-exec-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1584) [hive-exec-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1361) [hive-exec-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1184) [hive-exec-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1172) [hive-exec-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:233) [hive-cli-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:184) [hive-cli-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:400) [hive-cli-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:778) [hive-cli-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:717) [hive-cli-2.0.0.jar:2.0.0] at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:645) [hive-cli-2.0.0.jar:2.0.0] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_77] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_77] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_77] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_77] at org.apache.hadoop.util.RunJar.run(RunJar.java:221) [spark-assembly-1.6.0-hadoop2.6.0.jar:1.6.0] at org.apache.hadoop.util.RunJar.main(RunJar.java:136) [spark-assembly-1.6.0-hadoop2.6.0.jar:1.6.0] Caused by: java.lang.RuntimeException: Cancel client '8ffe7ea3-aaf4-456c-ae18-23c572a766c5'. Error: Child process exited before connecting back at org.apache.hive.spark.client.rpc.RpcServer.cancelClient(RpcServer.java:180) ~[hive-exec-2.0.0.jar:2.0.0] at org.apache.hive.spark.client.SparkClientImpl$3.run(SparkClientImpl.java:450) ~[hive-exec-2.0.0.jar:2.0.0] at java.lang.Thread.run(Thread.java:745) ~[?:1.8.0_77] 16/05/16 18:00:33 [Driver]: WARN client.SparkClientImpl: Child process exited with code 1 I have built Spark 1.6.1 and hive 2.0.0 so the error has been changed to: Exception in thread "main" java.lang.NoClassDefFoundError: scala/collection/Iterable
  2. 0

    Encounter a no class def found error after a fresh install activator-1.2.3

    GitHub | 2 years ago | nicholasren
    java.lang.NoClassDefFoundError: activator/properties/ActivatorProperties
  3. Speed up your debug routine!

    Automated exception search integrated into your IDE

  4. 0

    Activator will not start -- java.lang.NoClassDefFoundError: activator/properties/ActivatorProperties

    GitHub | 3 years ago | dbaxa
    java.lang.NoClassDefFoundError: activator/properties/ActivatorProperties
  5. 0

    Fresh install fails "NoClassDefFoundError: activator/properties/ActivatorProperties"

    GitHub | 2 years ago | michaeldfallen
    java.lang.NoClassDefFoundError: activator/properties/ActivatorProperties
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.lang.ClassNotFoundException

    scala.collection.Iterable

    at java.net.URLClassLoader.findClass()
  2. Java RT
    ClassLoader.loadClass
    1. java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    2. java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    3. sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
    4. java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    4 frames
  3. org.apache.hadoop
    SetSparkReducerParallelism.process
    1. org.apache.hadoop.hive.ql.optimizer.spark.SetSparkReducerParallelism.process(SetSparkReducerParallelism.java:117)
    1 frame
  4. Hive Query Language
    DefaultGraphWalker.startWalking
    1. org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
    2. org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:105)
    3. org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:89)
    4. org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.walk(DefaultGraphWalker.java:158)
    5. org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:120)
    5 frames
  5. org.apache.hadoop
    SparkCompiler.optimizeOperatorPlan
    1. org.apache.hadoop.hive.ql.parse.spark.SparkCompiler.runJoinOptimizations(SparkCompiler.java:178)
    2. org.apache.hadoop.hive.ql.parse.spark.SparkCompiler.optimizeOperatorPlan(SparkCompiler.java:116)
    2 frames
  6. Hive Query Language
    Driver.run
    1. org.apache.hadoop.hive.ql.parse.TaskCompiler.compile(TaskCompiler.java:134)
    2. org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10857)
    3. org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:239)
    4. org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:250)
    5. org.apache.hadoop.hive.ql.Driver.compile(Driver.java:437)
    6. org.apache.hadoop.hive.ql.Driver.compile(Driver.java:329)
    7. org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1158)
    8. org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1253)
    9. org.apache.hadoop.hive.ql.Driver.run(Driver.java:1084)
    10. org.apache.hadoop.hive.ql.Driver.run(Driver.java:1072)
    10 frames
  7. org.apache.hadoop
    CliDriver.main
    1. org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:232)
    2. org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:183)
    3. org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:399)
    4. org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:776)
    5. org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:714)
    6. org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:641)
    6 frames
  8. Java RT
    Method.invoke
    1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    4. java.lang.reflect.Method.invoke(Method.java:498)
    4 frames
  9. Hadoop
    RunJar.main
    1. org.apache.hadoop.util.RunJar.run(RunJar.java:221)
    2. org.apache.hadoop.util.RunJar.main(RunJar.java:136)
    2 frames