scheduler.TaskSetManager: Lost task 1.0 in stage 1.0 (TID 17, hdp115-yarn.prod.ne.lan): java.lang.NoClassDefFoundError: Could not initialize class org.elasticsearch.threadpool.ThreadPool

GitHub | arturekbb | 8 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    Gauva version conflict when using with Apache Spark

    GitHub | 8 months ago | arturekbb
    scheduler.TaskSetManager: Lost task 1.0 in stage 1.0 (TID 17, hdp115-yarn.prod.ne.lan): java.lang.NoClassDefFoundError: Could not initialize class org.elasticsearch.threadpool.ThreadPool

    Root Cause Analysis

    1. scheduler.TaskSetManager

      Lost task 1.0 in stage 1.0 (TID 17, hdp115-yarn.prod.ne.lan): java.lang.NoClassDefFoundError: Could not initialize class org.elasticsearch.threadpool.ThreadPool

      at org.elasticsearch.client.transport.TransportClient$Builder.build()
    2. ElasticSearch
      TransportClient$Builder.build
      1. org.elasticsearch.client.transport.TransportClient$Builder.build(TransportClient.java:131)
      1 frame
    3. com.sksamuel.elastic4s
      ElasticClient$.remote
      1. com.sksamuel.elastic4s.ElasticClient$.transport(ElasticClient.scala:103)
      2. com.sksamuel.elastic4s.ElasticClient$.remote(ElasticClient.scala:111)
      2 frames
    4. com.hgintelligence
      MyJob$$anonfun$doMyJobOnRDD$3.apply
      1. com.hgintelligence.EsFetcher.<init>(EsFetcher.scala:18)
      2. com.hgintelligence.MyJob$$anonfun$doMyJobOnRDD$3.apply(MyJob.scala:47)
      3. com.hgintelligence.MyJob$$anonfun$doMyJobOnRDD$3.apply(MyJob.scala:46)
      3 frames
    5. Spark
      Executor$TaskRunner.run
      1. org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$29.apply(RDD.scala:878)
      2. org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$29.apply(RDD.scala:878)
      3. org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1767)
      4. org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1767)
      5. org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:63)
      6. org.apache.spark.scheduler.Task.run(Task.scala:70)
      7. org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
      7 frames
    6. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      3. java.lang.Thread.run(Thread.java:745)
      3 frames