scheduler.TaskSetManager: Lost task 0.0 in stage 5.0 (TID 10, rz-data-hdp-dn2113.rz.***.com): java.lang.NoClassDefFoundError: Could not initialize class ml.dmlc.xgboost4j.java.Rabit

GitHub | yxzf | 7 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    [jvm-packages] Running xgboost on the yarn-cluster with the error [/lib64/libc.so.6: version `GLIBC_2.14']

    GitHub | 7 months ago | yxzf
    scheduler.TaskSetManager: Lost task 0.0 in stage 5.0 (TID 10, rz-data-hdp-dn2113.rz.***.com): java.lang.NoClassDefFoundError: Could not initialize class ml.dmlc.xgboost4j.java.Rabit

    Root Cause Analysis

    1. scheduler.TaskSetManager

      Lost task 0.0 in stage 5.0 (TID 10, rz-data-hdp-dn2113.rz.***.com): java.lang.NoClassDefFoundError: Could not initialize class ml.dmlc.xgboost4j.java.Rabit

      at ml.dmlc.xgboost4j.scala.spark.XGBoost$$anonfun$buildDistributedBoosters$1.apply()
    2. ml.dmlc.xgboost4j
      XGBoost$$anonfun$buildDistributedBoosters$1.apply
      1. ml.dmlc.xgboost4j.scala.spark.XGBoost$$anonfun$buildDistributedBoosters$1.apply(XGBoost.scala:63)
      2. ml.dmlc.xgboost4j.scala.spark.XGBoost$$anonfun$buildDistributedBoosters$1.apply(XGBoost.scala:61)
      2 frames
    3. Spark
      Executor$TaskRunner.run
      1. org.apache.spark.rdd.RDD$$anonfun$mapPartitions$1$$anonfun$apply$17.apply(RDD.scala:706)
      2. org.apache.spark.rdd.RDD$$anonfun$mapPartitions$1$$anonfun$apply$17.apply(RDD.scala:706)
      3. org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
      4. org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:297)
      5. org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:69)
      6. org.apache.spark.rdd.RDD.iterator(RDD.scala:262)
      7. org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
      8. org.apache.spark.scheduler.Task.run(Task.scala:88)
      9. org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214)
      9 frames
    4. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      3. java.lang.Thread.run(Thread.java:745)
      3 frames