java.lang.reflect.InvocationTargetException

GitHub | luobailian | 5 months ago
  1. 0

    Apache Spark User List - java.io.IOException: Filesystem closed

    nabble.com | 1 year ago
    java.lang.reflect.InvocationTargetException
  2. Speed up your debug routine!

    Automated exception search integrated into your IDE

    2 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.io.IOException

      Filesystem closed

      at org.apache.hadoop.hdfs.DFSClient.checkOpen()
    2. Apache Hadoop HDFS
      DFSOutputStream.hflush
      1. org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:795)
      2. org.apache.hadoop.hdfs.DFSOutputStream.flushOrSync(DFSOutputStream.java:1985)
      3. org.apache.hadoop.hdfs.DFSOutputStream.hflush(DFSOutputStream.java:1946)
      3 frames
    3. Hadoop
      FSDataOutputStream.hflush
      1. org.apache.hadoop.fs.FSDataOutputStream.hflush(FSDataOutputStream.java:130)
      1 frame
    4. Java RT
      Method.invoke
      1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      4. java.lang.reflect.Method.invoke(Method.java:483)
      4 frames
    5. Spark
      EventLoggingListener$$anonfun$logEvent$3.apply
      1. org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)
      2. org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)
      2 frames
    6. Scala
      Option.foreach
      1. scala.Option.foreach(Option.scala:236)
      1 frame
    7. Spark
      AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply
      1. org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)
      2. org.apache.spark.scheduler.EventLoggingListener.onUnpersistRDD(EventLoggingListener.scala:186)
      3. org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:50)
      4. org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)
      5. org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)
      6. org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)
      7. org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)
      8. org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)
      9. org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)
      10. org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)
      10 frames
    8. Scala
      DynamicVariable.withValue
      1. scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)
      1 frame
    9. Spark
      AsynchronousListenerBus$$anon$1.run
      1. org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)
      2. org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)
      3. org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)
      3 frames