org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in stage 0.0 (TID 0, localhost): java.net.SocketTimeoutException: connect timed out

Stack Overflow | Alex Yeah | 6 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Spark submit local Executor cannot fetch jar

    Stack Overflow | 6 months ago | Alex Yeah
    org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in stage 0.0 (TID 0, localhost): java.net.SocketTimeoutException: connect timed out

    Root Cause Analysis

    1. org.apache.spark.SparkException

      Job aborted due to stage failure: Task 0 in stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in stage 0.0 (TID 0, localhost): java.net.SocketTimeoutException: connect timed out

      at java.net.PlainSocketImpl.socketConnect()
    2. Java RT
      HttpURLConnection.connect
      1. java.net.PlainSocketImpl.socketConnect(Native Method)
      2. java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
      3. java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
      4. java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
      5. java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
      6. java.net.Socket.connect(Socket.java:589)
      7. sun.net.NetworkClient.doConnect(NetworkClient.java:175)
      8. sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
      9. sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
      10. sun.net.www.http.HttpClient.<init>(HttpClient.java:211)
      11. sun.net.www.http.HttpClient.New(HttpClient.java:308)
      12. sun.net.www.http.HttpClient.New(HttpClient.java:326)
      13. sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1169)
      14. sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1105)
      15. sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:999)
      16. sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:933)
      16 frames
    3. Spark
      Executor$$anonfun$org$apache$spark$executor$Executor$$updateDependencies$5.apply
      1. org.apache.spark.util.Utils$.doFetchFile(Utils.scala:555)
      2. org.apache.spark.util.Utils$.fetchFile(Utils.scala:369)
      3. org.apache.spark.executor.Executor$$anonfun$org$apache$spark$executor$Executor$$updateDependencies$5.apply(Executor.scala:405)
      4. org.apache.spark.executor.Executor$$anonfun$org$apache$spark$executor$Executor$$updateDependencies$5.apply(Executor.scala:397)
      4 frames
    4. Scala
      TraversableLike$WithFilter.foreach
      1. scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:772)
      2. scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:98)
      3. scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:98)
      4. scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:226)
      5. scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:39)
      6. scala.collection.mutable.HashMap.foreach(HashMap.scala:98)
      7. scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:771)
      7 frames
    5. Spark
      Executor$TaskRunner.run
      1. org.apache.spark.executor.Executor.org$apache$spark$executor$Executor$$updateDependencies(Executor.scala:397)
      2. org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:193)
      2 frames
    6. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      3. java.lang.Thread.run(Thread.java:745)
      3 frames