org.apache.spark.SparkException: Job aborted.

Stack Overflow | jamborta | 7 months ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    target server failed to response spark s3

    Stack Overflow | 1 year ago | Aayush
    org.apache.http.NoHttpResponseException: The target server failed to respond
  2. 0

    Error while using Android Driver using EMulator

    Stack Overflow | 3 years ago | Rock1431
    org.apache.http.NoHttpResponseException: The target server failed to respond
  3. Speed up your debug routine!

    Automated exception search integrated into your IDE

  4. 0

    org.apache.http.NoHttpResponseException: accounts.google.com failed to respond

    Stack Overflow | 3 years ago | redsonic
    org.apache.http.NoHttpResponseException: accounts.google.com failed to respond
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. org.apache.http.NoHttpResponseException

    s3-bucket.s3.amazonaws.com:443 failed to respond

    at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead()
  2. Apache HttpClient
    DefaultHttpResponseParser.parseHead
    1. org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
    2. org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
    2 frames
  3. Apache Http
    AbstractHttpClientConnection.receiveResponseHeader
    1. org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
    2. org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
    2 frames
  4. Apache HttpClient
    AbstractClientConnAdapter.receiveResponseHeader
    1. org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:259)
    2. org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:232)
    2 frames
  5. Apache Http
    HttpRequestExecutor.execute
    1. org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
    2. org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
    2 frames
  6. Apache HttpClient
    CloseableHttpClient.execute
    1. org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:686)
    2. org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:488)
    3. org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:884)
    4. org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
    5. org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
    5 frames
  7. JetS3t
    StorageService.copyObject
    1. org.jets3t.service.impl.rest.httpclient.RestStorageService.performRequest(RestStorageService.java:326)
    2. org.jets3t.service.impl.rest.httpclient.RestStorageService.performRequest(RestStorageService.java:277)
    3. org.jets3t.service.impl.rest.httpclient.RestStorageService.performRestPut(RestStorageService.java:1143)
    4. org.jets3t.service.impl.rest.httpclient.RestStorageService.copyObjectImpl(RestStorageService.java:2117)
    5. org.jets3t.service.StorageService.copyObject(StorageService.java:898)
    6. org.jets3t.service.StorageService.copyObject(StorageService.java:943)
    6 frames
  8. Hadoop
    Jets3tNativeFileSystemStore.copy
    1. org.apache.hadoop.fs.s3native.Jets3tNativeFileSystemStore.copy(Jets3tNativeFileSystemStore.java:320)
    1 frame
  9. Java RT
    Method.invoke
    1. sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source)
    2. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    3. java.lang.reflect.Method.invoke(Method.java:606)
    3 frames
  10. Hadoop
    NativeS3FileSystem.rename
    1. org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:190)
    2. org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:103)
    3. org.apache.hadoop.fs.s3native.$Proxy20.copy(Unknown Source)
    4. org.apache.hadoop.fs.s3native.NativeS3FileSystem.rename(NativeS3FileSystem.java:645)
    4 frames
  11. Hadoop
    FileOutputCommitter.commitJob
    1. org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.mergePaths(FileOutputCommitter.java:345)
    2. org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.mergePaths(FileOutputCommitter.java:362)
    3. org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.commitJob(FileOutputCommitter.java:310)
    3 frames
  12. org.apache.parquet
    ParquetOutputCommitter.commitJob
    1. org.apache.parquet.hadoop.ParquetOutputCommitter.commitJob(ParquetOutputCommitter.java:46)
    1 frame
  13. org.apache.spark
    InsertIntoHadoopFsRelationCommand$$anonfun$run$1.apply
    1. org.apache.spark.sql.execution.datasources.BaseWriterContainer.commitJob(WriterContainer.scala:222)
    2. org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelationCommand$$anonfun$run$1.apply$mcV$sp(InsertIntoHadoopFsRelationCommand.scala:144)
    3. org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelationCommand$$anonfun$run$1.apply(InsertIntoHadoopFsRelationCommand.scala:115)
    4. org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelationCommand$$anonfun$run$1.apply(InsertIntoHadoopFsRelationCommand.scala:115)
    4 frames
  14. Spark Project SQL
    SQLExecution$.withNewExecutionId
    1. org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:57)
    1 frame
  15. org.apache.spark
    ExecutedCommandExec.doExecute
    1. org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelationCommand.run(InsertIntoHadoopFsRelationCommand.scala:115)
    2. org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:60)
    3. org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:58)
    4. org.apache.spark.sql.execution.command.ExecutedCommandExec.doExecute(commands.scala:74)
    4 frames
  16. Spark Project SQL
    SparkPlan$$anonfun$executeQuery$1.apply
    1. org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:115)
    2. org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:115)
    3. org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:136)
    3 frames
  17. Spark
    RDDOperationScope$.withScope
    1. org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
    1 frame
  18. Spark Project SQL
    QueryExecution.toRdd
    1. org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:133)
    2. org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:114)
    3. org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:86)
    4. org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:86)
    4 frames
  19. org.apache.spark
    DataSource.write
    1. org.apache.spark.sql.execution.datasources.DataSource.write(DataSource.scala:487)
    1 frame
  20. Spark Project SQL
    DataFrameWriter.save
    1. org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:211)
    2. org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:194)
    2 frames
  21. Java RT
    Method.invoke
    1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    4. java.lang.reflect.Method.invoke(Method.java:606)
    4 frames
  22. Py4J
    GatewayConnection.run
    1. py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:237)
    2. py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
    3. py4j.Gateway.invoke(Gateway.java:280)
    4. py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:128)
    5. py4j.commands.CallCommand.execute(CallCommand.java:79)
    6. py4j.GatewayConnection.run(GatewayConnection.java:211)
    6 frames
  23. Java RT
    Thread.run
    1. java.lang.Thread.run(Thread.java:745)
    1 frame