java.io.IOException

If you like a tip written by other Samebug users, mark is as helpful! Marks help our algorithm provide you better solutions and also help other users.
tip

Check if you didn't set RequestProperty Content-Type to the wrong type or if you're trying to send the wrong file to the server.

You have a different solution? A short tip here would help you and many other users who saw this issue last week.

  • common-user - using distcp for http source files
    via by Unknown author,
  • mod_jk in front of EJBCA
    via ejbca by plagri
    ,
  • Copying folders containing + & ! characters between hdfs (using hftp) does not work in distcp For example: Copying folder "string1+string2" at "namenode.address.com", hftp port myport to "/myotherhome/folder" on "myothermachine" does not work myothermachine prompt>>> hadoop --config ~/mycluster/ distcp "hftp://namenode.address.com:myport/myhome/dir/string1+string2" /myotherhome/folder/ -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Error results for hadoop job1: -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 08/07/16 00:27:39 INFO tools.DistCp: srcPaths=[hftp://namenode.address.com:myport/myhome/dir/string1+string2] 08/07/16 00:27:39 INFO tools.DistCp: destPath=/myotherhome/folder/ 08/07/16 00:27:41 INFO tools.DistCp: srcCount=2 08/07/16 00:27:42 INFO mapred.JobClient: Running job: job1 08/07/16 00:27:43 INFO mapred.JobClient: map 0% reduce 0% 08/07/16 00:27:58 INFO mapred.JobClient: Task Id : attempt_1_m_000000_0, Status : FAILED java.io.IOException: Copied: 0 Skipped: 0 Failed: 1 at org.apache.hadoop.tools.DistCp$CopyFilesMapper.close(DistCp.java:538) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:226) at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2208) 08/07/16 00:28:14 INFO mapred.JobClient: Task Id : attempt_1_m_000000_1, Status : FAILED java.io.IOException: Copied: 0 Skipped: 0 Failed: 1 at org.apache.hadoop.tools.DistCp$CopyFilesMapper.close(DistCp.java:538) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:226) at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2208) 08/07/16 00:28:28 INFO mapred.JobClient: Task Id : attempt_1_m_000000_2, Status : FAILED java.io.IOException: Copied: 0 Skipped: 0 Failed: 1 at org.apache.hadoop.tools.DistCp$CopyFilesMapper.close(DistCp.java:538) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:226) at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2208) With failures, global counters are inaccurate; consider running with -i Copy failed: java.io.IOException: Job failed! at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1053) at org.apache.hadoop.tools.DistCp.copy(DistCp.java:615) at org.apache.hadoop.tools.DistCp.run(DistCp.java:764) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) at org.apache.hadoop.tools.DistCp.main(DistCp.java:784) -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Error log for the map task which failed -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- INFO org.apache.hadoop.tools.DistCp: FAIL string1+string2/myjobtrackermachine.com-joblog.tar.gz : java.io.IOException: Server returned HTTP response code: 500 for URL: http://mymachine.com:myport/streamFile?filename=/myhome/dir/string1+string2/myjobtrackermachine.com-joblog.tar.gz&ugi=myid,mygroup at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241) at org.apache.hadoop.dfs.HftpFileSystem.open(HftpFileSystem.java:117) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:371) at org.apache.hadoop.tools.DistCp$CopyFilesMapper.copy(DistCp.java:377) at org.apache.hadoop.tools.DistCp$CopyFilesMapper.map(DistCp.java:504) at org.apache.hadoop.tools.DistCp$CopyFilesMapper.map(DistCp.java:279) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:226) at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2208) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
    via by Viraj Bhat,
    • java.io.IOException: Server returned HTTP response code: 503 for URL: http://localhost:3356/fsck at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1241) at org.apache.hadoop.http.TestGlobalFilter.access(TestGlobalFilter.java:89) at org.apache.hadoop.http.TestGlobalFilter.testServletFilter(TestGlobalFilter.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)

    Users with the same issue

    MattyMatty
    10 times, last one,
    Unknown UserUnknown User
    1 times, last one,
    tyson925tyson925
    4 times, last one,
    rprp
    1 times, last one,
    Unknown visitor
    Unknown visitor2 times, last one,
    74 more bugmates