java.lang.ArrayIndexOutOfBoundsException

Jenkins JIRA | sogabe | 6 years ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. Speed up your debug routine!

    Automated exception search integrated into your IDE

  2. 0

    I am using Terrier 4.1 with TR-316.v1.patch applied. Hadoop version is 2.6.0-cdh5.4.7. I am getting java.io.FileNotFoundException during reduce phase when it is around 80% finished. Here is the sample output from job: Setting TERRIER_HOME to /wsu/home/ft/ft33/ft3354/entity/terrier-core-4.1 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/local/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/jars/pig-0.12.0-cdh5.4.7.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/local/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/jars/slf4j-simple-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/local/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/jars/avro-tools-1.7.6-cdh5.4.7.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/local/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/jars/livy-assembly-3.7.0-cdh5.4.7.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/local/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/wsu/home/ft/ft33/ft3354/entity/terrier-core-4.1/target/terrier-core-4.1-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 15/12/15 13:28:48 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 15/12/15 13:28:48 INFO applications.HadoopIndexing: Term-partitioned Mode, 26 reducers creating one inverted index. 15/12/15 13:28:48 INFO io.HadoopUtility: Copying terrier share/ directory (/wsu/home/ft/ft33/ft3354/entity/terrier-core-4.1/share) to shared storage area (hdfs://kcnode1:8020/tmp/1708455605-terrier.share) 15/12/15 13:28:52 INFO client.RMProxy: Connecting to ResourceManager at kcnode1/172.31.25.101:8032 15/12/15 13:28:52 INFO client.RMProxy: Connecting to ResourceManager at kcnode1/172.31.25.101:8032 15/12/15 13:28:52 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 15/12/15 13:28:54 INFO hadoop.MultiFileCollectionInputFormat: Allocating 2016 files across 10 map tasks 15/12/15 13:28:57 INFO mapreduce.JobSubmitter: number of splits:10 15/12/15 13:28:57 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1450202857770_0002 15/12/15 13:28:58 INFO impl.YarnClientImpl: Submitted application application_1450202857770_0002 15/12/15 13:28:58 INFO mapreduce.Job: The url to track the job: http://kcnode1:8088/proxy/application_1450202857770_0002/ 15/12/15 13:28:58 INFO mapreduce.Job: Running job: job_1450202857770_0002 15/12/15 13:29:03 INFO mapreduce.Job: Job job_1450202857770_0002 running in uber mode : false 15/12/15 13:29:03 INFO mapreduce.Job: map 0% reduce 0% 15/12/15 13:29:48 INFO mapreduce.Job: map 1% reduce 0% 15/12/15 13:31:03 INFO mapreduce.Job: map 2% reduce 0% 15/12/15 13:32:17 INFO mapreduce.Job: map 3% reduce 0% 15/12/15 13:33:31 INFO mapreduce.Job: map 4% reduce 0% 15/12/15 13:34:45 INFO mapreduce.Job: map 5% reduce 0% 15/12/15 13:35:59 INFO mapreduce.Job: map 6% reduce 0% 15/12/15 13:37:13 INFO mapreduce.Job: map 7% reduce 0% 15/12/15 13:38:27 INFO mapreduce.Job: map 8% reduce 0% 15/12/15 13:39:41 INFO mapreduce.Job: map 9% reduce 0% 15/12/15 13:40:55 INFO mapreduce.Job: map 10% reduce 0% 15/12/15 13:42:09 INFO mapreduce.Job: map 11% reduce 0% 15/12/15 13:43:22 INFO mapreduce.Job: map 12% reduce 0% 15/12/15 13:44:36 INFO mapreduce.Job: map 13% reduce 0% 15/12/15 13:45:50 INFO mapreduce.Job: map 14% reduce 0% 15/12/15 13:47:04 INFO mapreduce.Job: map 15% reduce 0% 15/12/15 13:48:17 INFO mapreduce.Job: map 16% reduce 0% 15/12/15 13:49:36 INFO mapreduce.Job: map 17% reduce 0% 15/12/15 13:50:53 INFO mapreduce.Job: map 18% reduce 0% 15/12/15 13:52:09 INFO mapreduce.Job: map 19% reduce 0% 15/12/15 13:53:24 INFO mapreduce.Job: map 20% reduce 0% 15/12/15 13:54:37 INFO mapreduce.Job: map 21% reduce 0% 15/12/15 13:55:50 INFO mapreduce.Job: map 22% reduce 0% 15/12/15 13:57:03 INFO mapreduce.Job: map 23% reduce 0% 15/12/15 13:58:16 INFO mapreduce.Job: map 24% reduce 0% 15/12/15 13:59:31 INFO mapreduce.Job: map 25% reduce 0% 15/12/15 14:00:48 INFO mapreduce.Job: map 26% reduce 0% 15/12/15 14:02:02 INFO mapreduce.Job: map 27% reduce 0% 15/12/15 14:03:16 INFO mapreduce.Job: map 28% reduce 0% 15/12/15 14:04:33 INFO mapreduce.Job: map 29% reduce 0% 15/12/15 14:05:49 INFO mapreduce.Job: map 30% reduce 0% 15/12/15 14:07:02 INFO mapreduce.Job: map 31% reduce 0% 15/12/15 14:08:14 INFO mapreduce.Job: map 32% reduce 0% 15/12/15 14:09:28 INFO mapreduce.Job: map 33% reduce 0% 15/12/15 14:10:43 INFO mapreduce.Job: map 34% reduce 0% 15/12/15 14:11:56 INFO mapreduce.Job: map 35% reduce 0% 15/12/15 14:13:14 INFO mapreduce.Job: map 36% reduce 0% 15/12/15 14:14:28 INFO mapreduce.Job: map 37% reduce 0% 15/12/15 14:15:42 INFO mapreduce.Job: map 38% reduce 0% 15/12/15 14:16:59 INFO mapreduce.Job: map 39% reduce 0% 15/12/15 14:18:13 INFO mapreduce.Job: map 40% reduce 0% 15/12/15 14:19:28 INFO mapreduce.Job: map 41% reduce 0% 15/12/15 14:20:43 INFO mapreduce.Job: map 42% reduce 0% 15/12/15 14:21:56 INFO mapreduce.Job: map 43% reduce 0% 15/12/15 14:23:09 INFO mapreduce.Job: map 44% reduce 0% 15/12/15 14:24:22 INFO mapreduce.Job: map 45% reduce 0% 15/12/15 14:25:38 INFO mapreduce.Job: map 46% reduce 0% 15/12/15 14:26:54 INFO mapreduce.Job: map 47% reduce 0% 15/12/15 14:28:10 INFO mapreduce.Job: map 48% reduce 0% 15/12/15 14:29:27 INFO mapreduce.Job: map 49% reduce 0% 15/12/15 14:30:42 INFO mapreduce.Job: map 50% reduce 0% 15/12/15 14:31:57 INFO mapreduce.Job: map 51% reduce 0% 15/12/15 14:33:13 INFO mapreduce.Job: map 52% reduce 0% 15/12/15 14:34:27 INFO mapreduce.Job: map 53% reduce 0% 15/12/15 14:35:44 INFO mapreduce.Job: map 54% reduce 0% 15/12/15 14:37:01 INFO mapreduce.Job: map 55% reduce 0% 15/12/15 14:38:16 INFO mapreduce.Job: map 56% reduce 0% 15/12/15 14:39:35 INFO mapreduce.Job: map 57% reduce 0% 15/12/15 14:40:56 INFO mapreduce.Job: map 58% reduce 0% 15/12/15 14:42:15 INFO mapreduce.Job: map 59% reduce 0% 15/12/15 14:43:32 INFO mapreduce.Job: map 60% reduce 0% 15/12/15 14:44:49 INFO mapreduce.Job: map 61% reduce 0% 15/12/15 14:46:04 INFO mapreduce.Job: map 62% reduce 0% 15/12/15 14:47:20 INFO mapreduce.Job: map 63% reduce 0% 15/12/15 14:48:36 INFO mapreduce.Job: map 64% reduce 0% 15/12/15 14:49:53 INFO mapreduce.Job: map 65% reduce 0% 15/12/15 14:50:18 INFO mapreduce.Job: map 66% reduce 0% 15/12/15 14:50:27 INFO mapreduce.Job: map 67% reduce 0% 15/12/15 14:50:42 INFO mapreduce.Job: map 68% reduce 0% 15/12/15 14:50:54 INFO mapreduce.Job: map 69% reduce 0% 15/12/15 14:51:40 INFO mapreduce.Job: map 70% reduce 0% 15/12/15 14:51:49 INFO mapreduce.Job: map 71% reduce 0% 15/12/15 14:51:53 INFO mapreduce.Job: map 72% reduce 0% 15/12/15 14:51:58 INFO mapreduce.Job: map 73% reduce 0% 15/12/15 14:52:01 INFO mapreduce.Job: map 74% reduce 0% 15/12/15 14:52:05 INFO mapreduce.Job: map 75% reduce 0% 15/12/15 14:52:08 INFO mapreduce.Job: map 76% reduce 0% 15/12/15 14:52:11 INFO mapreduce.Job: map 77% reduce 0% 15/12/15 14:52:14 INFO mapreduce.Job: map 78% reduce 0% 15/12/15 14:52:17 INFO mapreduce.Job: map 79% reduce 0% 15/12/15 14:52:20 INFO mapreduce.Job: map 80% reduce 0% 15/12/15 14:52:23 INFO mapreduce.Job: map 81% reduce 0% 15/12/15 14:52:28 INFO mapreduce.Job: map 82% reduce 0% 15/12/15 14:52:29 INFO mapreduce.Job: map 83% reduce 0% 15/12/15 14:52:37 INFO mapreduce.Job: map 84% reduce 0% 15/12/15 14:52:46 INFO mapreduce.Job: map 85% reduce 0% 15/12/15 14:52:50 INFO mapreduce.Job: map 86% reduce 0% 15/12/15 14:54:36 INFO mapreduce.Job: map 87% reduce 0% 15/12/15 14:54:54 INFO mapreduce.Job: map 88% reduce 0% 15/12/15 14:55:03 INFO mapreduce.Job: map 89% reduce 0% 15/12/15 14:55:12 INFO mapreduce.Job: map 90% reduce 0% 15/12/15 14:55:18 INFO mapreduce.Job: map 91% reduce 0% 15/12/15 14:55:25 INFO mapreduce.Job: map 92% reduce 0% 15/12/15 14:55:28 INFO mapreduce.Job: map 93% reduce 0% 15/12/15 14:55:33 INFO mapreduce.Job: map 94% reduce 0% 15/12/15 14:55:42 INFO mapreduce.Job: map 95% reduce 0% 15/12/15 14:55:49 INFO mapreduce.Job: map 96% reduce 0% 15/12/15 14:56:00 INFO mapreduce.Job: map 96% reduce 7% 15/12/15 14:56:01 INFO mapreduce.Job: map 96% reduce 9% 15/12/15 14:56:03 INFO mapreduce.Job: map 96% reduce 13% 15/12/15 14:56:04 INFO mapreduce.Job: map 96% reduce 14% 15/12/15 14:56:06 INFO mapreduce.Job: map 96% reduce 17% 15/12/15 14:56:07 INFO mapreduce.Job: map 96% reduce 18% 15/12/15 14:56:09 INFO mapreduce.Job: map 96% reduce 20% 15/12/15 14:56:10 INFO mapreduce.Job: map 96% reduce 22% 15/12/15 14:59:45 INFO mapreduce.Job: map 97% reduce 22% 15/12/15 15:08:50 INFO mapreduce.Job: map 98% reduce 22% 15/12/15 15:09:02 INFO mapreduce.Job: map 99% reduce 22% 15/12/15 15:09:20 INFO mapreduce.Job: map 100% reduce 22% 15/12/15 15:09:24 INFO mapreduce.Job: map 100% reduce 23% 15/12/15 15:09:25 INFO mapreduce.Job: map 100% reduce 28% 15/12/15 15:09:26 INFO mapreduce.Job: map 100% reduce 29% 15/12/15 15:09:27 INFO mapreduce.Job: map 100% reduce 30% 15/12/15 15:09:28 INFO mapreduce.Job: map 100% reduce 33% 15/12/15 15:09:30 INFO mapreduce.Job: map 100% reduce 35% 15/12/15 15:09:31 INFO mapreduce.Job: map 100% reduce 38% 15/12/15 15:09:33 INFO mapreduce.Job: map 100% reduce 40% 15/12/15 15:09:34 INFO mapreduce.Job: map 100% reduce 43% 15/12/15 15:09:36 INFO mapreduce.Job: map 100% reduce 44% 15/12/15 15:09:37 INFO mapreduce.Job: map 100% reduce 47% 15/12/15 15:09:38 INFO mapreduce.Job: map 100% reduce 48% 15/12/15 15:09:39 INFO mapreduce.Job: map 100% reduce 49% 15/12/15 15:09:40 INFO mapreduce.Job: map 100% reduce 52% 15/12/15 15:09:43 INFO mapreduce.Job: map 100% reduce 55% 15/12/15 15:09:44 INFO mapreduce.Job: map 100% reduce 57% 15/12/15 15:09:46 INFO mapreduce.Job: map 100% reduce 59% 15/12/15 15:09:47 INFO mapreduce.Job: map 100% reduce 60% 15/12/15 15:09:49 INFO mapreduce.Job: map 100% reduce 63% 15/12/15 15:09:51 INFO mapreduce.Job: map 100% reduce 64% 15/12/15 15:09:52 INFO mapreduce.Job: map 100% reduce 66% 15/12/15 15:09:55 INFO mapreduce.Job: map 100% reduce 67% 15/12/15 15:09:56 INFO mapreduce.Job: map 100% reduce 69% 15/12/15 15:09:58 INFO mapreduce.Job: map 100% reduce 70% 15/12/15 15:09:59 INFO mapreduce.Job: map 100% reduce 71% 15/12/15 15:10:00 INFO mapreduce.Job: map 100% reduce 75% 15/12/15 15:10:01 INFO mapreduce.Job: map 100% reduce 76% 15/12/15 15:10:02 INFO mapreduce.Job: map 100% reduce 79% 15/12/15 15:10:02 INFO mapreduce.Job: Task Id : attempt_1450202857770_0002_r_000025_0, Status : FAILED Error: java.io.FileNotFoundException: File does not exist: hdfs://kcnode1:8020/user/ft3354/btc/simple/baseline-retrieval-index/_temporary/1/_temporary/attempt_1450202857770_0002_r_000021_0 at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1132) at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1124) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1124) at org.apache.hadoop.fs.FileSystem.resolvePath(FileSystem.java:750) at org.apache.hadoop.hdfs.DistributedFileSystem$16.<init>(DistributedFileSystem.java:779) at org.apache.hadoop.hdfs.DistributedFileSystem.listLocatedStatus(DistributedFileSystem.java:770) at org.apache.hadoop.fs.FileSystem.listLocatedStatus(FileSystem.java:1664) at org.apache.hadoop.fs.FileSystem$5.handleFileStat(FileSystem.java:1757) at org.apache.hadoop.fs.FileSystem$5.hasNext(FileSystem.java:1734) at org.terrier.structures.indexing.singlepass.hadoop.Hadoop_BasicSinglePassIndexer.loadRunData(Hadoop_BasicSinglePassIndexer.java:534) at org.terrier.structures.indexing.singlepass.hadoop.Hadoop_BasicSinglePassIndexer.reduce(Hadoop_BasicSinglePassIndexer.java:623) at org.terrier.structures.indexing.singlepass.hadoop.Hadoop_BasicSinglePassIndexer.reduce(Hadoop_BasicSinglePassIndexer.java:104) at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) 15/12/15 15:10:04 INFO mapreduce.Job: map 100% reduce 80% 15/12/15 15:10:05 INFO mapreduce.Job: map 100% reduce 81% 15/12/15 15:10:06 INFO mapreduce.Job: map 100% reduce 82% 15/12/15 15:10:07 INFO mapreduce.Job: map 100% reduce 83% 15/12/15 15:10:09 INFO mapreduce.Job: map 100% reduce 84% 15/12/15 15:10:10 INFO mapreduce.Job: map 100% reduce 85% 15/12/15 15:10:13 INFO mapreduce.Job: map 100% reduce 89% 15/12/15 15:10:16 INFO mapreduce.Job: map 100% reduce 90% 15/12/15 15:10:17 INFO mapreduce.Job: map 100% reduce 91% 15/12/15 15:10:19 INFO mapreduce.Job: map 100% reduce 92% 15/12/15 15:10:22 INFO mapreduce.Job: map 100% reduce 93% 15/12/15 15:10:25 INFO mapreduce.Job: map 100% reduce 94% 15/12/15 15:10:28 INFO mapreduce.Job: map 100% reduce 95% 15/12/15 15:10:31 INFO mapreduce.Job: map 100% reduce 96% 15/12/15 15:10:35 INFO mapreduce.Job: map 100% reduce 97% 15/12/15 15:10:41 INFO mapreduce.Job: map 100% reduce 98% 15/12/15 15:10:56 INFO mapreduce.Job: map 100% reduce 99% 15/12/15 15:11:20 INFO mapreduce.Job: map 100% reduce 100% 15/12/15 19:25:56 INFO mapreduce.Job: map 0% reduce 0% 15/12/15 19:25:56 INFO mapreduce.Job: Job job_1450202857770_0002 failed with state KILLED due to: Application killed by user. 15/12/15 19:25:56 INFO mapreduce.Job: Counters: 0 15/12/15 19:25:56 ERROR applications.HadoopIndexing: Problem running job java.io.IOException: Job failed! at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:838) at org.terrier.applications.HadoopIndexing.main(HadoopIndexing.java:244) at org.terrier.applications.TrecTerrier.run(TrecTerrier.java:391) at org.terrier.applications.TrecTerrier.applyOptions(TrecTerrier.java:599) at org.terrier.applications.TrecTerrier.main(TrecTerrier.java:246) Time Taken = 21429 seconds Time elapsed: 21429.554 seconds. bin/trec_terrier.sh -i -H 26.62s user 6.18s system 0% cpu 5:57:10.28 total

    JIRA | 1 year ago | Fedor Nikolaev
    java.lang.ArrayIndexOutOfBoundsException

    1 unregistered visitors

    Root Cause Analysis

    1. java.lang.ArrayIndexOutOfBoundsException

      No message provided

      at java.net.SocketOutputStream.socketWrite()
    2. Java RT
      DataOutputStream.write
      1. java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:87)
      2. java.net.SocketOutputStream.write(SocketOutputStream.java:136)
      3. java.io.DataOutputStream.write(DataOutputStream.java:90)
      3 frames
    3. org.jenkinsci.plugins
      ClamAvRecorder.perform
      1. org.jenkinsci.plugins.clamav.scanner.ClamAvScanner.instream(ClamAvScanner.java:167)
      2. org.jenkinsci.plugins.clamav.scanner.ClamAvScanner.scan(ClamAvScanner.java:94)
      3. org.jenkinsci.plugins.clamav.ClamAvRecorder.perform(ClamAvRecorder.java:115)
      3 frames
    4. Hudson
      AbstractBuild$AbstractRunner.performAllBuildSteps
      1. hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
      2. hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:664)
      3. hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:639)
      3 frames
    5. Hudson Maven Embedder
      MavenModuleSetBuild$RunnerImpl.post2
      1. hudson.maven.MavenModuleSetBuild$RunnerImpl.post2(MavenModuleSetBuild.java:895)
      1 frame
    6. Hudson
      Run.run
      1. hudson.model.AbstractBuild$AbstractRunner.post(AbstractBuild.java:586)
      2. hudson.model.Run.run(Run.java:1400)
      2 frames
    7. Hudson Maven Embedder
      MavenModuleSetBuild.run
      1. hudson.maven.MavenModuleSetBuild.run(MavenModuleSetBuild.java:465)
      1 frame
    8. Hudson
      ResourceController.execute
      1. hudson.model.ResourceController.execute(ResourceController.java:88)
      1 frame