java.lang.ArrayIndexOutOfBoundsException

Jenkins JIRA | sogabe | 5 years ago
  1. Speed up your debug routine!

    Automated exception search integrated into your IDE

  2. 0

    I am using Terrier 4.1 with TR-316.v1.patch applied. Hadoop version is 2.6.0-cdh5.4.7. I am getting java.io.FileNotFoundException during reduce phase when it is around 80% finished. Here is the sample output from job: Setting TERRIER_HOME to /wsu/home/ft/ft33/ft3354/entity/terrier-core-4.1 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/local/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/jars/pig-0.12.0-cdh5.4.7.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/local/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/jars/slf4j-simple-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/local/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/jars/avro-tools-1.7.6-cdh5.4.7.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/local/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/jars/livy-assembly-3.7.0-cdh5.4.7.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/local/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/wsu/home/ft/ft33/ft3354/entity/terrier-core-4.1/target/terrier-core-4.1-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 15/12/15 13:28:48 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 15/12/15 13:28:48 INFO applications.HadoopIndexing: Term-partitioned Mode, 26 reducers creating one inverted index. 15/12/15 13:28:48 INFO io.HadoopUtility: Copying terrier share/ directory (/wsu/home/ft/ft33/ft3354/entity/terrier-core-4.1/share) to shared storage area (hdfs://kcnode1:8020/tmp/1708455605-terrier.share) 15/12/15 13:28:52 INFO client.RMProxy: Connecting to ResourceManager at kcnode1/172.31.25.101:8032 15/12/15 13:28:52 INFO client.RMProxy: Connecting to ResourceManager at kcnode1/172.31.25.101:8032 15/12/15 13:28:52 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 15/12/15 13:28:54 INFO hadoop.MultiFileCollectionInputFormat: Allocating 2016 files across 10 map tasks 15/12/15 13:28:57 INFO mapreduce.JobSubmitter: number of splits:10 15/12/15 13:28:57 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1450202857770_0002 15/12/15 13:28:58 INFO impl.YarnClientImpl: Submitted application application_1450202857770_0002 15/12/15 13:28:58 INFO mapreduce.Job: The url to track the job: http://kcnode1:8088/proxy/application_1450202857770_0002/ 15/12/15 13:28:58 INFO mapreduce.Job: Running job: job_1450202857770_0002 15/12/15 13:29:03 INFO mapreduce.Job: Job job_1450202857770_0002 running in uber mode : false 15/12/15 13:29:03 INFO mapreduce.Job: map 0% reduce 0% 15/12/15 13:29:48 INFO mapreduce.Job: map 1% reduce 0% 15/12/15 13:31:03 INFO mapreduce.Job: map 2% reduce 0% 15/12/15 13:32:17 INFO mapreduce.Job: map 3% reduce 0% 15/12/15 13:33:31 INFO mapreduce.Job: map 4% reduce 0% 15/12/15 13:34:45 INFO mapreduce.Job: map 5% reduce 0% 15/12/15 13:35:59 INFO mapreduce.Job: map 6% reduce 0% 15/12/15 13:37:13 INFO mapreduce.Job: map 7% reduce 0% 15/12/15 13:38:27 INFO mapreduce.Job: map 8% reduce 0% 15/12/15 13:39:41 INFO mapreduce.Job: map 9% reduce 0% 15/12/15 13:40:55 INFO mapreduce.Job: map 10% reduce 0% 15/12/15 13:42:09 INFO mapreduce.Job: map 11% reduce 0% 15/12/15 13:43:22 INFO mapreduce.Job: map 12% reduce 0% 15/12/15 13:44:36 INFO mapreduce.Job: map 13% reduce 0% 15/12/15 13:45:50 INFO mapreduce.Job: map 14% reduce 0% 15/12/15 13:47:04 INFO mapreduce.Job: map 15% reduce 0% 15/12/15 13:48:17 INFO mapreduce.Job: map 16% reduce 0% 15/12/15 13:49:36 INFO mapreduce.Job: map 17% reduce 0% 15/12/15 13:50:53 INFO mapreduce.Job: map 18% reduce 0% 15/12/15 13:52:09 INFO mapreduce.Job: map 19% reduce 0% 15/12/15 13:53:24 INFO mapreduce.Job: map 20% reduce 0% 15/12/15 13:54:37 INFO mapreduce.Job: map 21% reduce 0% 15/12/15 13:55:50 INFO mapreduce.Job: map 22% reduce 0% 15/12/15 13:57:03 INFO mapreduce.Job: map 23% reduce 0% 15/12/15 13:58:16 INFO mapreduce.Job: map 24% reduce 0% 15/12/15 13:59:31 INFO mapreduce.Job: map 25% reduce 0% 15/12/15 14:00:48 INFO mapreduce.Job: map 26% reduce 0% 15/12/15 14:02:02 INFO mapreduce.Job: map 27% reduce 0% 15/12/15 14:03:16 INFO mapreduce.Job: map 28% reduce 0% 15/12/15 14:04:33 INFO mapreduce.Job: map 29% reduce 0% 15/12/15 14:05:49 INFO mapreduce.Job: map 30% reduce 0% 15/12/15 14:07:02 INFO mapreduce.Job: map 31% reduce 0% 15/12/15 14:08:14 INFO mapreduce.Job: map 32% reduce 0% 15/12/15 14:09:28 INFO mapreduce.Job: map 33% reduce 0% 15/12/15 14:10:43 INFO mapreduce.Job: map 34% reduce 0% 15/12/15 14:11:56 INFO mapreduce.Job: map 35% reduce 0% 15/12/15 14:13:14 INFO mapreduce.Job: map 36% reduce 0% 15/12/15 14:14:28 INFO mapreduce.Job: map 37% reduce 0% 15/12/15 14:15:42 INFO mapreduce.Job: map 38% reduce 0% 15/12/15 14:16:59 INFO mapreduce.Job: map 39% reduce 0% 15/12/15 14:18:13 INFO mapreduce.Job: map 40% reduce 0% 15/12/15 14:19:28 INFO mapreduce.Job: map 41% reduce 0% 15/12/15 14:20:43 INFO mapreduce.Job: map 42% reduce 0% 15/12/15 14:21:56 INFO mapreduce.Job: map 43% reduce 0% 15/12/15 14:23:09 INFO mapreduce.Job: map 44% reduce 0% 15/12/15 14:24:22 INFO mapreduce.Job: map 45% reduce 0% 15/12/15 14:25:38 INFO mapreduce.Job: map 46% reduce 0% 15/12/15 14:26:54 INFO mapreduce.Job: map 47% reduce 0% 15/12/15 14:28:10 INFO mapreduce.Job: map 48% reduce 0% 15/12/15 14:29:27 INFO mapreduce.Job: map 49% reduce 0% 15/12/15 14:30:42 INFO mapreduce.Job: map 50% reduce 0% 15/12/15 14:31:57 INFO mapreduce.Job: map 51% reduce 0% 15/12/15 14:33:13 INFO mapreduce.Job: map 52% reduce 0% 15/12/15 14:34:27 INFO mapreduce.Job: map 53% reduce 0% 15/12/15 14:35:44 INFO mapreduce.Job: map 54% reduce 0% 15/12/15 14:37:01 INFO mapreduce.Job: map 55% reduce 0% 15/12/15 14:38:16 INFO mapreduce.Job: map 56% reduce 0% 15/12/15 14:39:35 INFO mapreduce.Job: map 57% reduce 0% 15/12/15 14:40:56 INFO mapreduce.Job: map 58% reduce 0% 15/12/15 14:42:15 INFO mapreduce.Job: map 59% reduce 0% 15/12/15 14:43:32 INFO mapreduce.Job: map 60% reduce 0% 15/12/15 14:44:49 INFO mapreduce.Job: map 61% reduce 0% 15/12/15 14:46:04 INFO mapreduce.Job: map 62% reduce 0% 15/12/15 14:47:20 INFO mapreduce.Job: map 63% reduce 0% 15/12/15 14:48:36 INFO mapreduce.Job: map 64% reduce 0% 15/12/15 14:49:53 INFO mapreduce.Job: map 65% reduce 0% 15/12/15 14:50:18 INFO mapreduce.Job: map 66% reduce 0% 15/12/15 14:50:27 INFO mapreduce.Job: map 67% reduce 0% 15/12/15 14:50:42 INFO mapreduce.Job: map 68% reduce 0% 15/12/15 14:50:54 INFO mapreduce.Job: map 69% reduce 0% 15/12/15 14:51:40 INFO mapreduce.Job: map 70% reduce 0% 15/12/15 14:51:49 INFO mapreduce.Job: map 71% reduce 0% 15/12/15 14:51:53 INFO mapreduce.Job: map 72% reduce 0% 15/12/15 14:51:58 INFO mapreduce.Job: map 73% reduce 0% 15/12/15 14:52:01 INFO mapreduce.Job: map 74% reduce 0% 15/12/15 14:52:05 INFO mapreduce.Job: map 75% reduce 0% 15/12/15 14:52:08 INFO mapreduce.Job: map 76% reduce 0% 15/12/15 14:52:11 INFO mapreduce.Job: map 77% reduce 0% 15/12/15 14:52:14 INFO mapreduce.Job: map 78% reduce 0% 15/12/15 14:52:17 INFO mapreduce.Job: map 79% reduce 0% 15/12/15 14:52:20 INFO mapreduce.Job: map 80% reduce 0% 15/12/15 14:52:23 INFO mapreduce.Job: map 81% reduce 0% 15/12/15 14:52:28 INFO mapreduce.Job: map 82% reduce 0% 15/12/15 14:52:29 INFO mapreduce.Job: map 83% reduce 0% 15/12/15 14:52:37 INFO mapreduce.Job: map 84% reduce 0% 15/12/15 14:52:46 INFO mapreduce.Job: map 85% reduce 0% 15/12/15 14:52:50 INFO mapreduce.Job: map 86% reduce 0% 15/12/15 14:54:36 INFO mapreduce.Job: map 87% reduce 0% 15/12/15 14:54:54 INFO mapreduce.Job: map 88% reduce 0% 15/12/15 14:55:03 INFO mapreduce.Job: map 89% reduce 0% 15/12/15 14:55:12 INFO mapreduce.Job: map 90% reduce 0% 15/12/15 14:55:18 INFO mapreduce.Job: map 91% reduce 0% 15/12/15 14:55:25 INFO mapreduce.Job: map 92% reduce 0% 15/12/15 14:55:28 INFO mapreduce.Job: map 93% reduce 0% 15/12/15 14:55:33 INFO mapreduce.Job: map 94% reduce 0% 15/12/15 14:55:42 INFO mapreduce.Job: map 95% reduce 0% 15/12/15 14:55:49 INFO mapreduce.Job: map 96% reduce 0% 15/12/15 14:56:00 INFO mapreduce.Job: map 96% reduce 7% 15/12/15 14:56:01 INFO mapreduce.Job: map 96% reduce 9% 15/12/15 14:56:03 INFO mapreduce.Job: map 96% reduce 13% 15/12/15 14:56:04 INFO mapreduce.Job: map 96% reduce 14% 15/12/15 14:56:06 INFO mapreduce.Job: map 96% reduce 17% 15/12/15 14:56:07 INFO mapreduce.Job: map 96% reduce 18% 15/12/15 14:56:09 INFO mapreduce.Job: map 96% reduce 20% 15/12/15 14:56:10 INFO mapreduce.Job: map 96% reduce 22% 15/12/15 14:59:45 INFO mapreduce.Job: map 97% reduce 22% 15/12/15 15:08:50 INFO mapreduce.Job: map 98% reduce 22% 15/12/15 15:09:02 INFO mapreduce.Job: map 99% reduce 22% 15/12/15 15:09:20 INFO mapreduce.Job: map 100% reduce 22% 15/12/15 15:09:24 INFO mapreduce.Job: map 100% reduce 23% 15/12/15 15:09:25 INFO mapreduce.Job: map 100% reduce 28% 15/12/15 15:09:26 INFO mapreduce.Job: map 100% reduce 29% 15/12/15 15:09:27 INFO mapreduce.Job: map 100% reduce 30% 15/12/15 15:09:28 INFO mapreduce.Job: map 100% reduce 33% 15/12/15 15:09:30 INFO mapreduce.Job: map 100% reduce 35% 15/12/15 15:09:31 INFO mapreduce.Job: map 100% reduce 38% 15/12/15 15:09:33 INFO mapreduce.Job: map 100% reduce 40% 15/12/15 15:09:34 INFO mapreduce.Job: map 100% reduce 43% 15/12/15 15:09:36 INFO mapreduce.Job: map 100% reduce 44% 15/12/15 15:09:37 INFO mapreduce.Job: map 100% reduce 47% 15/12/15 15:09:38 INFO mapreduce.Job: map 100% reduce 48% 15/12/15 15:09:39 INFO mapreduce.Job: map 100% reduce 49% 15/12/15 15:09:40 INFO mapreduce.Job: map 100% reduce 52% 15/12/15 15:09:43 INFO mapreduce.Job: map 100% reduce 55% 15/12/15 15:09:44 INFO mapreduce.Job: map 100% reduce 57% 15/12/15 15:09:46 INFO mapreduce.Job: map 100% reduce 59% 15/12/15 15:09:47 INFO mapreduce.Job: map 100% reduce 60% 15/12/15 15:09:49 INFO mapreduce.Job: map 100% reduce 63% 15/12/15 15:09:51 INFO mapreduce.Job: map 100% reduce 64% 15/12/15 15:09:52 INFO mapreduce.Job: map 100% reduce 66% 15/12/15 15:09:55 INFO mapreduce.Job: map 100% reduce 67% 15/12/15 15:09:56 INFO mapreduce.Job: map 100% reduce 69% 15/12/15 15:09:58 INFO mapreduce.Job: map 100% reduce 70% 15/12/15 15:09:59 INFO mapreduce.Job: map 100% reduce 71% 15/12/15 15:10:00 INFO mapreduce.Job: map 100% reduce 75% 15/12/15 15:10:01 INFO mapreduce.Job: map 100% reduce 76% 15/12/15 15:10:02 INFO mapreduce.Job: map 100% reduce 79% 15/12/15 15:10:02 INFO mapreduce.Job: Task Id : attempt_1450202857770_0002_r_000025_0, Status : FAILED Error: java.io.FileNotFoundException: File does not exist: hdfs://kcnode1:8020/user/ft3354/btc/simple/baseline-retrieval-index/_temporary/1/_temporary/attempt_1450202857770_0002_r_000021_0 at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1132) at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1124) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1124) at org.apache.hadoop.fs.FileSystem.resolvePath(FileSystem.java:750) at org.apache.hadoop.hdfs.DistributedFileSystem$16.<init>(DistributedFileSystem.java:779) at org.apache.hadoop.hdfs.DistributedFileSystem.listLocatedStatus(DistributedFileSystem.java:770) at org.apache.hadoop.fs.FileSystem.listLocatedStatus(FileSystem.java:1664) at org.apache.hadoop.fs.FileSystem$5.handleFileStat(FileSystem.java:1757) at org.apache.hadoop.fs.FileSystem$5.hasNext(FileSystem.java:1734) at org.terrier.structures.indexing.singlepass.hadoop.Hadoop_BasicSinglePassIndexer.loadRunData(Hadoop_BasicSinglePassIndexer.java:534) at org.terrier.structures.indexing.singlepass.hadoop.Hadoop_BasicSinglePassIndexer.reduce(Hadoop_BasicSinglePassIndexer.java:623) at org.terrier.structures.indexing.singlepass.hadoop.Hadoop_BasicSinglePassIndexer.reduce(Hadoop_BasicSinglePassIndexer.java:104) at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) 15/12/15 15:10:04 INFO mapreduce.Job: map 100% reduce 80% 15/12/15 15:10:05 INFO mapreduce.Job: map 100% reduce 81% 15/12/15 15:10:06 INFO mapreduce.Job: map 100% reduce 82% 15/12/15 15:10:07 INFO mapreduce.Job: map 100% reduce 83% 15/12/15 15:10:09 INFO mapreduce.Job: map 100% reduce 84% 15/12/15 15:10:10 INFO mapreduce.Job: map 100% reduce 85% 15/12/15 15:10:13 INFO mapreduce.Job: map 100% reduce 89% 15/12/15 15:10:16 INFO mapreduce.Job: map 100% reduce 90% 15/12/15 15:10:17 INFO mapreduce.Job: map 100% reduce 91% 15/12/15 15:10:19 INFO mapreduce.Job: map 100% reduce 92% 15/12/15 15:10:22 INFO mapreduce.Job: map 100% reduce 93% 15/12/15 15:10:25 INFO mapreduce.Job: map 100% reduce 94% 15/12/15 15:10:28 INFO mapreduce.Job: map 100% reduce 95% 15/12/15 15:10:31 INFO mapreduce.Job: map 100% reduce 96% 15/12/15 15:10:35 INFO mapreduce.Job: map 100% reduce 97% 15/12/15 15:10:41 INFO mapreduce.Job: map 100% reduce 98% 15/12/15 15:10:56 INFO mapreduce.Job: map 100% reduce 99% 15/12/15 15:11:20 INFO mapreduce.Job: map 100% reduce 100% 15/12/15 19:25:56 INFO mapreduce.Job: map 0% reduce 0% 15/12/15 19:25:56 INFO mapreduce.Job: Job job_1450202857770_0002 failed with state KILLED due to: Application killed by user. 15/12/15 19:25:56 INFO mapreduce.Job: Counters: 0 15/12/15 19:25:56 ERROR applications.HadoopIndexing: Problem running job java.io.IOException: Job failed! at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:838) at org.terrier.applications.HadoopIndexing.main(HadoopIndexing.java:244) at org.terrier.applications.TrecTerrier.run(TrecTerrier.java:391) at org.terrier.applications.TrecTerrier.applyOptions(TrecTerrier.java:599) at org.terrier.applications.TrecTerrier.main(TrecTerrier.java:246) Time Taken = 21429 seconds Time elapsed: 21429.554 seconds. bin/trec_terrier.sh -i -H 26.62s user 6.18s system 0% cpu 5:57:10.28 total

    JIRA | 12 months ago | Fedor Nikolaev
    java.lang.ArrayIndexOutOfBoundsException

    1 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.ArrayIndexOutOfBoundsException

      No message provided

      at java.net.SocketOutputStream.socketWrite()
    2. Java RT
      DataOutputStream.write
      1. java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:87)
      2. java.net.SocketOutputStream.write(SocketOutputStream.java:136)
      3. java.io.DataOutputStream.write(DataOutputStream.java:90)
      3 frames
    3. org.jenkinsci.plugins
      ClamAvRecorder.perform
      1. org.jenkinsci.plugins.clamav.scanner.ClamAvScanner.instream(ClamAvScanner.java:167)
      2. org.jenkinsci.plugins.clamav.scanner.ClamAvScanner.scan(ClamAvScanner.java:94)
      3. org.jenkinsci.plugins.clamav.ClamAvRecorder.perform(ClamAvRecorder.java:115)
      3 frames
    4. Hudson
      AbstractBuild$AbstractRunner.performAllBuildSteps
      1. hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
      2. hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:664)
      3. hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:639)
      3 frames
    5. Hudson Maven Embedder
      MavenModuleSetBuild$RunnerImpl.post2
      1. hudson.maven.MavenModuleSetBuild$RunnerImpl.post2(MavenModuleSetBuild.java:895)
      1 frame
    6. Hudson
      Run.run
      1. hudson.model.AbstractBuild$AbstractRunner.post(AbstractBuild.java:586)
      2. hudson.model.Run.run(Run.java:1400)
      2 frames
    7. Hudson Maven Embedder
      MavenModuleSetBuild.run
      1. hudson.maven.MavenModuleSetBuild.run(MavenModuleSetBuild.java:465)
      1 frame
    8. Hudson
      ResourceController.execute
      1. hudson.model.ResourceController.execute(ResourceController.java:88)
      1 frame