java.lang.ArrayIndexOutOfBoundsException: -2143289344

JIRA | Earl Hathaway | 4 years ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    I built a large airline dataset by concatenating the individual year files. This sometimes crashes the parse with the below error; other times, the parse just appears to freeze. Sometimes you see the below exception; sometimes you don't. Setups: h2o h2o-1.7.0.493 / sha 4 node cluster, Xmx10g, one node each on 1.161-1.164. data -> import files -> parse on /home/earl/./oldairlines/airlines.orig.all.withheader.25.csv.gz it will also die if you gunzip that; kevin and I repeatedly split the csv file and it will also die on /home/earl/oldairlines/25.splits/12.splits/6.split/xaa diagnoses: always dies on 4 nodes (4x10g on the 0xb[1-4] machines) dies < 10% of the time on 3 nodes (4x10g on 0xb[1-3]) rarely dies on 2 nodes (4x10g on 0xb[1-2]) sporadically dies on 1 node (4x40g on 0xb1) exact version: 04:01:10.042 main      INFO WATER: Build git branch: master 04:01:10.042 main      INFO WATER: Build git hash: ba4f4e157944e1adaff48e59f770c4a6dd02e6de 04:01:10.042 main      INFO WATER: Build git describe: ba4f4e1 04:01:10.042 main      INFO WATER: Build project version: 1.7.0.493 04:01:10.042 main      INFO WATER: Built by: 'jenkins' 04:01:10.043 main      INFO WATER: Built on: 'Tue Aug 20 01:01:45 PDT 2013' exception: 06:24:28.365 FJ-10-1 INFO WATER: Cloud of size 2 formed [/192.168.1.161:54321, /192.168.1.162:54321] 06:24:31.365 FJ-10-1 INFO WATER: Cloud of size 3 formed [/192.168.1.161:54321, /192.168.1.162:54321, /192.168.1.163:54321] 06:24:33.491 FJ-10-1 INFO WATER: Cloud of size 4 formed [/192.168.1.161:54321, /192.168.1.162:54321, /192.168.1.163:54321, /192.168.1.164:54321] 06:25:09.510 #:54321-0 INFO WATER: Start remote task#13 class water.parser.DParseTask from /192.168.1.163:54321 java.lang.ArrayIndexOutOfBoundsException: -2143289344 06:25:25.704 FJ-9-5 INFO WATER: at water.parser.CsvParser.parallelParse(CsvParser.java:436) 06:25:25.705 FJ-9-5 INFO WATER: at water.parser.DParseTask.map(DParseTask.java:536) 06:25:25.705 FJ-9-5 INFO WATER: at water.MRTask.lcompute(MRTask.java:66) 06:25:25.705 FJ-9-5 INFO WATER: at water.DRemoteTask.compute2(DRemoteTask.java:76) 06:25:25.705 FJ-9-5 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:572) 06:25:25.705 FJ-9-5 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 06:25:25.706 FJ-9-5 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 06:25:25.706 FJ-9-5 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 06:25:25.706 FJ-9-5 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 06:25:25.706 FJ-9-5 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 06:25:25.770 FJ-9-5 INFO WATER: Done remote task#13 class water.parser.DParseTask to /192.168.1.163:54321 java.lang.NullPointerException 06:25:25.893 FJ-9-7 INFO WATER: at water.parser.DParseTask.addNumCol(DParseTask.java:944) 06:25:25.895 FJ-9-7 INFO WATER: at water.parser.CsvParser.parallelParse(CsvParser.java:273) 06:25:25.895 FJ-9-7 INFO WATER: at water.parser.DParseTask.map(DParseTask.java:565) 06:25:25.896 FJ-9-7 INFO WATER: at water.MRTask.lcompute(MRTask.java:66) 06:25:25.896 FJ-9-7 INFO WATER: at water.DRemoteTask.compute2(DRemoteTask.java:76) 06:25:25.897 FJ-9-7 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:572) 06:25:25.897 FJ-9-7 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 06:25:25.898 FJ-9-7 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 06:25:25.898 FJ-9-7 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 06:25:25.899 FJ-9-7 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 06:25:25.899 FJ-9-7 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 4 years ago | Earl Hathaway
    java.lang.ArrayIndexOutOfBoundsException: -2143289344
  2. 0

    I built a large airline dataset by concatenating the individual year files. This sometimes crashes the parse with the below error; other times, the parse just appears to freeze. Sometimes you see the below exception; sometimes you don't. Setups: h2o h2o-1.7.0.493 / sha 4 node cluster, Xmx10g, one node each on 1.161-1.164. data -> import files -> parse on /home/earl/./oldairlines/airlines.orig.all.withheader.25.csv.gz it will also die if you gunzip that; kevin and I repeatedly split the csv file and it will also die on /home/earl/oldairlines/25.splits/12.splits/6.split/xaa diagnoses: always dies on 4 nodes (4x10g on the 0xb[1-4] machines) dies < 10% of the time on 3 nodes (4x10g on 0xb[1-3]) rarely dies on 2 nodes (4x10g on 0xb[1-2]) sporadically dies on 1 node (4x40g on 0xb1) exact version: 04:01:10.042 main      INFO WATER: Build git branch: master 04:01:10.042 main      INFO WATER: Build git hash: ba4f4e157944e1adaff48e59f770c4a6dd02e6de 04:01:10.042 main      INFO WATER: Build git describe: ba4f4e1 04:01:10.042 main      INFO WATER: Build project version: 1.7.0.493 04:01:10.042 main      INFO WATER: Built by: 'jenkins' 04:01:10.043 main      INFO WATER: Built on: 'Tue Aug 20 01:01:45 PDT 2013' exception: 06:24:28.365 FJ-10-1 INFO WATER: Cloud of size 2 formed [/192.168.1.161:54321, /192.168.1.162:54321] 06:24:31.365 FJ-10-1 INFO WATER: Cloud of size 3 formed [/192.168.1.161:54321, /192.168.1.162:54321, /192.168.1.163:54321] 06:24:33.491 FJ-10-1 INFO WATER: Cloud of size 4 formed [/192.168.1.161:54321, /192.168.1.162:54321, /192.168.1.163:54321, /192.168.1.164:54321] 06:25:09.510 #:54321-0 INFO WATER: Start remote task#13 class water.parser.DParseTask from /192.168.1.163:54321 java.lang.ArrayIndexOutOfBoundsException: -2143289344 06:25:25.704 FJ-9-5 INFO WATER: at water.parser.CsvParser.parallelParse(CsvParser.java:436) 06:25:25.705 FJ-9-5 INFO WATER: at water.parser.DParseTask.map(DParseTask.java:536) 06:25:25.705 FJ-9-5 INFO WATER: at water.MRTask.lcompute(MRTask.java:66) 06:25:25.705 FJ-9-5 INFO WATER: at water.DRemoteTask.compute2(DRemoteTask.java:76) 06:25:25.705 FJ-9-5 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:572) 06:25:25.705 FJ-9-5 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 06:25:25.706 FJ-9-5 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 06:25:25.706 FJ-9-5 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 06:25:25.706 FJ-9-5 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 06:25:25.706 FJ-9-5 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 06:25:25.770 FJ-9-5 INFO WATER: Done remote task#13 class water.parser.DParseTask to /192.168.1.163:54321 java.lang.NullPointerException 06:25:25.893 FJ-9-7 INFO WATER: at water.parser.DParseTask.addNumCol(DParseTask.java:944) 06:25:25.895 FJ-9-7 INFO WATER: at water.parser.CsvParser.parallelParse(CsvParser.java:273) 06:25:25.895 FJ-9-7 INFO WATER: at water.parser.DParseTask.map(DParseTask.java:565) 06:25:25.896 FJ-9-7 INFO WATER: at water.MRTask.lcompute(MRTask.java:66) 06:25:25.896 FJ-9-7 INFO WATER: at water.DRemoteTask.compute2(DRemoteTask.java:76) 06:25:25.897 FJ-9-7 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:572) 06:25:25.897 FJ-9-7 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 06:25:25.898 FJ-9-7 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 06:25:25.898 FJ-9-7 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 06:25:25.899 FJ-9-7 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 06:25:25.899 FJ-9-7 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 4 years ago | Earl Hathaway
    java.lang.ArrayIndexOutOfBoundsException: -2143289344 06:25:25.704 FJ-9-5 INFO WATER: at water.parser.CsvParser.parallelParse(CsvParser.java:436)

    Root Cause Analysis

    1. java.lang.ArrayIndexOutOfBoundsException

      -2143289344

      at water.parser.CsvParser.parallelParse()
    2. water.parser
      DParseTask.map
      1. water.parser.CsvParser.parallelParse(CsvParser.java:436)
      2. water.parser.DParseTask.map(DParseTask.java:536)
      2 frames
    3. water
      H2O$H2OCountedCompleter.compute
      1. water.MRTask.lcompute(MRTask.java:66)
      2. water.DRemoteTask.compute2(DRemoteTask.java:76)
      3. water.H2O$H2OCountedCompleter.compute(H2O.java:572)
      3 frames
    4. jsr166y
      ForkJoinWorkerThread.run
      1. jsr166y.CountedCompleter.exec(CountedCompleter.java:429)
      2. jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      3. jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      4. jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      5. jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      5 frames