java.lang.ArrayIndexOutOfBoundsException: -74112 while mapping key $00000000000000000000$syn_time.csv_0.hex

JIRA | Kevin Normoyle | 3 years ago
  1. 0

    updated a time parse test and got a stack trace. Would be nice to just get rid of Summary1/va, but may need to put some of the Summary2 bin/bounds updates into Summary1 got stack trace below in Summary1 data was just this. but it translates to numbers that are all ...E12 in h2o that apparently causes bad Summary1 behavior 14-Jun-41, 29-Mar-58, 12-OCT-23, 11-Feb-65, 31-JAN-40, 18-Apr-31 14-Jun-41, 29-Mar-58, 12-OCT-23, 11-Feb-65, 31-JAN-40, 18-Apr-31 14-Jun-41, 29-Mar-58, 12-OCT-23, 11-Feb-65, 31-JAN-40, 18-Apr-31 14-Jun-41, 29-Mar-58, 12-OCT-23, 11-Feb-65, 31-JAN-40, 18-Apr-31 14-Jun-41, 29-Mar-58, 12-OCT-23, 11-Feb-65, 31-JAN-40, 18-Apr-31 14-Jun-41, 29-Mar-58, 12-OCT-23, 11-Feb-65, 31-JAN-40, 18-Apr-31 14-Jun-41, 29-Mar-58, 12-OCT-23, 11-Feb-65, 31-JAN-40, 18-Apr-31 14-Jun-41, 29-Mar-58, 12-OCT-23, 11-Feb-65, 31-JAN-40, 18-Apr-31 14-Jun-41, 29-Mar-58, 12-OCT-23, 11-Feb-65, 31-JAN-40, 18-Apr-31 14-Jun-41, 29-Mar-58, 12-OCT-23, 11-Feb-65, 31-JAN-40, 18-Apr-31 14-Jun-41, 29-Mar-58, 12-OCT-23, 11-Feb-65, 31-JAN-40, 18-Apr-31 14-Jun-41, 29-Mar-58, 12-OCT-23, 11-Feb-65, 31-JAN-40, 18-Apr-31 14-Jun-41, 29-Mar-58, 12-OCT-23, 11-Feb-65, 31-JAN-40, 18-Apr-31 14-Jun-41, 29-Mar-58, 12-OCT-23, 11-Feb-65, 31-JAN-40, 18-Apr-31 14-Jun-41, 29-Mar-58, 12-OCT-23, 11-Feb-65, 31-JAN-40, 18-Apr-31 might guess these numbers would also cause problems 2.254806E12,2.7846108E12,1.697094E12,3.0015648E12,2.2116096E12,1.934262E12 2.254806E12,2.7846108E12,1.697094E12,3.0015648E12,2.2116096E12,1.934262E12 water.DException$DistributedException: from /192.168.0.37:54323; java.lang.ArrayIndexOutOfBoundsException: -74112 while mapping key $00000000000000000000$syn_time.csv_0.hex at hex.Summary$ColSummary.add(Summary.java:201) at hex.ColSummaryTask.map(ColSummaryTask.java:13) at hex.ColSummaryTask.map(ColSummaryTask.java:5) at hex.RowTask.map(RowTask.java:45) at water.MRTask.lcompute(MRTask.java:66) at water.DRemoteTask.compute2(DRemoteTask.java:91) at water.H2O$H2OCountedCompleter.compute(H2O.java:713) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 3 years ago | Kevin Normoyle
    java.lang.ArrayIndexOutOfBoundsException: -74112 while mapping key $00000000000000000000$syn_time.csv_0.hex
  2. Speed up your debug routine!

    Automated exception search integrated into your IDE

  3. 0

    master 5d7e1d5f5ef1974cbb Parse the attached file with Beta->ImportFiles2 (or with TestUtil.parseFromH2OFolder("irislarge.csv.gz"); Note that this test passes for an uncompressed file, or if ParseVA is used. How the file was made: cat the iris files together many times (Note: Will parse if using fewer than 16 in the command below: need to have > 2^23 rows, and probably requires a very small zip file (< 4MB?)) > cd smalldata/iris > cp iris.csv tmp; for i in {1..16}; do cat tmp tmp >> tmp2; mv tmp2 tmp; done; cat tmp | gzip > irislarge.csv.gz && rm tmp Stacktrace: 06:25:34.482 127.0.0.1:54321 # Session GET /2/Parse2.query source_key=nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz 06:25:35.403 127.0.0.1:54321 # Session GET /2/Parse2.html single_quotes=0 delete_on_done=1 header=0 separator=44 parser_type=CSV destination_key=irislarge.csv.hex source_key=nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz java.lang.RuntimeException: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 while mapping key nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz at water.DRemoteTask.block(DRemoteTask.java:81) at jsr166y.ForkJoinPool.managedBlock(ForkJoinPool.java:2803) at water.DRemoteTask.invoke(DRemoteTask.java:60) at water.fvec.ParseDataset2.parse_impl(ParseDataset2.java:288) at water.fvec.ParseDataset2.access$000(ParseDataset2.java:25) at water.fvec.ParseDataset2$ParserFJTask.compute2(ParseDataset2.java:87) at water.H2O$H2OCountedCompleter.compute(H2O.java:712) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 while mapping key nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz at water.fvec.NewChunk.append2slow(NewChunk.java:117) at water.fvec.NewChunk.append2(NewChunk.java:88) at water.fvec.NewChunk.addNum(NewChunk.java:79) at water.fvec.ParseDataset2$FVecDataOut.addNumCol(ParseDataset2.java:630) at water.parser.CsvParser.parallelParse(CsvParser.java:276) at water.parser.CustomParser.streamParse(CustomParser.java:195) at water.fvec.ParseDataset2$MultiFileParseTask.streamParse(ParseDataset2.java:486) at water.fvec.ParseDataset2$MultiFileParseTask.map(ParseDataset2.java:438) at water.MRTask.lcompute(MRTask.java:66) at water.DRemoteTask.compute2(DRemoteTask.java:91) ... 6 more

    JIRA | 3 years ago | Arno Candel
    java.lang.RuntimeException: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 while mapping key nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz
  4. 0

    master 5d7e1d5f5ef1974cbb Parse the attached file with Beta->ImportFiles2 (or with TestUtil.parseFromH2OFolder("irislarge.csv.gz"); Note that this test passes for an uncompressed file, or if ParseVA is used. How the file was made: cat the iris files together many times (Note: Will parse if using fewer than 16 in the command below: need to have > 2^23 rows, and probably requires a very small zip file (< 4MB?)) > cd smalldata/iris > cp iris.csv tmp; for i in {1..16}; do cat tmp tmp >> tmp2; mv tmp2 tmp; done; cat tmp | gzip > irislarge.csv.gz && rm tmp Stacktrace: 06:25:34.482 127.0.0.1:54321 # Session GET /2/Parse2.query source_key=nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz 06:25:35.403 127.0.0.1:54321 # Session GET /2/Parse2.html single_quotes=0 delete_on_done=1 header=0 separator=44 parser_type=CSV destination_key=irislarge.csv.hex source_key=nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz java.lang.RuntimeException: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 while mapping key nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz at water.DRemoteTask.block(DRemoteTask.java:81) at jsr166y.ForkJoinPool.managedBlock(ForkJoinPool.java:2803) at water.DRemoteTask.invoke(DRemoteTask.java:60) at water.fvec.ParseDataset2.parse_impl(ParseDataset2.java:288) at water.fvec.ParseDataset2.access$000(ParseDataset2.java:25) at water.fvec.ParseDataset2$ParserFJTask.compute2(ParseDataset2.java:87) at water.H2O$H2OCountedCompleter.compute(H2O.java:712) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 while mapping key nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz at water.fvec.NewChunk.append2slow(NewChunk.java:117) at water.fvec.NewChunk.append2(NewChunk.java:88) at water.fvec.NewChunk.addNum(NewChunk.java:79) at water.fvec.ParseDataset2$FVecDataOut.addNumCol(ParseDataset2.java:630) at water.parser.CsvParser.parallelParse(CsvParser.java:276) at water.parser.CustomParser.streamParse(CustomParser.java:195) at water.fvec.ParseDataset2$MultiFileParseTask.streamParse(ParseDataset2.java:486) at water.fvec.ParseDataset2$MultiFileParseTask.map(ParseDataset2.java:438) at water.MRTask.lcompute(MRTask.java:66) at water.DRemoteTask.compute2(DRemoteTask.java:91) ... 6 more

    JIRA | 3 years ago | Arno Candel
    java.lang.RuntimeException: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 while mapping key nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.ArrayIndexOutOfBoundsException

      -74112 while mapping key $00000000000000000000$syn_time.csv_0.hex

      at hex.Summary$ColSummary.add()
    2. hex
      RowTask.map
      1. hex.Summary$ColSummary.add(Summary.java:201)
      2. hex.ColSummaryTask.map(ColSummaryTask.java:13)
      3. hex.ColSummaryTask.map(ColSummaryTask.java:5)
      4. hex.RowTask.map(RowTask.java:45)
      4 frames
    3. water
      H2O$H2OCountedCompleter.compute
      1. water.MRTask.lcompute(MRTask.java:66)
      2. water.DRemoteTask.compute2(DRemoteTask.java:91)
      3. water.H2O$H2OCountedCompleter.compute(H2O.java:713)
      3 frames
    4. jsr166y
      ForkJoinWorkerThread.run
      1. jsr166y.CountedCompleter.exec(CountedCompleter.java:429)
      2. jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      3. jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      4. jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      5. jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      5 frames