java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608

JIRA | Kevin Normoyle | 2 years ago
  1. 0

    repros every time. single jvm create 9M vector with Rapids, then add it to itself test does some other Rapids first, but eventually fails here cd h2o-dev/py2/testdir_single_jvm python test_rapids_vec_fail1.py if connecting to existing localhost:54321 python test_rapids_vec_fail1.py -uc rapids parameters: {'funs': None, 'ast': '(= !v (c {(: #0 #8999999)})'} exec: { "ast": "(= !v (c {(: #0 #8999999)})", "col_names": [ "C1" ], "exception": null, "funs": null, "funstr": null, "key": { "name": "v" }, "num_cols": 1, "num_rows": 9000000, "result": "", "scalar": 0.0, "schema_name": "RapidsV1", "schema_type": "Rapids", "schema_version": 1, "string": null } rapids parameters: {'funs': None, 'ast': '(= !v (+ $v $v))'} ERROR 11-23 17:15:04.468 192.168.0.34:54333 10641 # Session ERRR: java.lang.RuntimeException: water.DException$DistributedException: from /192.168.0.34:54333; by class water.rapids.ASTBinOp$1; class java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 at water.fvec.NewChunk.append2slowd(NewChunk.java:392) at water.fvec.NewChunk.addNum(NewChunk.java:239) at water.rapids.ASTBinOp$1.map(ASTOp.java:921) at water.MRTask.compute2(MRTask.java:426) at water.H2O$H2OCountedCompleter.compute(H2O.java:566) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) ERROR

    JIRA | 2 years ago | Kevin Normoyle
    java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608
  2. 0

    repros every time. single jvm create 9M vector with Rapids, then add it to itself test does some other Rapids first, but eventually fails here cd h2o-dev/py2/testdir_single_jvm python test_rapids_vec_fail1.py if connecting to existing localhost:54321 python test_rapids_vec_fail1.py -uc rapids parameters: {'funs': None, 'ast': '(= !v (c {(: #0 #8999999)})'} exec: { "ast": "(= !v (c {(: #0 #8999999)})", "col_names": [ "C1" ], "exception": null, "funs": null, "funstr": null, "key": { "name": "v" }, "num_cols": 1, "num_rows": 9000000, "result": "", "scalar": 0.0, "schema_name": "RapidsV1", "schema_type": "Rapids", "schema_version": 1, "string": null } rapids parameters: {'funs': None, 'ast': '(= !v (+ $v $v))'} ERROR 11-23 17:15:04.468 192.168.0.34:54333 10641 # Session ERRR: java.lang.RuntimeException: water.DException$DistributedException: from /192.168.0.34:54333; by class water.rapids.ASTBinOp$1; class java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 at water.fvec.NewChunk.append2slowd(NewChunk.java:392) at water.fvec.NewChunk.addNum(NewChunk.java:239) at water.rapids.ASTBinOp$1.map(ASTOp.java:921) at water.MRTask.compute2(MRTask.java:426) at water.H2O$H2OCountedCompleter.compute(H2O.java:566) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) ERROR

    JIRA | 2 years ago | Kevin Normoyle
    java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608
  3. 0

    Finding mean departure delays by day of week, using following function- fun <- function(df){ sum(df[,16],na.rm=T)/nrow(df) } h2o.addFunction(remote.h2o, fun) res <- h2o.ddply(air_noDepDelayedNAs, c('DayOfWeek'), fun) Error in .h2o.__remoteSend(client, .h2o.__PAGE_EXEC2, str = expr) : http://192.168.1.162:54545/2/Exec2.json returned the following error: from /192.168.1.162:54545; java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 Get following error (on master)- 06-Mar 01:06:22.103 192.168.1.162:54545 31087 # Session INFO HTTPD: POST /2/Exec2.json str=Last.value.19 = ddply(Last.value.13,c(4),fun) 06-Mar 01:06:49.975 192.168.1.162:54545 31087 # Session ERRR WATER: + water.DException$DistributedException: from /192.168.1.162:54545; java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 + at water.fvec.NewChunk.append2slow(NewChunk.java:151) + at water.fvec.NewChunk.append2(NewChunk.java:122) + at water.fvec.NewChunk.addNum(NewChunk.java:91) + at water.fvec.Frame$DeepSlice.map(Frame.java:762) + at water.MRTask2.compute2(MRTask2.java:366) + at water.H2O$H2OCountedCompleter.compute(H2O.java:713) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 3 years ago | Nidhi Mehta
    java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    master 5d7e1d5f5ef1974cbb Parse the attached file with Beta->ImportFiles2 (or with TestUtil.parseFromH2OFolder("irislarge.csv.gz"); Note that this test passes for an uncompressed file, or if ParseVA is used. How the file was made: cat the iris files together many times (Note: Will parse if using fewer than 16 in the command below: need to have > 2^23 rows, and probably requires a very small zip file (< 4MB?)) > cd smalldata/iris > cp iris.csv tmp; for i in {1..16}; do cat tmp tmp >> tmp2; mv tmp2 tmp; done; cat tmp | gzip > irislarge.csv.gz && rm tmp Stacktrace: 06:25:34.482 127.0.0.1:54321 # Session GET /2/Parse2.query source_key=nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz 06:25:35.403 127.0.0.1:54321 # Session GET /2/Parse2.html single_quotes=0 delete_on_done=1 header=0 separator=44 parser_type=CSV destination_key=irislarge.csv.hex source_key=nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz java.lang.RuntimeException: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 while mapping key nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz at water.DRemoteTask.block(DRemoteTask.java:81) at jsr166y.ForkJoinPool.managedBlock(ForkJoinPool.java:2803) at water.DRemoteTask.invoke(DRemoteTask.java:60) at water.fvec.ParseDataset2.parse_impl(ParseDataset2.java:288) at water.fvec.ParseDataset2.access$000(ParseDataset2.java:25) at water.fvec.ParseDataset2$ParserFJTask.compute2(ParseDataset2.java:87) at water.H2O$H2OCountedCompleter.compute(H2O.java:712) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 while mapping key nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz at water.fvec.NewChunk.append2slow(NewChunk.java:117) at water.fvec.NewChunk.append2(NewChunk.java:88) at water.fvec.NewChunk.addNum(NewChunk.java:79) at water.fvec.ParseDataset2$FVecDataOut.addNumCol(ParseDataset2.java:630) at water.parser.CsvParser.parallelParse(CsvParser.java:276) at water.parser.CustomParser.streamParse(CustomParser.java:195) at water.fvec.ParseDataset2$MultiFileParseTask.streamParse(ParseDataset2.java:486) at water.fvec.ParseDataset2$MultiFileParseTask.map(ParseDataset2.java:438) at water.MRTask.lcompute(MRTask.java:66) at water.DRemoteTask.compute2(DRemoteTask.java:91) ... 6 more

    JIRA | 3 years ago | Arno Candel
    java.lang.RuntimeException: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 while mapping key nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz
  6. 0

    master 5d7e1d5f5ef1974cbb Parse the attached file with Beta->ImportFiles2 (or with TestUtil.parseFromH2OFolder("irislarge.csv.gz"); Note that this test passes for an uncompressed file, or if ParseVA is used. How the file was made: cat the iris files together many times (Note: Will parse if using fewer than 16 in the command below: need to have > 2^23 rows, and probably requires a very small zip file (< 4MB?)) > cd smalldata/iris > cp iris.csv tmp; for i in {1..16}; do cat tmp tmp >> tmp2; mv tmp2 tmp; done; cat tmp | gzip > irislarge.csv.gz && rm tmp Stacktrace: 06:25:34.482 127.0.0.1:54321 # Session GET /2/Parse2.query source_key=nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz 06:25:35.403 127.0.0.1:54321 # Session GET /2/Parse2.html single_quotes=0 delete_on_done=1 header=0 separator=44 parser_type=CSV destination_key=irislarge.csv.hex source_key=nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz java.lang.RuntimeException: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 while mapping key nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz at water.DRemoteTask.block(DRemoteTask.java:81) at jsr166y.ForkJoinPool.managedBlock(ForkJoinPool.java:2803) at water.DRemoteTask.invoke(DRemoteTask.java:60) at water.fvec.ParseDataset2.parse_impl(ParseDataset2.java:288) at water.fvec.ParseDataset2.access$000(ParseDataset2.java:25) at water.fvec.ParseDataset2$ParserFJTask.compute2(ParseDataset2.java:87) at water.H2O$H2OCountedCompleter.compute(H2O.java:712) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 while mapping key nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz at water.fvec.NewChunk.append2slow(NewChunk.java:117) at water.fvec.NewChunk.append2(NewChunk.java:88) at water.fvec.NewChunk.addNum(NewChunk.java:79) at water.fvec.ParseDataset2$FVecDataOut.addNumCol(ParseDataset2.java:630) at water.parser.CsvParser.parallelParse(CsvParser.java:276) at water.parser.CustomParser.streamParse(CustomParser.java:195) at water.fvec.ParseDataset2$MultiFileParseTask.streamParse(ParseDataset2.java:486) at water.fvec.ParseDataset2$MultiFileParseTask.map(ParseDataset2.java:438) at water.MRTask.lcompute(MRTask.java:66) at water.DRemoteTask.compute2(DRemoteTask.java:91) ... 6 more

    JIRA | 3 years ago | Arno Candel
    java.lang.RuntimeException: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 8388608 while mapping key nfs://Users/arno/h2o/./smalldata/iris/irislarge.csv.gz

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.ArrayIndexOutOfBoundsException

      Array index out of range: 8388608

      at water.fvec.NewChunk.append2slowd()
    2. water.fvec
      NewChunk.addNum
      1. water.fvec.NewChunk.append2slowd(NewChunk.java:392)
      2. water.fvec.NewChunk.addNum(NewChunk.java:239)
      2 frames
    3. water.rapids
      ASTBinOp$1.map
      1. water.rapids.ASTBinOp$1.map(ASTOp.java:921)
      1 frame
    4. water
      H2O$H2OCountedCompleter.compute
      1. water.MRTask.compute2(MRTask.java:426)
      2. water.H2O$H2OCountedCompleter.compute(H2O.java:566)
      2 frames
    5. jsr166y
      ForkJoinWorkerThread.run
      1. jsr166y.CountedCompleter.exec(CountedCompleter.java:429)
      2. jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      3. jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      4. jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      5. jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      5 frames