java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 5233

JIRA | Arno Candel | 9 months ago
  1. 0

    Parse attached file (unzip first) via {code} train.hex <- h2o.uploadFile("preparedTrain.csv", destination_frame = "train.hex") {code} Then build DL model in Flow (1 node): {code} buildModel 'deeplearning', {"model_id":"deeplearning-e5f73f18-316d-4320-b6c1-fdd761c6c01d","training_frame":"train.hex","nfolds":"2","response_column":"TARGET","ignored_columns":[],"ignore_const_cols":true,"activation":"Rectifier","hidden":[200,200],"epochs":10,"variable_importances":false,"fold_assignment":"AUTO","score_each_iteration":false,"checkpoint":"","use_all_factor_levels":true,"standardize":true,"train_samples_per_iteration":-2,"adaptive_rate":true,"input_dropout_ratio":0,"l1":0,"l2":0,"loss":"Automatic","distribution":"AUTO","score_interval":5,"score_training_samples":10000,"score_duty_cycle":0.1,"stopping_rounds":5,"stopping_metric":"AUTO","stopping_tolerance":0,"max_runtime_secs":0,"autoencoder":false,"keep_cross_validation_predictions":false,"pretrained_autoencoder":"","target_ratio_comm_to_comp":0.05,"seed":3861197540933068300,"rho":0.99,"epsilon":1e-8,"max_w2":"Infinity","initial_weight_distribution":"UniformAdaptive","regression_stop":0.000001,"diagnostics":true,"fast_mode":true,"force_load_balance":true,"single_node_mode":false,"shuffle_training_data":false,"missing_values_handling":"MeanImputation","quiet_mode":false,"sparse":false,"col_major":false,"average_activation":0,"sparsity_beta":0,"max_categorical_features":2147483647,"reproducible":false,"export_weights_and_biases":false,"mini_batch_size":1,"elastic_averaging":false} {code} {code} water.DException$DistributedException: from /192.168.11.2:54321; by class hex.ModelBuilder$1; class java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 5233 at java.util.Arrays.rangeCheck(Arrays.java:120) at java.util.Arrays.binarySearch(Arrays.java:1901) at water.fvec.NewChunk.values(NewChunk.java:160) at water.fvec.RebalanceDataSet$RebalanceTask.rebalanceChunk(RebalanceDataSet.java:118) at water.fvec.RebalanceDataSet$RebalanceTask.map(RebalanceDataSet.java:142) at water.MRTask.compute2(MRTask.java:615) at water.MRTask.compute2(MRTask.java:570) at water.MRTask.compute2(MRTask.java:570) at water.MRTask.compute2(MRTask.java:570) at water.H2O$H2OCountedCompleter.compute1(H2O.java:1093) at water.fvec.RebalanceDataSet$RebalanceTask$Icer.compute1(RebalanceDataSet$RebalanceTask$Icer.java) at water.H2O$H2OCountedCompleter.compute(H2O.java:1089) at jsr166y.CountedCompleter.exec(CountedCompleter.java:468) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:914) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:979) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) {code}

    JIRA | 9 months ago | Arno Candel
    java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 5233
  2. Speed up your debug routine!

    Automated exception search integrated into your IDE

  3. 0

    From hermanvanhovell@gmail.com Hi all, I am getting strange errors when running H2O (using RF/GBM), it seems cross validation related. Here is the R output for a random forrest: model.rf = h2o.randomForest(x = x, y = y, data = train.h2o, nfolds = nfolds, key = sprintf("model_RF_%s_I%s", date, iteration), classification = F, ntree = 30, depth = 10, type = "BigData", importance = T) |================== | 17% Polling fails: <simpleError in .h2o.__poll(client, job_key): Got exception 'class java.lang.RuntimeException', with msg 'java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 934' java.lang.RuntimeException: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 934 at hex.FrameExtractor.getResult(FrameExtractor.java:77) at water.util.CrossValUtils.crossValidate(CrossValUtils.java:29) at hex.drf.DRF.execImpl(DRF.java:189) at water.Func.exec(Func.java:42) at water.Job$3.compute2(Job.java:333) at water.H2O$H2OCountedCompleter.compute(H2O.java:633) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 934 at java.util.Arrays.rangeCheck(Arrays.java:801) at java.util.Arrays.binarySearch(Arrays.java:945) at water.fvec.NewChunk.values(NewChunk.java:84) at water.fvec.ChunkSplitter.extractChunkPart(ChunkSplitter.java:26) at hex.NFoldFrameExtractor$FoldExtractTask.map(NFoldFrameExtractor.java:105) at water.MRTask2.compute2(MRTask2.java:404) at water.MRTask2.compute2(MRTask2.java:365) at water.MRTask2.compute2(MRTask2.java:365) at water.MRTask2.compute2(MRTask2.java:365) at water.MRTask2.compute2(MRTask2.java:365) at water.MRTask2.compute2(MRTask2.java:365) at water.MRTask2.compute2(MRTask2.java:365) at water.MRTask2.compute2(MRTask2.java:365) ... 6 more ...and here is the R output for GBM: # Estimate GBM model.gbm = h2o.gbm(x = x, y = y, data = train.h2o, nfolds = nfolds, key = sprintf("model_GBM_%s_I%s", date, iteration), distribution = "gaussian", n.trees = 30, interaction.depth = 7, n.minobsinnode = 10, shrinkage = 0.2, importance = T) |================== | 17% Polling fails: <simpleError in .h2o.__poll(client, job_key): Got exception 'class java.lang.RuntimeException', with msg 'java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 932' java.lang.RuntimeException: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 932 at hex.FrameExtractor.getResult(FrameExtractor.java:77) at water.util.CrossValUtils.crossValidate(CrossValUtils.java:29) at hex.gbm.GBM.execImpl(GBM.java:201) at water.Func.exec(Func.java:42) at water.Job$3.compute2(Job.java:333) at water.H2O$H2OCountedCompleter.compute(H2O.java:633) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 932 at java.util.Arrays.rangeCheck(Arrays.java:801) at java.util.Arrays.binarySearch(Arrays.java:945) at water.fvec.NewChunk.values(NewChunk.java:84) at water.fvec.ChunkSplitter.extractChunkPart(ChunkSplitter.java:26) at hex.NFoldFrameExtractor$FoldExtractTask.map(NFoldFrameExtractor.java:105) at water.MRTask2.compute2(MRTask2.java:404) at water.MRTask2.compute2(MRTask2.java:365) at water.MRTask2.compute2(MRTask2.java:365) at water.MRTask2.compute2(MRTask2.java:365) at water.MRTask2.compute2(MRTask2.java:365) at water.MRTask2.compute2(MRTask2.java:365) at water.MRTask2.compute2(MRTask2.java:365) at water.MRTask2.compute2(MRTask2.java:365) ... 6 more Any idea what is causing this, and how to fix this? Kind regards, Herman

    JIRA | 2 years ago | Tom Kraljevic
    java.lang.RuntimeException: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 934
  4. 0

    Build git branch:master Build git hash:e62440a967648b95ec782070c16c67051c532759 While splitting the frame from R, get NPE. Dataset attached. Run the following commands- myIP = '10.0.0.3' myPort = 54321 h <- h2o.init(ip = myIP, port = myPort) BostonHousing = h2o.importFile(h,"/Users/nidhimehta/Desktop/Bostonhousingdata.txt", key="BostonHousing") dim(BostonHousing) colnames(BostonHousing) = c("CRIM","ZN", "INDUS","CHAS","NOX","RM","AGE","DIS","RAD","TAX","PTRATIO","B","LSTAT","MEDV") str(BostonHousing) BostonHousing$CHAS = as.factor(BostonHousing$CHAS) s = h2o.splitFrame(data = BostonHousing,ratios=.7) Error: Internal Server Error 10:55:44.961 # Session INFO HTTPD: POST /2/FrameSplitPage.json shuffle=0 ratios=0.7 source=BostonHousing 10:55:44.962 # Session INFO HTTPD: POST /2/FrameSplitPage.json shuffle=0 ratios=0.7 source=BostonHousing 10:55:44.978 FJ-0-11 ERRR WATER: + java.lang.NullPointerException + at water.fvec.NewChunk.values(NewChunk.java:121) + at water.fvec.ChunkSplitter.extractChunkPart(ChunkSplitter.java:28) + at hex.FrameSplitter$FrameSplitTask.map(FrameSplitter.java:197) + at water.MRTask2.compute2(MRTask2.java:404) + at water.H2O$H2OCountedCompleter.compute(H2O.java:641) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 10:55:44.979 FJ-0-11 ERRR WATER: gor exception in chunkSplitter, ic = FlatTransfChunk(start = 0, len = 506), oc = C0LChunk(start = 0, len = 354) startRow = 0 nrows = 354 10:55:44.979 FJ-0-7 ERRR WATER: + java.lang.NullPointerException + at water.fvec.NewChunk.values(NewChunk.java:121) + at water.fvec.ChunkSplitter.extractChunkPart(ChunkSplitter.java:28) + at hex.FrameSplitter$FrameSplitTask.map(FrameSplitter.java:197) + at water.MRTask2.compute2(MRTask2.java:404) + at water.H2O$H2OCountedCompleter.compute(H2O.java:641) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 10:55:44.980 FJ-0-7 ERRR WATER: gor exception in chunkSplitter, ic = FlatTransfChunk(start = 0, len = 506), oc = C0LChunk(start = 0, len = 152) startRow = 354 nrows = 152 java.lang.RuntimeException: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 506 at hex.FrameSplitter.getResult(FrameSplitter.java:102) at water.api.FrameSplitPage.execImpl(FrameSplitPage.java:73) at water.Func.exec(Func.java:42) at water.Func.invoke(Func.java:29) at water.Func.serve(Func.java:61) at water.api.Request.serveGrid(Request.java:165) at water.Request2.superServeGrid(Request2.java:481) at water.Request2.serveGrid(Request2.java:402) at water.api.Request.serve(Request.java:142) at water.api.RequestServer.serve(RequestServer.java:498) at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:424) at java.lang.Thread.run(Thread.java:744) Caused by: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 506 at java.util.Arrays.rangeCheck(Arrays.java:801) at java.util.Arrays.binarySearch(Arrays.java:945) at water.fvec.NewChunk.values(NewChunk.java:86) at water.fvec.ChunkSplitter.extractChunkPart(ChunkSplitter.java:28) at hex.FrameSplitter$FrameSplitTask.map(FrameSplitter.java:197) at water.MRTask2.compute2(MRTask2.java:404) at water.H2O$H2OCountedCompleter.compute(H2O.java:641) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 2 years ago | Nidhi Mehta
    java.lang.RuntimeException: java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 506

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.ArrayIndexOutOfBoundsException

      Array index out of range: 5233

      at java.util.Arrays.rangeCheck()
    2. Java RT
      Arrays.binarySearch
      1. java.util.Arrays.rangeCheck(Arrays.java:120)
      2. java.util.Arrays.binarySearch(Arrays.java:1901)
      2 frames
    3. water.fvec
      RebalanceDataSet$RebalanceTask.map
      1. water.fvec.NewChunk.values(NewChunk.java:160)
      2. water.fvec.RebalanceDataSet$RebalanceTask.rebalanceChunk(RebalanceDataSet.java:118)
      3. water.fvec.RebalanceDataSet$RebalanceTask.map(RebalanceDataSet.java:142)
      3 frames
    4. water
      H2O$H2OCountedCompleter.compute1
      1. water.MRTask.compute2(MRTask.java:615)
      2. water.MRTask.compute2(MRTask.java:570)
      3. water.MRTask.compute2(MRTask.java:570)
      4. water.MRTask.compute2(MRTask.java:570)
      5. water.H2O$H2OCountedCompleter.compute1(H2O.java:1093)
      5 frames
    5. water.fvec
      RebalanceDataSet$RebalanceTask$Icer.compute1
      1. water.fvec.RebalanceDataSet$RebalanceTask$Icer.compute1(RebalanceDataSet$RebalanceTask$Icer.java)
      1 frame
    6. water
      H2O$H2OCountedCompleter.compute
      1. water.H2O$H2OCountedCompleter.compute(H2O.java:1089)
      1 frame
    7. jsr166y
      ForkJoinWorkerThread.run
      1. jsr166y.CountedCompleter.exec(CountedCompleter.java:468)
      2. jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      3. jsr166y.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:914)
      4. jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:979)
      5. jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      6. jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      6 frames