java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1

JIRA | Nidhi Mehta | 2 years ago
  1. 0

    A proper error msg should be thrown when user sets the max depth =0 ntr = h2o.uploadFile(h,"/Users/nidhimehta/Desktop/shuttle_tr.csv", key="ntr") nts = h2o.uploadFile(h,"/Users/nidhimehta/Desktop/shuttle_ts.csv", key="nts") ntr ntr$C10 = as.factor(ntr$C10) nts$C10 = as.factor(nts$C10) myX = 1:9 myY = 10 tree = 10 my_gbm = h2o.gbm(x=myX,y=myY,loss = "multinomial",training_frame=ntr,validation_frame=nts, ntrees=tree,max_depth=0,min_rows=10,learn_rate=0.01,nbins=20) | | 0% Got exception 'class java.lang.RuntimeException', with msg 'water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1' java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1 at water.MRTask.getResult(MRTask.java:265) at water.MRTask.doAll(MRTask.java:220) at water.MRTask.doAll(MRTask.java:216) at hex.tree.gbm.GBM$GBMDriver.buildNextKTrees(GBM.java:311) at hex.tree.gbm.GBM$GBMDriver.buildModel(GBM.java:150) at hex.tree.SharedTree$Driver.compute2(SharedTree.java:165) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1 at hex.tree.DTree.node(DTree.java:50) at hex.tree.DTree.decided(DTree.java:53) at hex.tree.gbm.GBM$GBMDriver$GammaPass.map(GBM.java:404) at water.MRTask.compute2(MRTask.java:415) ... 6 more Error: 'water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1'

    JIRA | 2 years ago | Nidhi Mehta
    java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1
  2. 0

    A proper error msg should be thrown when user sets the max depth =0 ntr = h2o.uploadFile(h,"/Users/nidhimehta/Desktop/shuttle_tr.csv", key="ntr") nts = h2o.uploadFile(h,"/Users/nidhimehta/Desktop/shuttle_ts.csv", key="nts") ntr ntr$C10 = as.factor(ntr$C10) nts$C10 = as.factor(nts$C10) myX = 1:9 myY = 10 tree = 10 my_gbm = h2o.gbm(x=myX,y=myY,loss = "multinomial",training_frame=ntr,validation_frame=nts, ntrees=tree,max_depth=0,min_rows=10,learn_rate=0.01,nbins=20) | | 0% Got exception 'class java.lang.RuntimeException', with msg 'water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1' java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1 at water.MRTask.getResult(MRTask.java:265) at water.MRTask.doAll(MRTask.java:220) at water.MRTask.doAll(MRTask.java:216) at hex.tree.gbm.GBM$GBMDriver.buildNextKTrees(GBM.java:311) at hex.tree.gbm.GBM$GBMDriver.buildModel(GBM.java:150) at hex.tree.SharedTree$Driver.compute2(SharedTree.java:165) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1 at hex.tree.DTree.node(DTree.java:50) at hex.tree.DTree.decided(DTree.java:53) at hex.tree.gbm.GBM$GBMDriver$GammaPass.map(GBM.java:404) at water.MRTask.compute2(MRTask.java:415) ... 6 more Error: 'water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1'

    JIRA | 2 years ago | Nidhi Mehta
    java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1
  3. 0

    datafile on : 172.16.2.183:/home/nidhi/fac.csv.zip buildModel 'pca', {"model_id":"pca-5bb089b3-5a88-42eb-a6e2-ec77dd35f4a2","training_frame":"fac","ignore_const_cols":true,"score_each_iteration":false,"transform":"STANDARDIZE","k":"10","max_iterations":"2000","seed":1432658940947321000} Got exception 'class java.lang.RuntimeException', with msg 'water.DException$DistributedException: from /192.168.1.13:54321; by class hex.svd.SVD$CalcSigmaU; class java.lang.ArrayIndexOutOfBoundsException: 4900' java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.13:54321; by class hex.svd.SVD$CalcSigmaU; class java.lang.ArrayIndexOutOfBoundsException: 4900 at water.MRTask.getResult(MRTask.java:267) at water.MRTask.doAll(MRTask.java:221) at water.MRTask.doAll(MRTask.java:217) at hex.svd.SVD$SVDDriver.compute2(SVD.java:188) at water.H2O$H2OCountedCompleter.compute(H2O.java:666) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: water.DException$DistributedException: from /192.168.1.13:54321; by class hex.svd.SVD$CalcSigmaU; class java.lang.ArrayIndexOutOfBoundsException: 4900 at hex.svd.SVD.l2norm2(SVD.java:283) at hex.svd.SVD.access$900(SVD.java:25) at hex.svd.SVD$CalcSigmaU.map(SVD.java:331) at water.MRTask.compute2(MRTask.java:443) ... 6 more

    JIRA | 2 years ago | Nidhi Mehta
    java.lang.ArrayIndexOutOfBoundsException: 4900' java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.13:54321; by class hex.svd.SVD$CalcSigmaU; class java.lang.ArrayIndexOutOfBoundsException: 4900
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Parse attached file (unzip first) via {code} train.hex <- h2o.uploadFile("preparedTrain.csv", destination_frame = "train.hex") {code} Then build DL model in Flow (1 node): {code} buildModel 'deeplearning', {"model_id":"deeplearning-e5f73f18-316d-4320-b6c1-fdd761c6c01d","training_frame":"train.hex","nfolds":"2","response_column":"TARGET","ignored_columns":[],"ignore_const_cols":true,"activation":"Rectifier","hidden":[200,200],"epochs":10,"variable_importances":false,"fold_assignment":"AUTO","score_each_iteration":false,"checkpoint":"","use_all_factor_levels":true,"standardize":true,"train_samples_per_iteration":-2,"adaptive_rate":true,"input_dropout_ratio":0,"l1":0,"l2":0,"loss":"Automatic","distribution":"AUTO","score_interval":5,"score_training_samples":10000,"score_duty_cycle":0.1,"stopping_rounds":5,"stopping_metric":"AUTO","stopping_tolerance":0,"max_runtime_secs":0,"autoencoder":false,"keep_cross_validation_predictions":false,"pretrained_autoencoder":"","target_ratio_comm_to_comp":0.05,"seed":3861197540933068300,"rho":0.99,"epsilon":1e-8,"max_w2":"Infinity","initial_weight_distribution":"UniformAdaptive","regression_stop":0.000001,"diagnostics":true,"fast_mode":true,"force_load_balance":true,"single_node_mode":false,"shuffle_training_data":false,"missing_values_handling":"MeanImputation","quiet_mode":false,"sparse":false,"col_major":false,"average_activation":0,"sparsity_beta":0,"max_categorical_features":2147483647,"reproducible":false,"export_weights_and_biases":false,"mini_batch_size":1,"elastic_averaging":false} {code} {code} water.DException$DistributedException: from /192.168.11.2:54321; by class hex.ModelBuilder$1; class java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 5233 at java.util.Arrays.rangeCheck(Arrays.java:120) at java.util.Arrays.binarySearch(Arrays.java:1901) at water.fvec.NewChunk.values(NewChunk.java:160) at water.fvec.RebalanceDataSet$RebalanceTask.rebalanceChunk(RebalanceDataSet.java:118) at water.fvec.RebalanceDataSet$RebalanceTask.map(RebalanceDataSet.java:142) at water.MRTask.compute2(MRTask.java:615) at water.MRTask.compute2(MRTask.java:570) at water.MRTask.compute2(MRTask.java:570) at water.MRTask.compute2(MRTask.java:570) at water.H2O$H2OCountedCompleter.compute1(H2O.java:1093) at water.fvec.RebalanceDataSet$RebalanceTask$Icer.compute1(RebalanceDataSet$RebalanceTask$Icer.java) at water.H2O$H2OCountedCompleter.compute(H2O.java:1089) at jsr166y.CountedCompleter.exec(CountedCompleter.java:468) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:914) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:979) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) {code}

    JIRA | 11 months ago | Arno Candel
    water.DException$DistributedException: from /192.168.11.2:54321; by class hex.ModelBuilder$1; class java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 5233
  6. 0

    http://mr-0xa1:8080/job/master_runit_medium_large/520/artifact/h2o-r/tests/results/testdir_misc_runit_airlines_all_parse_medium.R.out.txt }) 12: tryCatchList(expr, classes, parentenv, handlers) 13: tryCatchOne(expr, names, parentenv, handlers[[1L]]) 14: doTryCatch(return(expr), name, parentenv, handler) 15: stop(m, call. = FALSE) 16: .handleSimpleError(function (e) { e$calls <- head(sys.calls()[-seq_len(frame + 7)], -2) signalCondition(e) }, "'water.DException$DistributedException: from /172.17.2.152:45000; by class water.parser.ParseDataset$EnumUpdateTask; class java.lang.ArrayIndexOutOfBoundsException: -1'", quote(NULL)). SEED used: 1774063150 [2015-07-04 20:30:44] [ERROR] : TEST FAILED here's the h2o stdout http://mr-0xa1:8080/job/master_runit_medium_large/520/artifact/h2o-r/tests/results/java_0_0.out.txt 07-04 20:30:19.386 172.17.2.152:45000 39463 # Session INFO: STARTING TEST: runit_airlines_all_parse_medium.R 07-04 20:30:19.397 172.17.2.152:45000 39463 # Session INFO: 07-04 20:30:19.413 172.17.2.152:45000 39463 # Session INFO: ------------------------------------------------------------ 07-04 20:30:19.426 172.17.2.152:45000 39463 # Session INFO: Method: DELETE, URI: /3/DKV, route: /3/DKV, parms: {} 07-04 20:30:19.426 172.17.2.152:45000 39463 # Session INFO: Removing all objects 07-04 20:30:19.429 172.17.2.152:45000 39463 # Session INFO: Finished removing objects 07-04 20:30:19.441 172.17.2.152:45000 39463 # Session INFO: Method: GET , URI: /3/InitID, route: /3/InitID, parms: {} 07-04 20:30:19.648 172.17.2.152:45000 39463 # Session INFO: Method: GET , URI: /3/ImportFiles, route: /3/ImportFiles, parms: {path=/home/0xdiag/datasets/airlines/2008.csv} 07-04 20:30:19.829 172.17.2.152:45000 39463 # Session INFO: Method: POST , URI: /3/ParseSetup, route: /3/ParseSetup, parms: {source_frames=["nfs://home/0xdiag/datasets/airlines/2008.csv"], check_header=0} 07-04 20:30:20.088 172.17.2.152:45000 39463 # Session INFO: Method: POST , URI: /3/Parse, route: /3/Parse, parms: {number_columns=29, source_frames=["nfs://home/0xdiag/datasets/airlines/2008.csv"], column_types=["Numeric","Numeric","Numeric","Numeric","Numeric","Numeric","Numeric","Numeric","Enum","Numeric","Enum","Numeric","Numeric","Numeric","Numeric","Numeric","Enum","Enum","Numeric","Numeric","Numeric","Numeric","Enum","Numeric","Numeric","Numeric","Numeric","Numeric","Numeric"], single_quotes=FALSE, parse_type=CSV, destination_frame=hex, delete_on_done=TRUE, column_names=["Year","Month","DayofMonth","DayOfWeek","DepTime","CRSDepTime","ArrTime","CRSArrTime","UniqueCarrier","FlightNum","TailNum","ActualElapsedTime","CRSElapsedTime","AirTime","ArrDelay","DepDelay","Origin","Dest","Distance","TaxiIn","TaxiOut","Cancelled","CancellationCode","Diverted","CarrierDelay","WeatherDelay","NASDelay","SecurityDelay","LateAircraftDelay"], check_header=1, separator=44, blocking=FALSE, na_s trings=[], chunk_size=1048576} 07-04 20:30:20.092 172.17.2.152:45000 39463 # Session INFO: Parse chunk size 1048576 barrier onExCompletion for water.parser.ParseDataset$ParserFJTask@30468792 java.lang.RuntimeException: water.DException$DistributedException: from /172.17.2.152:45000; by class water.parser.ParseDataset$EnumUpdateTask; class java.lang.ArrayIndexOutOfBoundsException: -1 at water.MRTask.getResult(MRTask.java:489) at water.MRTask.doAll(MRTask.java:386) at water.MRTask.doAll(MRTask.java:375) at water.MRTask.doAll(MRTask.java:374) at water.parser.ParseDataset.parseAllKeys(ParseDataset.java:278) at water.parser.ParseDataset.access$100(ParseDataset.java:25) at water.parser.ParseDataset$ParserFJTask.compute2(ParseDataset.java:156) at water.H2O$H2OCountedCompleter.compute(H2O.java:698) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: water.DException$DistributedException: from /172.17.2.152:45000; by class water.parser.ParseDataset$EnumUpdateTask; class java.lang.ArrayIndexOutOfBoundsException: -1 at water.parser.ParseDataset$EnumUpdateTask.emap(ParseDataset.java:321) at water.parser.ParseDataset$EnumUpdateTask.map(ParseDataset.java:323) at water.MRTask.compute2(MRTask.java:641) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.H2O$H2OCountedCompleter.compute(H2O.java:698) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:914) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:979) ... 2 more onExCompletion for water.parser.ParseDataset$EnumUpdateTask@46982b5b onExCompletion for water.parser.ParseDataset$EnumUpdateTask@46982b5b java.lang.ArrayIndexOutOfBoundsException: -1 at water.parser.ParseDataset$EnumUpdateTask.emap(ParseDataset.java:321) at water.parser.ParseDataset$EnumUpdateTask.map(ParseDataset.java:323) at water.MRTask.compute2(MRTask.java:641) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.H2O$H2OCountedCompleter.compute(H2O.java:698) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:914) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:979) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) water.DException$DistributedException: from /172.17.2.152:45002; by class water.parser.ParseDataset$EnumUpdateTask; class java.lang.ArrayIndexOutOfBoundsException: -1 at water.parser.ParseDataset$EnumUpdateTask.emap(ParseDataset.java:321) at water.parser.ParseDataset$EnumUpdateTask.map(ParseDataset.java:323) at water.MRTask.compute2(MRTask.java:641) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.H2O$H2OCountedCompleter.compute(H2O.java:698) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 2 years ago | Kevin Normoyle
    water.DException$DistributedException: from /172.17.2.152:45002; by class water.parser.ParseDataset$EnumUpdateTask; class java.lang.ArrayIndexOutOfBoundsException: -1

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. water.DException$DistributedException

      from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1

      at hex.tree.DTree.node()
    2. hex.tree
      DTree.decided
      1. hex.tree.DTree.node(DTree.java:50)
      2. hex.tree.DTree.decided(DTree.java:53)
      2 frames
    3. hex.tree.gbm
      GBM$GBMDriver$GammaPass.map
      1. hex.tree.gbm.GBM$GBMDriver$GammaPass.map(GBM.java:404)
      1 frame
    4. water
      H2O$H2OCountedCompleter.compute
      1. water.MRTask.compute2(MRTask.java:415)
      2. water.H2O$H2OCountedCompleter.compute(H2O.java:682)
      2 frames
    5. jsr166y
      ForkJoinWorkerThread.run
      1. jsr166y.CountedCompleter.exec(CountedCompleter.java:429)
      2. jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      3. jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      4. jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      5. jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      5 frames