java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1

JIRA | Nidhi Mehta | 2 years ago
  1. 0

    A proper error msg should be thrown when user sets the max depth =0 ntr = h2o.uploadFile(h,"/Users/nidhimehta/Desktop/shuttle_tr.csv", key="ntr") nts = h2o.uploadFile(h,"/Users/nidhimehta/Desktop/shuttle_ts.csv", key="nts") ntr ntr$C10 = as.factor(ntr$C10) nts$C10 = as.factor(nts$C10) myX = 1:9 myY = 10 tree = 10 my_gbm = h2o.gbm(x=myX,y=myY,loss = "multinomial",training_frame=ntr,validation_frame=nts, ntrees=tree,max_depth=0,min_rows=10,learn_rate=0.01,nbins=20) | | 0% Got exception 'class java.lang.RuntimeException', with msg 'water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1' java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1 at water.MRTask.getResult(MRTask.java:265) at water.MRTask.doAll(MRTask.java:220) at water.MRTask.doAll(MRTask.java:216) at hex.tree.gbm.GBM$GBMDriver.buildNextKTrees(GBM.java:311) at hex.tree.gbm.GBM$GBMDriver.buildModel(GBM.java:150) at hex.tree.SharedTree$Driver.compute2(SharedTree.java:165) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1 at hex.tree.DTree.node(DTree.java:50) at hex.tree.DTree.decided(DTree.java:53) at hex.tree.gbm.GBM$GBMDriver$GammaPass.map(GBM.java:404) at water.MRTask.compute2(MRTask.java:415) ... 6 more Error: 'water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1'

    JIRA | 2 years ago | Nidhi Mehta
    java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1
  2. 0

    A proper error msg should be thrown when user sets the max depth =0 ntr = h2o.uploadFile(h,"/Users/nidhimehta/Desktop/shuttle_tr.csv", key="ntr") nts = h2o.uploadFile(h,"/Users/nidhimehta/Desktop/shuttle_ts.csv", key="nts") ntr ntr$C10 = as.factor(ntr$C10) nts$C10 = as.factor(nts$C10) myX = 1:9 myY = 10 tree = 10 my_gbm = h2o.gbm(x=myX,y=myY,loss = "multinomial",training_frame=ntr,validation_frame=nts, ntrees=tree,max_depth=0,min_rows=10,learn_rate=0.01,nbins=20) | | 0% Got exception 'class java.lang.RuntimeException', with msg 'water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1' java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1 at water.MRTask.getResult(MRTask.java:265) at water.MRTask.doAll(MRTask.java:220) at water.MRTask.doAll(MRTask.java:216) at hex.tree.gbm.GBM$GBMDriver.buildNextKTrees(GBM.java:311) at hex.tree.gbm.GBM$GBMDriver.buildModel(GBM.java:150) at hex.tree.SharedTree$Driver.compute2(SharedTree.java:165) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1 at hex.tree.DTree.node(DTree.java:50) at hex.tree.DTree.decided(DTree.java:53) at hex.tree.gbm.GBM$GBMDriver$GammaPass.map(GBM.java:404) at water.MRTask.compute2(MRTask.java:415) ... 6 more Error: 'water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1'

    JIRA | 2 years ago | Nidhi Mehta
    java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1
  3. 0

    Parse attached file (unzip first) via {code} train.hex <- h2o.uploadFile("preparedTrain.csv", destination_frame = "train.hex") {code} Then build DL model in Flow (1 node): {code} buildModel 'deeplearning', {"model_id":"deeplearning-e5f73f18-316d-4320-b6c1-fdd761c6c01d","training_frame":"train.hex","nfolds":"2","response_column":"TARGET","ignored_columns":[],"ignore_const_cols":true,"activation":"Rectifier","hidden":[200,200],"epochs":10,"variable_importances":false,"fold_assignment":"AUTO","score_each_iteration":false,"checkpoint":"","use_all_factor_levels":true,"standardize":true,"train_samples_per_iteration":-2,"adaptive_rate":true,"input_dropout_ratio":0,"l1":0,"l2":0,"loss":"Automatic","distribution":"AUTO","score_interval":5,"score_training_samples":10000,"score_duty_cycle":0.1,"stopping_rounds":5,"stopping_metric":"AUTO","stopping_tolerance":0,"max_runtime_secs":0,"autoencoder":false,"keep_cross_validation_predictions":false,"pretrained_autoencoder":"","target_ratio_comm_to_comp":0.05,"seed":3861197540933068300,"rho":0.99,"epsilon":1e-8,"max_w2":"Infinity","initial_weight_distribution":"UniformAdaptive","regression_stop":0.000001,"diagnostics":true,"fast_mode":true,"force_load_balance":true,"single_node_mode":false,"shuffle_training_data":false,"missing_values_handling":"MeanImputation","quiet_mode":false,"sparse":false,"col_major":false,"average_activation":0,"sparsity_beta":0,"max_categorical_features":2147483647,"reproducible":false,"export_weights_and_biases":false,"mini_batch_size":1,"elastic_averaging":false} {code} {code} water.DException$DistributedException: from /192.168.11.2:54321; by class hex.ModelBuilder$1; class java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 5233 at java.util.Arrays.rangeCheck(Arrays.java:120) at java.util.Arrays.binarySearch(Arrays.java:1901) at water.fvec.NewChunk.values(NewChunk.java:160) at water.fvec.RebalanceDataSet$RebalanceTask.rebalanceChunk(RebalanceDataSet.java:118) at water.fvec.RebalanceDataSet$RebalanceTask.map(RebalanceDataSet.java:142) at water.MRTask.compute2(MRTask.java:615) at water.MRTask.compute2(MRTask.java:570) at water.MRTask.compute2(MRTask.java:570) at water.MRTask.compute2(MRTask.java:570) at water.H2O$H2OCountedCompleter.compute1(H2O.java:1093) at water.fvec.RebalanceDataSet$RebalanceTask$Icer.compute1(RebalanceDataSet$RebalanceTask$Icer.java) at water.H2O$H2OCountedCompleter.compute(H2O.java:1089) at jsr166y.CountedCompleter.exec(CountedCompleter.java:468) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:914) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:979) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) {code}

    JIRA | 9 months ago | Arno Candel
    water.DException$DistributedException: from /192.168.11.2:54321; by class hex.ModelBuilder$1; class java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 5233
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    http://mr-0xa1:8080/job/master_runit_medium_large/520/artifact/h2o-r/tests/results/testdir_misc_runit_airlines_all_parse_medium.R.out.txt }) 12: tryCatchList(expr, classes, parentenv, handlers) 13: tryCatchOne(expr, names, parentenv, handlers[[1L]]) 14: doTryCatch(return(expr), name, parentenv, handler) 15: stop(m, call. = FALSE) 16: .handleSimpleError(function (e) { e$calls <- head(sys.calls()[-seq_len(frame + 7)], -2) signalCondition(e) }, "'water.DException$DistributedException: from /172.17.2.152:45000; by class water.parser.ParseDataset$EnumUpdateTask; class java.lang.ArrayIndexOutOfBoundsException: -1'", quote(NULL)). SEED used: 1774063150 [2015-07-04 20:30:44] [ERROR] : TEST FAILED here's the h2o stdout http://mr-0xa1:8080/job/master_runit_medium_large/520/artifact/h2o-r/tests/results/java_0_0.out.txt 07-04 20:30:19.386 172.17.2.152:45000 39463 # Session INFO: STARTING TEST: runit_airlines_all_parse_medium.R 07-04 20:30:19.397 172.17.2.152:45000 39463 # Session INFO: 07-04 20:30:19.413 172.17.2.152:45000 39463 # Session INFO: ------------------------------------------------------------ 07-04 20:30:19.426 172.17.2.152:45000 39463 # Session INFO: Method: DELETE, URI: /3/DKV, route: /3/DKV, parms: {} 07-04 20:30:19.426 172.17.2.152:45000 39463 # Session INFO: Removing all objects 07-04 20:30:19.429 172.17.2.152:45000 39463 # Session INFO: Finished removing objects 07-04 20:30:19.441 172.17.2.152:45000 39463 # Session INFO: Method: GET , URI: /3/InitID, route: /3/InitID, parms: {} 07-04 20:30:19.648 172.17.2.152:45000 39463 # Session INFO: Method: GET , URI: /3/ImportFiles, route: /3/ImportFiles, parms: {path=/home/0xdiag/datasets/airlines/2008.csv} 07-04 20:30:19.829 172.17.2.152:45000 39463 # Session INFO: Method: POST , URI: /3/ParseSetup, route: /3/ParseSetup, parms: {source_frames=["nfs://home/0xdiag/datasets/airlines/2008.csv"], check_header=0} 07-04 20:30:20.088 172.17.2.152:45000 39463 # Session INFO: Method: POST , URI: /3/Parse, route: /3/Parse, parms: {number_columns=29, source_frames=["nfs://home/0xdiag/datasets/airlines/2008.csv"], column_types=["Numeric","Numeric","Numeric","Numeric","Numeric","Numeric","Numeric","Numeric","Enum","Numeric","Enum","Numeric","Numeric","Numeric","Numeric","Numeric","Enum","Enum","Numeric","Numeric","Numeric","Numeric","Enum","Numeric","Numeric","Numeric","Numeric","Numeric","Numeric"], single_quotes=FALSE, parse_type=CSV, destination_frame=hex, delete_on_done=TRUE, column_names=["Year","Month","DayofMonth","DayOfWeek","DepTime","CRSDepTime","ArrTime","CRSArrTime","UniqueCarrier","FlightNum","TailNum","ActualElapsedTime","CRSElapsedTime","AirTime","ArrDelay","DepDelay","Origin","Dest","Distance","TaxiIn","TaxiOut","Cancelled","CancellationCode","Diverted","CarrierDelay","WeatherDelay","NASDelay","SecurityDelay","LateAircraftDelay"], check_header=1, separator=44, blocking=FALSE, na_s trings=[], chunk_size=1048576} 07-04 20:30:20.092 172.17.2.152:45000 39463 # Session INFO: Parse chunk size 1048576 barrier onExCompletion for water.parser.ParseDataset$ParserFJTask@30468792 java.lang.RuntimeException: water.DException$DistributedException: from /172.17.2.152:45000; by class water.parser.ParseDataset$EnumUpdateTask; class java.lang.ArrayIndexOutOfBoundsException: -1 at water.MRTask.getResult(MRTask.java:489) at water.MRTask.doAll(MRTask.java:386) at water.MRTask.doAll(MRTask.java:375) at water.MRTask.doAll(MRTask.java:374) at water.parser.ParseDataset.parseAllKeys(ParseDataset.java:278) at water.parser.ParseDataset.access$100(ParseDataset.java:25) at water.parser.ParseDataset$ParserFJTask.compute2(ParseDataset.java:156) at water.H2O$H2OCountedCompleter.compute(H2O.java:698) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: water.DException$DistributedException: from /172.17.2.152:45000; by class water.parser.ParseDataset$EnumUpdateTask; class java.lang.ArrayIndexOutOfBoundsException: -1 at water.parser.ParseDataset$EnumUpdateTask.emap(ParseDataset.java:321) at water.parser.ParseDataset$EnumUpdateTask.map(ParseDataset.java:323) at water.MRTask.compute2(MRTask.java:641) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.H2O$H2OCountedCompleter.compute(H2O.java:698) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:914) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:979) ... 2 more onExCompletion for water.parser.ParseDataset$EnumUpdateTask@46982b5b onExCompletion for water.parser.ParseDataset$EnumUpdateTask@46982b5b java.lang.ArrayIndexOutOfBoundsException: -1 at water.parser.ParseDataset$EnumUpdateTask.emap(ParseDataset.java:321) at water.parser.ParseDataset$EnumUpdateTask.map(ParseDataset.java:323) at water.MRTask.compute2(MRTask.java:641) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.H2O$H2OCountedCompleter.compute(H2O.java:698) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:914) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:979) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) water.DException$DistributedException: from /172.17.2.152:45002; by class water.parser.ParseDataset$EnumUpdateTask; class java.lang.ArrayIndexOutOfBoundsException: -1 at water.parser.ParseDataset$EnumUpdateTask.emap(ParseDataset.java:321) at water.parser.ParseDataset$EnumUpdateTask.map(ParseDataset.java:323) at water.MRTask.compute2(MRTask.java:641) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.MRTask.compute2(MRTask.java:599) at water.H2O$H2OCountedCompleter.compute(H2O.java:698) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 1 year ago | Kevin Normoyle
    water.DException$DistributedException: from /172.17.2.152:45002; by class water.parser.ParseDataset$EnumUpdateTask; class java.lang.ArrayIndexOutOfBoundsException: -1
  6. 0

    Steps to reproduce: {code} val data = sc.parallelize((1 to 100000).map(_=>java.util.UUID.randomUUID().toString+" "+java.util.UUID.randomUUID().toString)) val schema = StructType(Seq(StructField("c1", StringType, true))) val rowRDD = data.map(Row(_)) val stringColumnTable = sqlContext.applySchema(rowRDD, schema) val h2oFrame = toDataFrame(stringColumnTable) scala> h2oFrame.vecs.map(_.get_type_str) res2: Array[String] = Array(string) scala> org.apache.spark.examples.h2o.DemoUtils.splitFrame(h2oFrame, Array("1","2","3"), Array(0.6,0.2,0.2)) onExCompletion for hex.splitframe.ShuffleSplitFrame$1@5d9445ed onExCompletion for hex.splitframe.ShuffleSplitFrame$1@5d9445ed water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.fvec.CStrChunk.atd_impl(CStrChunk.java:39) at water.fvec.Chunk.atd(Chunk.java:252) at hex.splitframe.ShuffleSplitFrame$1.map(ShuffleSplitFrame.java:40) at water.MRTask.compute2(MRTask.java:430) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) water.DException$DistributedException: from /192.168.1.4:54323; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.fvec.CStrChunk.atd_impl(CStrChunk.java:39) at water.fvec.Chunk.atd(Chunk.java:252) at hex.splitframe.ShuffleSplitFrame$1.map(ShuffleSplitFrame.java:40) at water.MRTask.compute2(MRTask.java:430) at water.MRTask.compute2(MRTask.java:374) at water.MRTask.compute2(MRTask.java:374) at water.MRTask.compute2(MRTask.java:374) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.4:54327; by class hex.splitframe.ShuffleSplitFrame$1; class water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.MRTask.getResult(MRTask.java:265) at water.MRTask.doAll(MRTask.java:220) at water.MRTask.doAll(MRTask.java:217) at hex.splitframe.ShuffleSplitFrame.shuffleSplitFrame(ShuffleSplitFrame.java:29) at org.apache.spark.examples.h2o.DemoUtils$.splitFrame(DemoUtils.scala:110) at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:35) at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:40) at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:42) at $iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:44) at $iwC$$iwC$$iwC$$iwC.<init>(<console>:46) at $iwC$$iwC$$iwC.<init>(<console>:48) at $iwC$$iwC.<init>(<console>:50) at $iwC.<init>(<console>:52) at <init>(<console>:54) at .<init>(<console>:58) at .<clinit>(<console>) at .<init>(<console>:7) at .<clinit>(<console>) at $print(<console>) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.spark.repl.SparkIMain$ReadEvalPrint.call(SparkIMain.scala:852) at org.apache.spark.repl.SparkIMain$Request.loadAndRun(SparkIMain.scala:1125) at org.apache.spark.repl.SparkIMain.loadAndRunReq$1(SparkIMain.scala:674) at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:705) at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:669) at org.apache.spark.repl.SparkILoop.reallyInterpret$1(SparkILoop.scala:828) at org.apache.spark.repl.SparkILoop.interpretStartingWith(SparkILoop.scala:873) at org.apache.spark.repl.SparkILoop.command(SparkILoop.scala:785) at org.apache.spark.repl.SparkILoop.processLine$1(SparkILoop.scala:628) at org.apache.spark.repl.SparkILoop.innerLoop$1(SparkILoop.scala:636) at org.apache.spark.repl.SparkILoop.loop(SparkILoop.scala:641) at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply$mcZ$sp(SparkILoop.scala:968) at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply(SparkILoop.scala:916) at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply(SparkILoop.scala:916) at scala.tools.nsc.util.ScalaClassLoader$.savingContextLoader(ScalaClassLoader.scala:135) at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:916) at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:1011) at org.apache.spark.repl.Main$.main(Main.scala:31) at org.apache.spark.repl.Main.main(Main.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:358) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) Caused by: water.DException$DistributedException: from /192.168.1.4:54327; by class hex.splitframe.ShuffleSplitFrame$1; class water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.fvec.CStrChunk.atd_impl(CStrChunk.java:39) at water.fvec.Chunk.atd(Chunk.java:252) at hex.splitframe.ShuffleSplitFrame$1.map(ShuffleSplitFrame.java:40) at water.MRTask.compute2(MRTask.java:430) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) {code} Reproduced on this build: http://h2o-release.s3.amazonaws.com/sparkling-water/master/86/index.html

    JIRA | 2 years ago | Peter Rudenko
    water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector.

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. water.DException$DistributedException

      from /192.168.1.100:54321; by class hex.tree.gbm.GBM$GBMDriver$GammaPass; class java.lang.ArrayIndexOutOfBoundsException: -1

      at hex.tree.DTree.node()
    2. hex.tree
      DTree.decided
      1. hex.tree.DTree.node(DTree.java:50)
      2. hex.tree.DTree.decided(DTree.java:53)
      2 frames
    3. hex.tree.gbm
      GBM$GBMDriver$GammaPass.map
      1. hex.tree.gbm.GBM$GBMDriver$GammaPass.map(GBM.java:404)
      1 frame
    4. water
      H2O$H2OCountedCompleter.compute
      1. water.MRTask.compute2(MRTask.java:415)
      2. water.H2O$H2OCountedCompleter.compute(H2O.java:682)
      2 frames
    5. jsr166y
      ForkJoinWorkerThread.run
      1. jsr166y.CountedCompleter.exec(CountedCompleter.java:429)
      2. jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      3. jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      4. jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      5. jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      5 frames