java.lang.AssertionError: Coldata -2.0 out of range glycogen:0.0-6.0 step=1.0 nbins=6 isInt=1 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR:

JIRA | Nidhi Mehta | 4 months ago
  1. 0

    H2O Build git hash d651ad244a9510d286c6b6f0bc4a8d23b2f485ed Running a gbm grid search (with cross validation) on a couple of datasets and hit a few NPEs and java assertion error due to leaked frames and missing chunks. Could not repro the errors when ran them again. here are the stack traces- {code:java} [1] "/home/nidhi/auto_sklearn_csv/dataset_22_mfeat-zernike.arff.txt" Hyper-parameter: col_sample_rate_per_tree, 0.6 Hyper-parameter: learn_rate, 0.5 Hyper-parameter: max_depth, 1 Hyper-parameter: min_rows, 100 Hyper-parameter: min_split_improvement, 1e-04 Hyper-parameter: ntrees, 10000 Hyper-parameter: sample_rate, 0.8 [2016-09-05 07:06:27] failure_details: DistributedException from /172.17.2.208:28555 [2016-09-05 07:06:27] failure_stack_traces: DistributedException from /172.17.2.208:28555, caused by java.lang.NullPointerException at water.MRTask.getResult(MRTask.java:477) at water.MRTask.getResult(MRTask.java:485) at water.MRTask.doAll(MRTask.java:389) at water.MRTask.doAll(MRTask.java:383) at hex.tree.gbm.GBM$GBMDriver.buildNextKTrees(GBM.java:444) at hex.tree.SharedTree$Driver.scoreAndBuildTrees(SharedTree.java:344) at hex.tree.SharedTree$Driver.computeImpl(SharedTree.java:284) at hex.ModelBuilder$Driver.compute2(ModelBuilder.java:168) at water.H2O$H2OCountedCompleter.compute(H2O.java:1198) at jsr166y.CountedCompleter.exec(CountedCompleter.java:468) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: java.lang.NullPointerException at water.fvec.NewChunk.chunkD(NewChunk.java:1395) at water.fvec.NewChunk.compress2(NewChunk.java:1114) at water.fvec.NewChunk.compress(NewChunk.java:1013) at water.fvec.NewChunk.new_close(NewChunk.java:876) at water.fvec.Chunk.close(Chunk.java:561) at water.MRTask.compute2(MRTask.java:650) at water.H2O$H2OCountedCompleter.compute1(H2O.java:1201) at hex.tree.gbm.GBM$GBMDriver$ComputePredAndRes$Icer.compute1(GBM$GBMDriver$ComputePredAndRes$Icer.java) at water.H2O$H2OCountedCompleter.compute(H2O.java:1197) ... 5 more {code} {code:java} ##when rerun runs fine [1] "/home/nidhi/auto_sklearn_csv/oh10.wc.arff.txt" |======================================================================| 100% |====== | 8% java.lang.AssertionError: Coldata -2.0 out of range glycogen:0.0-6.0 step=1.0 nbins=6 isInt=1 cnt=0.000000, [0.000000 - 1.000000], mean/var= 0.00/ 0.00, cnt=0.000000, [1.000000 - 2.000000], mean/var= 0.00/ 0.00, cnt=0.000000, [2.000000 - 3.000000], mean/var= 0.00/ 0.00, cnt=0.000000, [3.000000 - 4.000000], mean/var= 0.00/ 0.00, cnt=0.000000, [4.000000 - 5.000000], mean/var= 0.00/ 0.00, cnt=0.000000, [5.000000 - 6.000000], mean/var= 0.00/ 0.00, Error: java.lang.AssertionError: Coldata -2.0 out of range glycogen:0.0-6.0 step=1.0 nbins=6 isInt=1 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at hex.tree.DHistogram.bin(DHistogram.java:172) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at hex.tree.DHistogram.updateSharedHistosAndReset(DHistogram.java:617) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at hex.tree.ScoreBuildHistogram.accum_all(ScoreBuildHistogram.java:256) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at hex.tree.ScoreBuildHistogram.map(ScoreBuildHistogram.java:123) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at water.MRTask.compute2(MRTask.java:630) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at water.H2O$H2OCountedCompleter.compute1(H2O.java:1201) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at hex.tree.ScoreBuildHistogram$Icer.compute1(ScoreBuildHistogram$Icer.java) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at water.H2O$H2OCountedCompleter.compute(H2O.java:1197) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at jsr166y.CountedCompleter.exec(CountedCompleter.java:468) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-3-9 ERRR: Error: Missing chunk 9 for $04ff2e020080ffffffff$nfs://home/nidhi/auto_sklearn_csv/oh10.wc.arff.txt 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-3-21 ERRR: Error: Missing chunk 15 for $04ff2e020080ffffffff$nfs://home/nidhi/auto_sklearn_csv/oh10.wc.arff.txt ################ {code} {code:java} ##COULD NOT REPRO ON MASTER 18 fails check nohupR.out rollup error 08-31 03:59:44.789 172.16.2.188:23555 8819 FJ-2-171 INFO: {"_train":{"name":"dataset_16_mfeat-karhunen.arff.txt_model_8_cv_5_train","type":"Key"},"_valid":{"name":"dataset_16_mfeat-karhunen.arff.txt_model_8_cv_5_valid","type":"Key"},"_nfolds":0,"_keep_cross_validation_predictions":false,"_keep_cross_validation_fold_assignment":false,"_parallelize_cross_validation":true,"_auto_rebalance":true,"_seed":4563563636689,"_fold_assignment":"AUTO","_categorical_encoding":"AUTO","_distribution":"AUTO","_tweedie_power":1.5,"_quantile_alpha":0.5,"_huber_alpha":0.9,"_ignored_columns":[""],"_ignore_const_cols":true,"_weights_column":"__internal_cv_weights__","_offset_column":null,"_fold_column":null,"_is_cv_model":true,"_score_each_iteration":false,"_max_runtime_secs":0.0,"_stopping_rounds":2,"_stopping_metric":"AUTO","_stopping_tolerance":0.001,"_response_column":"class","_balance_classes":false,"_max_after_balance_size":5.0,"_class_sampling_factors":null,"_max_confusion_matrix_size":20,"_checkpoint":null,"_pretrained_autoencoder":null,"_ntrees":10000,"_max_depth":3,"_min_rows":1.0,"_nbins":20,"_nbins_cats":1024,"_min_split_improvement":1.0E-5,"_histogram_type":"AUTO","_r2_stopping":1.7976931348623157E308,"_nbins_top_level":1024,"_build_tree_one_node":false,"_score_tree_interval":20,"_initial_score_interval":4000,"_score_interval":4000,"_sample_rate":1.0,"_sample_rate_per_class":null,"_col_sample_rate_change_per_level":1.0,"_col_sample_rate_per_tree":1.0,"_learn_rate":0.01,"_learn_rate_annealing":1.0,"_col_sample_rate":1.0,"_max_abs_leafnode_pred":1.7976931348623157E308} 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: Grid search: model builder for parameters hex.tree.gbm.GBMModel$GBMParameters@127558f failed! Exception: java.lang.NullPointerExceptionjava.lang.NullPointerException 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at water.fvec.NewChunk.bufB(NewChunk.java:1455) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at water.fvec.NewChunk.compress2(NewChunk.java:1209) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at water.fvec.NewChunk.compress(NewChunk.java:1013) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at water.fvec.NewChunk.new_close(NewChunk.java:876) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at water.fvec.Chunk.close(Chunk.java:561) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at water.MRTask.compute2(MRTask.java:650) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at water.H2O$H2OCountedCompleter.compute1(H2O.java:1201) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at hex.tree.ScoreBuildHistogram$Icer.compute1(ScoreBuildHistogram$Icer.java) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at water.H2O$H2OCountedCompleter.compute(H2O.java:1197) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at jsr166y.CountedCompleter.exec(CountedCompleter.java:468) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at jsr166y.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:914) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:979) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 INFO: Windowed averages (window size 2) of grid's best 3 logloss metrics: [0.20842527609394138, 0.18711026295815913, 0.16014838264852577] 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 INFO: Checking convergence with logloss metric: 0.20842527609394138 --> 0.16014838264852577 (still improving). 08-31 03:59:44.902 172.16.2.188:23555 8819 FJ-1-43 INFO: Creating 5 cross-validation splits with random number seed: 4563563636689 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: java.lang.AssertionError: null vec: $04ff1e000000ffffffff$nfs://home/nidhi/auto_sklearn_csv/dataset_16_mfeat-karhunen.arff.txt 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at water.fvec.Frame.<init>(Frame.java:113) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at water.fvec.Frame.<init>(Frame.java:83) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at hex.ModelBuilder.cv_makeFramesAndBuilders(ModelBuilder.java:353) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at hex.ModelBuilder.computeCrossValidation(ModelBuilder.java:262) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at hex.ModelBuilder.trainModelNested(ModelBuilder.java:212) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at hex.grid.GridSearch.startBuildModel(GridSearch.java:329) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at hex.grid.GridSearch.buildModel(GridSearch.java:311) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at hex.grid.GridSearch.gridSearch(GridSearch.java:215) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at hex.grid.GridSearch.access$000(GridSearch.java:69) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at hex.grid.GridSearch$1.compute2(GridSearch.java:136) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at water.H2O$H2OCountedCompleter.compute(H2O.java:1198) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at jsr166y.CountedCompleter.exec(CountedCompleter.java:468) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 08-31 08:33:42.526 172.16.2.188:23555 8819 #47664-12 INFO: GET /3/Frames, parms: {} 08-31 08:33:42.606 172.16.2.188:23555 8819 #47664-12 WARN: Leaked frame: Frame data points to one or more deleted vecs. ####################### {code}

    JIRA | 4 months ago | Nidhi Mehta
    java.lang.AssertionError: Coldata -2.0 out of range glycogen:0.0-6.0 step=1.0 nbins=6 isInt=1 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR:
  2. 0

    running random forest from R or python on prostate with this parameter combination: pros = h2o.upload_file(h2o.locate("smalldata/prostate/prostate.csv.zip")) pros[1] = pros[1].asfactor() pros[4] = pros[4].asfactor() pros[5] = pros[5].asfactor() pros[8] = pros[8].asfactor() x: [7, 4, 3, 6, 5, 8] y: 1 validation: False nbins: 1 ntrees: 4 min_rows: 1 seed: 2969 balance_classes: True max_depth: 1 gives this stacktrace: URI: /3/ModelBuilders/drf, route: /3/ModelBuilders/drf, parms: {max_depth=1, seed=2969, training_frame=py22e16c1f-e74f-4860-8aa9-577f00392520, ntrees=4, nbins=1, balance_classes=True, response_column=CAPSULE, min_rows=1} 05-01 10:21:32.660 172.16.2.40:54321 44212 FJ-0-19 INFO: Building H2O DRF model with these parameters: 05-01 10:21:32.660 172.16.2.40:54321 44212 FJ-0-19 INFO: {"_model_id":null,"_train":{"name":"py22e16c1f-e74f-4860-8aa9-577f00392520","type":"Key"},"_valid":null,"_ignored_columns":null,"_drop_na20_cols":false,"_dropConsCols":true,"_score_each_iteration":false,"_response_column":"CAPSULE","_balance_classes":true,"_max_after_balance_size":5.0,"_class_sampling_factors":null,"_max_hit_ratio_k":10,"_max_confusion_matrix_size":20,"_ntrees":4,"_max_depth":1,"_min_rows":1,"_nbins":1,"_seed":2969,"_checkpoint":false,"_mtries":-1,"_sample_rate":0.6666667,"_build_tree_one_node":false} 05-01 10:21:32.670 172.16.2.40:54321 44212 FJ-0-19 INFO: Doing stratified sampling for data set containing 156001 rows from 2 classes. Oversampling: on 05-01 10:21:32.670 172.16.2.40:54321 44212 FJ-0-19 INFO: Stratified sampling to a total of 186,380 rows. 05-01 10:21:32.670 172.16.2.40:54321 44212 FJ-0-19 INFO: Class '0' sampling ratio: 1.0 05-01 10:21:32.670 172.16.2.40:54321 44212 FJ-0-19 INFO: Class '1' sampling ratio: 1.4836574 05-01 10:21:32.799 172.16.2.40:54321 44212 FJ-0-19 INFO: Prior class distribution: [0.5973679655899642, 0.4026320344100358] 05-01 10:21:32.799 172.16.2.40:54321 44212 FJ-0-19 INFO: Model class distribution: [0.49985249550781774, 0.5001475044921823] 05-01 10:21:32.818 172.16.2.40:54321 44212 FJ-0-19 INFO: ============================================================== 05-01 10:21:32.821 172.16.2.40:54321 44212 FJ-0-19 INFO: training r2 is NaN, MSE is NaN, logloss is NaN, with 0x2 trees (average of 1.0 nodes) onExCompletion for hex.tree.SharedTree$ScoreBuildOneTree@75d5552b onExCompletion for hex.tree.SharedTree$ScoreBuildOneTree@8cab67d java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) barrier onExCompletion for hex.tree.drf.DRF$DRFDriver@1b5462fc java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- x: [3, 8, 7, 5, 6] y: 1 validation: False nbins: 1 build_tree_one_node: True min_rows: 10 seed: 7995 sample_rate: 0.00104403884699 balance_classes: True URI: /3/ModelBuilders/drf, route: /3/ModelBuilders/drf, parms: {build_tree_one_node=True, seed=7995, sample_rate=0.00104403884699, training_frame=pyd17cff5c-8b97-4936-9675-87bb812baab2, nbins=1, balance_classes=True, response_column=CAPSULE, min_rows=10} 05-01 10:40:43.019 172.16.2.40:54321 44212 FJ-0-3 INFO: Building H2O DRF model with these parameters: 05-01 10:40:43.019 172.16.2.40:54321 44212 FJ-0-3 INFO: {"_model_id":null,"_train":{"name":"pyd17cff5c-8b97-4936-9675-87bb812baab2","type":"Key"},"_valid":null,"_ignored_columns":null,"_drop_na20_cols":false,"_dropConsCols":true,"_score_each_iteration":false,"_response_column":"CAPSULE","_balance_classes":true,"_max_after_balance_size":5.0,"_class_sampling_factors":null,"_max_hit_ratio_k":10,"_max_confusion_matrix_size":20,"_ntrees":50,"_max_depth":20,"_min_rows":10,"_nbins":1,"_seed":7995,"_checkpoint":false,"_mtries":-1,"_sample_rate":0.0010440388,"_build_tree_one_node":true} 05-01 10:40:43.027 172.16.2.40:54321 44212 FJ-0-3 INFO: Doing stratified sampling for data set containing 155533 rows from 2 classes. Oversampling: on 05-01 10:40:43.027 172.16.2.40:54321 44212 FJ-0-3 INFO: Stratified sampling to a total of 185,684 rows. 05-01 10:40:43.027 172.16.2.40:54321 44212 FJ-0-3 INFO: Class '0' sampling ratio: 1.0 05-01 10:40:43.027 172.16.2.40:54321 44212 FJ-0-3 INFO: Class '1' sampling ratio: 1.4809463 05-01 10:40:43.118 172.16.2.40:54321 44212 FJ-0-3 INFO: Prior class distribution: [0.5969279831289823, 0.40307201687101774] 05-01 10:40:43.118 172.16.2.40:54321 44212 FJ-0-3 INFO: Model class distribution: [0.5004500935224265, 0.49954990647757347] 05-01 10:40:43.133 172.16.2.40:54321 44212 FJ-0-3 INFO: ============================================================== 05-01 10:40:43.136 172.16.2.40:54321 44212 FJ-0-3 INFO: training r2 is NaN, MSE is NaN, logloss is NaN, with 0x2 trees (average of 1.0 nodes) onExCompletion for hex.tree.SharedTree$ScoreBuildOneTree@46e1d5d9 java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) onExCompletion for hex.tree.SharedTree$ScoreBuildOneTree@44ca27eb java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) barrier onExCompletion for hex.tree.drf.DRF$DRFDriver@26d938e0 java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 2 years ago | Eric Eckstrand
    java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1
  3. 0

    running random forest from R or python on prostate with this parameter combination: pros = h2o.upload_file(h2o.locate("smalldata/prostate/prostate.csv.zip")) pros[1] = pros[1].asfactor() pros[4] = pros[4].asfactor() pros[5] = pros[5].asfactor() pros[8] = pros[8].asfactor() x: [7, 4, 3, 6, 5, 8] y: 1 validation: False nbins: 1 ntrees: 4 min_rows: 1 seed: 2969 balance_classes: True max_depth: 1 gives this stacktrace: URI: /3/ModelBuilders/drf, route: /3/ModelBuilders/drf, parms: {max_depth=1, seed=2969, training_frame=py22e16c1f-e74f-4860-8aa9-577f00392520, ntrees=4, nbins=1, balance_classes=True, response_column=CAPSULE, min_rows=1} 05-01 10:21:32.660 172.16.2.40:54321 44212 FJ-0-19 INFO: Building H2O DRF model with these parameters: 05-01 10:21:32.660 172.16.2.40:54321 44212 FJ-0-19 INFO: {"_model_id":null,"_train":{"name":"py22e16c1f-e74f-4860-8aa9-577f00392520","type":"Key"},"_valid":null,"_ignored_columns":null,"_drop_na20_cols":false,"_dropConsCols":true,"_score_each_iteration":false,"_response_column":"CAPSULE","_balance_classes":true,"_max_after_balance_size":5.0,"_class_sampling_factors":null,"_max_hit_ratio_k":10,"_max_confusion_matrix_size":20,"_ntrees":4,"_max_depth":1,"_min_rows":1,"_nbins":1,"_seed":2969,"_checkpoint":false,"_mtries":-1,"_sample_rate":0.6666667,"_build_tree_one_node":false} 05-01 10:21:32.670 172.16.2.40:54321 44212 FJ-0-19 INFO: Doing stratified sampling for data set containing 156001 rows from 2 classes. Oversampling: on 05-01 10:21:32.670 172.16.2.40:54321 44212 FJ-0-19 INFO: Stratified sampling to a total of 186,380 rows. 05-01 10:21:32.670 172.16.2.40:54321 44212 FJ-0-19 INFO: Class '0' sampling ratio: 1.0 05-01 10:21:32.670 172.16.2.40:54321 44212 FJ-0-19 INFO: Class '1' sampling ratio: 1.4836574 05-01 10:21:32.799 172.16.2.40:54321 44212 FJ-0-19 INFO: Prior class distribution: [0.5973679655899642, 0.4026320344100358] 05-01 10:21:32.799 172.16.2.40:54321 44212 FJ-0-19 INFO: Model class distribution: [0.49985249550781774, 0.5001475044921823] 05-01 10:21:32.818 172.16.2.40:54321 44212 FJ-0-19 INFO: ============================================================== 05-01 10:21:32.821 172.16.2.40:54321 44212 FJ-0-19 INFO: training r2 is NaN, MSE is NaN, logloss is NaN, with 0x2 trees (average of 1.0 nodes) onExCompletion for hex.tree.SharedTree$ScoreBuildOneTree@75d5552b onExCompletion for hex.tree.SharedTree$ScoreBuildOneTree@8cab67d java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) barrier onExCompletion for hex.tree.drf.DRF$DRFDriver@1b5462fc java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- x: [3, 8, 7, 5, 6] y: 1 validation: False nbins: 1 build_tree_one_node: True min_rows: 10 seed: 7995 sample_rate: 0.00104403884699 balance_classes: True URI: /3/ModelBuilders/drf, route: /3/ModelBuilders/drf, parms: {build_tree_one_node=True, seed=7995, sample_rate=0.00104403884699, training_frame=pyd17cff5c-8b97-4936-9675-87bb812baab2, nbins=1, balance_classes=True, response_column=CAPSULE, min_rows=10} 05-01 10:40:43.019 172.16.2.40:54321 44212 FJ-0-3 INFO: Building H2O DRF model with these parameters: 05-01 10:40:43.019 172.16.2.40:54321 44212 FJ-0-3 INFO: {"_model_id":null,"_train":{"name":"pyd17cff5c-8b97-4936-9675-87bb812baab2","type":"Key"},"_valid":null,"_ignored_columns":null,"_drop_na20_cols":false,"_dropConsCols":true,"_score_each_iteration":false,"_response_column":"CAPSULE","_balance_classes":true,"_max_after_balance_size":5.0,"_class_sampling_factors":null,"_max_hit_ratio_k":10,"_max_confusion_matrix_size":20,"_ntrees":50,"_max_depth":20,"_min_rows":10,"_nbins":1,"_seed":7995,"_checkpoint":false,"_mtries":-1,"_sample_rate":0.0010440388,"_build_tree_one_node":true} 05-01 10:40:43.027 172.16.2.40:54321 44212 FJ-0-3 INFO: Doing stratified sampling for data set containing 155533 rows from 2 classes. Oversampling: on 05-01 10:40:43.027 172.16.2.40:54321 44212 FJ-0-3 INFO: Stratified sampling to a total of 185,684 rows. 05-01 10:40:43.027 172.16.2.40:54321 44212 FJ-0-3 INFO: Class '0' sampling ratio: 1.0 05-01 10:40:43.027 172.16.2.40:54321 44212 FJ-0-3 INFO: Class '1' sampling ratio: 1.4809463 05-01 10:40:43.118 172.16.2.40:54321 44212 FJ-0-3 INFO: Prior class distribution: [0.5969279831289823, 0.40307201687101774] 05-01 10:40:43.118 172.16.2.40:54321 44212 FJ-0-3 INFO: Model class distribution: [0.5004500935224265, 0.49954990647757347] 05-01 10:40:43.133 172.16.2.40:54321 44212 FJ-0-3 INFO: ============================================================== 05-01 10:40:43.136 172.16.2.40:54321 44212 FJ-0-3 INFO: training r2 is NaN, MSE is NaN, logloss is NaN, with 0x2 trees (average of 1.0 nodes) onExCompletion for hex.tree.SharedTree$ScoreBuildOneTree@46e1d5d9 java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) onExCompletion for hex.tree.SharedTree$ScoreBuildOneTree@44ca27eb java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) barrier onExCompletion for hex.tree.drf.DRF$DRFDriver@26d938e0 java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 2 years ago | Eric Eckstrand
    java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0
    samebug tip
    Check if you use the right path
  6. 0

    there's another jira probably somewhere. I don't know if it's possible for this to show up in other datasets. has importance=1 and just 1 tree. don't know if that matters it might be the NaN in the dataset here's the drf: /2/DRF.json?classification=1&importance=1&source=parsetmp_1_0_2_0.hex&ntrees=1&response=DateofBirth FJ-0-3 ERRR WATER: java.lang.AssertionError: col_data Infinity out of range FirstName:-Infinity-Infinity step=Infinity nbins=1024 isInt=0 cnt=29, [-6.000000 - 6.000000], mean/var= 0.52/ 0.26, cnt=0, [-6.000000 - 6.000000], mean/var= 0.00/ 0.00, cnt=0, [-6.000000 - 6.000000], mean/var= 0.00/ 0.00, cnt=0, [-6.000000 - 6.000000], mean/var= 0.00/ 0.00, cnt=0, [-6.000000 - 6.000000], mean/var= 0.00/ 0.00, .... at hex.gbm.DHistogram.incr(DHistogram.java:137) at hex.gbm.SharedTreeModelBuilder$ScoreBuildHistogram.accum_subset(SharedTreeModelBuilder.java:518) at hex.gbm.SharedTreeModelBuilder$ScoreBuildHistogram.map(SharedTreeModelBuilder.java:452) at water.MRTask2.compute2(MRTask2.java:391) at water.H2O$H2OCountedCompleter.compute(H2O.java:711) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) it's pretty simple. hive separator in this case, but not sure if that matters I attached the file here: FirstName^AMiddleInitials^ALastName^ADateofBirth 0^A0.5^A1^A0 3^ANaN^A4^A1 6^A^A8^A0 0.6^A0.7^A0.8^A1 +0.6^A+0.7^A+0.8^A0 -0.6^A-0.7^A-0.8^A1 .6^A.7^A.8^A0 +.6^A+.7^A+.8^A1 -.6^A-.7^A-.8^A0 +0.6e0^A+0.7e0^A+0.8e0^A1 -0.6e0^A-0.7e0^A-0.8e0^A0 .6e0^A.7e0^A.8e0^A1 +.6e0^A+.7e0^A+.8e0^A0 -.6e0^A-.7e0^A-.8e0^A1 +0.6e00^A+0.7e00^A+0.8e00^A0 -0.6e00^A-0.7e00^A-0.8e00^A1 .6e00^A.7e00^A.8e00^A0 +.6e00^A+.7e00^A+.8e00^A1 -.6e00^A-.7e00^A-.8e00^A0 +0.6e-01^A+0.7e-01^A+0.8e-01^A1 -0.6e-01^A-0.7e-01^A-0.8e-01^A0 .6e-01^A.7e-01^A.8e-01^A1 +.6e-01^A+.7e-01^A+.8e-01^A0 -.6e-01^A-.7e-01^A-.8e-01^A1 +0.6e+01^A+0.7e+01^A+0.8e+01^A0 -0.6e+01^A-0.7e+01^A-0.8e+01^A1 .6e+01^A.7e+01^A.8e+01^A0 +.6e+01^A+.7e+01^A+.8e+01^A1 -.6e+01^A-.7e+01^A-.8e+01^A0 +0.6e102^A+0.7e102^A+0.8e102^A1 -0.6e102^A-0.7e102^A-0.8e102^A0 .6e102^A.7e102^A.8e102^A1 +.6e102^A+.7e102^A+.8e102^A0 -.6e102^A-.7e102^A-.8e102^A1 2014-06-30 15:44:44.245461 -- Start http://192.168.1.40:54321/2/PostFile.json?key=parsetmp_1_0_2_0.data #/home/kevin/h2o/py/testdir_single_jvm/sandbox/syn_datasets/parsetmp_1_0_2_0.data 2014-06-30 15:44:44.253077 -- Start http://192.168.1.40:54321/2/Parse2.json?single_quotes=0&source_key=parsetmp_1_0_2_0.data 2014-06-30 15:44:45.260299 -- Start http://192.168.1.40:54321/2/Progress2.json?job_key=$0301c0a8012832d4ffffffff$_a57367bdc85fd058b738e6d9faae422f&destination_key=parsetmp_1_0_2_0.hex 2014-06-30 15:44:45.274134 -- Start http://192.168.1.40:54321/2/Inspect2.json?src_key=parsetmp_1_0_2_0.hex 2014-06-30 15:44:45.285336 -- Start http://192.168.1.40:54321/2/SummaryPage2.json?source=parsetmp_1_0_2_0.hex&max_ncols=4 2014-06-30 15:44:45.378326 -- Start http://192.168.1.40:54321/2/Inspect2.json?src_key=parsetmp_1_0_2_0.hex 2014-06-30 15:44:45.382202 -- Start http://192.168.1.40:54321/2/DRF.json?classification=1&importance=1&source=parsetmp_1_0_2_0.hex&ntrees=1&response=DateofBirth 2014-06-30 15:44:50.501616 -- Start http://192.168.1.40:54321/2/DRFProgressPage.json?job_key=$0301c0a8012832d4ffffffff$_a8eee7196ec0cc243d39cc05e41541fb&destination_key=DRF_9b148a6e6efc058cdab1b9f7c54142ff 2014-06-30 15:44:50.610065 -- Start http://192.168.1.40:54321/2/DRFProgressPage.json?job_key=$0301c0a8012832d4ffffffff$_a8eee7196ec0cc243d39cc05e41541fb&destination_key=DRF_9b148a6e6efc058cdab1b9f7c54142ff 2014-06-30 15:44:50.713537 -- Start http://192.168.1.40:54321/2/DRFProgressPage.json?job_key=$0301c0a8012832d4ffffffff$_a8eee7196ec0cc243d39cc05e41541fb&destination_key=DRF_9b148a6e6efc058cdab1b9f7c54142ff 2014-06-30 15:44:50.817189 -- Start http://192.168.1.40:54321/2/DRFProgressPage.json?job_key=$0301c0a8012832d4ffffffff$_a8eee7196ec0cc243d39cc05e41541fb&destination_key=DRF_9b148a6e6efc058cdab1b9f7c54142ff 2014-06-30 15:44:50.920776 -- Start http://192.168.1.40:54321/2/DRFProgressPage.json?job_key=$0301c0a8012832d4ffffffff$_a8eee7196ec0cc243d39cc05e41541fb&destination_key=DRF_9b148a6e6efc058cdab1b9f7c54142ff 2014-06-30 15:44:51.029056 -- Start http://192.168.1.40:54321/2/DRFProgressPage.json?job_key=$0301c0a8012832d4ffffffff$_a8eee7196ec0cc243d39cc05e41541fb&destination_key=DRF_9b148a6e6efc058cdab1b9f7c54142ff

    JIRA | 3 years ago | Kevin Normoyle
    java.lang.AssertionError: col_data Infinity out of range FirstName:-Infinity-Infinity step=Infinity nbins=1024 isInt=0 cnt=29, [-6.000000 - 6.000000], mean/var= 0.52/ 0.26, cnt=0, [-6.000000 - 6.000000], mean/var= 0.00/ 0.00, cnt=0, [-6.000000 - 6.000000], mean/var= 0.00/ 0.00, cnt=0, [-6.000000 - 6.000000], mean/var= 0.00/ 0.00, cnt=0, [-6.000000 - 6.000000], mean/var= 0.00/ 0.00, ....

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.AssertionError

      Coldata -2.0 out of range glycogen:0.0-6.0 step=1.0 nbins=6 isInt=1 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR:

      at hex.tree.DHistogram.bin()
    2. hex.tree
      ScoreBuildHistogram.map
      1. hex.tree.DHistogram.bin(DHistogram.java:172)
      2. hex.tree.DHistogram.updateSharedHistosAndReset(DHistogram.java:617)
      3. hex.tree.ScoreBuildHistogram.accum_all(ScoreBuildHistogram.java:256)
      4. hex.tree.ScoreBuildHistogram.map(ScoreBuildHistogram.java:123)
      4 frames
    3. water
      H2O$H2OCountedCompleter.compute1
      1. water.MRTask.compute2(MRTask.java:630)
      2. water.H2O$H2OCountedCompleter.compute1(H2O.java:1201)
      2 frames
    4. hex.tree
      ScoreBuildHistogram$Icer.compute1
      1. hex.tree.ScoreBuildHistogram$Icer.compute1(ScoreBuildHistogram$Icer.java)
      1 frame
    5. water
      H2O$H2OCountedCompleter.compute
      1. water.H2O$H2OCountedCompleter.compute(H2O.java:1197)
      1 frame
    6. jsr166y
      ForkJoinWorkerThread.run
      1. jsr166y.CountedCompleter.exec(CountedCompleter.java:468)
      2. jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      3. jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      4. jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      5. jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      5 frames