java.lang.AssertionError: Coldata -2.0 out of range glycogen:0.0-6.0 step=1.0 nbins=6 isInt=1 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR:

JIRA | Nidhi Mehta | 3 months ago
  1. 0

    H2O Build git hash d651ad244a9510d286c6b6f0bc4a8d23b2f485ed Running a gbm grid search (with cross validation) on a couple of datasets and hit a few NPEs and java assertion error due to leaked frames and missing chunks. Could not repro the errors when ran them again. here are the stack traces- {code:java} [1] "/home/nidhi/auto_sklearn_csv/dataset_22_mfeat-zernike.arff.txt" Hyper-parameter: col_sample_rate_per_tree, 0.6 Hyper-parameter: learn_rate, 0.5 Hyper-parameter: max_depth, 1 Hyper-parameter: min_rows, 100 Hyper-parameter: min_split_improvement, 1e-04 Hyper-parameter: ntrees, 10000 Hyper-parameter: sample_rate, 0.8 [2016-09-05 07:06:27] failure_details: DistributedException from /172.17.2.208:28555 [2016-09-05 07:06:27] failure_stack_traces: DistributedException from /172.17.2.208:28555, caused by java.lang.NullPointerException at water.MRTask.getResult(MRTask.java:477) at water.MRTask.getResult(MRTask.java:485) at water.MRTask.doAll(MRTask.java:389) at water.MRTask.doAll(MRTask.java:383) at hex.tree.gbm.GBM$GBMDriver.buildNextKTrees(GBM.java:444) at hex.tree.SharedTree$Driver.scoreAndBuildTrees(SharedTree.java:344) at hex.tree.SharedTree$Driver.computeImpl(SharedTree.java:284) at hex.ModelBuilder$Driver.compute2(ModelBuilder.java:168) at water.H2O$H2OCountedCompleter.compute(H2O.java:1198) at jsr166y.CountedCompleter.exec(CountedCompleter.java:468) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: java.lang.NullPointerException at water.fvec.NewChunk.chunkD(NewChunk.java:1395) at water.fvec.NewChunk.compress2(NewChunk.java:1114) at water.fvec.NewChunk.compress(NewChunk.java:1013) at water.fvec.NewChunk.new_close(NewChunk.java:876) at water.fvec.Chunk.close(Chunk.java:561) at water.MRTask.compute2(MRTask.java:650) at water.H2O$H2OCountedCompleter.compute1(H2O.java:1201) at hex.tree.gbm.GBM$GBMDriver$ComputePredAndRes$Icer.compute1(GBM$GBMDriver$ComputePredAndRes$Icer.java) at water.H2O$H2OCountedCompleter.compute(H2O.java:1197) ... 5 more {code} {code:java} ##when rerun runs fine [1] "/home/nidhi/auto_sklearn_csv/oh10.wc.arff.txt" |======================================================================| 100% |====== | 8% java.lang.AssertionError: Coldata -2.0 out of range glycogen:0.0-6.0 step=1.0 nbins=6 isInt=1 cnt=0.000000, [0.000000 - 1.000000], mean/var= 0.00/ 0.00, cnt=0.000000, [1.000000 - 2.000000], mean/var= 0.00/ 0.00, cnt=0.000000, [2.000000 - 3.000000], mean/var= 0.00/ 0.00, cnt=0.000000, [3.000000 - 4.000000], mean/var= 0.00/ 0.00, cnt=0.000000, [4.000000 - 5.000000], mean/var= 0.00/ 0.00, cnt=0.000000, [5.000000 - 6.000000], mean/var= 0.00/ 0.00, Error: java.lang.AssertionError: Coldata -2.0 out of range glycogen:0.0-6.0 step=1.0 nbins=6 isInt=1 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at hex.tree.DHistogram.bin(DHistogram.java:172) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at hex.tree.DHistogram.updateSharedHistosAndReset(DHistogram.java:617) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at hex.tree.ScoreBuildHistogram.accum_all(ScoreBuildHistogram.java:256) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at hex.tree.ScoreBuildHistogram.map(ScoreBuildHistogram.java:123) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at water.MRTask.compute2(MRTask.java:630) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at water.H2O$H2OCountedCompleter.compute1(H2O.java:1201) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at hex.tree.ScoreBuildHistogram$Icer.compute1(ScoreBuildHistogram$Icer.java) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at water.H2O$H2OCountedCompleter.compute(H2O.java:1197) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at jsr166y.CountedCompleter.exec(CountedCompleter.java:468) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-3-9 ERRR: Error: Missing chunk 9 for $04ff2e020080ffffffff$nfs://home/nidhi/auto_sklearn_csv/oh10.wc.arff.txt 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-3-21 ERRR: Error: Missing chunk 15 for $04ff2e020080ffffffff$nfs://home/nidhi/auto_sklearn_csv/oh10.wc.arff.txt ################ {code} {code:java} ##COULD NOT REPRO ON MASTER 18 fails check nohupR.out rollup error 08-31 03:59:44.789 172.16.2.188:23555 8819 FJ-2-171 INFO: {"_train":{"name":"dataset_16_mfeat-karhunen.arff.txt_model_8_cv_5_train","type":"Key"},"_valid":{"name":"dataset_16_mfeat-karhunen.arff.txt_model_8_cv_5_valid","type":"Key"},"_nfolds":0,"_keep_cross_validation_predictions":false,"_keep_cross_validation_fold_assignment":false,"_parallelize_cross_validation":true,"_auto_rebalance":true,"_seed":4563563636689,"_fold_assignment":"AUTO","_categorical_encoding":"AUTO","_distribution":"AUTO","_tweedie_power":1.5,"_quantile_alpha":0.5,"_huber_alpha":0.9,"_ignored_columns":[""],"_ignore_const_cols":true,"_weights_column":"__internal_cv_weights__","_offset_column":null,"_fold_column":null,"_is_cv_model":true,"_score_each_iteration":false,"_max_runtime_secs":0.0,"_stopping_rounds":2,"_stopping_metric":"AUTO","_stopping_tolerance":0.001,"_response_column":"class","_balance_classes":false,"_max_after_balance_size":5.0,"_class_sampling_factors":null,"_max_confusion_matrix_size":20,"_checkpoint":null,"_pretrained_autoencoder":null,"_ntrees":10000,"_max_depth":3,"_min_rows":1.0,"_nbins":20,"_nbins_cats":1024,"_min_split_improvement":1.0E-5,"_histogram_type":"AUTO","_r2_stopping":1.7976931348623157E308,"_nbins_top_level":1024,"_build_tree_one_node":false,"_score_tree_interval":20,"_initial_score_interval":4000,"_score_interval":4000,"_sample_rate":1.0,"_sample_rate_per_class":null,"_col_sample_rate_change_per_level":1.0,"_col_sample_rate_per_tree":1.0,"_learn_rate":0.01,"_learn_rate_annealing":1.0,"_col_sample_rate":1.0,"_max_abs_leafnode_pred":1.7976931348623157E308} 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: Grid search: model builder for parameters hex.tree.gbm.GBMModel$GBMParameters@127558f failed! Exception: java.lang.NullPointerExceptionjava.lang.NullPointerException 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at water.fvec.NewChunk.bufB(NewChunk.java:1455) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at water.fvec.NewChunk.compress2(NewChunk.java:1209) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at water.fvec.NewChunk.compress(NewChunk.java:1013) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at water.fvec.NewChunk.new_close(NewChunk.java:876) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at water.fvec.Chunk.close(Chunk.java:561) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at water.MRTask.compute2(MRTask.java:650) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at water.H2O$H2OCountedCompleter.compute1(H2O.java:1201) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at hex.tree.ScoreBuildHistogram$Icer.compute1(ScoreBuildHistogram$Icer.java) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at water.H2O$H2OCountedCompleter.compute(H2O.java:1197) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at jsr166y.CountedCompleter.exec(CountedCompleter.java:468) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at jsr166y.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:914) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:979) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 WARN: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 INFO: Windowed averages (window size 2) of grid's best 3 logloss metrics: [0.20842527609394138, 0.18711026295815913, 0.16014838264852577] 08-31 03:59:44.858 172.16.2.188:23555 8819 FJ-1-43 INFO: Checking convergence with logloss metric: 0.20842527609394138 --> 0.16014838264852577 (still improving). 08-31 03:59:44.902 172.16.2.188:23555 8819 FJ-1-43 INFO: Creating 5 cross-validation splits with random number seed: 4563563636689 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: java.lang.AssertionError: null vec: $04ff1e000000ffffffff$nfs://home/nidhi/auto_sklearn_csv/dataset_16_mfeat-karhunen.arff.txt 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at water.fvec.Frame.<init>(Frame.java:113) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at water.fvec.Frame.<init>(Frame.java:83) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at hex.ModelBuilder.cv_makeFramesAndBuilders(ModelBuilder.java:353) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at hex.ModelBuilder.computeCrossValidation(ModelBuilder.java:262) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at hex.ModelBuilder.trainModelNested(ModelBuilder.java:212) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at hex.grid.GridSearch.startBuildModel(GridSearch.java:329) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at hex.grid.GridSearch.buildModel(GridSearch.java:311) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at hex.grid.GridSearch.gridSearch(GridSearch.java:215) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at hex.grid.GridSearch.access$000(GridSearch.java:69) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at hex.grid.GridSearch$1.compute2(GridSearch.java:136) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at water.H2O$H2OCountedCompleter.compute(H2O.java:1198) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at jsr166y.CountedCompleter.exec(CountedCompleter.java:468) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 08-31 03:59:44.910 172.16.2.188:23555 8819 FJ-1-43 ERRR: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 08-31 08:33:42.526 172.16.2.188:23555 8819 #47664-12 INFO: GET /3/Frames, parms: {} 08-31 08:33:42.606 172.16.2.188:23555 8819 #47664-12 WARN: Leaked frame: Frame data points to one or more deleted vecs. ####################### {code}

    JIRA | 3 months ago | Nidhi Mehta
    java.lang.AssertionError: Coldata -2.0 out of range glycogen:0.0-6.0 step=1.0 nbins=6 isInt=1 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR:
  2. 0

    When run gbm multinomial on allstate data from flow- dataset - /home/0xdiag/home-0xdiag-datasets/allstate/test_set.zip buildModel 'gbm', {"destination_key":"gbm-1370eca6-bdc9-4afd-ae0d-54fa2250e308","training_frame":"test_set.hex","ignored_columns":["Row_ID","Household_ID"],"dropNA20Cols":false,"response_column":"Blind_Model","ntrees":50,"max_depth":5,"min_rows":10,"nbins":20,"learn_rate":0.1,"loss":"multinomial","balance_classes":false,"class_sampling_factors":[],"max_after_balance_size":5,"seed":0} Get - Got exception 'class java.lang.AssertionError', with msg 'null' java.lang.AssertionError at hex.tree.gbm.GBM$GBMDriver$GammaPass.map(GBM.java:393) at water.MRTask.compute2(MRTask.java:415) at water.MRTask.compute2(MRTask.java:374) at water.MRTask.compute2(MRTask.java:374) at water.MRTask.compute2(MRTask.java:374) at water.MRTask.compute2(MRTask.java:374) at water.MRTask.compute2(MRTask.java:374) at water.MRTask.compute2(MRTask.java:374) at water.MRTask.compute2(MRTask.java:374) at water.H2O$H2OCountedCompleter.compute(H2O.java:632) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 2 years ago | Nidhi Mehta
    java.lang.AssertionError: Coldata 48.0 out of range Blind_Make:14.0-29.0 step=1.0 nbins=15 isInt=2 cnt=0, [14.000000 - 15.000000], mean/var= 0.00/ 0.00, cnt=0, [15.000000 - 16.000000], mean/var= 0.00/ 0.00, cnt=0, [16.000000 - 17.000000], mean/var= 0.00/ 0.00, cnt=0, [17.000000 - 18.000000], mean/var= 0.00/ 0.00, cnt=0, [18.000000 - 19.000000], mean/var= 0.00/ 0.00, cnt=0, [19.000000 - 20.000000], mean/var= 0.00/ 0.00, cnt=0, [20.000000 - 21.000000], mean/var= 0.00/ 0.00, cnt=0, [21.000000 - 22.000000], mean/var= 0.00/ 0.00, cnt=0, [22.000000 - 23.000000], mean/var= 0.00/ 0.00, cnt=0, [23.000000 - 24.000000], mean/var= 0.00/ 0.00, cnt=0, [24.000000 - 25.000000], mean/var= 0.00/ 0.00, cnt=0, [25.000000 - 26.000000], mean/var= 0.00/ 0.00, cnt=0, [26.000000 - 27.000000], mean/var= 0.00/ 0.00, cnt=0, [27.000000 - 28.000000], mean/var= 0.00/ 0.00, cnt=0, [28.000000 - 29.000000], mean/var= 0.00/ 0.00,
  3. 0

    running random forest from R or python on prostate with this parameter combination: pros = h2o.upload_file(h2o.locate("smalldata/prostate/prostate.csv.zip")) pros[1] = pros[1].asfactor() pros[4] = pros[4].asfactor() pros[5] = pros[5].asfactor() pros[8] = pros[8].asfactor() x: [7, 4, 3, 6, 5, 8] y: 1 validation: False nbins: 1 ntrees: 4 min_rows: 1 seed: 2969 balance_classes: True max_depth: 1 gives this stacktrace: URI: /3/ModelBuilders/drf, route: /3/ModelBuilders/drf, parms: {max_depth=1, seed=2969, training_frame=py22e16c1f-e74f-4860-8aa9-577f00392520, ntrees=4, nbins=1, balance_classes=True, response_column=CAPSULE, min_rows=1} 05-01 10:21:32.660 172.16.2.40:54321 44212 FJ-0-19 INFO: Building H2O DRF model with these parameters: 05-01 10:21:32.660 172.16.2.40:54321 44212 FJ-0-19 INFO: {"_model_id":null,"_train":{"name":"py22e16c1f-e74f-4860-8aa9-577f00392520","type":"Key"},"_valid":null,"_ignored_columns":null,"_drop_na20_cols":false,"_dropConsCols":true,"_score_each_iteration":false,"_response_column":"CAPSULE","_balance_classes":true,"_max_after_balance_size":5.0,"_class_sampling_factors":null,"_max_hit_ratio_k":10,"_max_confusion_matrix_size":20,"_ntrees":4,"_max_depth":1,"_min_rows":1,"_nbins":1,"_seed":2969,"_checkpoint":false,"_mtries":-1,"_sample_rate":0.6666667,"_build_tree_one_node":false} 05-01 10:21:32.670 172.16.2.40:54321 44212 FJ-0-19 INFO: Doing stratified sampling for data set containing 156001 rows from 2 classes. Oversampling: on 05-01 10:21:32.670 172.16.2.40:54321 44212 FJ-0-19 INFO: Stratified sampling to a total of 186,380 rows. 05-01 10:21:32.670 172.16.2.40:54321 44212 FJ-0-19 INFO: Class '0' sampling ratio: 1.0 05-01 10:21:32.670 172.16.2.40:54321 44212 FJ-0-19 INFO: Class '1' sampling ratio: 1.4836574 05-01 10:21:32.799 172.16.2.40:54321 44212 FJ-0-19 INFO: Prior class distribution: [0.5973679655899642, 0.4026320344100358] 05-01 10:21:32.799 172.16.2.40:54321 44212 FJ-0-19 INFO: Model class distribution: [0.49985249550781774, 0.5001475044921823] 05-01 10:21:32.818 172.16.2.40:54321 44212 FJ-0-19 INFO: ============================================================== 05-01 10:21:32.821 172.16.2.40:54321 44212 FJ-0-19 INFO: training r2 is NaN, MSE is NaN, logloss is NaN, with 0x2 trees (average of 1.0 nodes) onExCompletion for hex.tree.SharedTree$ScoreBuildOneTree@75d5552b onExCompletion for hex.tree.SharedTree$ScoreBuildOneTree@8cab67d java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) barrier onExCompletion for hex.tree.drf.DRF$DRFDriver@1b5462fc java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- x: [3, 8, 7, 5, 6] y: 1 validation: False nbins: 1 build_tree_one_node: True min_rows: 10 seed: 7995 sample_rate: 0.00104403884699 balance_classes: True URI: /3/ModelBuilders/drf, route: /3/ModelBuilders/drf, parms: {build_tree_one_node=True, seed=7995, sample_rate=0.00104403884699, training_frame=pyd17cff5c-8b97-4936-9675-87bb812baab2, nbins=1, balance_classes=True, response_column=CAPSULE, min_rows=10} 05-01 10:40:43.019 172.16.2.40:54321 44212 FJ-0-3 INFO: Building H2O DRF model with these parameters: 05-01 10:40:43.019 172.16.2.40:54321 44212 FJ-0-3 INFO: {"_model_id":null,"_train":{"name":"pyd17cff5c-8b97-4936-9675-87bb812baab2","type":"Key"},"_valid":null,"_ignored_columns":null,"_drop_na20_cols":false,"_dropConsCols":true,"_score_each_iteration":false,"_response_column":"CAPSULE","_balance_classes":true,"_max_after_balance_size":5.0,"_class_sampling_factors":null,"_max_hit_ratio_k":10,"_max_confusion_matrix_size":20,"_ntrees":50,"_max_depth":20,"_min_rows":10,"_nbins":1,"_seed":7995,"_checkpoint":false,"_mtries":-1,"_sample_rate":0.0010440388,"_build_tree_one_node":true} 05-01 10:40:43.027 172.16.2.40:54321 44212 FJ-0-3 INFO: Doing stratified sampling for data set containing 155533 rows from 2 classes. Oversampling: on 05-01 10:40:43.027 172.16.2.40:54321 44212 FJ-0-3 INFO: Stratified sampling to a total of 185,684 rows. 05-01 10:40:43.027 172.16.2.40:54321 44212 FJ-0-3 INFO: Class '0' sampling ratio: 1.0 05-01 10:40:43.027 172.16.2.40:54321 44212 FJ-0-3 INFO: Class '1' sampling ratio: 1.4809463 05-01 10:40:43.118 172.16.2.40:54321 44212 FJ-0-3 INFO: Prior class distribution: [0.5969279831289823, 0.40307201687101774] 05-01 10:40:43.118 172.16.2.40:54321 44212 FJ-0-3 INFO: Model class distribution: [0.5004500935224265, 0.49954990647757347] 05-01 10:40:43.133 172.16.2.40:54321 44212 FJ-0-3 INFO: ============================================================== 05-01 10:40:43.136 172.16.2.40:54321 44212 FJ-0-3 INFO: training r2 is NaN, MSE is NaN, logloss is NaN, with 0x2 trees (average of 1.0 nodes) onExCompletion for hex.tree.SharedTree$ScoreBuildOneTree@46e1d5d9 java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) onExCompletion for hex.tree.SharedTree$ScoreBuildOneTree@44ca27eb java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) barrier onExCompletion for hex.tree.drf.DRF$DRFDriver@26d938e0 java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 2 years ago | Eric Eckstrand
    java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    running random forest from R or python on prostate with this parameter combination: pros = h2o.upload_file(h2o.locate("smalldata/prostate/prostate.csv.zip")) pros[1] = pros[1].asfactor() pros[4] = pros[4].asfactor() pros[5] = pros[5].asfactor() pros[8] = pros[8].asfactor() x: [7, 4, 3, 6, 5, 8] y: 1 validation: False nbins: 1 ntrees: 4 min_rows: 1 seed: 2969 balance_classes: True max_depth: 1 gives this stacktrace: URI: /3/ModelBuilders/drf, route: /3/ModelBuilders/drf, parms: {max_depth=1, seed=2969, training_frame=py22e16c1f-e74f-4860-8aa9-577f00392520, ntrees=4, nbins=1, balance_classes=True, response_column=CAPSULE, min_rows=1} 05-01 10:21:32.660 172.16.2.40:54321 44212 FJ-0-19 INFO: Building H2O DRF model with these parameters: 05-01 10:21:32.660 172.16.2.40:54321 44212 FJ-0-19 INFO: {"_model_id":null,"_train":{"name":"py22e16c1f-e74f-4860-8aa9-577f00392520","type":"Key"},"_valid":null,"_ignored_columns":null,"_drop_na20_cols":false,"_dropConsCols":true,"_score_each_iteration":false,"_response_column":"CAPSULE","_balance_classes":true,"_max_after_balance_size":5.0,"_class_sampling_factors":null,"_max_hit_ratio_k":10,"_max_confusion_matrix_size":20,"_ntrees":4,"_max_depth":1,"_min_rows":1,"_nbins":1,"_seed":2969,"_checkpoint":false,"_mtries":-1,"_sample_rate":0.6666667,"_build_tree_one_node":false} 05-01 10:21:32.670 172.16.2.40:54321 44212 FJ-0-19 INFO: Doing stratified sampling for data set containing 156001 rows from 2 classes. Oversampling: on 05-01 10:21:32.670 172.16.2.40:54321 44212 FJ-0-19 INFO: Stratified sampling to a total of 186,380 rows. 05-01 10:21:32.670 172.16.2.40:54321 44212 FJ-0-19 INFO: Class '0' sampling ratio: 1.0 05-01 10:21:32.670 172.16.2.40:54321 44212 FJ-0-19 INFO: Class '1' sampling ratio: 1.4836574 05-01 10:21:32.799 172.16.2.40:54321 44212 FJ-0-19 INFO: Prior class distribution: [0.5973679655899642, 0.4026320344100358] 05-01 10:21:32.799 172.16.2.40:54321 44212 FJ-0-19 INFO: Model class distribution: [0.49985249550781774, 0.5001475044921823] 05-01 10:21:32.818 172.16.2.40:54321 44212 FJ-0-19 INFO: ============================================================== 05-01 10:21:32.821 172.16.2.40:54321 44212 FJ-0-19 INFO: training r2 is NaN, MSE is NaN, logloss is NaN, with 0x2 trees (average of 1.0 nodes) onExCompletion for hex.tree.SharedTree$ScoreBuildOneTree@75d5552b onExCompletion for hex.tree.SharedTree$ScoreBuildOneTree@8cab67d java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) barrier onExCompletion for hex.tree.drf.DRF$DRFDriver@1b5462fc java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- x: [3, 8, 7, 5, 6] y: 1 validation: False nbins: 1 build_tree_one_node: True min_rows: 10 seed: 7995 sample_rate: 0.00104403884699 balance_classes: True URI: /3/ModelBuilders/drf, route: /3/ModelBuilders/drf, parms: {build_tree_one_node=True, seed=7995, sample_rate=0.00104403884699, training_frame=pyd17cff5c-8b97-4936-9675-87bb812baab2, nbins=1, balance_classes=True, response_column=CAPSULE, min_rows=10} 05-01 10:40:43.019 172.16.2.40:54321 44212 FJ-0-3 INFO: Building H2O DRF model with these parameters: 05-01 10:40:43.019 172.16.2.40:54321 44212 FJ-0-3 INFO: {"_model_id":null,"_train":{"name":"pyd17cff5c-8b97-4936-9675-87bb812baab2","type":"Key"},"_valid":null,"_ignored_columns":null,"_drop_na20_cols":false,"_dropConsCols":true,"_score_each_iteration":false,"_response_column":"CAPSULE","_balance_classes":true,"_max_after_balance_size":5.0,"_class_sampling_factors":null,"_max_hit_ratio_k":10,"_max_confusion_matrix_size":20,"_ntrees":50,"_max_depth":20,"_min_rows":10,"_nbins":1,"_seed":7995,"_checkpoint":false,"_mtries":-1,"_sample_rate":0.0010440388,"_build_tree_one_node":true} 05-01 10:40:43.027 172.16.2.40:54321 44212 FJ-0-3 INFO: Doing stratified sampling for data set containing 155533 rows from 2 classes. Oversampling: on 05-01 10:40:43.027 172.16.2.40:54321 44212 FJ-0-3 INFO: Stratified sampling to a total of 185,684 rows. 05-01 10:40:43.027 172.16.2.40:54321 44212 FJ-0-3 INFO: Class '0' sampling ratio: 1.0 05-01 10:40:43.027 172.16.2.40:54321 44212 FJ-0-3 INFO: Class '1' sampling ratio: 1.4809463 05-01 10:40:43.118 172.16.2.40:54321 44212 FJ-0-3 INFO: Prior class distribution: [0.5969279831289823, 0.40307201687101774] 05-01 10:40:43.118 172.16.2.40:54321 44212 FJ-0-3 INFO: Model class distribution: [0.5004500935224265, 0.49954990647757347] 05-01 10:40:43.133 172.16.2.40:54321 44212 FJ-0-3 INFO: ============================================================== 05-01 10:40:43.136 172.16.2.40:54321 44212 FJ-0-3 INFO: training r2 is NaN, MSE is NaN, logloss is NaN, with 0x2 trees (average of 1.0 nodes) onExCompletion for hex.tree.SharedTree$ScoreBuildOneTree@46e1d5d9 java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) onExCompletion for hex.tree.SharedTree$ScoreBuildOneTree@44ca27eb java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) barrier onExCompletion for hex.tree.drf.DRF$DRFDriver@26d938e0 java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1 at hex.tree.drf.DRF$DRFUndecidedNode.scoreCols(DRF.java:445) at hex.tree.DTree$UndecidedNode.<init>(DTree.java:240) at hex.tree.drf.DRF$DRFUndecidedNode.<init>(DRF.java:436) at hex.tree.drf.DRF$DRFDecidedNode.makeUndecidedNode(DRF.java:412) at hex.tree.DTree$DecidedNode.<init>(DTree.java:373) at hex.tree.drf.DRF$DRFDecidedNode.<init>(DRF.java:410) at hex.tree.drf.DRF.makeDecided(DRF.java:402) at hex.tree.SharedTree$ScoreBuildOneTree.onCompletion(SharedTree.java:275) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:439) at water.H2O$H2OCountedCompleter.compute(H2O.java:682) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 2 years ago | Eric Eckstrand
    java.lang.AssertionError: broken histo range RACE:1.0-3.0 step=2.0 nbins=1 isInt=1
  6. 0

    Input: - 64 machines, jordan release - airlines allyears1987-2007.csv from S3N via importfiles1 - drf2 50 trees, depth 60 Output: during generation of first tree DRF failed on : ERRR WATER: + java.lang.AssertionError: col_data 0.0 out of range CRSArrTime:1.0-2401.0 step=119.99999 nbins=20 isInt=1 + cnt=88, [13.000000 - 2400.000000], mean/var= 0.11/ 0.10, + cnt=0, [13.000000 - 2400.000000], mean/var= 0.00/ 0.00, + cnt=0, [13.000000 - 2400.000000], mean/var= 0.00/ 0.00, + cnt=0, [13.000000 - 2400.000000], mean/var= 0.00/ 0.00, + cnt=32, [13.000000 - 2400.000000], mean/var= 0.78/ 0.18, + cnt=59, [13.000000 - 2400.000000], mean/var= 0.00/ 0.00, + cnt=1165, [13.000000 - 2400.000000], mean/var= 0.27/ 0.20, + cnt=1031, [13.000000 - 2400.000000], mean/var= 0.24/ 0.18, + cnt=1022, [13.000000 - 2400.000000], mean/var= 0.14/ 0.12, + cnt=1039, [13.000000 - 2400.000000], mean/var= 0.21/ 0.16, + cnt=1257, [13.000000 - 2400.000000], mean/var= 0.18/ 0.15, + cnt=1270, [13.000000 - 2400.000000], mean/var= 0.17/ 0.14, + cnt=1161, [13.000000 - 2400.000000], mean/var= 0.20/ 0.16, + cnt=1145, [13.000000 - 2400.000000], mean/var= 0.08/ 0.08, + cnt=1075, [13.000000 - 2400.000000], mean/var= 0.13/ 0.11, + cnt=1298, [13.000000 - 2400.000000], mean/var= 0.14/ 0.12, + cnt=1391, [13.000000 - 2400.000000], mean/var= 0.18/ 0.15, + cnt=1158, [13.000000 - 2400.000000], mean/var= 0.19/ 0.16, + cnt=700, [13.000000 - 2400.000000], mean/var= 0.06/ 0.05, + cnt=514, [13.000000 - 2400.000000], mean/var= 0.12/ 0.11, + + at hex.gbm.DHistogram.incr(DHistogram.java:137) + at hex.gbm.SharedTreeModelBuilder$ScoreBuildHistogram.accum_subset(SharedTreeModelBuilder.java:432) + at hex.gbm.SharedTreeModelBuilder$ScoreBuildHistogram.map(SharedTreeModelBuilder.java:368) + at water.MRTask2.compute2(MRTask2.java:353) + at water.MRTask2.compute2(MRTask2.java:320) + at water.MRTask2.compute2(MRTask2.java:320) + at water.MRTask2.compute2(MRTask2.java:320) + at water.MRTask2.compute2(MRTask2.java:320) + at water.MRTask2.compute2(MRTask2.java:320) + at water.MRTask2.compute2(MRTask2.java:320) + at water.MRTask2.compute2(MRTask2.java:320) + at water.MRTask2.compute2(MRTask2.java:320) + at water.H2O$H2OCountedCompleter.compute(H2O.java:713) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 3 years ago | Michal Malohlava
    java.lang.AssertionError: col_data 0.0 out of range CRSArrTime:1.0-2401.0 step=119.99999 nbins=20 isInt=1 cnt=88, [13.000000 - 2400.000000], mean/var= 0.11/ 0.10, cnt=0, [13.000000 - 2400.000000], mean/var= 0.00/ 0.00, cnt=0, [13.000000 - 2400.000000], mean/var= 0.00/ 0.00, cnt=0, [13.000000 - 2400.000000], mean/var= 0.00/ 0.00, cnt=32, [13.000000 - 2400.000000], mean/var= 0.78/ 0.18, cnt=59, [13.000000 - 2400.000000], mean/var= 0.00/ 0.00, cnt=1165, [13.000000 - 2400.000000], mean/var= 0.27/ 0.20, cnt=1031, [13.000000 - 2400.000000], mean/var= 0.24/ 0.18, cnt=1022, [13.000000 - 2400.000000], mean/var= 0.14/ 0.12, cnt=1039, [13.000000 - 2400.000000], mean/var= 0.21/ 0.16, cnt=1257, [13.000000 - 2400.000000], mean/var= 0.18/ 0.15, cnt=1270, [13.000000 - 2400.000000], mean/var= 0.17/ 0.14, cnt=1161, [13.000000 - 2400.000000], mean/var= 0.20/ 0.16, cnt=1145, [13.000000 - 2400.000000], mean/var= 0.08/ 0.08, cnt=1075, [13.000000 - 2400.000000], mean/var= 0.13/ 0.11, cnt=1298, [13.000000 - 2400.000000], mean/var= 0.14/ 0.12, cnt=1391, [13.000000 - 2400.000000], mean/var= 0.18/ 0.15, cnt=1158, [13.000000 - 2400.000000], mean/var= 0.19/ 0.16, cnt=700, [13.000000 - 2400.000000], mean/var= 0.06/ 0.05, cnt=514, [13.000000 - 2400.000000], mean/var= 0.12/ 0.11,

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.AssertionError

      Coldata -2.0 out of range glycogen:0.0-6.0 step=1.0 nbins=6 isInt=1 09-01 11:39:15.863 172.16.2.189:43555 22281 FJ-1-57 ERRR:

      at hex.tree.DHistogram.bin()
    2. hex.tree
      ScoreBuildHistogram.map
      1. hex.tree.DHistogram.bin(DHistogram.java:172)
      2. hex.tree.DHistogram.updateSharedHistosAndReset(DHistogram.java:617)
      3. hex.tree.ScoreBuildHistogram.accum_all(ScoreBuildHistogram.java:256)
      4. hex.tree.ScoreBuildHistogram.map(ScoreBuildHistogram.java:123)
      4 frames
    3. water
      H2O$H2OCountedCompleter.compute1
      1. water.MRTask.compute2(MRTask.java:630)
      2. water.H2O$H2OCountedCompleter.compute1(H2O.java:1201)
      2 frames
    4. hex.tree
      ScoreBuildHistogram$Icer.compute1
      1. hex.tree.ScoreBuildHistogram$Icer.compute1(ScoreBuildHistogram$Icer.java)
      1 frame
    5. water
      H2O$H2OCountedCompleter.compute
      1. water.H2O$H2OCountedCompleter.compute(H2O.java:1197)
      1 frame
    6. jsr166y
      ForkJoinWorkerThread.run
      1. jsr166y.CountedCompleter.exec(CountedCompleter.java:468)
      2. jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      3. jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      4. jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      5. jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      5 frames