java.lang.NullPointerException

There are no available Samebug tips for this exception. Do you have an idea how to solve this issue? A short tip would help users who saw this issue last week.

  • Multifile parse with more than 128 files some of which have more than 1 chunk and less than 10 will fail with NPE (missing chunk). This is caused by new many small files pars mode which disables distributed parse and calls stream parse, however the overloaded stream parse method used in this case does not work properly and will only produce single output chunk. Since parse expects to have the same number of output chunks as input chunks, the remaining chunks are missing. Parse than fails when unifying enums (or one computing rollups if there are no enums). stack trace : DistributedException from /10.24.42.145:54323, caused by java.lang.NullPointerException 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.MRTask.getResult(MRTask.java:477) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.MRTask.getResult(MRTask.java:485) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.MRTask.doAll(MRTask.java:389) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.MRTask.doAll(MRTask.java:376) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.MRTask.doAll(MRTask.java:375) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.parser.ParseDataset.parseAllKeys(ParseDataset.java:310) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.parser.ParseDataset.access$000(ParseDataset.java:27) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.parser.ParseDataset$ParserFJTask.compute2(ParseDataset.java:195) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.H2O$H2OCountedCompleter.compute(H2O.java:1198) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at jsr166y.CountedCompleter.exec(CountedCompleter.java:468) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: Caused by: java.lang.NullPointerException 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.fvec.Vec.chunkForChunkIdx(Vec.java:892) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.MRTask.compute2(MRTask.java:612) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.MRTask.compute2(MRTask.java:585) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.MRTask.compute2(MRTask.java:585) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.MRTask.compute2(MRTask.java:585) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.MRTask.compute2(MRTask.java:585) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.MRTask.compute2(MRTask.java:585) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.H2O$H2OCountedCompleter.compute1(H2O.java:1201) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.parser.ParseDataset$UpdateCategoricalChunksTask$Icer.compute1(ParseDataset$UpdateCategoricalChunksTask$Icer.java) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at water.H2O$H2OCountedCompleter.compute(H2O.java:1197) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at jsr166y.CountedCompleter.exec(CountedCompleter.java:468) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at jsr166y.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:914) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:979) 08-30 17:40:21.625 10.24.42.145:54323 40084 FJ-1-93 ERRR: ... 2 more
    via by Tomas Nykodym,
  • while building a model, go to the dataset and change a column type to get npe in the building model data- /Users/nidhimehta/h2o-3/bigdata/laptop/milsongs/milsongs-cls-train.csv" {code:java} buildModel 'gbm', {"model_id":"gbm-cd6b97db-3ec9-487f-a019-b74ca17f4878","training_frame":"milsongs_cls_train.hex","nfolds":0,"response_column":"C1","ignored_columns":[],"ignore_const_cols":true,"ntrees":50,"max_depth":5,"min_rows":10,"nbins":20,"nbins_cats":1024,"seed":3988775424555483000,"learn_rate":0.1,"distribution":"AUTO","sample_rate":1,"col_sample_rate":1,"col_sample_rate_per_tree":1,"score_each_iteration":false,"fold_assignment":"AUTO","balance_classes":false,"max_confusion_matrix_size":20,"max_hit_ratio_k":10,"r2_stopping":0.999999,"stopping_rounds":0,"stopping_metric":"AUTO","stopping_tolerance":0.001,"build_tree_one_node":false,"tweedie_power":1.5,"checkpoint":"","keep_cross_validation_predictions":false,"class_sampling_factors":[],"max_after_balance_size":5,"nbins_top_level":1024} {code} {code:java} Got exception 'class java.lang.NullPointerException', with msg 'null' java.lang.NullPointerException at water.fvec.Vec.chunkForChunkIdx(Vec.java:853) at water.MRTask.compute2(MRTask.java:645) at water.H2O$H2OCountedCompleter.compute1(H2O.java:1060) at hex.tree.ScoreBuildHistogram$Icer.compute1(ScoreBuildHistogram$Icer.java) at water.H2O$H2OCountedCompleter.compute(H2O.java:1056) at jsr166y.CountedCompleter.exec(CountedCompleter.java:468) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) {code}
    via by Nidhi Mehta,
    • java.lang.NullPointerException at water.MRTask.getResult(MRTask.java:477) at water.MRTask.getResult(MRTask.java:485) at water.MRTask.doAll(MRTask.java:389) at water.MRTask.doAll(MRTask.java:376) at water.MRTask.doAll(MRTask.java:375) at water.parser.ParseDataset.parseAllKeys(ParseDataset.java:310) at water.parser.ParseDataset.access$000(ParseDataset.java:27) at water.parser.ParseDataset$ParserFJTask.compute2(ParseDataset.java:195) at water.H2O$H2OCountedCompleter.compute(H2O.java:1198) at jsr166y.CountedCompleter.exec(CountedCompleter.java:468) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: java.lang.NullPointerException at water.fvec.Vec.chunkForChunkIdx(Vec.java:892) at water.MRTask.compute2(MRTask.java:612) at water.MRTask.compute2(MRTask.java:585) at water.MRTask.compute2(MRTask.java:585) at water.MRTask.compute2(MRTask.java:585) at water.MRTask.compute2(MRTask.java:585) at water.MRTask.compute2(MRTask.java:585) at water.H2O$H2OCountedCompleter.compute1(H2O.java:1201) at water.parser.ParseDataset$UpdateCategoricalChunksTask$Icer.compute1(ParseDataset$UpdateCategoricalChunksTask$Icer.java) at water.H2O$H2OCountedCompleter.compute(H2O.java:1197) at jsr166y.CountedCompleter.exec(CountedCompleter.java:468) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:914) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:979) ... 2 more
    No Bugmate found.