java.lang.RuntimeException: GLM2[dest=GLMModel__b779758b29d625985bd5144d73d34b36, iteration=1, lambda = 1.0E-5]: got NaNs and/or Infs in beta

JIRA | Prithvi Prabhu | 2 years ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Getting this failure while building a GLM model on smalldata/airlines. Using h2o-dev/master, d1705680ef5417bcfdff34b84cdca2c7212c74dd. Log output: 02-05 14:23:01.959 172.16.2.96:54321 10761 # Session INFO: Method: POST , Path: /3/ModelBuilders/glm, route: /3/ModelBuilders/glm, parms: {tweedie_variance_power=NaN, standardize=true, alpha=[0.5], balance_classes=false, lambda_min_ratio=-1, tweedie_link_power=NaN, higher_accuracy=false, max_after_balance_size=5, link=family_default, use_all_factor_levels=false, lambda=[0.00001], response_column=IsDepDelayed, nlambdas=-1, do_classification=true, class_sampling_factors=, lambda_search=false, training_frame=allyears2k_headers.hex, n_folds=0, family=gaussian, prior1=0, solver=ADMM, destination_key=} 02-05 14:23:01.962 172.16.2.96:54321 10761 # Session INFO: Building H2O GLM model with these parameters: 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: { 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_train": { 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "name": "allyears2k_headers.hex", 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "type": "Key" 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: }, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_dropNA20Cols": false, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_dropConsCols": true, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_score_each_iteration": false, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_max_confusion_matrix_size": 20, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_response_column": "IsDepDelayed", 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_convert_to_enum": true, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_balance_classes": false, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_max_after_balance_size": 5.0, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_max_hit_ratio_k": 10, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_standardize": true, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_family": "gaussian", 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_link": "family_default", 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_solver": "ADMM", 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_tweedie_variance_power": "NaN", 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_tweedie_link_power": "NaN", 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_alpha": [ 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: 0.5 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: ], 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_lambda": [ 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: 1.0E-5 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: ], 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_prior": -1.0, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_lambda_search": false, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_nlambdas": -1, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_lambda_min_ratio": -1.0, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_higher_accuracy": false, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_use_all_factor_levels": false, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_n_folds": 0, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_max_active_predictors": 10000 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: } ... barrier onExCompletion for hex.glm.GLM$1@79ea98b java.lang.RuntimeException: GLM2[dest=GLMModel__b779758b29d625985bd5144d73d34b36, iteration=1, lambda = 1.0E-5]: got NaNs and/or Infs in beta at hex.glm.GLM$GLMLambdaTask$Iteration.callback(GLM.java:530) at hex.glm.GLM$GLMLambdaTask$Iteration.callback(GLM.java:464) at water.H2O$H2OCallback.onCompletion(H2O.java:640) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:437) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 2 years ago | Prithvi Prabhu
    java.lang.RuntimeException: GLM2[dest=GLMModel__b779758b29d625985bd5144d73d34b36, iteration=1, lambda = 1.0E-5]: got NaNs and/or Infs in beta
  2. 0

    Getting this failure while building a GLM model on smalldata/airlines. Using h2o-dev/master, d1705680ef5417bcfdff34b84cdca2c7212c74dd. Log output: 02-05 14:23:01.959 172.16.2.96:54321 10761 # Session INFO: Method: POST , Path: /3/ModelBuilders/glm, route: /3/ModelBuilders/glm, parms: {tweedie_variance_power=NaN, standardize=true, alpha=[0.5], balance_classes=false, lambda_min_ratio=-1, tweedie_link_power=NaN, higher_accuracy=false, max_after_balance_size=5, link=family_default, use_all_factor_levels=false, lambda=[0.00001], response_column=IsDepDelayed, nlambdas=-1, do_classification=true, class_sampling_factors=, lambda_search=false, training_frame=allyears2k_headers.hex, n_folds=0, family=gaussian, prior1=0, solver=ADMM, destination_key=} 02-05 14:23:01.962 172.16.2.96:54321 10761 # Session INFO: Building H2O GLM model with these parameters: 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: { 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_train": { 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "name": "allyears2k_headers.hex", 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "type": "Key" 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: }, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_dropNA20Cols": false, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_dropConsCols": true, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_score_each_iteration": false, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_max_confusion_matrix_size": 20, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_response_column": "IsDepDelayed", 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_convert_to_enum": true, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_balance_classes": false, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_max_after_balance_size": 5.0, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_max_hit_ratio_k": 10, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_standardize": true, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_family": "gaussian", 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_link": "family_default", 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_solver": "ADMM", 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_tweedie_variance_power": "NaN", 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_tweedie_link_power": "NaN", 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_alpha": [ 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: 0.5 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: ], 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_lambda": [ 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: 1.0E-5 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: ], 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_prior": -1.0, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_lambda_search": false, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_nlambdas": -1, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_lambda_min_ratio": -1.0, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_higher_accuracy": false, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_use_all_factor_levels": false, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_n_folds": 0, 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: "_max_active_predictors": 10000 02-05 14:23:01.975 172.16.2.96:54321 10761 # Session INFO: } ... barrier onExCompletion for hex.glm.GLM$1@79ea98b java.lang.RuntimeException: GLM2[dest=GLMModel__b779758b29d625985bd5144d73d34b36, iteration=1, lambda = 1.0E-5]: got NaNs and/or Infs in beta at hex.glm.GLM$GLMLambdaTask$Iteration.callback(GLM.java:530) at hex.glm.GLM$GLMLambdaTask$Iteration.callback(GLM.java:464) at water.H2O$H2OCallback.onCompletion(H2O.java:640) at jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386) at water.MRTask.compute2(MRTask.java:437) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 2 years ago | Prithvi Prabhu
    java.lang.RuntimeException: GLM2[dest=GLMModel__b779758b29d625985bd5144d73d34b36, iteration=1, lambda = 1.0E-5]: got NaNs and/or Infs in beta

    Root Cause Analysis

    1. java.lang.RuntimeException

      GLM2[dest=GLMModel__b779758b29d625985bd5144d73d34b36, iteration=1, lambda = 1.0E-5]: got NaNs and/or Infs in beta

      at hex.glm.GLM$GLMLambdaTask$Iteration.callback()
    2. hex.glm
      GLM$GLMLambdaTask$Iteration.callback
      1. hex.glm.GLM$GLMLambdaTask$Iteration.callback(GLM.java:530)
      2. hex.glm.GLM$GLMLambdaTask$Iteration.callback(GLM.java:464)
      2 frames
    3. water
      H2O$H2OCallback.onCompletion
      1. water.H2O$H2OCallback.onCompletion(H2O.java:640)
      1 frame
    4. jsr166y
      CountedCompleter.tryComplete
      1. jsr166y.CountedCompleter.tryComplete(CountedCompleter.java:386)
      1 frame
    5. water
      H2O$H2OCountedCompleter.compute
      1. water.MRTask.compute2(MRTask.java:437)
      2. water.H2O$H2OCountedCompleter.compute(H2O.java:582)
      2 frames
    6. jsr166y
      ForkJoinWorkerThread.run
      1. jsr166y.CountedCompleter.exec(CountedCompleter.java:429)
      2. jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      3. jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      4. jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      5. jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      5 frames