java.util.concurrent.ExecutionException: java.lang.NullPointerException

JIRA | Kevin Normoyle | 3 years ago
  1. 0

    2 jvms, each 6GB dataset is /home/0xdiag/datasets/standard/covtype.shuffled.10pct.data (10% of covtype) I had tried it with 1 jvm. seems slower with 2 jvms in any case, got this stack trace as I went thru a list of functions to use with ddply [2014-04-16 16:55:39.118801] Path h2o will be told to use: /home/kevin/home-0xdiag-datasets/standard/covtype.shuffled.10pct.data [2014-04-16 16:55:39.118870] If local jvms, path resolves locally as: /home/0xdiag/datasets/standard/covtype.shuffled.10pct.data [2014-04-16 16:55:39.119049] parse parameters: {'destination_key': 'i.hex', 'parser_type': None, 'single_quotes': None, 'source_key': 'nfs://home/kevin/home-0xdiag-datasets/standard/covtype.shuffled.10pct.data', 'header': None, 'exclude': None, 'header_from_file': None, 'delete_on_done': None, 'blocking': None, 'separator': None, 'preview': None} [2014-04-16 16:55:39.714257] redirect http://192.168.1.40:54323/2/Progress2.json?job_key=%240301c0a8012834d4ffffffff%24_89a08f6cb3f589fdde88e655df864e18&destination_key=i.hex [2014-04-16 16:55:40.600321] summary_page parameters: {'max_qbins': None, 'source': u'i.hex', 'cols': None, 'max_ncols': 1000} [2014-04-16 16:55:41.332384] exec_query parameters: {'str': 'r.hex=i.hex'} [2014-04-16 16:55:42.783662] Frame return [2014-04-16 16:55:43.471011] exec_query parameters: {'str': 'r.hex'} [2014-04-16 16:55:43.471087] exec_query parameters: {'str': 'ddply(r.hex, c(2), function(x) { mean( x[,2]) })'} [2014-04-16 16:55:43.746039] Frame return [2014-04-16 16:55:51.335012] exec_query parameters: {'str': 'ddply(r.hex, c(2), function(x) { sd( x[,2]) })'} [2014-04-16 16:55:51.335101] Frame return [2014-04-16 16:56:02.200121] exec_query parameters: {'str': 'ddply(r.hex, c(2), function(x) { quantile(x[,2] , c(0.9) ) })'} [2014-04-16 16:56:02.200190] Frame return [2014-04-16 16:56:23.874399] exec_query parameters: {'str': 'ddply(r.hex, c(2), nrow)'} [2014-04-16 16:56:23.874474] Frame return [2014-04-16 16:56:37.187861] exec_query parameters: {'str': 'ddply(r.hex, c(2), ncol)'} [2014-04-16 16:56:37.187959] Frame return [2014-04-16 16:56:55.941166] exec_query parameters: {'str': 'ddply(r.hex, c(2), length)'} [2014-04-16 16:56:55.941256] Frame return [2014-04-16 16:57:12.742012] exec_query parameters: {'str': 'ddply(r.hex, c(2), is.factor)'} [2014-04-16 16:57:12.742084] java.lang.NullPointerException [2014-04-16 16:57:28.293047] at water.fvec.Frame$1.compute2(Frame.java:128) [2014-04-16 16:57:28.293273] at water.H2O$H2OCountedCompleter.compute(H2O.java:712) [2014-04-16 16:57:28.293331] at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) [2014-04-16 16:57:28.293407] at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) [2014-04-16 16:57:28.293458] at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) [2014-04-16 16:57:28.293512] at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) [2014-04-16 16:57:28.293562] at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) [2014-04-16 16:57:28.293614] 04:57:14.513 FJ-14-3 ERRR WATER: Missing vector during Frame fetch: $04ff87e60100ffffffff9f6cf76234d468be9441f9d36db8$J\ [2014-04-16 16:57:28.293860] 04:57:14.515 FJ-15-7 ERRR WATER: [2014-04-16 16:57:28.293905] + java.util.concurrent.ExecutionException: java.lang.NullPointerException [2014-04-16 16:57:28.293958] + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) [2014-04-16 16:57:28.294006] + at water.Futures.blockForPending(Futures.java:67) [2014-04-16 16:57:28.294057] + at water.fvec.Frame.vecs_impl(Frame.java:135) [2014-04-16 16:57:28.294109] + at water.fvec.Frame.vecs(Frame.java:109) [2014-04-16 16:57:28.294158] + at water.exec.Env.addRef(Env.java:295) [2014-04-16 16:57:28.294207] + at water.exec.Env.push(Env.java:81) [2014-04-16 16:57:28.294255] + at water.exec.ASTddply$RemoteExec.compute2(ASTRApply.java:470) [2014-04-16 16:57:28.294311] + at water.DTask.dinvoke(DTask.java:78) [2014-04-16 16:57:28.294361] + at water.RPC$RPCCall.compute2(RPC.java:299) [2014-04-16 16:57:28.294410] + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) [2014-04-16 16:57:28.294466] + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) [2014-04-16 16:57:28.294521] + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) [2014-04-16 16:57:28.294574] + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) [2014-04-16 16:57:28.294630] + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) [2014-04-16 16:57:28.294684] + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) [2014-04-16 16:57:28.294740] + Caused by: java.lang.NullPointerException [2014-04-16 16:57:28.294801] + at water.fvec.Frame$1.compute2(Frame.java:128) [2014-04-16 16:57:28.294850] + ... 6 more

    JIRA | 3 years ago | Kevin Normoyle
    java.util.concurrent.ExecutionException: java.lang.NullPointerException
  2. 0

    I used a reduced size covtype (10%) parsed to i.hex (r.hex) to make it go faster import_only: test_exec2_ddply_phrases.py uses local://home/kevin/home-0xdiag-datasets/standard/covtype.shuffled.10pct.data Path h2o will be told to use: /home/kevin/home-0xdiag-datasets/standard/covtype.shuffled.10pct.data parse parameters: {'header': None, 'destination_key': 'i.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': 'nfs://home/kevin/home-0xdiag-datasets/standard/covtype.shuffled.10pct.data'} exec_query parameters: {'str': 'r.hex=i.hex'} exec_query parameters: {'str': 'ddply(r.hex, c(2,3), function(x) { cbind( mean(x[,1]), mean(x[,2]) ) })'} ERROR: got exception on http://192.168.0.37:54321/2/Exec2.json?str=ddply(r.hex, c(2,3), function(x) { cbind( mean(x[,1]), mean(x[,2]) ) }) to h2o. java.lang.NullPointerException at water.fvec.Frame$1.compute2(Frame.java:131) at water.H2O$H2OCountedCompleter.compute(H2O.java:712) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 12:12:02.184 FJ-15-11 ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs_impl(Frame.java:138) + at water.fvec.Frame.vecs(Frame.java:109) + at water.exec.Env.addRef(Env.java:294) + at water.exec.Env.push(Env.java:80) + at water.exec.ASTddply$RemoteExec.compute2(ASTRApply.java:470) + at water.DTask.dinvoke(DTask.java:78) + at water.RPC$RPCCall.compute2(RPC.java:299) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:131) + ... 6 more

    JIRA | 3 years ago | Kevin Normoyle
    java.util.concurrent.ExecutionException: java.lang.NullPointerException
  3. 0

    start 16 nodes, 4 nodes per machine import/parse covtype 09:42:08.311 FJ-120-43 ERRR WATER: Missing vector #53 (C54) during Frame fetch: $04ff6d000000ffffffff$nfs://home/0xdiag/datasets/standard/covtype.data 09:42:08.312 FJ-120-7 ERRR WATER: Missing vector #54 (C55) during Frame fetch: $04ff6e000000ffffffff$nfs://home/0xdiag/datasets/standard/covtype.data 09:42:08.313 FJ-0-33 ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs_impl(Frame.java:208) + at water.fvec.Frame.vecs(Frame.java:182) + at water.fvec.ParseDataset2$SVFTask.map(ParseDataset2.java:304) + at water.MRTask.lcompute(MRTask.java:68) + at water.DRemoteTask.compute2(DRemoteTask.java:91) + at water.H2O$H2OCountedCompleter.compute(H2O.java:714) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:201) + ... 6 more 09:42:08.316 FJ-120-21 ERRR WATER: Missing vector #54 (C55) during Frame fetch: $04ff6e000000ffffffff$nfs://home/0xdiag/datasets/standard/covtype.data 09:42:08.317 FJ-0-61 ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs_impl(Frame.java:208) + at water.fvec.Frame.vecs(Frame.java:182) + at water.fvec.ParseDataset2$SVFTask.map(ParseDataset2.java:304) + at water.MRTask.lcompute(MRTask.java:68) + at water.DRemoteTask.compute2(DRemoteTask.java:91) + at water.H2O$H2OCountedCompleter.compute(H2O.java:714) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:201) + ... 6 more

    JIRA | 2 years ago | Spencer Aiello
    java.util.concurrent.ExecutionException: java.lang.NullPointerException
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    I used a reduced size covtype (10%) parsed to i.hex (r.hex) to make it go faster import_only: test_exec2_ddply_phrases.py uses local://home/kevin/home-0xdiag-datasets/standard/covtype.shuffled.10pct.data Path h2o will be told to use: /home/kevin/home-0xdiag-datasets/standard/covtype.shuffled.10pct.data parse parameters: {'header': None, 'destination_key': 'i.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': 'nfs://home/kevin/home-0xdiag-datasets/standard/covtype.shuffled.10pct.data'} exec_query parameters: {'str': 'r.hex=i.hex'} exec_query parameters: {'str': 'ddply(r.hex, c(2,3), function(x) { cbind( mean(x[,1]), mean(x[,2]) ) })'} ERROR: got exception on http://192.168.0.37:54321/2/Exec2.json?str=ddply(r.hex, c(2,3), function(x) { cbind( mean(x[,1]), mean(x[,2]) ) }) to h2o. java.lang.NullPointerException at water.fvec.Frame$1.compute2(Frame.java:131) at water.H2O$H2OCountedCompleter.compute(H2O.java:712) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 12:12:02.184 FJ-15-11 ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs_impl(Frame.java:138) + at water.fvec.Frame.vecs(Frame.java:109) + at water.exec.Env.addRef(Env.java:294) + at water.exec.Env.push(Env.java:80) + at water.exec.ASTddply$RemoteExec.compute2(ASTRApply.java:470) + at water.DTask.dinvoke(DTask.java:78) + at water.RPC$RPCCall.compute2(RPC.java:299) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:131) + ... 6 more

    JIRA | 3 years ago | Kevin Normoyle
    java.util.concurrent.ExecutionException: java.lang.NullPointerException
  6. 0

    start 16 nodes, 4 nodes per machine import/parse covtype 09:42:08.311 FJ-120-43 ERRR WATER: Missing vector #53 (C54) during Frame fetch: $04ff6d000000ffffffff$nfs://home/0xdiag/datasets/standard/covtype.data 09:42:08.312 FJ-120-7 ERRR WATER: Missing vector #54 (C55) during Frame fetch: $04ff6e000000ffffffff$nfs://home/0xdiag/datasets/standard/covtype.data 09:42:08.313 FJ-0-33 ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs_impl(Frame.java:208) + at water.fvec.Frame.vecs(Frame.java:182) + at water.fvec.ParseDataset2$SVFTask.map(ParseDataset2.java:304) + at water.MRTask.lcompute(MRTask.java:68) + at water.DRemoteTask.compute2(DRemoteTask.java:91) + at water.H2O$H2OCountedCompleter.compute(H2O.java:714) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:201) + ... 6 more 09:42:08.316 FJ-120-21 ERRR WATER: Missing vector #54 (C55) during Frame fetch: $04ff6e000000ffffffff$nfs://home/0xdiag/datasets/standard/covtype.data 09:42:08.317 FJ-0-61 ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs_impl(Frame.java:208) + at water.fvec.Frame.vecs(Frame.java:182) + at water.fvec.ParseDataset2$SVFTask.map(ParseDataset2.java:304) + at water.MRTask.lcompute(MRTask.java:68) + at water.DRemoteTask.compute2(DRemoteTask.java:91) + at water.H2O$H2OCountedCompleter.compute(H2O.java:714) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:201) + ... 6 more

    JIRA | 2 years ago | Spencer Aiello
    java.util.concurrent.ExecutionException: java.lang.NullPointerException

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.NullPointerException

      No message provided

      at water.fvec.Frame$1.compute2()
    2. water.fvec
      Frame$1.compute2
      1. water.fvec.Frame$1.compute2(Frame.java:128)
      1 frame
    3. water
      H2O$H2OCountedCompleter.compute
      1. water.H2O$H2OCountedCompleter.compute(H2O.java:712)
      1 frame
    4. jsr166y
      ForkJoinWorkerThread.run
      1. jsr166y.CountedCompleter.exec(CountedCompleter.java:429)
      2. jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      3. jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      4. jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      5. jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      5 frames