java.util.concurrent.ExecutionException: java.lang.NullPointerException

JIRA | Kevin Normoyle | 3 years ago
  1. 0

    it's parsing 50 files out of the directory. does it with and import/parse using this import /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz then this parse /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz 40GB jvms test_B_c3_rel_long (test_c3_rel.releaseTest) ... 40 GB java heap(s) with 4 total nodes import_only: /var/lib/jenkins/jobs/h2o_release_tests_164/workspace/py/testdir_release/c3/test_c3_rel.py uses local://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Path h2o will be told to use: /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz import_only: /var/lib/jenkins/jobs/h2o_release_tests_164/workspace/py/testdir_release/c3/test_c3_rel.py uses local://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Path h2o will be told to use: /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz parse parameters: {'header': None, 'destination_key': 'file_50_A.dat.gz.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': u'nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz'} ERROR tearDown java.lang.NullPointerException 04:32:56.308 FJ-16-7 INFO WATER: at water.fvec.Frame$1.compute2(Frame.java:78) 04:32:56.310 FJ-16-7 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:712) 04:32:56.311 FJ-16-7 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 04:32:56.311 FJ-16-7 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 04:32:56.308 # Session ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs(Frame.java:85) + at water.Value.isRawData(Value.java:244) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:90) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:65) + at water.api.RequestArguments$Argument.check(RequestArguments.java:546) + at water.api.RequestQueries.checkArguments(RequestQueries.java:69) + at water.api.Request.serveGrid(Request.java:125) + at water.api.Request.serve(Request.java:108) + at water.api.RequestServer.serve(RequestServer.java:286) + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) + at java.lang.Thread.run(Thread.java:662) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:78) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)04:32:56.312 FJ-16-7 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 04:32:56.314 FJ-16-7 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 04:32:56.314 FJ-16-7 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) ERROR

    JIRA | 3 years ago | Kevin Normoyle
    java.util.concurrent.ExecutionException: java.lang.NullPointerException
  2. 0

    not sure what's going on here. passes sometimes with one machine can fail with one machine. fails using pytest_config-176-180.json the commands.log shows the key commands:2014-02-12 23:57:59.139100 -- Start http://192.168.1.172:54321/2/ImportFiles2.json?path=/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz 2014-02-12 23:57:59.816826 -- Start http://192.168.1.172:54321/2/ImportFiles2.json?path=/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz 2014-02-12 23:58:01.971278 -- Start http://192.168.1.172:54321/2/Parse2.json?destination_key=file_1_A.dat.gz.hex&source_key=nfs://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz did the import twice, but it's failing on the parse here's just one machine cd testdir_0xdata_slow python test_benchmark_1.py -cj ../testdir_hosts/pytest_config-172.json -dts Test: test_benchmark_1.py command line: python test_benchmark_1.py -cj ../testdir_hosts/pytest_config-172.json -dts Python runs on: 192.168.1.172 test_benchmark_import (__main__.Basic) ... Using .gz'ed files in manyfiles-nflx-gz * Using config JSON you passed as -cj argument: ../testdir_hosts/pytest_config-172.json Skipping upload of file ../../target/h2o.jar. File /tmp/29297f521517fb5f47fe9baadbaa742d-h2o.jar exists on remote side! Skipping upload of file pytest_flatfile-kevin. File /tmp/8e276e5ed35977db0d421057c7a99668-pytest_flatfile-kevin exists on remote side! Skipping upload of file ../../target/h2o.jar. File /tmp/29297f521517fb5f47fe9baadbaa742d-h2o.jar exists on remote side! Skipping upload of file pytest_flatfile-kevin. File /tmp/8e276e5ed35977db0d421057c7a99668-pytest_flatfile-kevin exists on remote side! java_heap_GB 20 Running h2o to get java version 11:57:50.411 main INFO WATER: Build git branch: (unknown) 11:57:50.411 main INFO WATER: Build git hash: (unknown) 11:57:50.411 main INFO WATER: Build git describe: (unknown) 11:57:50.412 main INFO WATER: Build project version: (unknown) 11:57:50.412 main INFO WATER: Built by: '(unknown)' 11:57:50.412 main INFO WATER: Built on: '(unknown)' 11:57:50.416 main INFO WATER: OS version: Linux 3.2.0-58-generic (amd64) Appending to benchmark_test_benchmark_1.py.log. Between tests, you may want to delete it if it gets too big 2 total jvms in H2O cloud Saving the ../testdir_hosts/pytest_config-172.json we used to sandbox Found h2o_nodes[0].h2o_remote_buckets_root: /home/0xdiag import_only: test_benchmark_1.py uses local://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz Path h2o will be told to use: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz Problem if this is not empty: importFailList: [ "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_59.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_94.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_62.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_36.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_49.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_83.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_41.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_32.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_71.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_86.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_34.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_54.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_48.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_87.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_37.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_50.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_58.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_81.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_68.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_89.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_52.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_74.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_53.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_64.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_90.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_63.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_80.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_65.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_31.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_97.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_44.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_72.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_57.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_47.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_75.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_73.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_99.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_88.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_95.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_67.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_60.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_92.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_70.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_66.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_96.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_82.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_76.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_42.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_43.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_56.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/doit", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_45.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_91.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_61.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_69.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_55.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_93.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_77.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_46.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_39.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_78.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_98.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_33.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_38.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_85.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_51.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_40.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_84.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_35.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_79.dat.gz" ] Switch. Now appending to benchmark_file_1_A.dat.gz.log. Between tests, you may want to delete it if it gets too big Found h2o_nodes[0].h2o_remote_buckets_root: /home/0xdiag import_only: test_benchmark_1.py uses local://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz Path h2o will be told to use: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz parse parameters: {'header': None, 'destination_key': 'file_1_A.dat.gz.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': u'nfs://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz'} ERROR java.lang.NullPointerException 11:58:02.019 FJ-16-1 INFO WATER: at water.fvec.Frame$1.compute2(Frame.java:76) 11:58:02.021 FJ-16-1 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:712) 11:58:02.021 FJ-16-1 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 11:58:02.022 FJ-16-1 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 11:58:02.022 FJ-16-1 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 11:58:02.022 FJ-16-1 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 11:58:02.019 # Session ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs(Frame.java:83) + at water.Value.isRawData(Value.java:244) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:90) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:65) + at water.api.RequestArguments$Argument.check(RequestArguments.java:546) + at water.api.RequestQueries.checkArguments(RequestQueries.java:69) + at water.api.Request.serveGrid(Request.java:125) + at water.api.Request.serve(Request.java:108) + at water.api.RequestServer.serve(RequestServer.java:315) + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) + at java.lang.Thread.run(Thread.java:662) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:76) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 11:58:02.023 FJ-16-1 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) ERROR

    JIRA | 3 years ago | Kevin Normoyle
    java.util.concurrent.ExecutionException: java.lang.NullPointerException
  3. 0

    Looks like the test currently does full fvec, (even though I forgot to put fvec in it's name) there are two parses, but the key thing is cd testdir_multi_jvm python test_GBM_manyfiles_train_test.py what's interesting is it seems to be doing test and train datasets..using same source for both...the exec works okay for the first time (train) but not for test the exec that causes it: test.hex[,378+1]=test.hex[,378+1]>15 both train.hex and test.hex are parsing the same file: /home/kevin/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz 11:05:43.614 # Session INFO HTTPD: GET /2/Parse2.json destination_key=train.hex source_key=nfs://home/kevin/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz 11:05:58.394 # Session INFO HTTPD: GET /2/Inspect2.json src_key=train.hex 11:05:59.090 # Session INFO HTTPD: GET /2/Exec2.json str=train.hex[,378+1]=train.hex[,378+1]>15 11:06:11.322 # Session INFO HTTPD: GET /2/ImportFiles2.json path=/home/kevin/home-0xdiag-datasets/manyfiles-nflx-gz 11:06:12.121 # Session INFO HTTPD: GET /2/Parse2.json destination_key=test.hex source_key=nfs://home/kevin/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz 11:06:24.362 # Session INFO HTTPD: GET /2/Exec2.json str=test.hex[,378+1]=test.hex[,378+1]>15 11:06:24.386 # Session ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs(Frame.java:83) + at water.exec.Env.addRef(Env.java:280) + at water.exec.Env.push(Env.java:78) + at water.exec.Env.push(Env.java:81) + at water.exec.Exec2.exec(Exec2.java:82) + at water.api.Exec2.serve(Exec2.java:34) + at water.api.Request.serveGrid(Request.java:129) + at water.Request2.superServeGrid(Request2.java:466) + at water.api.Exec2.serveGrid(Exec2.java:71) + at water.api.Request.serve(Request.java:108) + at water.api.RequestServer.serve(RequestServer.java:315) + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) + at java.lang.Thread.run(Thread.java:744) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:76) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 3 years ago | Kevin Normoyle
    java.util.concurrent.ExecutionException: java.lang.NullPointerException
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    I used a reduced size covtype (10%) parsed to i.hex (r.hex) to make it go faster import_only: test_exec2_ddply_phrases.py uses local://home/kevin/home-0xdiag-datasets/standard/covtype.shuffled.10pct.data Path h2o will be told to use: /home/kevin/home-0xdiag-datasets/standard/covtype.shuffled.10pct.data parse parameters: {'header': None, 'destination_key': 'i.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': 'nfs://home/kevin/home-0xdiag-datasets/standard/covtype.shuffled.10pct.data'} exec_query parameters: {'str': 'r.hex=i.hex'} exec_query parameters: {'str': 'ddply(r.hex, c(2,3), function(x) { cbind( mean(x[,1]), mean(x[,2]) ) })'} ERROR: got exception on http://192.168.0.37:54321/2/Exec2.json?str=ddply(r.hex, c(2,3), function(x) { cbind( mean(x[,1]), mean(x[,2]) ) }) to h2o. java.lang.NullPointerException at water.fvec.Frame$1.compute2(Frame.java:131) at water.H2O$H2OCountedCompleter.compute(H2O.java:712) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 12:12:02.184 FJ-15-11 ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs_impl(Frame.java:138) + at water.fvec.Frame.vecs(Frame.java:109) + at water.exec.Env.addRef(Env.java:294) + at water.exec.Env.push(Env.java:80) + at water.exec.ASTddply$RemoteExec.compute2(ASTRApply.java:470) + at water.DTask.dinvoke(DTask.java:78) + at water.RPC$RPCCall.compute2(RPC.java:299) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:131) + ... 6 more

    JIRA | 3 years ago | Kevin Normoyle
    java.lang.NullPointerException
  6. 0

    in the 164 jenkins http://192.168.1.164:8080/job/h2o_release_tests_164/410/testReport/junit/test_c5_KMeans_sphere_26GB_fvec/releaseTest/test_c5_KMeans_sphere_26GB_fvec_2/ just an import/parse (fvec), so should be able to do it from browser. (I'm revisiting these, because I'm biased away from doing large files now, yet the customers are starting to do large files..) basically covering my ass..i.e. I don't think big files parse 100% reliably. 2014-05-09 02:41:54.990779 -- Start http://192.168.1.164:54357/2/ImportFiles2.json?path=hdfs://192.168.1.176/datasets/kmeans_big 2014-05-09 02:41:57.021222 -- Start http://192.168.1.164:54357/2/Parse2.json?destination_key=syn_sphere_gen.csv_0.hex&source_key=hdfs://192.168.1.176/datasets/kmeans_big/syn_sphere_gen.csv cloud is 40GB jvms on 164 2014-05-09 01:59:01.191995 -- java -Xms40G -Xmx40G -ea -jar /tmp/bb5bf84b5125a175d95b030e23f571c9-h2o.jar --port=54357 --flatfile=/tmp/776701d2a0903c4dad1ffbe496a8a0bb-pytest_flatfile-jenkins --ice_root=/home/0xcustomer/ice.54357.1399625941.18 --name=jenkins-164 -hdfs hdfs://192.168.1.176 -hdfs_version=cdh3 #Remote on 192.168.1.164, stdout remote-h2o-0-192.168.1.164.stdout.27CaVQ.log, stderr remote-h2o-0-192.168.1.164.stderr.o928Ql.log 2014-05-09 01:59:01.214465 -- java -Xms40G -Xmx40G -ea -jar /tmp/bb5bf84b5125a175d95b030e23f571c9-h2o.jar --port=54355 --flatfile=/tmp/776701d2a0903c4dad1ffbe496a8a0bb-pytest_flatfile-jenkins --ice_root=/home/0xcustomer/ice.54355.1399625941.21 --name=jenkins-164 -hdfs hdfs://192.168.1.176 -hdfs_version=cdh3 #Remote on 192.168.1.164, stdout remote-h2o-1-192.168.1.164.stdout.jWwiNs.log, stderr remote-h2o-1-192.168.1.164.stderr.SxnJpH.log 2014-05-09 01:59:01.231209 -- java -Xms40G -Xmx40G -ea -jar /tmp/bb5bf84b5125a175d95b030e23f571c9-h2o.jar --port=54361 --flatfile=/tmp/776701d2a0903c4dad1ffbe496a8a0bb-pytest_flatfile-jenkins --ice_root=/home/0xcustomer/ice.54361.1399625941.23 --name=jenkins-164 -hdfs hdfs://192.168.1.176 -hdfs_version=cdh3 #Remote on 192.168.1.164, stdout remote-h2o-2-192.168.1.164.stdout.5XKE4k.log, stderr remote-h2o-2-192.168.1.164.stderr.SN0IE9.log 2014-05-09 01:59:01.237977 -- java -Xms40G -Xmx40G -ea -jar /tmp/bb5bf84b5125a175d95b030e23f571c9-h2o.jar --port=54359 --flatfile=/tmp/776701d2a0903c4dad1ffbe496a8a0bb-pytest_flatfile-jenkins --ice_root=/home/0xcustomer/ice.54359.1399625941.23 --name=jenkins-164 -hdfs hdfs://192.168.1.176 -hdfs_version=cdh3 #Remote on 192.168.1.164, stdout remote-h2o-3-192.168.1.164.stdout.wxOLt7.log, stderr remote-h2o-3-192.168.1.164.stderr.zodOGj.log Failed test_c5_KMeans_sphere_26GB_fvec.releaseTest.test_c5_KMeans_sphere_26GB_fvec (from nosetests) Failing for the past 31 builds (Since #380 ) Took 2.2 sec. Error Message check_sandbox_for_errors: Errors in sandbox stdout or stderr (or R stdout/stderr). Could have occurred at any prior time 02:41:57.067 FJ-120-59 ERRR WATER: Missing vector during Frame fetch: $04ff00000000ffffffff$hdfs://192.168.1.176/datasets/kmeans_big/syn_sphere_gen.csv java.lang.NullPointerException at water.fvec.Frame$1.compute2(Frame.java:135) at water.H2O$H2OCountedCompleter.compute(H2O.java:732) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 02:41:57.069 # Session ERRR WATER:

    JIRA | 3 years ago | Kevin Normoyle
    java.lang.NullPointerException

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.NullPointerException

      No message provided

      at water.fvec.Frame$1.compute2()
    2. water.fvec
      Frame$1.compute2
      1. water.fvec.Frame$1.compute2(Frame.java:78)
      1 frame
    3. water
      H2O$H2OCountedCompleter.compute
      1. water.H2O$H2OCountedCompleter.compute(H2O.java:712)
      1 frame
    4. jsr166y
      ForkJoinWorkerThread.run
      1. jsr166y.CountedCompleter.exec(CountedCompleter.java:429)
      2. jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      3. jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      4. jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      5. jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      6. jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      7. jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      8. jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      8 frames