java.lang.NullPointerException

There are no available Samebug tips for this exception. Do you have an idea how to solve this issue? A short tip would help users who saw this issue last week.

  • not sure what's going on here. passes sometimes with one machine can fail with one machine. fails using pytest_config-176-180.json the commands.log shows the key commands:2014-02-12 23:57:59.139100 -- Start http://192.168.1.172:54321/2/ImportFiles2.json?path=/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz 2014-02-12 23:57:59.816826 -- Start http://192.168.1.172:54321/2/ImportFiles2.json?path=/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz 2014-02-12 23:58:01.971278 -- Start http://192.168.1.172:54321/2/Parse2.json?destination_key=file_1_A.dat.gz.hex&source_key=nfs://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz did the import twice, but it's failing on the parse here's just one machine cd testdir_0xdata_slow python test_benchmark_1.py -cj ../testdir_hosts/pytest_config-172.json -dts Test: test_benchmark_1.py command line: python test_benchmark_1.py -cj ../testdir_hosts/pytest_config-172.json -dts Python runs on: 192.168.1.172 test_benchmark_import (__main__.Basic) ... Using .gz'ed files in manyfiles-nflx-gz * Using config JSON you passed as -cj argument: ../testdir_hosts/pytest_config-172.json Skipping upload of file ../../target/h2o.jar. File /tmp/29297f521517fb5f47fe9baadbaa742d-h2o.jar exists on remote side! Skipping upload of file pytest_flatfile-kevin. File /tmp/8e276e5ed35977db0d421057c7a99668-pytest_flatfile-kevin exists on remote side! Skipping upload of file ../../target/h2o.jar. File /tmp/29297f521517fb5f47fe9baadbaa742d-h2o.jar exists on remote side! Skipping upload of file pytest_flatfile-kevin. File /tmp/8e276e5ed35977db0d421057c7a99668-pytest_flatfile-kevin exists on remote side! java_heap_GB 20 Running h2o to get java version 11:57:50.411 main INFO WATER: Build git branch: (unknown) 11:57:50.411 main INFO WATER: Build git hash: (unknown) 11:57:50.411 main INFO WATER: Build git describe: (unknown) 11:57:50.412 main INFO WATER: Build project version: (unknown) 11:57:50.412 main INFO WATER: Built by: '(unknown)' 11:57:50.412 main INFO WATER: Built on: '(unknown)' 11:57:50.416 main INFO WATER: OS version: Linux 3.2.0-58-generic (amd64) Appending to benchmark_test_benchmark_1.py.log. Between tests, you may want to delete it if it gets too big 2 total jvms in H2O cloud Saving the ../testdir_hosts/pytest_config-172.json we used to sandbox Found h2o_nodes[0].h2o_remote_buckets_root: /home/0xdiag import_only: test_benchmark_1.py uses local://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz Path h2o will be told to use: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz Problem if this is not empty: importFailList: [ "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_59.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_94.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_62.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_36.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_49.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_83.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_41.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_32.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_71.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_86.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_34.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_54.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_48.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_87.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_37.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_50.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_58.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_81.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_68.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_89.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_52.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_74.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_53.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_64.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_90.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_63.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_80.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_65.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_31.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_97.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_44.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_72.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_57.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_47.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_75.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_73.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_99.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_88.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_95.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_67.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_60.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_92.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_70.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_66.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_96.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_82.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_76.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_42.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_43.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_56.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/doit", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_45.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_91.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_61.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_69.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_55.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_93.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_77.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_46.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_39.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_78.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_98.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_33.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_38.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_85.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_51.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_40.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_84.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_35.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_79.dat.gz" ] Switch. Now appending to benchmark_file_1_A.dat.gz.log. Between tests, you may want to delete it if it gets too big Found h2o_nodes[0].h2o_remote_buckets_root: /home/0xdiag import_only: test_benchmark_1.py uses local://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz Path h2o will be told to use: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz parse parameters: {'header': None, 'destination_key': 'file_1_A.dat.gz.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': u'nfs://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz'} ERROR java.lang.NullPointerException 11:58:02.019 FJ-16-1 INFO WATER: at water.fvec.Frame$1.compute2(Frame.java:76) 11:58:02.021 FJ-16-1 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:712) 11:58:02.021 FJ-16-1 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 11:58:02.022 FJ-16-1 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 11:58:02.022 FJ-16-1 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 11:58:02.022 FJ-16-1 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 11:58:02.019 # Session ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs(Frame.java:83) + at water.Value.isRawData(Value.java:244) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:90) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:65) + at water.api.RequestArguments$Argument.check(RequestArguments.java:546) + at water.api.RequestQueries.checkArguments(RequestQueries.java:69) + at water.api.Request.serveGrid(Request.java:125) + at water.api.Request.serve(Request.java:108) + at water.api.RequestServer.serve(RequestServer.java:315) + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) + at java.lang.Thread.run(Thread.java:662) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:76) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 11:58:02.023 FJ-16-1 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) ERROR
    via by Kevin Normoyle,
  • it's parsing 50 files out of the directory. does it with and import/parse using this import /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz then this parse /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz 40GB jvms test_B_c3_rel_long (test_c3_rel.releaseTest) ... 40 GB java heap(s) with 4 total nodes import_only: /var/lib/jenkins/jobs/h2o_release_tests_164/workspace/py/testdir_release/c3/test_c3_rel.py uses local://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Path h2o will be told to use: /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz import_only: /var/lib/jenkins/jobs/h2o_release_tests_164/workspace/py/testdir_release/c3/test_c3_rel.py uses local://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Path h2o will be told to use: /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz parse parameters: {'header': None, 'destination_key': 'file_50_A.dat.gz.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': u'nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz'} ERROR tearDown java.lang.NullPointerException 04:32:56.308 FJ-16-7 INFO WATER: at water.fvec.Frame$1.compute2(Frame.java:78) 04:32:56.310 FJ-16-7 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:712) 04:32:56.311 FJ-16-7 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 04:32:56.311 FJ-16-7 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 04:32:56.308 # Session ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs(Frame.java:85) + at water.Value.isRawData(Value.java:244) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:90) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:65) + at water.api.RequestArguments$Argument.check(RequestArguments.java:546) + at water.api.RequestQueries.checkArguments(RequestQueries.java:69) + at water.api.Request.serveGrid(Request.java:125) + at water.api.Request.serve(Request.java:108) + at water.api.RequestServer.serve(RequestServer.java:286) + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) + at java.lang.Thread.run(Thread.java:662) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:78) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)04:32:56.312 FJ-16-7 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 04:32:56.314 FJ-16-7 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 04:32:56.314 FJ-16-7 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) ERROR
    via by Kevin Normoyle,
  • doing a multi-file gz parse of the standard files on 164 with pattern matching to get multiple files import_only: /home4/jenkins/jobs/h2o_release_tests_164/workspace/py/testdir_release/c3/test_c3_fvec.py uses local://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Path h2o will be told to use: /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz parse parameters: {'header': None, 'destination_key': 'file_50_A.dat.gz.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': u'nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz'} http://192.168.1.164:8080/view/h2o_release_tests/job/h2o_release_tests_164/320/testReport/junit/test_c3_fvec/releaseTest/test_B_c3_fvec_long_2/ Error Message check_sandbox_for_errors: Errors in sandbox stdout or stderr (or R stdout/stderr). Could have occurred at any prior time java.lang.NullPointerException 04:00:35.349 FJ-16-9 INFO WATER: at water.fvec.Frame$1.compute2(Frame.java:74) 04:00:35.349 FJ-16-9 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:713) 04:00:35.349 FJ-16-9 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 04:00:35.348 # Session ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs(Frame.java:81) + at water.Value.isRawData(Value.java:245) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:90) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:65) + at water.api.RequestArguments$Argument.check(RequestArguments.java:551) + at water.api.RequestQueries.checkArguments(RequestQueries.java:69) + at water.api.Request.serveGrid(Request.java:125) + at water.api.Request.serve(Request.java:108) + at water.api.RequestServer.serve(RequestServer.java:315) + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) + at java.lang.Thread.run(Thread.java:662) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:74) + at water.H2O$H2OCountedCompleter.compute(H2O.java:713) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)04:00:35.351 FJ-16-9 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Stacktrace Traceback (most recent call last): File "/usr/lib/python2.7/unittest/case.py", line 356, in run self.tearDown() File "../h2o_common.py", line 82, in tearDown h2o.check_sandbox_for_errors() File "../h2o.py", line 734, in check_sandbox_for_errors python_test_name=python_test_name) File "../h2o_sandbox.py", line 176, in check_sandbox_for_errors raise Exception(errorMessage) Exception: check_sandbox_for_errors: Errors in sandbox stdout or stderr (or R stdout/stderr). Could have occurred at any prior time java.lang.NullPointerException 04:00:35.349 FJ-16-9 INFO WATER: at water.fvec.Frame$1.compute2(Frame.java:74) 04:00:35.349 FJ-16-9 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:713) 04:00:35.349 FJ-16-9 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 04:00:35.348 # Session ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs(Frame.java:81) + at water.Value.isRawData(Value.java:245) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:90) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:65) + at water.api.RequestArguments$Argument.check(RequestArguments.java:551) + at water.api.RequestQueries.checkArguments(RequestQueries.java:69) + at water.api.Request.serveGrid(Request.java:125) + at water.api.Request.serve(Request.java:108) + at water.api.RequestServer.serve(RequestServer.java:315) + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) + at java.lang.Thread.run(Thread.java:662) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:74) + at water.H2O$H2OCountedCompleter.compute(H2O.java:713) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)04:00:35.351 FJ-16-9 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Standard Output Appending to benchmark_test_c3_fvec.py.log. Between tests, you may want to delete it if it gets too big Using .gz'ed files in manyfiles-nflx-gz Found h2o_nodes[0].h2o_remote_buckets_root: /home/0xcustomer import_only: /home4/jenkins/jobs/h2o_release_tests_164/workspace/py/testdir_release/c3/test_c3_fvec.py uses local://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Path h2o will be told to use: /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Problem if this is not empty: importFailList: [] Switch. Now appending to benchmark_file_50_A.dat.gz.log. Between tests, you may want to delete it if it gets too big Found h2o_nodes[0].h2o_remote_buckets_root: /home/0xcustomer import_only: /home4/jenkins/jobs/h2o_release_tests_164/workspace/py/testdir_release/c3/test_c3_fvec.py uses local://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Path h2o will be told to use: /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz parse parameters: {'header': None, 'destination_key': 'file_50_A.dat.gz.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': u'nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz'} rjson: { "error": "RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException", "response": { "h2o": "jenkins-164", "node": "/192.168.1.164:54359", "status": "error", "time": 0 } } tearDown java.lang.NullPointerException 04:00:35.349 FJ-16-9 INFO WATER: at water.fvec.Frame$1.compute2(Frame.java:74) 04:00:35.349 FJ-16-9 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:713) 04:00:35.349 FJ-16-9 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 04:00:35.348 # Session ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs(Frame.java:81) + at water.Value.isRawData(Value.java:245) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:90) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:65) + at water.api.RequestArguments$Argument.check(RequestArguments.java:551) + at water.api.RequestQueries.checkArguments(RequestQueries.java:69) + at water.api.Request.serveGrid(Request.java:125) + at water.api.Request.serve(Request.java:108) + at water.api.RequestServer.serve(RequestServer.java:315) + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) + at java.lang.Thread.run(Thread.java:662) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:74) + at water.H2O$H2OCountedCompleter.compute(H2O.java:713) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)04:00:35.351 FJ-16-9 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
    via by Kevin Normoyle,
  • basic 50 manyfiles gz parse fail. on 2 machines (176-177). Passes if run just on 164. You can run the test yourself with this cd py/testdir_release python c3/test_c3_fvec.py -dts -cj ../testdir_hosts/pytest_config-176-177.json or just on 164 (passes) python c3/test_c3_fvec.py -dts -cj ../testdir_hosts/pytest_config-164.json Here's a fail case, with a build of current master on 176-177 Built cloud: 28 GB java heap(s) with 2 total nodes test_B_c3_fvec_long (__main__.releaseTest) ... 2 total jvms in H2O cloud Saving the ../testdir_hosts/pytest_config-176-177.json we used to sandbox Appending to benchmark_test_c3_fvec.py.log. Between tests, you may want to delete it if it gets too big Using .gz'ed files in manyfiles-nflx-gz Found h2o_nodes[0].h2o_remote_buckets_root: /home/0xdiag import_only: c3/test_c3_fvec.py uses local://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Path h2o will be told to use: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Problem if this is not empty: importFailList: [] Switch. Now appending to benchmark_file_50_A.dat.gz.log. Between tests, you may want to delete it if it gets too big Found h2o_nodes[0].h2o_remote_buckets_root: /home/0xdiag import_only: c3/test_c3_fvec.py uses local://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Path h2o will be told to use: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz parse parameters: {'header': None, 'destination_key': 'file_50_A.dat.gz.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': u'nfs://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz'} ERROR rjson: { "error": "RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException", "response": { "h2o": "pytest-jenkins-12022", "node": "/192.168.1.176:54311", "status": "error", "time": 0 } } tearDown Downloading h2o log(s) using: http://192.168.1.176:54311/LogDownload.json z.namelist: ['h2ologs_20140406_095532/', 'h2ologs_20140406_095532/node0_192.168.1.176_54311.zip', 'h2ologs_20140406_095532/node1_192.168.1.177_54311.zip'] z.printdir: File Name Modified Size h2ologs_20140406_095532/ 2014-04-06 21:55:32 0 h2ologs_20140406_095532/node0_192.168.1.176_54311.zip 2014-04-06 21:55:32 2165 h2ologs_20140406_095532/node1_192.168.1.177_54311.zip 2014-04-06 21:55:32 1367 None java.lang.NullPointerException 09:55:32.421 FJ-14-1 INFO WATER: at water.fvec.Frame$1.compute2(Frame.java:128) 09:55:32.422 FJ-14-1 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:712) 09:55:32.422 FJ-14-1 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 09:55:32.422 FJ-14-1 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 09:55:32.422 FJ-14-1 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 09:55:32.423 FJ-14-1 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 09:55:32.421 # Session ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs_impl(Frame.java:135) + at water.fvec.Frame.vecs(Frame.java:109) + at water.Value.isRawData(Value.java:245) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:90) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:65) + at water.api.RequestArguments$Argument.check(RequestArguments.java:550) + at water.api.RequestQueries.checkArguments(RequestQueries.java:69) + at water.api.Request.serveGrid(Request.java:133) + at water.api.Request.serve(Request.java:116) + at water.api.RequestServer.serve(RequestServer.java:328) + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) + at java.lang.Thread.run(Thread.java:662) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:128) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)09:55:32.423 FJ-14-1 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) here's a one machine run on 164, completing the parse Switch. Now appending to benchmark_file_50_A.dat.gz.log. Between tests, you may want to delete it if it gets too big Found h2o_nodes[0].h2o_remote_buckets_root: /home/0xdiag import_only: c3/test_c3_fvec.py uses local://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Path h2o will be told to use: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz parse parameters: {'header': None, 'destination_key': 'file_50_A.dat.gz.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': u'nfs://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz'} redirect http://192.168.1.164:54318/2/Progress2.json?job_key=%240301c0a801a42fd4ffffffff%24_955259ba71d98b04c011f3c6cb97489d&destination_key=file_50_A.dat.gz.hex poll 0.3583986 http://192.168.1.164:54318/2/Progress2.json?job_key=%240301c0a801a42fd4ffffffff%24_955259ba71d98b04c011f3c6cb97489d&destination_key=file_50_A.dat.gz.hex poll 0.7272318 http://192.168.1.164:54318/2/Progress2.json?job_key=%240301c0a801a42fd4ffffffff%24_955259ba71d98b04c011f3c6cb97489d&destination_key=file_50_A.dat.gz.hex poll 1.0 http://192.168.1.164:54318/2/Progress2.json?job_key=%240301c0a801a42fd4ffffffff%24_955259ba71d98b04c011f3c6cb97489d&destination_key=file_50_A.dat.gz.hex summary_page parameters: {'max_qbins': None, 'source': u'file_50_A.dat.gz.hex', 'cols': None, 'max_ncols': 1000}
    via by Kevin Normoyle,
  • basic 50 manyfiles gz parse fail. on 2 machines (176-177). Passes if run just on 164. You can run the test yourself with this cd py/testdir_release python c3/test_c3_fvec.py -dts -cj ../testdir_hosts/pytest_config-176-177.json or just on 164 (passes) python c3/test_c3_fvec.py -dts -cj ../testdir_hosts/pytest_config-164.json Here's a fail case, with a build of current master on 176-177 Built cloud: 28 GB java heap(s) with 2 total nodes test_B_c3_fvec_long (__main__.releaseTest) ... 2 total jvms in H2O cloud Saving the ../testdir_hosts/pytest_config-176-177.json we used to sandbox Appending to benchmark_test_c3_fvec.py.log. Between tests, you may want to delete it if it gets too big Using .gz'ed files in manyfiles-nflx-gz Found h2o_nodes[0].h2o_remote_buckets_root: /home/0xdiag import_only: c3/test_c3_fvec.py uses local://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Path h2o will be told to use: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Problem if this is not empty: importFailList: [] Switch. Now appending to benchmark_file_50_A.dat.gz.log. Between tests, you may want to delete it if it gets too big Found h2o_nodes[0].h2o_remote_buckets_root: /home/0xdiag import_only: c3/test_c3_fvec.py uses local://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Path h2o will be told to use: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz parse parameters: {'header': None, 'destination_key': 'file_50_A.dat.gz.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': u'nfs://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz'} ERROR rjson: { "error": "RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException", "response": { "h2o": "pytest-jenkins-12022", "node": "/192.168.1.176:54311", "status": "error", "time": 0 } } tearDown Downloading h2o log(s) using: http://192.168.1.176:54311/LogDownload.json z.namelist: ['h2ologs_20140406_095532/', 'h2ologs_20140406_095532/node0_192.168.1.176_54311.zip', 'h2ologs_20140406_095532/node1_192.168.1.177_54311.zip'] z.printdir: File Name Modified Size h2ologs_20140406_095532/ 2014-04-06 21:55:32 0 h2ologs_20140406_095532/node0_192.168.1.176_54311.zip 2014-04-06 21:55:32 2165 h2ologs_20140406_095532/node1_192.168.1.177_54311.zip 2014-04-06 21:55:32 1367 None java.lang.NullPointerException 09:55:32.421 FJ-14-1 INFO WATER: at water.fvec.Frame$1.compute2(Frame.java:128) 09:55:32.422 FJ-14-1 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:712) 09:55:32.422 FJ-14-1 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 09:55:32.422 FJ-14-1 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 09:55:32.422 FJ-14-1 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 09:55:32.423 FJ-14-1 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 09:55:32.421 # Session ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs_impl(Frame.java:135) + at water.fvec.Frame.vecs(Frame.java:109) + at water.Value.isRawData(Value.java:245) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:90) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:65) + at water.api.RequestArguments$Argument.check(RequestArguments.java:550) + at water.api.RequestQueries.checkArguments(RequestQueries.java:69) + at water.api.Request.serveGrid(Request.java:133) + at water.api.Request.serve(Request.java:116) + at water.api.RequestServer.serve(RequestServer.java:328) + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) + at java.lang.Thread.run(Thread.java:662) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:128) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)09:55:32.423 FJ-14-1 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) here's a one machine run on 164, completing the parse Switch. Now appending to benchmark_file_50_A.dat.gz.log. Between tests, you may want to delete it if it gets too big Found h2o_nodes[0].h2o_remote_buckets_root: /home/0xdiag import_only: c3/test_c3_fvec.py uses local://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Path h2o will be told to use: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz parse parameters: {'header': None, 'destination_key': 'file_50_A.dat.gz.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': u'nfs://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz'} redirect http://192.168.1.164:54318/2/Progress2.json?job_key=%240301c0a801a42fd4ffffffff%24_955259ba71d98b04c011f3c6cb97489d&destination_key=file_50_A.dat.gz.hex poll 0.3583986 http://192.168.1.164:54318/2/Progress2.json?job_key=%240301c0a801a42fd4ffffffff%24_955259ba71d98b04c011f3c6cb97489d&destination_key=file_50_A.dat.gz.hex poll 0.7272318 http://192.168.1.164:54318/2/Progress2.json?job_key=%240301c0a801a42fd4ffffffff%24_955259ba71d98b04c011f3c6cb97489d&destination_key=file_50_A.dat.gz.hex poll 1.0 http://192.168.1.164:54318/2/Progress2.json?job_key=%240301c0a801a42fd4ffffffff%24_955259ba71d98b04c011f3c6cb97489d&destination_key=file_50_A.dat.gz.hex summary_page parameters: {'max_qbins': None, 'source': u'file_50_A.dat.gz.hex', 'cols': None, 'max_ncols': 1000}
    via by Kevin Normoyle,
  • doing a multi-file gz parse of the standard files on 164 with pattern matching to get multiple files import_only: /home4/jenkins/jobs/h2o_release_tests_164/workspace/py/testdir_release/c3/test_c3_fvec.py uses local://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Path h2o will be told to use: /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz parse parameters: {'header': None, 'destination_key': 'file_50_A.dat.gz.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': u'nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz'} http://192.168.1.164:8080/view/h2o_release_tests/job/h2o_release_tests_164/320/testReport/junit/test_c3_fvec/releaseTest/test_B_c3_fvec_long_2/ Error Message check_sandbox_for_errors: Errors in sandbox stdout or stderr (or R stdout/stderr). Could have occurred at any prior time java.lang.NullPointerException 04:00:35.349 FJ-16-9 INFO WATER: at water.fvec.Frame$1.compute2(Frame.java:74) 04:00:35.349 FJ-16-9 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:713) 04:00:35.349 FJ-16-9 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 04:00:35.348 # Session ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs(Frame.java:81) + at water.Value.isRawData(Value.java:245) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:90) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:65) + at water.api.RequestArguments$Argument.check(RequestArguments.java:551) + at water.api.RequestQueries.checkArguments(RequestQueries.java:69) + at water.api.Request.serveGrid(Request.java:125) + at water.api.Request.serve(Request.java:108) + at water.api.RequestServer.serve(RequestServer.java:315) + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) + at java.lang.Thread.run(Thread.java:662) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:74) + at water.H2O$H2OCountedCompleter.compute(H2O.java:713) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)04:00:35.351 FJ-16-9 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Stacktrace Traceback (most recent call last): File "/usr/lib/python2.7/unittest/case.py", line 356, in run self.tearDown() File "../h2o_common.py", line 82, in tearDown h2o.check_sandbox_for_errors() File "../h2o.py", line 734, in check_sandbox_for_errors python_test_name=python_test_name) File "../h2o_sandbox.py", line 176, in check_sandbox_for_errors raise Exception(errorMessage) Exception: check_sandbox_for_errors: Errors in sandbox stdout or stderr (or R stdout/stderr). Could have occurred at any prior time java.lang.NullPointerException 04:00:35.349 FJ-16-9 INFO WATER: at water.fvec.Frame$1.compute2(Frame.java:74) 04:00:35.349 FJ-16-9 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:713) 04:00:35.349 FJ-16-9 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 04:00:35.348 # Session ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs(Frame.java:81) + at water.Value.isRawData(Value.java:245) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:90) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:65) + at water.api.RequestArguments$Argument.check(RequestArguments.java:551) + at water.api.RequestQueries.checkArguments(RequestQueries.java:69) + at water.api.Request.serveGrid(Request.java:125) + at water.api.Request.serve(Request.java:108) + at water.api.RequestServer.serve(RequestServer.java:315) + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) + at java.lang.Thread.run(Thread.java:662) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:74) + at water.H2O$H2OCountedCompleter.compute(H2O.java:713) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)04:00:35.351 FJ-16-9 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Standard Output Appending to benchmark_test_c3_fvec.py.log. Between tests, you may want to delete it if it gets too big Using .gz'ed files in manyfiles-nflx-gz Found h2o_nodes[0].h2o_remote_buckets_root: /home/0xcustomer import_only: /home4/jenkins/jobs/h2o_release_tests_164/workspace/py/testdir_release/c3/test_c3_fvec.py uses local://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Path h2o will be told to use: /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Problem if this is not empty: importFailList: [] Switch. Now appending to benchmark_file_50_A.dat.gz.log. Between tests, you may want to delete it if it gets too big Found h2o_nodes[0].h2o_remote_buckets_root: /home/0xcustomer import_only: /home4/jenkins/jobs/h2o_release_tests_164/workspace/py/testdir_release/c3/test_c3_fvec.py uses local://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz Path h2o will be told to use: /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz parse parameters: {'header': None, 'destination_key': 'file_50_A.dat.gz.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': u'nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz'} rjson: { "error": "RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException", "response": { "h2o": "jenkins-164", "node": "/192.168.1.164:54359", "status": "error", "time": 0 } } tearDown java.lang.NullPointerException 04:00:35.349 FJ-16-9 INFO WATER: at water.fvec.Frame$1.compute2(Frame.java:74) 04:00:35.349 FJ-16-9 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:713) 04:00:35.349 FJ-16-9 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 04:00:35.348 # Session ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs(Frame.java:81) + at water.Value.isRawData(Value.java:245) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:90) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:65) + at water.api.RequestArguments$Argument.check(RequestArguments.java:551) + at water.api.RequestQueries.checkArguments(RequestQueries.java:69) + at water.api.Request.serveGrid(Request.java:125) + at water.api.Request.serve(Request.java:108) + at water.api.RequestServer.serve(RequestServer.java:315) + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) + at java.lang.Thread.run(Thread.java:662) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:74) + at water.H2O$H2OCountedCompleter.compute(H2O.java:713) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)04:00:35.351 FJ-16-9 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
    via by Kevin Normoyle,
  • not sure what's going on here. passes sometimes with one machine can fail with one machine. fails using pytest_config-176-180.json the commands.log shows the key commands:2014-02-12 23:57:59.139100 -- Start http://192.168.1.172:54321/2/ImportFiles2.json?path=/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz 2014-02-12 23:57:59.816826 -- Start http://192.168.1.172:54321/2/ImportFiles2.json?path=/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz 2014-02-12 23:58:01.971278 -- Start http://192.168.1.172:54321/2/Parse2.json?destination_key=file_1_A.dat.gz.hex&source_key=nfs://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz did the import twice, but it's failing on the parse here's just one machine cd testdir_0xdata_slow python test_benchmark_1.py -cj ../testdir_hosts/pytest_config-172.json -dts Test: test_benchmark_1.py command line: python test_benchmark_1.py -cj ../testdir_hosts/pytest_config-172.json -dts Python runs on: 192.168.1.172 test_benchmark_import (__main__.Basic) ... Using .gz'ed files in manyfiles-nflx-gz * Using config JSON you passed as -cj argument: ../testdir_hosts/pytest_config-172.json Skipping upload of file ../../target/h2o.jar. File /tmp/29297f521517fb5f47fe9baadbaa742d-h2o.jar exists on remote side! Skipping upload of file pytest_flatfile-kevin. File /tmp/8e276e5ed35977db0d421057c7a99668-pytest_flatfile-kevin exists on remote side! Skipping upload of file ../../target/h2o.jar. File /tmp/29297f521517fb5f47fe9baadbaa742d-h2o.jar exists on remote side! Skipping upload of file pytest_flatfile-kevin. File /tmp/8e276e5ed35977db0d421057c7a99668-pytest_flatfile-kevin exists on remote side! java_heap_GB 20 Running h2o to get java version 11:57:50.411 main INFO WATER: Build git branch: (unknown) 11:57:50.411 main INFO WATER: Build git hash: (unknown) 11:57:50.411 main INFO WATER: Build git describe: (unknown) 11:57:50.412 main INFO WATER: Build project version: (unknown) 11:57:50.412 main INFO WATER: Built by: '(unknown)' 11:57:50.412 main INFO WATER: Built on: '(unknown)' 11:57:50.416 main INFO WATER: OS version: Linux 3.2.0-58-generic (amd64) Appending to benchmark_test_benchmark_1.py.log. Between tests, you may want to delete it if it gets too big 2 total jvms in H2O cloud Saving the ../testdir_hosts/pytest_config-172.json we used to sandbox Found h2o_nodes[0].h2o_remote_buckets_root: /home/0xdiag import_only: test_benchmark_1.py uses local://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz Path h2o will be told to use: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz Problem if this is not empty: importFailList: [ "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_59.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_94.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_62.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_36.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_49.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_83.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_41.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_32.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_71.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_86.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_34.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_54.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_48.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_87.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_37.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_50.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_58.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_81.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_68.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_89.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_52.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_74.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_53.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_64.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_90.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_63.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_80.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_65.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_31.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_97.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_44.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_72.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_57.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_47.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_75.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_73.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_99.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_88.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_95.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_67.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_60.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_92.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_70.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_66.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_96.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_82.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_76.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_42.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_43.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_56.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/doit", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_45.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_91.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_61.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_69.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_55.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_93.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_77.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_46.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_39.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_78.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_98.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_33.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_38.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_85.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_51.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_40.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_84.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_35.dat.gz", "/home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_79.dat.gz" ] Switch. Now appending to benchmark_file_1_A.dat.gz.log. Between tests, you may want to delete it if it gets too big Found h2o_nodes[0].h2o_remote_buckets_root: /home/0xdiag import_only: test_benchmark_1.py uses local://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz Path h2o will be told to use: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz parse parameters: {'header': None, 'destination_key': 'file_1_A.dat.gz.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': u'nfs://home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz'} ERROR java.lang.NullPointerException 11:58:02.019 FJ-16-1 INFO WATER: at water.fvec.Frame$1.compute2(Frame.java:76) 11:58:02.021 FJ-16-1 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:712) 11:58:02.021 FJ-16-1 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 11:58:02.022 FJ-16-1 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 11:58:02.022 FJ-16-1 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 11:58:02.022 FJ-16-1 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 11:58:02.019 # Session ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs(Frame.java:83) + at water.Value.isRawData(Value.java:244) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:90) + at water.api.Parse$ExistingCSVKey.parse(Parse.java:65) + at water.api.RequestArguments$Argument.check(RequestArguments.java:546) + at water.api.RequestQueries.checkArguments(RequestQueries.java:69) + at water.api.Request.serveGrid(Request.java:125) + at water.api.Request.serve(Request.java:108) + at water.api.RequestServer.serve(RequestServer.java:315) + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) + at java.lang.Thread.run(Thread.java:662) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:76) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 11:58:02.023 FJ-16-1 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) ERROR
    via by Kevin Normoyle,
  • Looks like the test currently does full fvec, (even though I forgot to put fvec in it's name) there are two parses, but the key thing is cd testdir_multi_jvm python test_GBM_manyfiles_train_test.py what's interesting is it seems to be doing test and train datasets..using same source for both...the exec works okay for the first time (train) but not for test the exec that causes it: test.hex[,378+1]=test.hex[,378+1]>15 both train.hex and test.hex are parsing the same file: /home/kevin/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz 11:05:43.614 # Session INFO HTTPD: GET /2/Parse2.json destination_key=train.hex source_key=nfs://home/kevin/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz 11:05:58.394 # Session INFO HTTPD: GET /2/Inspect2.json src_key=train.hex 11:05:59.090 # Session INFO HTTPD: GET /2/Exec2.json str=train.hex[,378+1]=train.hex[,378+1]>15 11:06:11.322 # Session INFO HTTPD: GET /2/ImportFiles2.json path=/home/kevin/home-0xdiag-datasets/manyfiles-nflx-gz 11:06:12.121 # Session INFO HTTPD: GET /2/Parse2.json destination_key=test.hex source_key=nfs://home/kevin/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz 11:06:24.362 # Session INFO HTTPD: GET /2/Exec2.json str=test.hex[,378+1]=test.hex[,378+1]>15 11:06:24.386 # Session ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs(Frame.java:83) + at water.exec.Env.addRef(Env.java:280) + at water.exec.Env.push(Env.java:78) + at water.exec.Env.push(Env.java:81) + at water.exec.Exec2.exec(Exec2.java:82) + at water.api.Exec2.serve(Exec2.java:34) + at water.api.Request.serveGrid(Request.java:129) + at water.Request2.superServeGrid(Request2.java:466) + at water.api.Exec2.serveGrid(Exec2.java:71) + at water.api.Request.serve(Request.java:108) + at water.api.RequestServer.serve(RequestServer.java:315) + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) + at java.lang.Thread.run(Thread.java:744) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:76) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
    via by Kevin Normoyle,
  • Looks like the test currently does full fvec, (even though I forgot to put fvec in it's name) there are two parses, but the key thing is cd testdir_multi_jvm python test_GBM_manyfiles_train_test.py what's interesting is it seems to be doing test and train datasets..using same source for both...the exec works okay for the first time (train) but not for test the exec that causes it: test.hex[,378+1]=test.hex[,378+1]>15 both train.hex and test.hex are parsing the same file: /home/kevin/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz 11:05:43.614 # Session INFO HTTPD: GET /2/Parse2.json destination_key=train.hex source_key=nfs://home/kevin/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz 11:05:58.394 # Session INFO HTTPD: GET /2/Inspect2.json src_key=train.hex 11:05:59.090 # Session INFO HTTPD: GET /2/Exec2.json str=train.hex[,378+1]=train.hex[,378+1]>15 11:06:11.322 # Session INFO HTTPD: GET /2/ImportFiles2.json path=/home/kevin/home-0xdiag-datasets/manyfiles-nflx-gz 11:06:12.121 # Session INFO HTTPD: GET /2/Parse2.json destination_key=test.hex source_key=nfs://home/kevin/home-0xdiag-datasets/manyfiles-nflx-gz/file_1.dat.gz 11:06:24.362 # Session INFO HTTPD: GET /2/Exec2.json str=test.hex[,378+1]=test.hex[,378+1]>15 11:06:24.386 # Session ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs(Frame.java:83) + at water.exec.Env.addRef(Env.java:280) + at water.exec.Env.push(Env.java:78) + at water.exec.Env.push(Env.java:81) + at water.exec.Exec2.exec(Exec2.java:82) + at water.api.Exec2.serve(Exec2.java:34) + at water.api.Request.serveGrid(Request.java:129) + at water.Request2.superServeGrid(Request2.java:466) + at water.api.Exec2.serveGrid(Exec2.java:71) + at water.api.Request.serve(Request.java:108) + at water.api.RequestServer.serve(RequestServer.java:315) + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) + at java.lang.Thread.run(Thread.java:744) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:76) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
    via by Kevin Normoyle,
  • I used a reduced size covtype (10%) parsed to i.hex (r.hex) to make it go faster import_only: test_exec2_ddply_phrases.py uses local://home/kevin/home-0xdiag-datasets/standard/covtype.shuffled.10pct.data Path h2o will be told to use: /home/kevin/home-0xdiag-datasets/standard/covtype.shuffled.10pct.data parse parameters: {'header': None, 'destination_key': 'i.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': 'nfs://home/kevin/home-0xdiag-datasets/standard/covtype.shuffled.10pct.data'} exec_query parameters: {'str': 'r.hex=i.hex'} exec_query parameters: {'str': 'ddply(r.hex, c(2,3), function(x) { cbind( mean(x[,1]), mean(x[,2]) ) })'} ERROR: got exception on http://192.168.0.37:54321/2/Exec2.json?str=ddply(r.hex, c(2,3), function(x) { cbind( mean(x[,1]), mean(x[,2]) ) }) to h2o. java.lang.NullPointerException at water.fvec.Frame$1.compute2(Frame.java:131) at water.H2O$H2OCountedCompleter.compute(H2O.java:712) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 12:12:02.184 FJ-15-11 ERRR WATER: + java.util.concurrent.ExecutionException: java.lang.NullPointerException + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) + at water.Futures.blockForPending(Futures.java:67) + at water.fvec.Frame.vecs_impl(Frame.java:138) + at water.fvec.Frame.vecs(Frame.java:109) + at water.exec.Env.addRef(Env.java:294) + at water.exec.Env.push(Env.java:80) + at water.exec.ASTddply$RemoteExec.compute2(ASTRApply.java:470) + at water.DTask.dinvoke(DTask.java:78) + at water.RPC$RPCCall.compute2(RPC.java:299) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) + Caused by: java.lang.NullPointerException + at water.fvec.Frame$1.compute2(Frame.java:131) + ... 6 more
    via by Kevin Normoyle,
    • java.lang.NullPointerException at water.fvec.Frame$1.compute2(Frame.java:76) at water.H2O$H2OCountedCompleter.compute(H2O.java:712) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
    No Bugmate found.