java.lang.RuntimeException: java.lang.NullPointerException

JIRA | Kevin Normoyle | 3 years ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    test is old. it was part of our standard multi-node, multi-file testing. just switched back to focusing on va parse. test is cd testdir_ec2_only python test_GBM_manyfiles_s3n.py does multi-file parse (va) from s3 just import then parse fails every time. 10:28:58.275 # Session INFO HTTPD: GET /Parse.json destination_key=file_10.hex source_key=s3n://home-0xdiag-datasets/manyfiles-nflx-gz/file_[0-9].dat.gz water.DException$DistributedException: from /10.28.70.80:54321; java.lang.RuntimeException: java.lang.NullPointerException 10:29:00.141 FJ-9-1 INFO WATER: at water.parser.ParseDataset$UnzipAndParseTask$UnzipAndParseLocalTask.compute2(ParseDataset.java:524) 10:29:00.141 FJ-9-1 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:712) 10:29:00.142 FJ-9-1 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 10:29:00.142 FJ-9-1 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 10:29:00.142 FJ-9-1 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 10:29:00.143 FJ-9-1 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 10:29:00.143 FJ-9-1 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) sandbox/commands.log 2014-01-31 22:28:56.754159 -- #********************************************************************* 2014-01-31 22:28:56.754292 -- Starting new test: test_GBM_manyfiles_s3n.py at build_cloud() 2014-01-31 22:28:56.754381 -- #********************************************************************* 2014-01-31 22:28:58.512410 -- java -Xms30G -Xmx30G -ea -jar /tmp/7dc3687593409ab7b45adc4a53ba3e20-h2o.jar --port=54321 --flatfile=/tmp/267312fbf6338fe119d754fb90e6b782-pytest_flatfile-kevin --ice_root=/tmp/ice.54321.1391236138.5 --name=pytest-kevin-21722 -hdfs_config /tmp/66300a7fb4cfe447c08c41f0e04cc8b1-core-site.xml -hdfs hdfs://10.78.14.235:9000 -hdfs_version=0.20.2 --aws_credentials=/tmp/5155fcd314dab5b32ceaa078b06e45bf-AwsCredentials.properties #Remote on 10.30.146.112, stdout remote-h2o-0-10.30.146.112.stdout.SCUI1F.log, stderr remote-h2o-0-10.30.146.112.stderr.FZrfk4.log 2014-01-31 22:28:59.546477 -- java -Xms30G -Xmx30G -ea -jar /tmp/7dc3687593409ab7b45adc4a53ba3e20-h2o.jar --port=54321 --flatfile=/tmp/267312fbf6338fe119d754fb90e6b782-pytest_flatfile-kevin --ice_root=/tmp/ice.54321.1391236139.54 --name=pytest-kevin-21722 -hdfs_config /tmp/66300a7fb4cfe447c08c41f0e04cc8b1-core-site.xml -hdfs hdfs://10.78.14.235:9000 -hdfs_version=0.20.2 --aws_credentials=/tmp/5155fcd314dab5b32ceaa078b06e45bf-AwsCredentials.properties #Remote on 10.30.165.214, stdout remote-h2o-1-10.30.165.214.stdout.zB45nk.log, stderr remote-h2o-1-10.30.165.214.stderr.s2kAHq.log 2014-01-31 22:29:00.579180 -- java -Xms30G -Xmx30G -ea -jar /tmp/7dc3687593409ab7b45adc4a53ba3e20-h2o.jar --port=54321 --flatfile=/tmp/267312fbf6338fe119d754fb90e6b782-pytest_flatfile-kevin --ice_root=/tmp/ice.54321.1391236140.57 --name=pytest-kevin-21722 -hdfs_config /tmp/66300a7fb4cfe447c08c41f0e04cc8b1-core-site.xml -hdfs hdfs://10.78.14.235:9000 -hdfs_version=0.20.2 --aws_credentials=/tmp/5155fcd314dab5b32ceaa078b06e45bf-AwsCredentials.properties #Remote on 10.28.52.211, stdout remote-h2o-2-10.28.52.211.stdout.yP6PWS.log, stderr remote-h2o-2-10.28.52.211.stderr.ZGs5f8.log 2014-01-31 22:29:01.614994 -- java -Xms30G -Xmx30G -ea -jar /tmp/7dc3687593409ab7b45adc4a53ba3e20-h2o.jar --port=54321 --flatfile=/tmp/267312fbf6338fe119d754fb90e6b782-pytest_flatfile-kevin --ice_root=/tmp/ice.54321.1391236141.61 --name=pytest-kevin-21722 -hdfs_config /tmp/66300a7fb4cfe447c08c41f0e04cc8b1-core-site.xml -hdfs hdfs://10.78.14.235:9000 -hdfs_version=0.20.2 --aws_credentials=/tmp/5155fcd314dab5b32ceaa078b06e45bf-AwsCredentials.properties #Remote on 10.159.2.225, stdout remote-h2o-3-10.159.2.225.stdout.s5QkRU.log, stderr remote-h2o-3-10.159.2.225.stderr.b86BC7.log 2014-01-31 22:29:02.654004 -- java -Xms30G -Xmx30G -ea -jar /tmp/7dc3687593409ab7b45adc4a53ba3e20-h2o.jar --port=54321 --flatfile=/tmp/267312fbf6338fe119d754fb90e6b782-pytest_flatfile-kevin --ice_root=/tmp/ice.54321.1391236142.64 --name=pytest-kevin-21722 -hdfs_config /tmp/66300a7fb4cfe447c08c41f0e04cc8b1-core-site.xml -hdfs hdfs://10.78.14.235:9000 -hdfs_version=0.20.2 --aws_credentials=/tmp/5155fcd314dab5b32ceaa078b06e45bf-AwsCredentials.properties #Remote on 10.28.70.80, stdout remote-h2o-4-10.28.70.80.stdout.9Chf1H.log, stderr remote-h2o-4-10.28.70.80.stderr.kd_GWt.log 2014-01-31 22:29:03.689145 -- java -Xms30G -Xmx30G -ea -jar /tmp/7dc3687593409ab7b45adc4a53ba3e20-h2o.jar --port=54321 --flatfile=/tmp/267312fbf6338fe119d754fb90e6b782-pytest_flatfile-kevin --ice_root=/tmp/ice.54321.1391236143.68 --name=pytest-kevin-21722 -hdfs_config /tmp/66300a7fb4cfe447c08c41f0e04cc8b1-core-site.xml -hdfs hdfs://10.78.14.235:9000 -hdfs_version=0.20.2 --aws_credentials=/tmp/5155fcd314dab5b32ceaa078b06e45bf-AwsCredentials.properties #Remote on 10.30.164.147, stdout remote-h2o-5-10.30.164.147.stdout.n1i2oE.log, stderr remote-h2o-5-10.30.164.147.stderr.h4G9Dx.log 2014-01-31 22:29:04.719724 -- java -Xms30G -Xmx30G -ea -jar /tmp/7dc3687593409ab7b45adc4a53ba3e20-h2o.jar --port=54321 --flatfile=/tmp/267312fbf6338fe119d754fb90e6b782-pytest_flatfile-kevin --ice_root=/tmp/ice.54321.1391236144.71 --name=pytest-kevin-21722 -hdfs_config /tmp/66300a7fb4cfe447c08c41f0e04cc8b1-core-site.xml -hdfs hdfs://10.78.14.235:9000 -hdfs_version=0.20.2 --aws_credentials=/tmp/5155fcd314dab5b32ceaa078b06e45bf-AwsCredentials.properties #Remote on 10.30.156.68, stdout remote-h2o-6-10.30.156.68.stdout.DHwmjR.log, stderr remote-h2o-6-10.30.156.68.stderr.QSIb4q.log after cloud is stable.. #*********************** python_test_name: test_GBM_manyfiles_s3n.py #*********************** 2014-01-31 22:29:16.077652 -- Start http://10.30.146.112:54321/ImportHdfs.json?path=s3n://home-0xdiag-datasets/manyfiles-nflx-gz 2014-01-31 22:29:17.405077 -- Start http://10.30.146.112:54321/Parse.json?destination_key=file_10.hex&source_key=s3n://home-0xdiag-datasets/manyfiles-nflx-gz/file_[0-9].dat.gz 2014-01-31 22:29:19.956710 -- Start http://10.30.146.112:54321/Progress?job=$03010a1e927032d4ffffffff$_9dd43770b1a3d960623a54659a8c4738&destination_key=file_10.hex

    JIRA | 3 years ago | Kevin Normoyle
    java.lang.RuntimeException: java.lang.NullPointerException

    Root Cause Analysis

    1. java.lang.RuntimeException

      java.lang.NullPointerException

      at water.parser.ParseDataset$UnzipAndParseTask$UnzipAndParseLocalTask.compute2()
    2. water.parser
      ParseDataset$UnzipAndParseTask$UnzipAndParseLocalTask.compute2
      1. water.parser.ParseDataset$UnzipAndParseTask$UnzipAndParseLocalTask.compute2(ParseDataset.java:524)
      1 frame
    3. water
      H2O$H2OCountedCompleter.compute
      1. water.H2O$H2OCountedCompleter.compute(H2O.java:712)
      1 frame
    4. jsr166y
      ForkJoinWorkerThread.run
      1. jsr166y.CountedCompleter.exec(CountedCompleter.java:429)
      2. jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      3. jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      4. jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      5. jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      5 frames