java.lang.NullPointerException

JIRA | Earl Hathaway | 3 years ago
  1. 0

    I built a large airline dataset by concatenating the individual year files. This sometimes crashes the parse with the below error; other times, the parse just appears to freeze. Sometimes you see the below exception; sometimes you don't. Setups: h2o h2o-1.7.0.493 / sha 4 node cluster, Xmx10g, one node each on 1.161-1.164. data -> import files -> parse on /home/earl/./oldairlines/airlines.orig.all.withheader.25.csv.gz it will also die if you gunzip that; kevin and I repeatedly split the csv file and it will also die on /home/earl/oldairlines/25.splits/12.splits/6.split/xaa diagnoses: always dies on 4 nodes (4x10g on the 0xb[1-4] machines) dies < 10% of the time on 3 nodes (4x10g on 0xb[1-3]) rarely dies on 2 nodes (4x10g on 0xb[1-2]) sporadically dies on 1 node (4x40g on 0xb1) exact version: 04:01:10.042 main      INFO WATER: Build git branch: master 04:01:10.042 main      INFO WATER: Build git hash: ba4f4e157944e1adaff48e59f770c4a6dd02e6de 04:01:10.042 main      INFO WATER: Build git describe: ba4f4e1 04:01:10.042 main      INFO WATER: Build project version: 1.7.0.493 04:01:10.042 main      INFO WATER: Built by: 'jenkins' 04:01:10.043 main      INFO WATER: Built on: 'Tue Aug 20 01:01:45 PDT 2013' exception: 06:24:28.365 FJ-10-1 INFO WATER: Cloud of size 2 formed [/192.168.1.161:54321, /192.168.1.162:54321] 06:24:31.365 FJ-10-1 INFO WATER: Cloud of size 3 formed [/192.168.1.161:54321, /192.168.1.162:54321, /192.168.1.163:54321] 06:24:33.491 FJ-10-1 INFO WATER: Cloud of size 4 formed [/192.168.1.161:54321, /192.168.1.162:54321, /192.168.1.163:54321, /192.168.1.164:54321] 06:25:09.510 #:54321-0 INFO WATER: Start remote task#13 class water.parser.DParseTask from /192.168.1.163:54321 java.lang.ArrayIndexOutOfBoundsException: -2143289344 06:25:25.704 FJ-9-5 INFO WATER: at water.parser.CsvParser.parallelParse(CsvParser.java:436) 06:25:25.705 FJ-9-5 INFO WATER: at water.parser.DParseTask.map(DParseTask.java:536) 06:25:25.705 FJ-9-5 INFO WATER: at water.MRTask.lcompute(MRTask.java:66) 06:25:25.705 FJ-9-5 INFO WATER: at water.DRemoteTask.compute2(DRemoteTask.java:76) 06:25:25.705 FJ-9-5 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:572) 06:25:25.705 FJ-9-5 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 06:25:25.706 FJ-9-5 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 06:25:25.706 FJ-9-5 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 06:25:25.706 FJ-9-5 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 06:25:25.706 FJ-9-5 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 06:25:25.770 FJ-9-5 INFO WATER: Done remote task#13 class water.parser.DParseTask to /192.168.1.163:54321 java.lang.NullPointerException 06:25:25.893 FJ-9-7 INFO WATER: at water.parser.DParseTask.addNumCol(DParseTask.java:944) 06:25:25.895 FJ-9-7 INFO WATER: at water.parser.CsvParser.parallelParse(CsvParser.java:273) 06:25:25.895 FJ-9-7 INFO WATER: at water.parser.DParseTask.map(DParseTask.java:565) 06:25:25.896 FJ-9-7 INFO WATER: at water.MRTask.lcompute(MRTask.java:66) 06:25:25.896 FJ-9-7 INFO WATER: at water.DRemoteTask.compute2(DRemoteTask.java:76) 06:25:25.897 FJ-9-7 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:572) 06:25:25.897 FJ-9-7 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 06:25:25.898 FJ-9-7 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 06:25:25.898 FJ-9-7 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 06:25:25.899 FJ-9-7 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 06:25:25.899 FJ-9-7 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 3 years ago | Earl Hathaway
    java.lang.NullPointerException
  2. 0

    [OLD-564] (During parse) java.lang.NullPointerException: null while mapping key - JIRA

    atlassian.net | 1 year ago
    java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException: null while mapping key $00000000c00100000000$pricer_examples3.txt
  3. 0

    [OLD-564] (During parse) java.lang.NullPointerException: null while mapping key - JIRA

    atlassian.net | 11 months ago
    java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException: null while mapping key $00000000c00100000000$pricer_examples3.txt
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Null pointer exception occurs when parsing a CSV with non-ascii characters. Attached is a small sample file which triggers this issue, as well as the logs. WATER: Build git branch: rel-ito WATER: Build git hash: a49bf63680d0181d97054c301583f6ed63c00060 WATER: Build git describe: nn-2-1112-ga49bf63 WATER: Build project version: 2.0.1.2 shiva:testdir_demos 0xdata$ java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException: null while mapping key $00000000000000000000$sample.csv.gz_UNZIPPED at water.parser.ParseDataset.parse(ParseDataset.java:330) at water.parser.ParseDataset$ParserFJTask.compute2(ParseDataset.java:359) at water.H2O$H2OCountedCompleter.compute(H2O.java:677) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: java.util.concurrent.ExecutionException: java.lang.NullPointerException: null while mapping key $00000000000000000000$sample.csv.gz_UNZIPPED at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) at water.parser.ParseDataset.parse(ParseDataset.java:329) ... 7 more Caused by: java.lang.NullPointerException: null while mapping key $00000000000000000000$sample.csv.gz_UNZIPPED at water.parser.Enum.getTokenId(Enum.java:83) at water.parser.DParseTask.addStrCol(DParseTask.java:901) at water.parser.CsvParser.parallelParse(CsvParser.java:127) at water.parser.DParseTask.map(DParseTask.java:575) at water.MRTask.lcompute(MRTask.java:66) at water.DRemoteTask.compute2(DRemoteTask.java:89) ... 6 more

    JIRA | 3 years ago | SriSatish Ambati
    java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException: null while mapping key $00000000000000000000$sample.csv.gz_UNZIPPED
  6. 0

    From dloyer5@gmail.com [h2ostream] Error parsing file Hi. I uploaded a dataset into both the last stable build as well as the latest nightly build. I get a error during parse into the hex file. The message is... Got Exception RuntimeException, with msg java.util.concurrent.ExecutionException: java.lang.NullPointerException: null while mapping key $00000000c00100000000$pricer_examples3.txt I got this error both with a 4 node test cluster as well as a single node. I got the error with a data set of > 5 million rows as well as a smaller sample of 100k rows. The only interesting thing about the file is that most of the columns are factors rather than integer or float values. The nightly build I am using is... 2.5.0.1294 ... Build I also see this problem on older builds, including the April 3 build. The following stack dump appears in the console... 06:48:27.097 # Session INFO HTTPD: GET /Parse.html single_quotes=0 header=0 separator=9 parser_type=CSV destination_key=pricer_examples3.hex source_key=pricer_examples3.txt java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException: null while mapping key $00000000c00100000000$pricer_examples3.txt at water.parser.ParseDataset.parse(ParseDataset.java:337) at water.parser.ParseDataset$ParserFJTask.compute2(ParseDataset.java:367) at water.H2O$H2OCountedCompleter.compute(H2O.java:712) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) Caused by: java.util.concurrent.ExecutionException: java.lang.NullPointerException: null while mapping key $00000000c00100000000$pricer_examples3.txt at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961) at water.parser.ParseDataset.parse(ParseDataset.java:336) ... 7 more Caused by: java.lang.NullPointerException: null while mapping key $00000000c00100000000$pricer_examples3.txt at water.parser.Enum.getTokenId(Enum.java:83) at water.parser.DParseTask.addStrCol(DParseTask.java:923) at water.parser.CsvParser.parallelParse(CsvParser.java:128) at water.parser.DParseTask.map(DParseTask.java:589) at water.MRTask.lcompute(MRTask.java:66) at water.DRemoteTask.compute2(DRemoteTask.java:91) at water.MRTask.lcompute(MRTask.java:62) at water.DRemoteTask.compute2(DRemoteTask.java:91) at water.MRTask.lcompute(MRTask.java:62) at water.DRemoteTask.compute2(DRemoteTask.java:91) at water.MRTask.lcompute(MRTask.java:62) at water.DRemoteTask.compute2(DRemoteTask.java:91) ... 6 more

    JIRA | 3 years ago | Tom Kraljevic
    java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException: null while mapping key $00000000c00100000000$pricer_examples3.txt

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.NullPointerException

      No message provided

      at water.parser.DParseTask.addNumCol()
    2. water.parser
      DParseTask.map
      1. water.parser.DParseTask.addNumCol(DParseTask.java:944)
      2. water.parser.CsvParser.parallelParse(CsvParser.java:273)
      3. water.parser.DParseTask.map(DParseTask.java:565)
      3 frames
    3. water
      H2O$H2OCountedCompleter.compute
      1. water.MRTask.lcompute(MRTask.java:66)
      2. water.DRemoteTask.compute2(DRemoteTask.java:76)
      3. water.H2O$H2OCountedCompleter.compute(H2O.java:572)
      3 frames
    4. jsr166y
      ForkJoinWorkerThread.run
      1. jsr166y.CountedCompleter.exec(CountedCompleter.java:429)
      2. jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      3. jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      4. jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      5. jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)
      5 frames