java.lang.RuntimeException: unimplemented

JIRA | Kevin Normoyle | 3 years ago
  1. 0

    I wanted to export to /tmp in hdfs then import and parse the file I exported I think h2o should ignore files with .prefix (must) rather than exception with "unimplemented" It failed, because the import saw "." prefixed files in /tmp (from cdh5 manager..i.e. they get constantly created as health test files) here's the json from an import, it does see them (along with the file I exported)...but the parse fails. [2014-04-29 19:12:33.686992] import_only: test_hdfs_cdh5_fvec.py hdfs uses hdfs://tmp/a0.csv [2014-04-29 19:12:33.687143] [ [2014-04-29 19:12:33.710208] { [2014-04-29 19:12:33.710208] "Request2": 0, [2014-04-29 19:12:33.710208] "dels": null, [2014-04-29 19:12:33.710208] "fails": [ [2014-04-29 19:12:33.710208] "hdfs://192.168.1.180/tmp" [2014-04-29 19:12:33.710208] ], [2014-04-29 19:12:33.710208] "files": [ [2014-04-29 19:12:33.710208] "hdfs://192.168.1.180/tmp/.cloudera_health_monitoring_canary_files/.canary_file_2014_02_22-22_30_06", [2014-04-29 19:12:33.710208] "hdfs://192.168.1.180/tmp/.cloudera_health_monitoring_canary_files/.canary_file_2014_03_15-20_29_48", [2014-04-29 19:12:33.710208] "hdfs://192.168.1.180/tmp/.cloudera_health_monitoring_canary_files/.canary_file_2014_04_13-01_04_18", [2014-04-29 19:12:33.710208] "hdfs://192.168.1.180/tmp/.cloudera_health_monitoring_canary_files/.canary_file_2014_04_17-02_08_34", [2014-04-29 19:12:33.710208] "hdfs://192.168.1.180/tmp/.cloudera_health_monitoring_canary_files/.canary_file_2014_04_17-02_09_44", [2014-04-29 19:12:33.710208] "hdfs://192.168.1.180/tmp/.cloudera_health_monitoring_canary_files/.canary_file_2014_04_17-02_11_54", [2014-04-29 19:12:33.710208] "hdfs://192.168.1.180/tmp/a0.csv" [2014-04-29 19:12:33.710208] ], [2014-04-29 19:12:33.710208] "keys": [ [2014-04-29 19:12:33.710208] "hdfs://192.168.1.180/tmp/.cloudera_health_monitoring_canary_files/.canary_file_2014_02_22-22_30_06", [2014-04-29 19:12:33.710208] "hdfs://192.168.1.180/tmp/.cloudera_health_monitoring_canary_files/.canary_file_2014_03_15-20_29_48", [2014-04-29 19:12:33.710208] "hdfs://192.168.1.180/tmp/.cloudera_health_monitoring_canary_files/.canary_file_2014_04_13-01_04_18", [2014-04-29 19:12:33.710208] "hdfs://192.168.1.180/tmp/.cloudera_health_monitoring_canary_files/.canary_file_2014_04_17-02_08_34", [2014-04-29 19:12:33.710208] "hdfs://192.168.1.180/tmp/.cloudera_health_monitoring_canary_files/.canary_file_2014_04_17-02_09_44", [2014-04-29 19:12:33.710208] "hdfs://192.168.1.180/tmp/.cloudera_health_monitoring_canary_files/.canary_file_2014_04_17-02_11_54", [2014-04-29 19:12:33.710208] "hdfs://192.168.1.180/tmp/a0.csv" [2014-04-29 19:12:33.710208] ], [2014-04-29 19:12:33.710208] "response_info": { [2014-04-29 19:12:33.710208] "h2o": "pytest-kevin-29116", [2014-04-29 19:12:33.710208] "node": "/192.168.1.176:54321", [2014-04-29 19:12:33.710208] "redirect_url": null, [2014-04-29 19:12:33.710208] "status": "done", [2014-04-29 19:12:33.710208] "time": 18 [2014-04-29 19:12:33.710208] } [2014-04-29 19:12:33.710208] }, [2014-04-29 19:12:33.710208] "hdfs://192.168.1.180/tmp/a0.csv" [2014-04-29 19:12:33.710208] ] [2014-04-29 19:12:33.710397] The import dies when it sees them [2014-04-29 19:20:48.191341] import_only: test_hdfs_cdh5_fvec.py hdfs uses hdfs://datasets/and-testing.data [2014-04-29 19:20:48.191399] parse parameters: {'destination_key': 'a.hex', 'parser_type': None, 'single_quotes': None, 'source_key': 'hdfs://192.168.1.180/datasets/and-testing.data', 'header': None, 'exclude': None, 'header_from_file': None, 'delete_on_done': None, 'blocking': None, 'separator': None, 'preview': None} [2014-04-29 19:20:48.480308] redirect http://192.168.1.176:54321/2/Progress2.json?job_key=%240301c0a801b032d4ffffffff%24_bd3bef2afc1d1fce9890625f9fa34daf&destination_key=a.hex [2014-04-29 19:20:49.652140] 07:20:48.001 # Session ERRR WATER: [2014-04-29 19:20:50.174152] + java.lang.RuntimeException: unimplemented [2014-04-29 19:20:50.174359] + at water.H2O.unimpl(H2O.java:72) [2014-04-29 19:20:50.174417] + at water.persist.PersistHdfs.addFolder2(PersistHdfs.java:310) [2014-04-29 19:20:50.174456] + at water.persist.PersistHdfs.addFolder2(PersistHdfs.java:303) [2014-04-29 19:20:50.174518] + at water.persist.PersistHdfs.addFolder2(PersistHdfs.java:292) [2014-04-29 19:20:50.174559] + at water.api.ImportFiles2.serveHdfs(ImportFiles2.java:89) [2014-04-29 19:20:50.174611] + at water.api.ImportFiles2.serve(ImportFiles2.java:70) [2014-04-29 19:20:50.174654] + at water.api.Request.serveGrid(Request.java:140) [2014-04-29 19:20:50.174688] + at water.Request2.superServeGrid(Request2.java:478) [2014-04-29 19:20:50.174737] + at water.Request2.serveGrid(Request2.java:399) [2014-04-29 19:20:50.174774] + at water.api.Request.serve(Request.java:117) [2014-04-29 19:20:50.174807] + at water.api.RequestServer.serve(RequestServer.java:388) [2014-04-29 19:20:50.174841] + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421) [2014-04-29 19:20:50.174875] + at java.lang.Thread.run(Thread.java:745) [2014-04-29 19:20:50.174907] ERROR

    JIRA | 3 years ago | Kevin Normoyle
    java.lang.RuntimeException: unimplemented
  2. Speed up your debug routine!

    Automated exception search integrated into your IDE

  3. 0

    models parameters: {'find_compatible_frames': False} JSON call returned non-200 status with http://172.16.2.222:54321/3/ModelMetrics.json/models/benign_w2v.hex/frames/syn_enums_500000x1.hex r.status_code: 500 r.headers: {'date': 'Thu, 18 Dec 2014 00:48:32 GMT', 'content-type': 'application/json'} r.text: {"__meta":{"schema_version":1,"schema_name":"HttpErrorV1","schema_type":"Iced"},"status_header":"500 Internal Server Error","errmsg":"RuntimeException: water.DException$DistributedException: from /172.16.2.222:54321; by class hex.Model$BigScore; class java.lang.RuntimeException: unimplemented","errurl":null,"stacktrace":["water.MRTask.getResult(MRTask.java:261)","water.MRTask.doAll(MRTask.java:216)","water.MRTask.doAll(MRTask.java:213)","hex.Model.scoreImpl(Model.java:377)","hex.Model.score(Model.java:330)","water.api.ModelMetricsHandler.score(ModelMetricsHandler.java:221)","sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)","sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)","sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)","java.lang.reflect.Method.invoke(Method.java:606)","water.api.Handler.handle(Handler.java:64)","water.api.RequestServer.handle(RequestServer.java:492)","water.api.RequestServer.serve(RequestServer.java:470)","water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:434)","java.lang.Thread.run(Thread.java:745)"]} ERROR java.lang.RuntimeException: unimplemented at water.H2O.unimpl(H2O.java:425) at hex.word2vec.Word2VecModel.score0(Word2VecModel.java:43) at hex.Model$BigScore.map(Model.java:395) at water.MRTask.compute2(MRTask.java:426) at water.H2O$H2OCountedCompleter.compute(H2O.java:577) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: java.lang.RuntimeException: water.DException$DistributedException: from /172.16.2.222:54321; by class hex.Model$BigScore; class java.lang.RuntimeException: unimplemented 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at water.MRTask.getResult(MRTask.java:261) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at water.MRTask.doAll(MRTask.java:216) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at water.MRTask.doAll(MRTask.java:213) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at hex.Model.scoreImpl(Model.java:377) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at hex.Model.score(Model.java:330) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at water.api.ModelMetricsHandler.score(ModelMetricsHandler.java:221) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at java.lang.reflect.Method.invoke(Method.java:606) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at water.api.Handler.handle(Handler.java:64) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at water.api.RequestServer.handle(RequestServer.java:492) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at water.api.RequestServer.serve(RequestServer.java:470) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:434) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at java.lang.Thread.run(Thread.java:745) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: Caused by: water.DException$DistributedException: from /172.16.2.222:54321; by class hex.Model$BigScore; class java.lang.RuntimeException: unimplemented 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at water.H2O.unimpl(H2O.java:425) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at hex.word2vec.Word2VecModel.score0(Word2VecModel.java:43) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at hex.Model$BigScore.map(Model.java:395) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at water.MRTask.compute2(MRTask.java:426) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at water.H2O$H2OCountedCompleter.compute(H2O.java:577) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) 12-17 16:48:32.150 172.16.2.222:54321 28013 # Session WARN: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) ERROR

    JIRA | 2 years ago | Kevin Normoyle
    java.lang.RuntimeException: unimplemented
  4. 0

    The Input File looks like- > head(iri) C0 C1 C2 C3 C4 C5 1 NA NA NA NA NA NA 2 1 5.1 3.5 1.4 0.2 setosa 3 2 4.9 3 1.4 0.2 setosa 4 3 4.7 3.2 1.3 0.2 setosa 5 4 4.6 3.1 1.5 0.2 setosa 6 5 5 3.6 1.4 0.2 setosa Running GBM on this file gives error- > hh=h2o.gbm(x=c(2,3,4,5),y=6,data=iri,n.trees=2) Error in h2o.__poll(data@h2o, res$job_key) : Job key $03017f00000132d4ffffffff$_b0f34d44632fa2b9babd7704906a4e6c has been cancelled 08-Jan 05:43:18.782 127.0.0.1:54321 1331 # Session INFO HTTPD: GBM source=iri validation=iri max_depth=5 response=C5 nbins=100 classification=1 learn_rate=0.02 cols=1,2,3,4 ntrees=2 min_rows=10 08-Jan 05:43:18.783 127.0.0.1:54321 1331 FJ-9-41 INFO WATER: Starting GBM model build... 08-Jan 05:43:18.783 127.0.0.1:54321 1331 FJ-9-41 INFO WATER: destination_key: GBM_aec75291b707150d91df2c3274054a15 08-Jan 05:43:18.783 127.0.0.1:54321 1331 FJ-9-41 INFO WATER: source.numCols(): 6 08-Jan 05:43:18.784 127.0.0.1:54321 1331 FJ-9-41 INFO WATER: source.numRows(): 151 08-Jan 05:43:18.784 127.0.0.1:54321 1331 FJ-9-41 INFO WATER: cols: 4 columns selected 08-Jan 05:43:18.784 127.0.0.1:54321 1331 FJ-9-41 INFO WATER: ignored_cols: 0 columns ignored 08-Jan 05:43:18.784 127.0.0.1:54321 1331 FJ-9-41 INFO WATER: response: C5 08-Jan 05:43:18.785 127.0.0.1:54321 1331 FJ-9-41 INFO WATER: classification 08-Jan 05:43:18.785 127.0.0.1:54321 1331 FJ-9-41 INFO WATER: validation.numCols(): 6 08-Jan 05:43:18.785 127.0.0.1:54321 1331 FJ-9-41 INFO WATER: validation.numRows(): 151 08-Jan 05:43:18.785 127.0.0.1:54321 1331 FJ-9-41 INFO WATER: ntrees: 2 08-Jan 05:43:18.786 127.0.0.1:54321 1331 FJ-9-41 INFO WATER: max_depth: 5 08-Jan 05:43:18.786 127.0.0.1:54321 1331 FJ-9-41 INFO WATER: min_rows: 10 08-Jan 05:43:18.786 127.0.0.1:54321 1331 FJ-9-41 INFO WATER: nbins: 100 08-Jan 05:43:18.786 127.0.0.1:54321 1331 FJ-9-41 INFO WATER: learn_rate: 0.02 08-Jan 05:43:18.787 127.0.0.1:54321 1331 # Session INFO HTTPD: Cloud 08-Jan 05:43:18.791 127.0.0.1:54321 1331 # Session INFO HTTPD: Cloud 08-Jan 05:43:18.796 127.0.0.1:54321 1331 # Session INFO HTTPD: Jobs 08-Jan 05:43:18.826 127.0.0.1:54321 1331 FJ-9-41 INFO GBM__: ============================================================== 08-Jan 05:43:18.827 127.0.0.1:54321 1331 FJ-9-41 INFO GBM__: Mean Squared Error is 0.4444444311989674, with 0x3 trees (average of 3.0 nodes) 08-Jan 05:43:18.827 127.0.0.1:54321 1331 FJ-9-41 INFO GBM__: Total of 100 errors on 150 rows, CM= [[16, 17, 17], [17, 17, 16], [17, 16, 17]] 08-Jan 05:43:18.829 127.0.0.1:54321 1331 FJ-9-41 ERRR WATER: + java.lang.RuntimeException: unimplemented + at water.H2O.unimpl(H2O.java:71) + at hex.gbm.GBM$ComputeRes.map(GBM.java:217) + at water.MRTask2.compute2(MRTask2.java:348) + at water.H2O$H2OCountedCompleter.compute(H2O.java:677) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

    JIRA | 3 years ago | Earl Hathaway
    java.lang.RuntimeException: unimplemented

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.RuntimeException

      unimplemented

      at water.H2O.unimpl()
    2. water
      H2O.unimpl
      1. water.H2O.unimpl(H2O.java:72)
      1 frame
    3. water.persist
      PersistHdfs.addFolder2
      1. water.persist.PersistHdfs.addFolder2(PersistHdfs.java:308)
      2. water.persist.PersistHdfs.addFolder2(PersistHdfs.java:292)
      2 frames
    4. water.api
      Request.serveGrid
      1. water.api.ImportFiles2.serveHdfs(ImportFiles2.java:89)
      2. water.api.ImportFiles2.serve(ImportFiles2.java:70)
      3. water.api.Request.serveGrid(Request.java:140)
      3 frames
    5. water
      Request2.serveGrid
      1. water.Request2.superServeGrid(Request2.java:478)
      2. water.Request2.serveGrid(Request2.java:399)
      2 frames
    6. water.api
      RequestServer.serve
      1. water.api.Request.serve(Request.java:117)
      2. water.api.RequestServer.serve(RequestServer.java:388)
      2 frames
    7. water
      NanoHTTPD$HTTPSession.run
      1. water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421)
      1 frame
    8. Java RT
      Thread.run
      1. java.lang.Thread.run(Thread.java:745)
      1 frame