java.lang.IllegalArgumentException: Key not loaded: nfs://home/kevin/home-0xdiag-datasets/mnist/mnist_training.csv.gz

JIRA | Kevin Normoyle | 2 years ago
  1. 0

    It sounds like we're not going to have import folder capability? or do I have to add something to my import parameter? the data exists at the folder path I'm using on my machine It's a soft link at /home/kevin/home-0xdiag-datasets, but I don't think that's an issue since it works for single file imports $ ls /home/kevin/home-0xdiag-datasets/mnist 5.csv a mnist_reals_testing.csv.gz mnist_reals_training.csv.gz mnist_testing.csv.gz mnist_training.csv.gz If I do this to h2o-dev: #*********************** python_test_name: test_parse_mnist.py #*********************** 2014-11-11 21:59:13.822383 -- Start http://192.168.0.34:54321/2/ImportFiles.json?path=/home/kevin/home-0xdiag-datasets/mnist 2014-11-11 21:59:13.896538 -- Start http://192.168.0.34:54321/ParseSetup.json?srcs=[nfs://home/kevin/home-0xdiag-datasets/mnist/mnist_training.csv.gz] ~ I get a 400 error on the parse, (no stacktrace in the response) but the h2o log has the stacktrace. It says it can't find the file (because it wasn't imported) import_only: test_parse_mnist.py local uses /home/kevin/home-0xdiag-datasets/mnist JSON call returned non-200 status with http://192.168.0.34:54321/ParseSetup.json?srcs=[nfs://home/kevin/home-0xdiag-datasets/mnist/mnist_training.csv.gz] r.status_code: 400 r.headers: {'date': 'Wed, 12 Nov 2014 06:03:11 GMT', 'content-type': 'application/json'} r.text: {"schema_version":-1,"schema_name":"Schema","schema_type":"Iced","status_header":"400 Bad Request","errmsg":"Key not loaded: nfs://home/kevin/home-0xdiag-datasets/mnist/mnist_training.csv.gz","errurl":"/ParseSetup.json","stacktrace":null} ERROR 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: java.lang.IllegalArgumentException: Key not loaded: nfs://home/kevin/home-0xdiag-datasets/mnist/mnist_training.csv.gz 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at water.parser.ParseSetupHandler.guessSetup(ParseSetupHandler.java:16) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at java.lang.reflect.Method.invoke(Method.java:606) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at water.api.Handler.handle(Handler.java:55) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at water.api.RequestServer.handle(RequestServer.java:470) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at water.api.RequestServer.serve(RequestServer.java:448) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:428) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at java.lang.Thread.run(Thread.java:745) ~

    JIRA | 2 years ago | Kevin Normoyle
    java.lang.IllegalArgumentException: Key not loaded: nfs://home/kevin/home-0xdiag-datasets/mnist/mnist_training.csv.gz
  2. 0

    It sounds like we're not going to have import folder capability? or do I have to add something to my import parameter? the data exists at the folder path I'm using on my machine It's a soft link at /home/kevin/home-0xdiag-datasets, but I don't think that's an issue since it works for single file imports $ ls /home/kevin/home-0xdiag-datasets/mnist 5.csv a mnist_reals_testing.csv.gz mnist_reals_training.csv.gz mnist_testing.csv.gz mnist_training.csv.gz If I do this to h2o-dev: #*********************** python_test_name: test_parse_mnist.py #*********************** 2014-11-11 21:59:13.822383 -- Start http://192.168.0.34:54321/2/ImportFiles.json?path=/home/kevin/home-0xdiag-datasets/mnist 2014-11-11 21:59:13.896538 -- Start http://192.168.0.34:54321/ParseSetup.json?srcs=[nfs://home/kevin/home-0xdiag-datasets/mnist/mnist_training.csv.gz] ~ I get a 400 error on the parse, (no stacktrace in the response) but the h2o log has the stacktrace. It says it can't find the file (because it wasn't imported) import_only: test_parse_mnist.py local uses /home/kevin/home-0xdiag-datasets/mnist JSON call returned non-200 status with http://192.168.0.34:54321/ParseSetup.json?srcs=[nfs://home/kevin/home-0xdiag-datasets/mnist/mnist_training.csv.gz] r.status_code: 400 r.headers: {'date': 'Wed, 12 Nov 2014 06:03:11 GMT', 'content-type': 'application/json'} r.text: {"schema_version":-1,"schema_name":"Schema","schema_type":"Iced","status_header":"400 Bad Request","errmsg":"Key not loaded: nfs://home/kevin/home-0xdiag-datasets/mnist/mnist_training.csv.gz","errurl":"/ParseSetup.json","stacktrace":null} ERROR 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: java.lang.IllegalArgumentException: Key not loaded: nfs://home/kevin/home-0xdiag-datasets/mnist/mnist_training.csv.gz 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at water.parser.ParseSetupHandler.guessSetup(ParseSetupHandler.java:16) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at java.lang.reflect.Method.invoke(Method.java:606) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at water.api.Handler.handle(Handler.java:55) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at water.api.RequestServer.handle(RequestServer.java:470) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at water.api.RequestServer.serve(RequestServer.java:448) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:428) 11-11 22:03:11.519 192.168.0.34:54321 29579 # Session WARN: at java.lang.Thread.run(Thread.java:745) ~

    JIRA | 2 years ago | Kevin Normoyle
    java.lang.IllegalArgumentException: Key not loaded: nfs://home/kevin/home-0xdiag-datasets/mnist/mnist_training.csv.gz
  3. 0

    (not shown here, but a prior parse got a stack trace, and apparently left a key locked) I'm transitioning to using remove_all()...so I'm just noting this in case we want remove_key to remove even if a key is locked (say due to an error) or whether we want a -force param details the test suite is running multiple tests on a single cloud...so I'm not sure what's going on now with the new behavior around locked keys. I used to remove all keys between tests. I probably have to update to the remove_all that forces key removal? this is an interesting message though. ...we probably don't wnat to cause exception on this? does this just send exception info to the browser, with no bad side effect on h2o (no crash? from /192.168.1.172:54355; java.lang.IllegalArgumentException: Dataset nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/file_100.dat.gz is already in use. Unable to use it now. Consider using a different destination name. + at water.Lockable$PriorWriteLock.atomic(Lockable.java:83) + at water.Lockable$PriorWriteLock.atomic(Lockable.java:72) /var/lib/jenkins/jobs/h2o_release_tests/workspace/py/testdir_release/c7/test_c7_rel.py check_sandbox_for_errors: Errors in sandbox stdout or stderr (or R stdout/stderr). Could have occurred at any prior time 10:01:12.429 # Session ERRR WATER: + water.DException$DistributedException: from /192.168.1.177:54355; java.lang.NullPointerException 10:01:12.435 # Session INFO HTTPD: GET /Remove.json key=nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/file_100.dat.gz 10:01:12.437 # Session ERRR WATER: + water.DException$DistributedException: from /192.168.1.172:54355; java.lang.IllegalArgumentException: Dataset nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/file_100.dat.gz is already in use. Unable to use it now. Consider using a different destination name. + at water.Lockable$PriorWriteLock.atomic(Lockable.java:83) + at water.Lockable$PriorWriteLock.atomic(Lockable.java:72) + at water.TAtomic.atomic(TAtomic.java:19) + at water.Atomic.compute2(Atomic.java:57) + at water.DTask.dinvoke(DTask.java:78) + at water.RPC$RPCCall.compute2(RPC.java:276) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 10:01:12.444 # Session INFO HTTPD: GET /Remove.json key=nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz

    JIRA | 3 years ago | Kevin Normoyle
    java.lang.IllegalArgumentException: Dataset nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/file_100.dat.gz is already in use. Unable to use it now. Consider using a different destination name.
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    (not shown here, but a prior parse got a stack trace, and apparently left a key locked) I'm transitioning to using remove_all()...so I'm just noting this in case we want remove_key to remove even if a key is locked (say due to an error) or whether we want a -force param details the test suite is running multiple tests on a single cloud...so I'm not sure what's going on now with the new behavior around locked keys. I used to remove all keys between tests. I probably have to update to the remove_all that forces key removal? this is an interesting message though. ...we probably don't wnat to cause exception on this? does this just send exception info to the browser, with no bad side effect on h2o (no crash? from /192.168.1.172:54355; java.lang.IllegalArgumentException: Dataset nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/file_100.dat.gz is already in use. Unable to use it now. Consider using a different destination name. + at water.Lockable$PriorWriteLock.atomic(Lockable.java:83) + at water.Lockable$PriorWriteLock.atomic(Lockable.java:72) /var/lib/jenkins/jobs/h2o_release_tests/workspace/py/testdir_release/c7/test_c7_rel.py check_sandbox_for_errors: Errors in sandbox stdout or stderr (or R stdout/stderr). Could have occurred at any prior time 10:01:12.429 # Session ERRR WATER: + water.DException$DistributedException: from /192.168.1.177:54355; java.lang.NullPointerException 10:01:12.435 # Session INFO HTTPD: GET /Remove.json key=nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/file_100.dat.gz 10:01:12.437 # Session ERRR WATER: + water.DException$DistributedException: from /192.168.1.172:54355; java.lang.IllegalArgumentException: Dataset nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/file_100.dat.gz is already in use. Unable to use it now. Consider using a different destination name. + at water.Lockable$PriorWriteLock.atomic(Lockable.java:83) + at water.Lockable$PriorWriteLock.atomic(Lockable.java:72) + at water.TAtomic.atomic(TAtomic.java:19) + at water.Atomic.compute2(Atomic.java:57) + at water.DTask.dinvoke(DTask.java:78) + at water.RPC$RPCCall.compute2(RPC.java:276) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 10:01:12.444 # Session INFO HTTPD: GET /Remove.json key=nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz

    JIRA | 3 years ago | Kevin Normoyle
    java.lang.IllegalArgumentException: Dataset nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/file_100.dat.gz is already in use. Unable to use it now. Consider using a different destination name.
  6. 0

    (not shown here, but a prior parse got a stack trace, and apparently left a key locked) I'm transitioning to using remove_all()...so I'm just noting this in case we want remove_key to remove even if a key is locked (say due to an error) or whether we want a -force param details the test suite is running multiple tests on a single cloud...so I'm not sure what's going on now with the new behavior around locked keys. I used to remove all keys between tests. I probably have to update to the remove_all that forces key removal? this is an interesting message though. ...we probably don't wnat to cause exception on this? does this just send exception info to the browser, with no bad side effect on h2o (no crash? from /192.168.1.172:54355; java.lang.IllegalArgumentException: Dataset nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/file_100.dat.gz is already in use. Unable to use it now. Consider using a different destination name. + at water.Lockable$PriorWriteLock.atomic(Lockable.java:83) + at water.Lockable$PriorWriteLock.atomic(Lockable.java:72) /var/lib/jenkins/jobs/h2o_release_tests/workspace/py/testdir_release/c7/test_c7_rel.py check_sandbox_for_errors: Errors in sandbox stdout or stderr (or R stdout/stderr). Could have occurred at any prior time 10:01:12.429 # Session ERRR WATER: + water.DException$DistributedException: from /192.168.1.177:54355; java.lang.NullPointerException 10:01:12.435 # Session INFO HTTPD: GET /Remove.json key=nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/file_100.dat.gz 10:01:12.437 # Session ERRR WATER: + water.DException$DistributedException: from /192.168.1.172:54355; java.lang.IllegalArgumentException: Dataset nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/file_100.dat.gz is already in use. Unable to use it now. Consider using a different destination name. + at water.Lockable$PriorWriteLock.atomic(Lockable.java:83) + at water.Lockable$PriorWriteLock.atomic(Lockable.java:72) + at water.TAtomic.atomic(TAtomic.java:19) + at water.Atomic.compute2(Atomic.java:57) + at water.DTask.dinvoke(DTask.java:78) + at water.RPC$RPCCall.compute2(RPC.java:276) + at water.H2O$H2OCountedCompleter.compute(H2O.java:712) + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) 10:01:12.444 # Session INFO HTTPD: GET /Remove.json key=nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz

    JIRA | 3 years ago | Kevin Normoyle
    java.lang.IllegalArgumentException: Dataset nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/file_100.dat.gz is already in use. Unable to use it now. Consider using a different destination name.

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.IllegalArgumentException

      Key not loaded: nfs://home/kevin/home-0xdiag-datasets/mnist/mnist_training.csv.gz

      at water.parser.ParseSetupHandler.guessSetup()
    2. water.parser
      ParseSetupHandler.guessSetup
      1. water.parser.ParseSetupHandler.guessSetup(ParseSetupHandler.java:16)
      1 frame
    3. Java RT
      Method.invoke
      1. sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2. sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      3. sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      4. java.lang.reflect.Method.invoke(Method.java:606)
      4 frames
    4. water.api
      RequestServer.serve
      1. water.api.Handler.handle(Handler.java:55)
      2. water.api.RequestServer.handle(RequestServer.java:470)
      3. water.api.RequestServer.serve(RequestServer.java:448)
      3 frames
    5. water
      NanoHTTPD$HTTPSession.run
      1. water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:428)
      1 frame
    6. Java RT
      Thread.run
      1. java.lang.Thread.run(Thread.java:745)
      1 frame