java.lang.RuntimeException: javassist.NotFoundException: $iwC$$iwC$test

JIRA | Michal Malohlava | 1 year ago
  1. 0

    Based on question from H2O stream (attached below) - we need to provide distributed class loading in h2o or use spark class loader to fetch newly created classes. ================= Hi Tong, the problem here is that remote nodes cannot see created class. We are missing this piece in our implementation right now. The workaround is to define and compile the class outside Spark shell and put it on the classpath of Spark shell via `--jars` option. Best regards, michal On 10/21/15 9:10 AM, Niu, Tong wrote: > > Hi Mike, > > > I defined a class test extends MRTask, but when I use it on my H2OFrame it said NotFoundException $iwC$$iwC$test > > > Following is what I wrote in sparkling-shell. How can I fix it? > > > scala> class test extends MRTask[test]{ > | override def map(c: Chunk, nc: NewChunk): Unit = { > | for (row <- 0 until c.len()) { > | nc.addNum(c.atd(row)+1) > | } > | } > | } > defined class test > > scala> h20Frame.add(new test().doAll(1, h20Frame.vec(0)).outputFrame(Array("test"), null)) > java.lang.RuntimeException: javassist.NotFoundException: $iwC$$iwC$test > at water.Weaver.genDelegate(Weaver.java:70) > at water.TypeMap.getIcer(TypeMap.java:186) > at water.TypeMap.getIcer(TypeMap.java:174) > at water.H2O$H2OCountedCompleter.icer(H2O.java:1040) > at water.H2O$H2OCountedCompleter.frozenType(H2O.java:1047) > at water.AutoBuffer.put(AutoBuffer.java:641) > at water.RPC.call(RPC.java:203) > at water.MRTask.remote_compute(MRTask.java:580) > at water.MRTask.setupLocal0(MRTask.java:533) > at water.MRTask.asyncExec(MRTask.java:478) > at water.MRTask.dfork(MRTask.java:458) > at water.MRTask.doAll(MRTask.java:385) > at water.MRTask.doAll(MRTask.java:375) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:70) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:75) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:77) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:79) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:81) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:83) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:85) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:87) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:89) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:91) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:93) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:95) > at $iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:97) > at $iwC$$iwC$$iwC$$iwC.<init>(<console>:99) > at $iwC$$iwC$$iwC.<init>(<console>:101) > at $iwC$$iwC.<init>(<console>:103) > at $iwC.<init>(<console>:105) > at <init>(<console>:107) > at .<init>(<console>:111) > at .<clinit>(<console>) > at .<init>(<console>:7) > at .<clinit>(<console>) > at $print(<console>) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.spark.repl.SparkIMain$ReadEvalPrint.call(SparkIMain.scala:1065) > at org.apache.spark.repl.SparkIMain$Request.loadAndRun(SparkIMain.scala:1338) > at org.apache.spark.repl.SparkIMain.loadAndRunReq$1(SparkIMain.scala:840) > at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:871) > at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:819) > at org.apache.spark.repl.SparkILoop.reallyInterpret$1(SparkILoop.scala:857) > at org.apache.spark.repl.SparkILoop.interpretStartingWith(SparkILoop.scala:902) > at org.apache.spark.repl.SparkILoop.command(SparkILoop.scala:814) > at org.apache.spark.repl.SparkILoop.processLine$1(SparkILoop.scala:657) > at org.apache.spark.repl.SparkILoop.innerLoop$1(SparkILoop.scala:665) > at org.apache.spark.repl.SparkILoop.org$apache$spark$repl$SparkILoop$$loop(SparkILoop.scala:670) > at org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply$mcZ$sp(SparkILoop.scala:997) > at org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply(SparkILoop.scala:945) > at org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply(SparkILoop.scala:945) > at scala.tools.nsc.util.ScalaClassLoader$.savingContextLoader(ScalaClassLoader.scala:135) > at org.apache.spark.repl.SparkILoop.org$apache$spark$repl$SparkILoop$$process(SparkILoop.scala:945) > at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:1059) > at org.apache.spark.repl.Main$.main(Main.scala:31) > at org.apache.spark.repl.Main.main(Main.scala) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:665) > at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:170) > at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:193) > at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:112) > at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > Caused by: javassist.NotFoundException: $iwC$$iwC$test > at javassist.ClassPool.get(ClassPool.java:450) > at water.Weaver.javassistLoadClass(Weaver.java:124) > at water.Weaver.genDelegate(Weaver.java:60) > > ... 67 more > > > Thanks, > > Tong > > >

    JIRA | 1 year ago | Michal Malohlava
    java.lang.RuntimeException: javassist.NotFoundException: $iwC$$iwC$test
  2. 0

    Based on question from H2O stream (attached below) - we need to provide distributed class loading in h2o or use spark class loader to fetch newly created classes. ================= Hi Tong, the problem here is that remote nodes cannot see created class. We are missing this piece in our implementation right now. The workaround is to define and compile the class outside Spark shell and put it on the classpath of Spark shell via `--jars` option. Best regards, michal On 10/21/15 9:10 AM, Niu, Tong wrote: > > Hi Mike, > > > I defined a class test extends MRTask, but when I use it on my H2OFrame it said NotFoundException $iwC$$iwC$test > > > Following is what I wrote in sparkling-shell. How can I fix it? > > > scala> class test extends MRTask[test]{ > | override def map(c: Chunk, nc: NewChunk): Unit = { > | for (row <- 0 until c.len()) { > | nc.addNum(c.atd(row)+1) > | } > | } > | } > defined class test > > scala> h20Frame.add(new test().doAll(1, h20Frame.vec(0)).outputFrame(Array("test"), null)) > java.lang.RuntimeException: javassist.NotFoundException: $iwC$$iwC$test > at water.Weaver.genDelegate(Weaver.java:70) > at water.TypeMap.getIcer(TypeMap.java:186) > at water.TypeMap.getIcer(TypeMap.java:174) > at water.H2O$H2OCountedCompleter.icer(H2O.java:1040) > at water.H2O$H2OCountedCompleter.frozenType(H2O.java:1047) > at water.AutoBuffer.put(AutoBuffer.java:641) > at water.RPC.call(RPC.java:203) > at water.MRTask.remote_compute(MRTask.java:580) > at water.MRTask.setupLocal0(MRTask.java:533) > at water.MRTask.asyncExec(MRTask.java:478) > at water.MRTask.dfork(MRTask.java:458) > at water.MRTask.doAll(MRTask.java:385) > at water.MRTask.doAll(MRTask.java:375) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:70) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:75) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:77) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:79) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:81) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:83) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:85) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:87) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:89) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:91) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:93) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:95) > at $iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:97) > at $iwC$$iwC$$iwC$$iwC.<init>(<console>:99) > at $iwC$$iwC$$iwC.<init>(<console>:101) > at $iwC$$iwC.<init>(<console>:103) > at $iwC.<init>(<console>:105) > at <init>(<console>:107) > at .<init>(<console>:111) > at .<clinit>(<console>) > at .<init>(<console>:7) > at .<clinit>(<console>) > at $print(<console>) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.spark.repl.SparkIMain$ReadEvalPrint.call(SparkIMain.scala:1065) > at org.apache.spark.repl.SparkIMain$Request.loadAndRun(SparkIMain.scala:1338) > at org.apache.spark.repl.SparkIMain.loadAndRunReq$1(SparkIMain.scala:840) > at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:871) > at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:819) > at org.apache.spark.repl.SparkILoop.reallyInterpret$1(SparkILoop.scala:857) > at org.apache.spark.repl.SparkILoop.interpretStartingWith(SparkILoop.scala:902) > at org.apache.spark.repl.SparkILoop.command(SparkILoop.scala:814) > at org.apache.spark.repl.SparkILoop.processLine$1(SparkILoop.scala:657) > at org.apache.spark.repl.SparkILoop.innerLoop$1(SparkILoop.scala:665) > at org.apache.spark.repl.SparkILoop.org$apache$spark$repl$SparkILoop$$loop(SparkILoop.scala:670) > at org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply$mcZ$sp(SparkILoop.scala:997) > at org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply(SparkILoop.scala:945) > at org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply(SparkILoop.scala:945) > at scala.tools.nsc.util.ScalaClassLoader$.savingContextLoader(ScalaClassLoader.scala:135) > at org.apache.spark.repl.SparkILoop.org$apache$spark$repl$SparkILoop$$process(SparkILoop.scala:945) > at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:1059) > at org.apache.spark.repl.Main$.main(Main.scala:31) > at org.apache.spark.repl.Main.main(Main.scala) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:665) > at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:170) > at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:193) > at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:112) > at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > Caused by: javassist.NotFoundException: $iwC$$iwC$test > at javassist.ClassPool.get(ClassPool.java:450) > at water.Weaver.javassistLoadClass(Weaver.java:124) > at water.Weaver.genDelegate(Weaver.java:60) > > ... 67 more > > > Thanks, > > Tong > > >

    JIRA | 1 year ago | Michal Malohlava
    java.lang.RuntimeException: javassist.NotFoundException: $iwC$$iwC$test
  3. 0

    Steps to reproduce: {code} val data = sc.parallelize((1 to 100000).map(_=>java.util.UUID.randomUUID().toString+" "+java.util.UUID.randomUUID().toString)) val schema = StructType(Seq(StructField("c1", StringType, true))) val rowRDD = data.map(Row(_)) val stringColumnTable = sqlContext.applySchema(rowRDD, schema) val h2oFrame = toDataFrame(stringColumnTable) scala> h2oFrame.vecs.map(_.get_type_str) res2: Array[String] = Array(string) scala> org.apache.spark.examples.h2o.DemoUtils.splitFrame(h2oFrame, Array("1","2","3"), Array(0.6,0.2,0.2)) onExCompletion for hex.splitframe.ShuffleSplitFrame$1@5d9445ed onExCompletion for hex.splitframe.ShuffleSplitFrame$1@5d9445ed water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.fvec.CStrChunk.atd_impl(CStrChunk.java:39) at water.fvec.Chunk.atd(Chunk.java:252) at hex.splitframe.ShuffleSplitFrame$1.map(ShuffleSplitFrame.java:40) at water.MRTask.compute2(MRTask.java:430) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) water.DException$DistributedException: from /192.168.1.4:54323; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.fvec.CStrChunk.atd_impl(CStrChunk.java:39) at water.fvec.Chunk.atd(Chunk.java:252) at hex.splitframe.ShuffleSplitFrame$1.map(ShuffleSplitFrame.java:40) at water.MRTask.compute2(MRTask.java:430) at water.MRTask.compute2(MRTask.java:374) at water.MRTask.compute2(MRTask.java:374) at water.MRTask.compute2(MRTask.java:374) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.4:54327; by class hex.splitframe.ShuffleSplitFrame$1; class water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.MRTask.getResult(MRTask.java:265) at water.MRTask.doAll(MRTask.java:220) at water.MRTask.doAll(MRTask.java:217) at hex.splitframe.ShuffleSplitFrame.shuffleSplitFrame(ShuffleSplitFrame.java:29) at org.apache.spark.examples.h2o.DemoUtils$.splitFrame(DemoUtils.scala:110) at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:35) at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:40) at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:42) at $iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:44) at $iwC$$iwC$$iwC$$iwC.<init>(<console>:46) at $iwC$$iwC$$iwC.<init>(<console>:48) at $iwC$$iwC.<init>(<console>:50) at $iwC.<init>(<console>:52) at <init>(<console>:54) at .<init>(<console>:58) at .<clinit>(<console>) at .<init>(<console>:7) at .<clinit>(<console>) at $print(<console>) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.spark.repl.SparkIMain$ReadEvalPrint.call(SparkIMain.scala:852) at org.apache.spark.repl.SparkIMain$Request.loadAndRun(SparkIMain.scala:1125) at org.apache.spark.repl.SparkIMain.loadAndRunReq$1(SparkIMain.scala:674) at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:705) at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:669) at org.apache.spark.repl.SparkILoop.reallyInterpret$1(SparkILoop.scala:828) at org.apache.spark.repl.SparkILoop.interpretStartingWith(SparkILoop.scala:873) at org.apache.spark.repl.SparkILoop.command(SparkILoop.scala:785) at org.apache.spark.repl.SparkILoop.processLine$1(SparkILoop.scala:628) at org.apache.spark.repl.SparkILoop.innerLoop$1(SparkILoop.scala:636) at org.apache.spark.repl.SparkILoop.loop(SparkILoop.scala:641) at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply$mcZ$sp(SparkILoop.scala:968) at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply(SparkILoop.scala:916) at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply(SparkILoop.scala:916) at scala.tools.nsc.util.ScalaClassLoader$.savingContextLoader(ScalaClassLoader.scala:135) at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:916) at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:1011) at org.apache.spark.repl.Main$.main(Main.scala:31) at org.apache.spark.repl.Main.main(Main.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:358) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) Caused by: water.DException$DistributedException: from /192.168.1.4:54327; by class hex.splitframe.ShuffleSplitFrame$1; class water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.fvec.CStrChunk.atd_impl(CStrChunk.java:39) at water.fvec.Chunk.atd(Chunk.java:252) at hex.splitframe.ShuffleSplitFrame$1.map(ShuffleSplitFrame.java:40) at water.MRTask.compute2(MRTask.java:430) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) {code} Reproduced on this build: http://h2o-release.s3.amazonaws.com/sparkling-water/master/86/index.html

    JIRA | 2 years ago | Peter Rudenko
    java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.4:54327; by class hex.splitframe.ShuffleSplitFrame$1; class water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector.
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    whd_orig <- h2o.uploadFile(locate("smalldata/demos/whd_whisard_truncated.zip"), col.types = c(rep("enum", 7), rep("numeric", 97))) zip_to_zcta <- h2o.uploadFile(locate("smalldata/demos/Zip_to_ZCTA_Crosswalk_JSI2014.csv"), col.types = rep("enum", 5)) zip_to_zcta_map <- zip_to_zcta[,colnames(zip_to_zcta) %in% c("ZIP", "ZCTA_crosswalk")] colnames(zip_to_zcta_map) <- c("zip_cd", "ZCTA5") whd_zcta <- h2o.merge(whd_orig, zip_to_zcta_map, all.x = TRUE, all.y = FALSE) whd_zcta$zip_cd <- NULL print(summary(whd_zcta)) onExCompletion for water.rapids.ASTMerge$MergeSet$MakeHash@53034cc9 java.lang.ArrayIndexOutOfBoundsException: 26589 at water.rapids.ASTMerge$Row.fill(ASTMerge.java:138) at water.rapids.ASTMerge$MergeSet$MakeHash.map(ASTMerge.java:195) at water.MRTask.compute2(MRTask.java:657) at water.H2O$H2OCountedCompleter.compute(H2O.java:1005) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.RuntimeException: water.DException$DistributedException: from /172.16.2.73:54321; by class water.rapids.ASTMerge$MergeSet$MakeHash; class java.lang.ArrayIndexOutOfBoundsException: 26589 at water.MRTask.getResult(MRTask.java:505) at water.MRTask.doAll(MRTask.java:386) at water.MRTask.doAll(MRTask.java:381) at water.rapids.ASTMerge$MergeSet.setupLocal(ASTMerge.java:185) at water.MRTask.setupLocal0(MRTask.java:580) at water.MRTask.doAll(MRTask.java:398) at water.MRTask.doAllNodes(MRTask.java:417) at water.rapids.ASTMerge.apply(ASTMerge.java:109) at water.rapids.AST.treeWalk(AST.java:74) at water.rapids.AST.treeWalk(AST.java:84) at water.rapids.Exec.exec(Exec.java:68) at water.api.RapidsHandler.exec(RapidsHandler.java:37) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at water.api.Handler.handle(Handler.java:58) at water.api.RequestServer.handle(RequestServer.java:635) at water.api.RequestServer.serve(RequestServer.java:576) at water.JettyHTTPD$H2oDefaultServlet.doGeneric(JettyHTTPD.java:559) at water.JettyHTTPD$H2oDefaultServlet.doPost(JettyHTTPD.java:507) at javax.servlet.http.HttpServlet.service(HttpServlet.java:755) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:370) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:494) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:982) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1043) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:865) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745)

    JIRA | 1 year ago | Anqi Fu
    java.lang.RuntimeException: water.DException$DistributedException: from /172.16.2.73:54321; by class water.rapids.ASTMerge$MergeSet$MakeHash; class java.lang.ArrayIndexOutOfBoundsException: 26589
  6. 0

    Steps to reproduce: {code} val data = sc.parallelize((1 to 100000).map(_=>java.util.UUID.randomUUID().toString+" "+java.util.UUID.randomUUID().toString)) val schema = StructType(Seq(StructField("c1", StringType, true))) val rowRDD = data.map(Row(_)) val stringColumnTable = sqlContext.applySchema(rowRDD, schema) val h2oFrame = toDataFrame(stringColumnTable) scala> h2oFrame.vecs.map(_.get_type_str) res2: Array[String] = Array(string) scala> org.apache.spark.examples.h2o.DemoUtils.splitFrame(h2oFrame, Array("1","2","3"), Array(0.6,0.2,0.2)) onExCompletion for hex.splitframe.ShuffleSplitFrame$1@5d9445ed onExCompletion for hex.splitframe.ShuffleSplitFrame$1@5d9445ed water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.fvec.CStrChunk.atd_impl(CStrChunk.java:39) at water.fvec.Chunk.atd(Chunk.java:252) at hex.splitframe.ShuffleSplitFrame$1.map(ShuffleSplitFrame.java:40) at water.MRTask.compute2(MRTask.java:430) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) water.DException$DistributedException: from /192.168.1.4:54323; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.fvec.CStrChunk.atd_impl(CStrChunk.java:39) at water.fvec.Chunk.atd(Chunk.java:252) at hex.splitframe.ShuffleSplitFrame$1.map(ShuffleSplitFrame.java:40) at water.MRTask.compute2(MRTask.java:430) at water.MRTask.compute2(MRTask.java:374) at water.MRTask.compute2(MRTask.java:374) at water.MRTask.compute2(MRTask.java:374) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.4:54327; by class hex.splitframe.ShuffleSplitFrame$1; class water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.MRTask.getResult(MRTask.java:265) at water.MRTask.doAll(MRTask.java:220) at water.MRTask.doAll(MRTask.java:217) at hex.splitframe.ShuffleSplitFrame.shuffleSplitFrame(ShuffleSplitFrame.java:29) at org.apache.spark.examples.h2o.DemoUtils$.splitFrame(DemoUtils.scala:110) at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:35) at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:40) at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:42) at $iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:44) at $iwC$$iwC$$iwC$$iwC.<init>(<console>:46) at $iwC$$iwC$$iwC.<init>(<console>:48) at $iwC$$iwC.<init>(<console>:50) at $iwC.<init>(<console>:52) at <init>(<console>:54) at .<init>(<console>:58) at .<clinit>(<console>) at .<init>(<console>:7) at .<clinit>(<console>) at $print(<console>) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.spark.repl.SparkIMain$ReadEvalPrint.call(SparkIMain.scala:852) at org.apache.spark.repl.SparkIMain$Request.loadAndRun(SparkIMain.scala:1125) at org.apache.spark.repl.SparkIMain.loadAndRunReq$1(SparkIMain.scala:674) at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:705) at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:669) at org.apache.spark.repl.SparkILoop.reallyInterpret$1(SparkILoop.scala:828) at org.apache.spark.repl.SparkILoop.interpretStartingWith(SparkILoop.scala:873) at org.apache.spark.repl.SparkILoop.command(SparkILoop.scala:785) at org.apache.spark.repl.SparkILoop.processLine$1(SparkILoop.scala:628) at org.apache.spark.repl.SparkILoop.innerLoop$1(SparkILoop.scala:636) at org.apache.spark.repl.SparkILoop.loop(SparkILoop.scala:641) at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply$mcZ$sp(SparkILoop.scala:968) at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply(SparkILoop.scala:916) at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply(SparkILoop.scala:916) at scala.tools.nsc.util.ScalaClassLoader$.savingContextLoader(ScalaClassLoader.scala:135) at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:916) at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:1011) at org.apache.spark.repl.Main$.main(Main.scala:31) at org.apache.spark.repl.Main.main(Main.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:358) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) Caused by: water.DException$DistributedException: from /192.168.1.4:54327; by class hex.splitframe.ShuffleSplitFrame$1; class water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.fvec.CStrChunk.atd_impl(CStrChunk.java:39) at water.fvec.Chunk.atd(Chunk.java:252) at hex.splitframe.ShuffleSplitFrame$1.map(ShuffleSplitFrame.java:40) at water.MRTask.compute2(MRTask.java:430) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) {code} Reproduced on this build: http://h2o-release.s3.amazonaws.com/sparkling-water/master/86/index.html

    JIRA | 2 years ago | Peter Rudenko
    java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.4:54327; by class hex.splitframe.ShuffleSplitFrame$1; class water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector.

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.RuntimeException

      javassist.NotFoundException: $iwC$$iwC$test

      at water.Weaver.genDelegate()
    2. water
      MRTask.doAll
      1. water.Weaver.genDelegate(Weaver.java:70)
      2. water.TypeMap.getIcer(TypeMap.java:186)
      3. water.TypeMap.getIcer(TypeMap.java:174)
      4. water.H2O$H2OCountedCompleter.icer(H2O.java:1040)
      5. water.H2O$H2OCountedCompleter.frozenType(H2O.java:1047)
      6. water.AutoBuffer.put(AutoBuffer.java:641)
      7. water.RPC.call(RPC.java:203)
      8. water.MRTask.remote_compute(MRTask.java:580)
      9. water.MRTask.setupLocal0(MRTask.java:533)
      10. water.MRTask.asyncExec(MRTask.java:478)
      11. water.MRTask.dfork(MRTask.java:458)
      12. water.MRTask.doAll(MRTask.java:385)
      13. water.MRTask.doAll(MRTask.java:375)
      13 frames
    3. Unknown
      $iwC.<init>
      1. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:70)
      2. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:75)
      3. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:77)
      4. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:79)
      5. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:81)
      6. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:83)
      7. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:85)
      8. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:87)
      9. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:89)
      10. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:91)
      11. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:93)
      12. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:95)
      13. $iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:97)
      14. $iwC$$iwC$$iwC$$iwC.<init>(<console>:99)
      15. $iwC$$iwC$$iwC.<init>(<console>:101)
      16. $iwC$$iwC.<init>(<console>:103)
      17. $iwC.<init>(<console>:105)
      17 frames