java.lang.RuntimeException: javassist.NotFoundException: $iwC$$iwC$test

JIRA | Michal Malohlava | 1 year ago
tip
Your exception is missing from the Samebug knowledge base.
Here are the best solutions we found on the Internet.
Click on the to mark the helpful solution and get rewards for you help.
  1. 0

    Based on question from H2O stream (attached below) - we need to provide distributed class loading in h2o or use spark class loader to fetch newly created classes. ================= Hi Tong, the problem here is that remote nodes cannot see created class. We are missing this piece in our implementation right now. The workaround is to define and compile the class outside Spark shell and put it on the classpath of Spark shell via `--jars` option. Best regards, michal On 10/21/15 9:10 AM, Niu, Tong wrote: > > Hi Mike, > > > I defined a class test extends MRTask, but when I use it on my H2OFrame it said NotFoundException $iwC$$iwC$test > > > Following is what I wrote in sparkling-shell. How can I fix it? > > > scala> class test extends MRTask[test]{ > | override def map(c: Chunk, nc: NewChunk): Unit = { > | for (row <- 0 until c.len()) { > | nc.addNum(c.atd(row)+1) > | } > | } > | } > defined class test > > scala> h20Frame.add(new test().doAll(1, h20Frame.vec(0)).outputFrame(Array("test"), null)) > java.lang.RuntimeException: javassist.NotFoundException: $iwC$$iwC$test > at water.Weaver.genDelegate(Weaver.java:70) > at water.TypeMap.getIcer(TypeMap.java:186) > at water.TypeMap.getIcer(TypeMap.java:174) > at water.H2O$H2OCountedCompleter.icer(H2O.java:1040) > at water.H2O$H2OCountedCompleter.frozenType(H2O.java:1047) > at water.AutoBuffer.put(AutoBuffer.java:641) > at water.RPC.call(RPC.java:203) > at water.MRTask.remote_compute(MRTask.java:580) > at water.MRTask.setupLocal0(MRTask.java:533) > at water.MRTask.asyncExec(MRTask.java:478) > at water.MRTask.dfork(MRTask.java:458) > at water.MRTask.doAll(MRTask.java:385) > at water.MRTask.doAll(MRTask.java:375) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:70) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:75) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:77) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:79) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:81) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:83) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:85) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:87) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:89) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:91) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:93) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:95) > at $iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:97) > at $iwC$$iwC$$iwC$$iwC.<init>(<console>:99) > at $iwC$$iwC$$iwC.<init>(<console>:101) > at $iwC$$iwC.<init>(<console>:103) > at $iwC.<init>(<console>:105) > at <init>(<console>:107) > at .<init>(<console>:111) > at .<clinit>(<console>) > at .<init>(<console>:7) > at .<clinit>(<console>) > at $print(<console>) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.spark.repl.SparkIMain$ReadEvalPrint.call(SparkIMain.scala:1065) > at org.apache.spark.repl.SparkIMain$Request.loadAndRun(SparkIMain.scala:1338) > at org.apache.spark.repl.SparkIMain.loadAndRunReq$1(SparkIMain.scala:840) > at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:871) > at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:819) > at org.apache.spark.repl.SparkILoop.reallyInterpret$1(SparkILoop.scala:857) > at org.apache.spark.repl.SparkILoop.interpretStartingWith(SparkILoop.scala:902) > at org.apache.spark.repl.SparkILoop.command(SparkILoop.scala:814) > at org.apache.spark.repl.SparkILoop.processLine$1(SparkILoop.scala:657) > at org.apache.spark.repl.SparkILoop.innerLoop$1(SparkILoop.scala:665) > at org.apache.spark.repl.SparkILoop.org$apache$spark$repl$SparkILoop$$loop(SparkILoop.scala:670) > at org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply$mcZ$sp(SparkILoop.scala:997) > at org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply(SparkILoop.scala:945) > at org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply(SparkILoop.scala:945) > at scala.tools.nsc.util.ScalaClassLoader$.savingContextLoader(ScalaClassLoader.scala:135) > at org.apache.spark.repl.SparkILoop.org$apache$spark$repl$SparkILoop$$process(SparkILoop.scala:945) > at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:1059) > at org.apache.spark.repl.Main$.main(Main.scala:31) > at org.apache.spark.repl.Main.main(Main.scala) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:665) > at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:170) > at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:193) > at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:112) > at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > Caused by: javassist.NotFoundException: $iwC$$iwC$test > at javassist.ClassPool.get(ClassPool.java:450) > at water.Weaver.javassistLoadClass(Weaver.java:124) > at water.Weaver.genDelegate(Weaver.java:60) > > ... 67 more > > > Thanks, > > Tong > > >

    JIRA | 1 year ago | Michal Malohlava
    java.lang.RuntimeException: javassist.NotFoundException: $iwC$$iwC$test
  2. 0

    Based on question from H2O stream (attached below) - we need to provide distributed class loading in h2o or use spark class loader to fetch newly created classes. ================= Hi Tong, the problem here is that remote nodes cannot see created class. We are missing this piece in our implementation right now. The workaround is to define and compile the class outside Spark shell and put it on the classpath of Spark shell via `--jars` option. Best regards, michal On 10/21/15 9:10 AM, Niu, Tong wrote: > > Hi Mike, > > > I defined a class test extends MRTask, but when I use it on my H2OFrame it said NotFoundException $iwC$$iwC$test > > > Following is what I wrote in sparkling-shell. How can I fix it? > > > scala> class test extends MRTask[test]{ > | override def map(c: Chunk, nc: NewChunk): Unit = { > | for (row <- 0 until c.len()) { > | nc.addNum(c.atd(row)+1) > | } > | } > | } > defined class test > > scala> h20Frame.add(new test().doAll(1, h20Frame.vec(0)).outputFrame(Array("test"), null)) > java.lang.RuntimeException: javassist.NotFoundException: $iwC$$iwC$test > at water.Weaver.genDelegate(Weaver.java:70) > at water.TypeMap.getIcer(TypeMap.java:186) > at water.TypeMap.getIcer(TypeMap.java:174) > at water.H2O$H2OCountedCompleter.icer(H2O.java:1040) > at water.H2O$H2OCountedCompleter.frozenType(H2O.java:1047) > at water.AutoBuffer.put(AutoBuffer.java:641) > at water.RPC.call(RPC.java:203) > at water.MRTask.remote_compute(MRTask.java:580) > at water.MRTask.setupLocal0(MRTask.java:533) > at water.MRTask.asyncExec(MRTask.java:478) > at water.MRTask.dfork(MRTask.java:458) > at water.MRTask.doAll(MRTask.java:385) > at water.MRTask.doAll(MRTask.java:375) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:70) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:75) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:77) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:79) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:81) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:83) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:85) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:87) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:89) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:91) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:93) > at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:95) > at $iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:97) > at $iwC$$iwC$$iwC$$iwC.<init>(<console>:99) > at $iwC$$iwC$$iwC.<init>(<console>:101) > at $iwC$$iwC.<init>(<console>:103) > at $iwC.<init>(<console>:105) > at <init>(<console>:107) > at .<init>(<console>:111) > at .<clinit>(<console>) > at .<init>(<console>:7) > at .<clinit>(<console>) > at $print(<console>) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.spark.repl.SparkIMain$ReadEvalPrint.call(SparkIMain.scala:1065) > at org.apache.spark.repl.SparkIMain$Request.loadAndRun(SparkIMain.scala:1338) > at org.apache.spark.repl.SparkIMain.loadAndRunReq$1(SparkIMain.scala:840) > at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:871) > at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:819) > at org.apache.spark.repl.SparkILoop.reallyInterpret$1(SparkILoop.scala:857) > at org.apache.spark.repl.SparkILoop.interpretStartingWith(SparkILoop.scala:902) > at org.apache.spark.repl.SparkILoop.command(SparkILoop.scala:814) > at org.apache.spark.repl.SparkILoop.processLine$1(SparkILoop.scala:657) > at org.apache.spark.repl.SparkILoop.innerLoop$1(SparkILoop.scala:665) > at org.apache.spark.repl.SparkILoop.org$apache$spark$repl$SparkILoop$$loop(SparkILoop.scala:670) > at org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply$mcZ$sp(SparkILoop.scala:997) > at org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply(SparkILoop.scala:945) > at org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply(SparkILoop.scala:945) > at scala.tools.nsc.util.ScalaClassLoader$.savingContextLoader(ScalaClassLoader.scala:135) > at org.apache.spark.repl.SparkILoop.org$apache$spark$repl$SparkILoop$$process(SparkILoop.scala:945) > at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:1059) > at org.apache.spark.repl.Main$.main(Main.scala:31) > at org.apache.spark.repl.Main.main(Main.scala) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:665) > at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:170) > at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:193) > at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:112) > at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > Caused by: javassist.NotFoundException: $iwC$$iwC$test > at javassist.ClassPool.get(ClassPool.java:450) > at water.Weaver.javassistLoadClass(Weaver.java:124) > at water.Weaver.genDelegate(Weaver.java:60) > > ... 67 more > > > Thanks, > > Tong > > >

    JIRA | 1 year ago | Michal Malohlava
    java.lang.RuntimeException: javassist.NotFoundException: $iwC$$iwC$test
  3. 0

    Steps to reproduce: {code} val data = sc.parallelize((1 to 100000).map(_=>java.util.UUID.randomUUID().toString+" "+java.util.UUID.randomUUID().toString)) val schema = StructType(Seq(StructField("c1", StringType, true))) val rowRDD = data.map(Row(_)) val stringColumnTable = sqlContext.applySchema(rowRDD, schema) val h2oFrame = toDataFrame(stringColumnTable) scala> h2oFrame.vecs.map(_.get_type_str) res2: Array[String] = Array(string) scala> org.apache.spark.examples.h2o.DemoUtils.splitFrame(h2oFrame, Array("1","2","3"), Array(0.6,0.2,0.2)) onExCompletion for hex.splitframe.ShuffleSplitFrame$1@5d9445ed onExCompletion for hex.splitframe.ShuffleSplitFrame$1@5d9445ed water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.fvec.CStrChunk.atd_impl(CStrChunk.java:39) at water.fvec.Chunk.atd(Chunk.java:252) at hex.splitframe.ShuffleSplitFrame$1.map(ShuffleSplitFrame.java:40) at water.MRTask.compute2(MRTask.java:430) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) water.DException$DistributedException: from /192.168.1.4:54323; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.fvec.CStrChunk.atd_impl(CStrChunk.java:39) at water.fvec.Chunk.atd(Chunk.java:252) at hex.splitframe.ShuffleSplitFrame$1.map(ShuffleSplitFrame.java:40) at water.MRTask.compute2(MRTask.java:430) at water.MRTask.compute2(MRTask.java:374) at water.MRTask.compute2(MRTask.java:374) at water.MRTask.compute2(MRTask.java:374) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.4:54327; by class hex.splitframe.ShuffleSplitFrame$1; class water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.MRTask.getResult(MRTask.java:265) at water.MRTask.doAll(MRTask.java:220) at water.MRTask.doAll(MRTask.java:217) at hex.splitframe.ShuffleSplitFrame.shuffleSplitFrame(ShuffleSplitFrame.java:29) at org.apache.spark.examples.h2o.DemoUtils$.splitFrame(DemoUtils.scala:110) at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:35) at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:40) at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:42) at $iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:44) at $iwC$$iwC$$iwC$$iwC.<init>(<console>:46) at $iwC$$iwC$$iwC.<init>(<console>:48) at $iwC$$iwC.<init>(<console>:50) at $iwC.<init>(<console>:52) at <init>(<console>:54) at .<init>(<console>:58) at .<clinit>(<console>) at .<init>(<console>:7) at .<clinit>(<console>) at $print(<console>) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.spark.repl.SparkIMain$ReadEvalPrint.call(SparkIMain.scala:852) at org.apache.spark.repl.SparkIMain$Request.loadAndRun(SparkIMain.scala:1125) at org.apache.spark.repl.SparkIMain.loadAndRunReq$1(SparkIMain.scala:674) at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:705) at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:669) at org.apache.spark.repl.SparkILoop.reallyInterpret$1(SparkILoop.scala:828) at org.apache.spark.repl.SparkILoop.interpretStartingWith(SparkILoop.scala:873) at org.apache.spark.repl.SparkILoop.command(SparkILoop.scala:785) at org.apache.spark.repl.SparkILoop.processLine$1(SparkILoop.scala:628) at org.apache.spark.repl.SparkILoop.innerLoop$1(SparkILoop.scala:636) at org.apache.spark.repl.SparkILoop.loop(SparkILoop.scala:641) at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply$mcZ$sp(SparkILoop.scala:968) at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply(SparkILoop.scala:916) at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply(SparkILoop.scala:916) at scala.tools.nsc.util.ScalaClassLoader$.savingContextLoader(ScalaClassLoader.scala:135) at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:916) at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:1011) at org.apache.spark.repl.Main$.main(Main.scala:31) at org.apache.spark.repl.Main.main(Main.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:358) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) Caused by: water.DException$DistributedException: from /192.168.1.4:54327; by class hex.splitframe.ShuffleSplitFrame$1; class water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.fvec.CStrChunk.atd_impl(CStrChunk.java:39) at water.fvec.Chunk.atd(Chunk.java:252) at hex.splitframe.ShuffleSplitFrame$1.map(ShuffleSplitFrame.java:40) at water.MRTask.compute2(MRTask.java:430) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) {code} Reproduced on this build: http://h2o-release.s3.amazonaws.com/sparkling-water/master/86/index.html

    JIRA | 2 years ago | Peter Rudenko
    java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.4:54327; by class hex.splitframe.ShuffleSplitFrame$1; class water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector.
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    whd_orig <- h2o.uploadFile(locate("smalldata/demos/whd_whisard_truncated.zip"), col.types = c(rep("enum", 7), rep("numeric", 97))) zip_to_zcta <- h2o.uploadFile(locate("smalldata/demos/Zip_to_ZCTA_Crosswalk_JSI2014.csv"), col.types = rep("enum", 5)) zip_to_zcta_map <- zip_to_zcta[,colnames(zip_to_zcta) %in% c("ZIP", "ZCTA_crosswalk")] colnames(zip_to_zcta_map) <- c("zip_cd", "ZCTA5") whd_zcta <- h2o.merge(whd_orig, zip_to_zcta_map, all.x = TRUE, all.y = FALSE) whd_zcta$zip_cd <- NULL print(summary(whd_zcta)) onExCompletion for water.rapids.ASTMerge$MergeSet$MakeHash@53034cc9 java.lang.ArrayIndexOutOfBoundsException: 26589 at water.rapids.ASTMerge$Row.fill(ASTMerge.java:138) at water.rapids.ASTMerge$MergeSet$MakeHash.map(ASTMerge.java:195) at water.MRTask.compute2(MRTask.java:657) at water.H2O$H2OCountedCompleter.compute(H2O.java:1005) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.RuntimeException: water.DException$DistributedException: from /172.16.2.73:54321; by class water.rapids.ASTMerge$MergeSet$MakeHash; class java.lang.ArrayIndexOutOfBoundsException: 26589 at water.MRTask.getResult(MRTask.java:505) at water.MRTask.doAll(MRTask.java:386) at water.MRTask.doAll(MRTask.java:381) at water.rapids.ASTMerge$MergeSet.setupLocal(ASTMerge.java:185) at water.MRTask.setupLocal0(MRTask.java:580) at water.MRTask.doAll(MRTask.java:398) at water.MRTask.doAllNodes(MRTask.java:417) at water.rapids.ASTMerge.apply(ASTMerge.java:109) at water.rapids.AST.treeWalk(AST.java:74) at water.rapids.AST.treeWalk(AST.java:84) at water.rapids.Exec.exec(Exec.java:68) at water.api.RapidsHandler.exec(RapidsHandler.java:37) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at water.api.Handler.handle(Handler.java:58) at water.api.RequestServer.handle(RequestServer.java:635) at water.api.RequestServer.serve(RequestServer.java:576) at water.JettyHTTPD$H2oDefaultServlet.doGeneric(JettyHTTPD.java:559) at water.JettyHTTPD$H2oDefaultServlet.doPost(JettyHTTPD.java:507) at javax.servlet.http.HttpServlet.service(HttpServlet.java:755) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:370) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:494) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:982) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1043) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:865) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745)

    JIRA | 2 years ago | Anqi Fu
    java.lang.RuntimeException: water.DException$DistributedException: from /172.16.2.73:54321; by class water.rapids.ASTMerge$MergeSet$MakeHash; class java.lang.ArrayIndexOutOfBoundsException: 26589
  6. 0

    Steps to reproduce: {code} val data = sc.parallelize((1 to 100000).map(_=>java.util.UUID.randomUUID().toString+" "+java.util.UUID.randomUUID().toString)) val schema = StructType(Seq(StructField("c1", StringType, true))) val rowRDD = data.map(Row(_)) val stringColumnTable = sqlContext.applySchema(rowRDD, schema) val h2oFrame = toDataFrame(stringColumnTable) scala> h2oFrame.vecs.map(_.get_type_str) res2: Array[String] = Array(string) scala> org.apache.spark.examples.h2o.DemoUtils.splitFrame(h2oFrame, Array("1","2","3"), Array(0.6,0.2,0.2)) onExCompletion for hex.splitframe.ShuffleSplitFrame$1@5d9445ed onExCompletion for hex.splitframe.ShuffleSplitFrame$1@5d9445ed water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.fvec.CStrChunk.atd_impl(CStrChunk.java:39) at water.fvec.Chunk.atd(Chunk.java:252) at hex.splitframe.ShuffleSplitFrame$1.map(ShuffleSplitFrame.java:40) at water.MRTask.compute2(MRTask.java:430) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) water.DException$DistributedException: from /192.168.1.4:54323; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.fvec.CStrChunk.atd_impl(CStrChunk.java:39) at water.fvec.Chunk.atd(Chunk.java:252) at hex.splitframe.ShuffleSplitFrame$1.map(ShuffleSplitFrame.java:40) at water.MRTask.compute2(MRTask.java:430) at water.MRTask.compute2(MRTask.java:374) at water.MRTask.compute2(MRTask.java:374) at water.MRTask.compute2(MRTask.java:374) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.4:54327; by class hex.splitframe.ShuffleSplitFrame$1; class water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.MRTask.getResult(MRTask.java:265) at water.MRTask.doAll(MRTask.java:220) at water.MRTask.doAll(MRTask.java:217) at hex.splitframe.ShuffleSplitFrame.shuffleSplitFrame(ShuffleSplitFrame.java:29) at org.apache.spark.examples.h2o.DemoUtils$.splitFrame(DemoUtils.scala:110) at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:35) at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:40) at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:42) at $iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:44) at $iwC$$iwC$$iwC$$iwC.<init>(<console>:46) at $iwC$$iwC$$iwC.<init>(<console>:48) at $iwC$$iwC.<init>(<console>:50) at $iwC.<init>(<console>:52) at <init>(<console>:54) at .<init>(<console>:58) at .<clinit>(<console>) at .<init>(<console>:7) at .<clinit>(<console>) at $print(<console>) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.spark.repl.SparkIMain$ReadEvalPrint.call(SparkIMain.scala:852) at org.apache.spark.repl.SparkIMain$Request.loadAndRun(SparkIMain.scala:1125) at org.apache.spark.repl.SparkIMain.loadAndRunReq$1(SparkIMain.scala:674) at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:705) at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:669) at org.apache.spark.repl.SparkILoop.reallyInterpret$1(SparkILoop.scala:828) at org.apache.spark.repl.SparkILoop.interpretStartingWith(SparkILoop.scala:873) at org.apache.spark.repl.SparkILoop.command(SparkILoop.scala:785) at org.apache.spark.repl.SparkILoop.processLine$1(SparkILoop.scala:628) at org.apache.spark.repl.SparkILoop.innerLoop$1(SparkILoop.scala:636) at org.apache.spark.repl.SparkILoop.loop(SparkILoop.scala:641) at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply$mcZ$sp(SparkILoop.scala:968) at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply(SparkILoop.scala:916) at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply(SparkILoop.scala:916) at scala.tools.nsc.util.ScalaClassLoader$.savingContextLoader(ScalaClassLoader.scala:135) at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:916) at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:1011) at org.apache.spark.repl.Main$.main(Main.scala:31) at org.apache.spark.repl.Main.main(Main.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:358) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) Caused by: water.DException$DistributedException: from /192.168.1.4:54327; by class hex.splitframe.ShuffleSplitFrame$1; class water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector. at water.fvec.CStrChunk.atd_impl(CStrChunk.java:39) at water.fvec.Chunk.atd(Chunk.java:252) at hex.splitframe.ShuffleSplitFrame$1.map(ShuffleSplitFrame.java:40) at water.MRTask.compute2(MRTask.java:430) at water.H2O$H2OCountedCompleter.compute(H2O.java:582) at jsr166y.CountedCompleter.exec(CountedCompleter.java:429) at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263) at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974) at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477) at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104) {code} Reproduced on this build: http://h2o-release.s3.amazonaws.com/sparkling-water/master/86/index.html

    JIRA | 2 years ago | Peter Rudenko
    java.lang.RuntimeException: water.DException$DistributedException: from /192.168.1.4:54327; by class hex.splitframe.ShuffleSplitFrame$1; class water.DException$DistributedException: from /192.168.1.4:54321; by class hex.splitframe.ShuffleSplitFrame$1; class java.lang.IllegalArgumentException: Operation not allowed on string vector.

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.RuntimeException

      javassist.NotFoundException: $iwC$$iwC$test

      at water.Weaver.genDelegate()
    2. water
      MRTask.doAll
      1. water.Weaver.genDelegate(Weaver.java:70)
      2. water.TypeMap.getIcer(TypeMap.java:186)
      3. water.TypeMap.getIcer(TypeMap.java:174)
      4. water.H2O$H2OCountedCompleter.icer(H2O.java:1040)
      5. water.H2O$H2OCountedCompleter.frozenType(H2O.java:1047)
      6. water.AutoBuffer.put(AutoBuffer.java:641)
      7. water.RPC.call(RPC.java:203)
      8. water.MRTask.remote_compute(MRTask.java:580)
      9. water.MRTask.setupLocal0(MRTask.java:533)
      10. water.MRTask.asyncExec(MRTask.java:478)
      11. water.MRTask.dfork(MRTask.java:458)
      12. water.MRTask.doAll(MRTask.java:385)
      13. water.MRTask.doAll(MRTask.java:375)
      13 frames
    3. Unknown
      $iwC.<init>
      1. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:70)
      2. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:75)
      3. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:77)
      4. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:79)
      5. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:81)
      6. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:83)
      7. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:85)
      8. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:87)
      9. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:89)
      10. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:91)
      11. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:93)
      12. $iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:95)
      13. $iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:97)
      14. $iwC$$iwC$$iwC$$iwC.<init>(<console>:99)
      15. $iwC$$iwC$$iwC.<init>(<console>:101)
      16. $iwC$$iwC.<init>(<console>:103)
      17. $iwC.<init>(<console>:105)
      17 frames