java.lang.ClassCastException: scala.collection.immutable.Set$Set2 cannot be cast to scala.collection.Seq

DataStax JIRA | Dmytro Popovych | 1 year ago
  1. 0

    The problem was fixed in the newest versions of connector here - https://github.com/datastax/spark-cassandra-connector/commit/6601ce67f6ea3aff5f6a8132c89bdba2bf1d1d20 Is it possible to apply the same fix for 1.3? (without UTF8String) {code} java.lang.ClassCastException: scala.collection.immutable.Set$Set2 cannot be cast to scala.collection.Seq at org.apache.spark.sql.catalyst.expressions.Cast$$anonfun$castArray$1$$anonfun$apply$56.apply(Cast.scala:382) at org.apache.spark.sql.catalyst.expressions.Cast.org$apache$spark$sql$catalyst$expressions$Cast$$buildCast(Cast.scala:111) at org.apache.spark.sql.catalyst.expressions.Cast$$anonfun$castArray$1.apply(Cast.scala:382) at org.apache.spark.sql.catalyst.expressions.Cast.eval(Cast.scala:426) at org.apache.spark.sql.catalyst.expressions.Alias.eval(namedExpressions.scala:113) at org.apache.spark.sql.catalyst.expressions.InterpretedMutableProjection.apply(Projection.scala:68) at org.apache.spark.sql.catalyst.expressions.InterpretedMutableProjection.apply(Projection.scala:52) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at scala.collection.Iterator$$anon$10.next(Iterator.scala:312) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.collection.ExternalSorter.spillToPartitionFiles(ExternalSorter.scala:371) at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:211) at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:63) at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:68) at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41) at org.apache.spark.scheduler.Task.run(Task.scala:64) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) {code}

    DataStax JIRA | 1 year ago | Dmytro Popovych
    java.lang.ClassCastException: scala.collection.immutable.Set$Set2 cannot be cast to scala.collection.Seq
  2. 0

    The problem was fixed in the newest versions of connector here - https://github.com/datastax/spark-cassandra-connector/commit/6601ce67f6ea3aff5f6a8132c89bdba2bf1d1d20 Is it possible to apply the same fix for 1.3? (without UTF8String) {code} java.lang.ClassCastException: scala.collection.immutable.Set$Set2 cannot be cast to scala.collection.Seq at org.apache.spark.sql.catalyst.expressions.Cast$$anonfun$castArray$1$$anonfun$apply$56.apply(Cast.scala:382) at org.apache.spark.sql.catalyst.expressions.Cast.org$apache$spark$sql$catalyst$expressions$Cast$$buildCast(Cast.scala:111) at org.apache.spark.sql.catalyst.expressions.Cast$$anonfun$castArray$1.apply(Cast.scala:382) at org.apache.spark.sql.catalyst.expressions.Cast.eval(Cast.scala:426) at org.apache.spark.sql.catalyst.expressions.Alias.eval(namedExpressions.scala:113) at org.apache.spark.sql.catalyst.expressions.InterpretedMutableProjection.apply(Projection.scala:68) at org.apache.spark.sql.catalyst.expressions.InterpretedMutableProjection.apply(Projection.scala:52) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at scala.collection.Iterator$$anon$10.next(Iterator.scala:312) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at scala.collection.Iterator$$anon$11.next(Iterator.scala:328) at org.apache.spark.util.collection.ExternalSorter.spillToPartitionFiles(ExternalSorter.scala:371) at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:211) at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:63) at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:68) at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41) at org.apache.spark.scheduler.Task.run(Task.scala:64) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) {code}

    DataStax JIRA | 1 year ago | Dmytro Popovych
    java.lang.ClassCastException: scala.collection.immutable.Set$Set2 cannot be cast to scala.collection.Seq
  3. 0

    GitHub comment 64#121237731

    GitHub | 1 year ago | 1stdayonthejob
    java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.spark.sql.types.UTF8String
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Empty output when reading a csv file into Rstudio using SparkR

    Stack Overflow | 1 year ago | Minnie
    java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.spark.unsafe.types.UTF8String
  6. 0

    GitHub comment 206#164175406

    GitHub | 12 months ago | kamakay
    java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.spark.unsafe.types.UTF8String

    1 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.ClassCastException

      scala.collection.immutable.Set$Set2 cannot be cast to scala.collection.Seq

      at org.apache.spark.sql.catalyst.expressions.Cast$$anonfun$castArray$1$$anonfun$apply$56.apply()
    2. Spark Project Catalyst
      InterpretedMutableProjection.apply
      1. org.apache.spark.sql.catalyst.expressions.Cast$$anonfun$castArray$1$$anonfun$apply$56.apply(Cast.scala:382)
      2. org.apache.spark.sql.catalyst.expressions.Cast.org$apache$spark$sql$catalyst$expressions$Cast$$buildCast(Cast.scala:111)
      3. org.apache.spark.sql.catalyst.expressions.Cast$$anonfun$castArray$1.apply(Cast.scala:382)
      4. org.apache.spark.sql.catalyst.expressions.Cast.eval(Cast.scala:426)
      5. org.apache.spark.sql.catalyst.expressions.Alias.eval(namedExpressions.scala:113)
      6. org.apache.spark.sql.catalyst.expressions.InterpretedMutableProjection.apply(Projection.scala:68)
      7. org.apache.spark.sql.catalyst.expressions.InterpretedMutableProjection.apply(Projection.scala:52)
      7 frames
    3. Scala
      Iterator$$anon$11.next
      1. scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
      2. scala.collection.Iterator$$anon$10.next(Iterator.scala:312)
      3. scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
      4. scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
      4 frames
    4. Spark
      Executor$TaskRunner.run
      1. org.apache.spark.util.collection.ExternalSorter.spillToPartitionFiles(ExternalSorter.scala:371)
      2. org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:211)
      3. org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:63)
      4. org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:68)
      5. org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
      6. org.apache.spark.scheduler.Task.run(Task.scala:64)
      7. org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
      7 frames
    5. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      3. java.lang.Thread.run(Thread.java:745)
      3 frames