org.apache.spark.SparkException: Job aborted due to stage failure: Task 4 in stage 5.0 failed 4 times, most recent failure: Lost task 4.3 in stage 5.0 (TID 1345, dev-dn04.myorg.org): org.apache.avro.AvroTypeException: Found metadata, expecting union

Stack Overflow | Matt Pollock | 9 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    How to unnest data with SparkR?

    Stack Overflow | 9 months ago | Matt Pollock
    org.apache.spark.SparkException: Job aborted due to stage failure: Task 4 in stage 5.0 failed 4 times, most recent failure: Lost task 4.3 in stage 5.0 (TID 1345, dev-dn04.myorg.org): org.apache.avro.AvroTypeException: Found metadata, expecting union

    Root Cause Analysis

    1. org.apache.spark.SparkException

      Job aborted due to stage failure: Task 4 in stage 5.0 failed 4 times, most recent failure: Lost task 4.3 in stage 5.0 (TID 1345, dev-dn04.myorg.org): org.apache.avro.AvroTypeException: Found metadata, expecting union

      at org.apache.avro.io.ResolvingDecoder.doAction()
    2. Apache Avro
      GenericDatumReader.readRecord
      1. org.apache.avro.io.ResolvingDecoder.doAction(ResolvingDecoder.java:292)
      2. org.apache.avro.io.parsing.Parser.advance(Parser.java:88)
      3. org.apache.avro.io.ResolvingDecoder.readIndex(ResolvingDecoder.java:267)
      4. org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:155)
      5. org.apache.avro.generic.GenericDatumReader.readArray(GenericDatumReader.java:219)
      6. org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:153)
      7. org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:155)
      8. org.apache.avro.generic.GenericDatumReader.readField(GenericDatumReader.java:193)
      9. org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:183)
      9 frames