org.apache.spark.SparkException: Job aborted due to stage failure: Task 2 in stage 10.0 failed 1 times, most recent failure: Lost task 2.0 in stage 10.0 (TID 36, localhost): java.lang.ArrayIndexOutOfBoundsException: 12

Stack Overflow | Tim Ryan | 6 months ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Is the Scala Breeze package thread safe for use in Spark Dataframe processing?

    Stack Overflow | 6 months ago | Tim Ryan
    org.apache.spark.SparkException: Job aborted due to stage failure: Task 2 in stage 10.0 failed 1 times, most recent failure: Lost task 2.0 in stage 10.0 (TID 36, localhost): java.lang.ArrayIndexOutOfBoundsException: 12

    Root Cause Analysis

    1. org.apache.spark.SparkException

      Job aborted due to stage failure: Task 2 in stage 10.0 failed 1 times, most recent failure: Lost task 2.0 in stage 10.0 (TID 36, localhost): java.lang.ArrayIndexOutOfBoundsException: 12

      at edu.emory.mathcs.jtransforms.fft.DoubleFFT_1D.passfg()
    2. edu.emory.mathcs
      DoubleFFT_1D.complexForward
      1. edu.emory.mathcs.jtransforms.fft.DoubleFFT_1D.passfg(DoubleFFT_1D.java:3843)
      2. edu.emory.mathcs.jtransforms.fft.DoubleFFT_1D.cfftf(DoubleFFT_1D.java:3390)
      3. edu.emory.mathcs.jtransforms.fft.DoubleFFT_1D.complexForward(DoubleFFT_1D.java:189)
      4. edu.emory.mathcs.jtransforms.fft.DoubleFFT_1D.complexForward(DoubleFFT_1D.java:161)
      4 frames
    3. breeze.signal
      fourierTr$$anon$5.apply
      1. breeze.signal.fourierTr$$anon$5.apply(fourierTr.scala:69)
      2. breeze.signal.fourierTr$$anon$5.apply(fourierTr.scala:62)
      2 frames
    4. breeze.generic
      UFunc$class.apply
      1. breeze.generic.UFunc$class.apply(UFunc.scala:48)
      1 frame
    5. breeze.signal
      fourierTr$.apply
      1. breeze.signal.fourierTr$.apply(fourierTr.scala:25)
      1 frame