java.io.IOException: Block 124537274368 is not available in Alluxio

Google Groups | Chanh Le | 7 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    java.io.IOException: Block 5922357248 is not available in Alluxio

    Google Groups | 7 months ago | Chanh Le
    java.io.IOException: Block 124537274368 is not available in Alluxio

    Root Cause Analysis

    1. java.io.IOException

      Block 124537274368 is not available in Alluxio

      at alluxio.client.block.AlluxioBlockStore.getInStream()
    2. alluxio.client.block
      AlluxioBlockStore.getInStream
      1. alluxio.client.block.AlluxioBlockStore.getInStream(AlluxioBlockStore.java:114)
      1 frame
    3. alluxio.client.file
      FileInStream.close
      1. alluxio.client.file.FileInStream.updateBlockInStream(FileInStream.java:508)
      2. alluxio.client.file.FileInStream.updateStreams(FileInStream.java:415)
      3. alluxio.client.file.FileInStream.close(FileInStream.java:147)
      3 frames
    4. alluxio.hadoop
      HdfsFileInputStream.close
      1. alluxio.hadoop.HdfsFileInputStream.close(HdfsFileInputStream.java:108)
      1 frame
    5. Java RT
      FilterInputStream.close
      1. java.io.FilterInputStream.close(FilterInputStream.java:181)
      1 frame
    6. org.apache.parquet
      ParquetFileReader.readFooter
      1. org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:432)
      2. org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:385)
      2 frames
    7. org.apache.spark
      FileScanRDD$$anon$1.hasNext
      1. org.apache.spark.sql.execution.datasources.parquet.SpecificParquetRecordReaderBase.initialize(SpecificParquetRecordReaderBase.java:100)
      2. org.apache.spark.sql.execution.datasources.parquet.VectorizedParquetRecordReader.initialize(VectorizedParquetRecordReader.java:109)
      3. org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormat$$anonfun$buildReader$1.apply(ParquetFileFormat.scala:360)
      4. org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormat$$anonfun$buildReader$1.apply(ParquetFileFormat.scala:339)
      5. org.apache.spark.sql.execution.datasources.FileScanRDD$$anon$1.nextIterator(FileScanRDD.scala:116)
      6. org.apache.spark.sql.execution.datasources.FileScanRDD$$anon$1.hasNext(FileScanRDD.scala:91)
      6 frames
    8. Spark Project Catalyst
      GeneratedClass$GeneratedIterator.processNext
      1. org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIterator.scan_nextBatch$(Unknown Source)
      2. org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIterator.processNext(Unknown Source)
      2 frames
    9. Spark Project SQL
      SparkPlan$$anonfun$4.apply
      1. org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43)
      2. org.apache.spark.sql.execution.WholeStageCodegenExec$$anonfun$8$$anon$1.hasNext(WholeStageCodegenExec.scala:370)
      3. org.apache.spark.sql.execution.SparkPlan$$anonfun$4.apply(SparkPlan.scala:246)
      4. org.apache.spark.sql.execution.SparkPlan$$anonfun$4.apply(SparkPlan.scala:240)
      4 frames
    10. Spark
      Executor$TaskRunner.run
      1. org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$24.apply(RDD.scala:784)
      2. org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$24.apply(RDD.scala:784)
      3. org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
      4. org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:319)
      5. org.apache.spark.rdd.RDD.iterator(RDD.scala:283)
      6. org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70)
      7. org.apache.spark.scheduler.Task.run(Task.scala:85)
      8. org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274)
      8 frames
    11. Java RT
      Thread.run
      1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      3. java.lang.Thread.run(Thread.java:745)
      3 frames