java.lang.OutOfMemoryError: Requested array size exceeds VM limit

nabble.com | 4 months ago
  1. 0

    Apache Spark User List - java.lang.OutOfMemoryError: Requested array size exceeds VM limit in window function in spark streaming

    nabble.com | 4 months ago
    java.lang.OutOfMemoryError: Requested array size exceeds VM limit
  2. 0

    Spark Streaming: java.lang.OutOfMemoryError: Java heap space

    Stack Overflow | 10 months ago | facha
    java.lang.OutOfMemoryError: Java heap space
  3. 0

    Spark streaming receiver Out of Memory (OOM)

    Stack Overflow | 5 months ago | X.Bin
    java.lang.OutOfMemoryError: Java heap space
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    java.lang.OutOfMemoryError: Requested array size exceeds VM limit

    Google Groups | 2 years ago | Mijung Kim
    java.lang.OutOfMemoryError: Requested array size exceeds VM limit
  6. 0

    Kryo out of memory

    Stack Overflow | 1 year ago | Eran Medan
    java.lang.OutOfMemoryError: Requested array size exceeds VM limit

    1 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.OutOfMemoryError

      Requested array size exceeds VM limit

      at java.util.Arrays.copyOf()
    2. Java RT
      BufferedOutputStream.write
      1. java.util.Arrays.copyOf(Arrays.java:3236)
      2. java.io.ByteArrayOutputStream.grow(ByteArrayOutputStream.java:113)
      3. java.io.ByteArrayOutputStream.ensureCapacity(ByteArrayOutputStream.java:93)
      4. java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:140)
      5. java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
      6. java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
      6 frames
    3. Kryo
      Kryo.writeClassAndObject
      1. com.esotericsoftware.kryo.io.Output.flush(Output.java:155)
      2. com.esotericsoftware.kryo.io.Output.require(Output.java:135)
      3. com.esotericsoftware.kryo.io.Output.writeBytes(Output.java:220)
      4. com.esotericsoftware.kryo.io.Output.writeBytes(Output.java:206)
      5. com.esotericsoftware.kryo.serializers.DefaultArraySerializers$ByteArraySerializer.write(DefaultArraySerializers.java:29)
      6. com.esotericsoftware.kryo.serializers.DefaultArraySerializers$ByteArraySerializer.write(DefaultArraySerializers.java:18)
      7. com.esotericsoftware.kryo.Kryo.writeObjectOrNull(Kryo.java:549)
      8. com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.write(FieldSerializer.java:570)
      9. com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:213)
      10. com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:501)
      11. com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.write(FieldSerializer.java:564)
      12. com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:213)
      13. com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:501)
      14. com.esotericsoftware.kryo.serializers.FieldSerializer$ObjectField.write(FieldSerializer.java:564)
      15. com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:213)
      16. com.esotericsoftware.kryo.Kryo.writeClassAndObject(Kryo.java:568)
      16 frames
    4. Spark
      RDD.iterator
      1. org.apache.spark.serializer.KryoSerializationStream.writeObject(KryoSerializer.scala:158)
      2. org.apache.spark.serializer.SerializationStream.writeAll(Serializer.scala:153)
      3. org.apache.spark.storage.BlockManager.dataSerializeStream(BlockManager.scala:1190)
      4. org.apache.spark.storage.BlockManager.dataSerialize(BlockManager.scala:1199)
      5. org.apache.spark.storage.MemoryStore.putArray(MemoryStore.scala:132)
      6. org.apache.spark.storage.BlockManager.doPut(BlockManager.scala:793)
      7. org.apache.spark.storage.BlockManager.putArray(BlockManager.scala:669)
      8. org.apache.spark.CacheManager.putInBlockManager(CacheManager.scala:175)
      9. org.apache.spark.CacheManager.getOrCompute(CacheManager.scala:78)
      10. org.apache.spark.rdd.RDD.iterator(RDD.scala:262)
      10 frames