java.lang.OutOfMemoryError: Java heap space

Stack Overflow | DaveDev | 2 months ago
  1. 0

    Explain to me how the Method Profiler works in the DDMS, I get heap space error

    Stack Overflow | 7 years ago | Pentium10
    java.lang.OutOfMemoryError: Java heap space
  2. 0

    ARGO out of memory

    GitHub | 1 year ago | ggalibert
    java.lang.Error: java.lang.OutOfMemoryError: Java heap space
  3. Speed up your debug routine!

    Automated exception search integrated into your IDE

  4. 0

    Using 3.1.0-826 I have a join that run in a transformation. The sorts get completed and then the process just hangs for some time and then I get the following error: INFO 26-01 20:28:35,323 - Sort rows 2.0 - Linenr 24350000 INFO 26-01 20:28:47,578 - Device.0 - Finished processing (I=24375026, O=0, R=0, W=24375026, U=24375026, E=0) INFO 26-01 20:28:51,160 - Sort rows 2.0 - Opening 17 tmp-files... ERROR 26-01 21:05:38,848 - Sort rows 2.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:05:38,851 - Sort rows 2.0 - java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.ValueMeta.readString(ValueMeta.java:2114) at org.pentaho.di.core.row.ValueMeta.readData(ValueMeta.java:2042) at org.pentaho.di.core.row.RowMeta.readData(RowMeta.java:508) at org.pentaho.di.trans.steps.sort.SortRows.getBuffer(SortRows.java:323) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:447) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 26-01 21:05:38,860 - Sort rows 2.0 - Finished processing (I=0, O=0, R=24375026, W=3883590, U=3883590, E=1) INFO 26-01 21:05:38,864 - sorted_join - Transformation detected one or more steps with errors. ERROR 26-01 21:08:58,093 - Merge Join.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:08:58,093 - Sort rows.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:08:58,095 - Sort rows.0 - java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.RowMeta.readData(RowMeta.java:505) at org.pentaho.di.trans.steps.sort.SortRows.getBuffer(SortRows.java:323) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:447) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 26-01 21:08:58,101 - Sort rows.0 - Finished processing (I=0, O=0, R=6621023, W=10005, U=10005, E=1) INFO 26-01 21:08:58,105 - sorted_join - Transformation detected one or more steps with errors. INFO 26-01 21:08:58,108 - sorted_join - Transformation is killing the other steps! Two files are being joined, one having 10M other having 24M records. File sizes are 1655660206 and 2869424171 respectively. Both have a single key field. I initially tried with JAVAMAXMEM=2048 and then with JAVAMAXMEM=3072. That didn't complete sorting and gave me the following error - INFO 27-01 11:38:51,519 - Filter rows.0 - linenr 4100000 ERROR 27-01 11:50:23,359 - Subscriber.0 - UnexpectedError: java.lang.OutOfMemoryError: GC overhead limit exceeded ERROR 27-01 11:50:23,361 - Subscriber.0 - java.lang.OutOfMemoryError: GC overhead limit exceeded at java.nio.CharBuffer.wrap(CharBuffer.java:350) at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:291) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:158) at sun.nio.cs.StreamDecoder.read0(StreamDecoder.java:107) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:93) at java.io.InputStreamReader.read(InputStreamReader.java:151) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.getLine(TextFileInput.java:113) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.processRow(TextFileInput.java:850) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.run(TextFileInput.java:1440) INFO 27-01 11:50:23,388 - Filter rows.0 - Finished processing (I=0, O=0, R=4118124, W=2732863, U=2732863, E=0) INFO 27-01 11:50:23,389 - Subscriber.0 - Finished processing (I=4118280, O=0, R=0, W=4118280, U=4118280, E=1) INFO 27-01 11:50:23,396 - sorted_join - Transformation detected one or more steps with errors. INFO 27-01 11:50:23,399 - sorted_join - Transformation is killing the other steps! ERROR 27-01 11:50:23,429 - Sort rows.0 - UnexpectedError: java.lang.OutOfMemoryError: GC overhead limit exceeded ERROR 27-01 11:50:23,431 - Sort rows.0 - java.lang.OutOfMemoryError: GC overhead limit exceeded at java.lang.Object.clone(Native Method) at java.util.Arrays.sort(Arrays.java:1206) at java.util.Collections.sort(Collections.java:159) at org.pentaho.di.trans.steps.sort.SortRows.quickSort(SortRows.java:532) at org.pentaho.di.trans.steps.sort.SortRows.addBuffer(SortRows.java:117) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:406) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 27-01 11:50:23,436 - Device.0 - Finished processing (I=5245663, O=0, R=0, W=5245662, U=5245662, E=0) INFO 27-01 11:50:23,438 - Sort rows.0 - Finished processing (I=0, O=0, R=2732707, W=0, U=0, E=1) ERROR 27-01 11:51:05,434 - Sort rows 2.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 27-01 11:51:05,436 - Sort rows 2.0 - java.lang.OutOfMemoryError: Java heap space at java.lang.Object.clone(Native Method) at java.util.Arrays.sort(Arrays.java:1206) at java.util.Collections.sort(Collections.java:159) at org.pentaho.di.trans.steps.sort.SortRows.quickSort(SortRows.java:532) at org.pentaho.di.trans.steps.sort.SortRows.addBuffer(SortRows.java:117) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:406) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) If I try with JAVAMAXMEM=4096 I get the following error - Error occurred during initialization of VM Could not reserve enough space for ParallelScavenge old gen heap

    Pentaho BI Platform Tracking | 8 years ago | Ranadeep Bhattacharya
    java.lang.OutOfMemoryError: Java heap space
  5. 0

    Using 3.1.0-826 I have a join that run in a transformation. The sorts get completed and then the process just hangs for some time and then I get the following error: INFO 26-01 20:28:35,323 - Sort rows 2.0 - Linenr 24350000 INFO 26-01 20:28:47,578 - Device.0 - Finished processing (I=24375026, O=0, R=0, W=24375026, U=24375026, E=0) INFO 26-01 20:28:51,160 - Sort rows 2.0 - Opening 17 tmp-files... ERROR 26-01 21:05:38,848 - Sort rows 2.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:05:38,851 - Sort rows 2.0 - java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.ValueMeta.readString(ValueMeta.java:2114) at org.pentaho.di.core.row.ValueMeta.readData(ValueMeta.java:2042) at org.pentaho.di.core.row.RowMeta.readData(RowMeta.java:508) at org.pentaho.di.trans.steps.sort.SortRows.getBuffer(SortRows.java:323) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:447) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 26-01 21:05:38,860 - Sort rows 2.0 - Finished processing (I=0, O=0, R=24375026, W=3883590, U=3883590, E=1) INFO 26-01 21:05:38,864 - sorted_join - Transformation detected one or more steps with errors. ERROR 26-01 21:08:58,093 - Merge Join.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:08:58,093 - Sort rows.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:08:58,095 - Sort rows.0 - java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.RowMeta.readData(RowMeta.java:505) at org.pentaho.di.trans.steps.sort.SortRows.getBuffer(SortRows.java:323) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:447) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 26-01 21:08:58,101 - Sort rows.0 - Finished processing (I=0, O=0, R=6621023, W=10005, U=10005, E=1) INFO 26-01 21:08:58,105 - sorted_join - Transformation detected one or more steps with errors. INFO 26-01 21:08:58,108 - sorted_join - Transformation is killing the other steps! Two files are being joined, one having 10M other having 24M records. File sizes are 1655660206 and 2869424171 respectively. Both have a single key field. I initially tried with JAVAMAXMEM=2048 and then with JAVAMAXMEM=3072. That didn't complete sorting and gave me the following error - INFO 27-01 11:38:51,519 - Filter rows.0 - linenr 4100000 ERROR 27-01 11:50:23,359 - Subscriber.0 - UnexpectedError: java.lang.OutOfMemoryError: GC overhead limit exceeded ERROR 27-01 11:50:23,361 - Subscriber.0 - java.lang.OutOfMemoryError: GC overhead limit exceeded at java.nio.CharBuffer.wrap(CharBuffer.java:350) at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:291) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:158) at sun.nio.cs.StreamDecoder.read0(StreamDecoder.java:107) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:93) at java.io.InputStreamReader.read(InputStreamReader.java:151) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.getLine(TextFileInput.java:113) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.processRow(TextFileInput.java:850) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.run(TextFileInput.java:1440) INFO 27-01 11:50:23,388 - Filter rows.0 - Finished processing (I=0, O=0, R=4118124, W=2732863, U=2732863, E=0) INFO 27-01 11:50:23,389 - Subscriber.0 - Finished processing (I=4118280, O=0, R=0, W=4118280, U=4118280, E=1) INFO 27-01 11:50:23,396 - sorted_join - Transformation detected one or more steps with errors. INFO 27-01 11:50:23,399 - sorted_join - Transformation is killing the other steps! ERROR 27-01 11:50:23,429 - Sort rows.0 - UnexpectedError: java.lang.OutOfMemoryError: GC overhead limit exceeded ERROR 27-01 11:50:23,431 - Sort rows.0 - java.lang.OutOfMemoryError: GC overhead limit exceeded at java.lang.Object.clone(Native Method) at java.util.Arrays.sort(Arrays.java:1206) at java.util.Collections.sort(Collections.java:159) at org.pentaho.di.trans.steps.sort.SortRows.quickSort(SortRows.java:532) at org.pentaho.di.trans.steps.sort.SortRows.addBuffer(SortRows.java:117) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:406) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 27-01 11:50:23,436 - Device.0 - Finished processing (I=5245663, O=0, R=0, W=5245662, U=5245662, E=0) INFO 27-01 11:50:23,438 - Sort rows.0 - Finished processing (I=0, O=0, R=2732707, W=0, U=0, E=1) ERROR 27-01 11:51:05,434 - Sort rows 2.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 27-01 11:51:05,436 - Sort rows 2.0 - java.lang.OutOfMemoryError: Java heap space at java.lang.Object.clone(Native Method) at java.util.Arrays.sort(Arrays.java:1206) at java.util.Collections.sort(Collections.java:159) at org.pentaho.di.trans.steps.sort.SortRows.quickSort(SortRows.java:532) at org.pentaho.di.trans.steps.sort.SortRows.addBuffer(SortRows.java:117) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:406) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) If I try with JAVAMAXMEM=4096 I get the following error - Error occurred during initialization of VM Could not reserve enough space for ParallelScavenge old gen heap

    Pentaho BI Platform Tracking | 8 years ago | Ranadeep Bhattacharya
    java.lang.OutOfMemoryError: Java heap space

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.OutOfMemoryError

      Java heap space

      at java.lang.Object.clone()
    2. Java RT
      Collections.sort
      1. java.lang.Object.clone(Native Method)
      2. java.util.Arrays.sort(Arrays.java:1206)
      3. java.util.Collections.sort(Collections.java:157)
      3 frames
    3. Android SDK's dx Tool
      Main.main
      1. com.android.dx.dex.file.MixedItemSection.placeItems(MixedItemSection.java:301)
      2. com.android.dx.dex.file.DexFile.toDex0(DexFile.java:541)
      3. com.android.dx.dex.file.DexFile.toDex(DexFile.java:214)
      4. com.android.dx.command.dexer.Main.writeDex(Main.java:856)
      5. com.android.dx.command.dexer.Main.runMonoDex(Main.java:323)
      6. com.android.dx.command.dexer.Main.run(Main.java:277)
      7. com.android.dx.command.dexer.Main.main(Main.java:245)
      8. com.android.dx.command.Main.main(Main.java:106)
      8 frames