java.lang.OutOfMemoryError

There are no available Samebug tips for this exception. Do you have an idea how to solve this issue? A short tip would help users who saw this issue last week.

  • ARGO out of memory
    via GitHub by ggalibert
    ,
  • Using 3.1.0-826 I have a join that run in a transformation. The sorts get completed and then the process just hangs for some time and then I get the following error: INFO 26-01 20:28:35,323 - Sort rows 2.0 - Linenr 24350000 INFO 26-01 20:28:47,578 - Device.0 - Finished processing (I=24375026, O=0, R=0, W=24375026, U=24375026, E=0) INFO 26-01 20:28:51,160 - Sort rows 2.0 - Opening 17 tmp-files... ERROR 26-01 21:05:38,848 - Sort rows 2.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:05:38,851 - Sort rows 2.0 - java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.ValueMeta.readString(ValueMeta.java:2114) at org.pentaho.di.core.row.ValueMeta.readData(ValueMeta.java:2042) at org.pentaho.di.core.row.RowMeta.readData(RowMeta.java:508) at org.pentaho.di.trans.steps.sort.SortRows.getBuffer(SortRows.java:323) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:447) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 26-01 21:05:38,860 - Sort rows 2.0 - Finished processing (I=0, O=0, R=24375026, W=3883590, U=3883590, E=1) INFO 26-01 21:05:38,864 - sorted_join - Transformation detected one or more steps with errors. ERROR 26-01 21:08:58,093 - Merge Join.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:08:58,093 - Sort rows.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:08:58,095 - Sort rows.0 - java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.RowMeta.readData(RowMeta.java:505) at org.pentaho.di.trans.steps.sort.SortRows.getBuffer(SortRows.java:323) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:447) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 26-01 21:08:58,101 - Sort rows.0 - Finished processing (I=0, O=0, R=6621023, W=10005, U=10005, E=1) INFO 26-01 21:08:58,105 - sorted_join - Transformation detected one or more steps with errors. INFO 26-01 21:08:58,108 - sorted_join - Transformation is killing the other steps! Two files are being joined, one having 10M other having 24M records. File sizes are 1655660206 and 2869424171 respectively. Both have a single key field. I initially tried with JAVAMAXMEM=2048 and then with JAVAMAXMEM=3072. That didn't complete sorting and gave me the following error - INFO 27-01 11:38:51,519 - Filter rows.0 - linenr 4100000 ERROR 27-01 11:50:23,359 - Subscriber.0 - UnexpectedError: java.lang.OutOfMemoryError: GC overhead limit exceeded ERROR 27-01 11:50:23,361 - Subscriber.0 - java.lang.OutOfMemoryError: GC overhead limit exceeded at java.nio.CharBuffer.wrap(CharBuffer.java:350) at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:291) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:158) at sun.nio.cs.StreamDecoder.read0(StreamDecoder.java:107) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:93) at java.io.InputStreamReader.read(InputStreamReader.java:151) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.getLine(TextFileInput.java:113) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.processRow(TextFileInput.java:850) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.run(TextFileInput.java:1440) INFO 27-01 11:50:23,388 - Filter rows.0 - Finished processing (I=0, O=0, R=4118124, W=2732863, U=2732863, E=0) INFO 27-01 11:50:23,389 - Subscriber.0 - Finished processing (I=4118280, O=0, R=0, W=4118280, U=4118280, E=1) INFO 27-01 11:50:23,396 - sorted_join - Transformation detected one or more steps with errors. INFO 27-01 11:50:23,399 - sorted_join - Transformation is killing the other steps! ERROR 27-01 11:50:23,429 - Sort rows.0 - UnexpectedError: java.lang.OutOfMemoryError: GC overhead limit exceeded ERROR 27-01 11:50:23,431 - Sort rows.0 - java.lang.OutOfMemoryError: GC overhead limit exceeded at java.lang.Object.clone(Native Method) at java.util.Arrays.sort(Arrays.java:1206) at java.util.Collections.sort(Collections.java:159) at org.pentaho.di.trans.steps.sort.SortRows.quickSort(SortRows.java:532) at org.pentaho.di.trans.steps.sort.SortRows.addBuffer(SortRows.java:117) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:406) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 27-01 11:50:23,436 - Device.0 - Finished processing (I=5245663, O=0, R=0, W=5245662, U=5245662, E=0) INFO 27-01 11:50:23,438 - Sort rows.0 - Finished processing (I=0, O=0, R=2732707, W=0, U=0, E=1) ERROR 27-01 11:51:05,434 - Sort rows 2.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 27-01 11:51:05,436 - Sort rows 2.0 - java.lang.OutOfMemoryError: Java heap space at java.lang.Object.clone(Native Method) at java.util.Arrays.sort(Arrays.java:1206) at java.util.Collections.sort(Collections.java:159) at org.pentaho.di.trans.steps.sort.SortRows.quickSort(SortRows.java:532) at org.pentaho.di.trans.steps.sort.SortRows.addBuffer(SortRows.java:117) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:406) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) If I try with JAVAMAXMEM=4096 I get the following error - Error occurred during initialization of VM Could not reserve enough space for ParallelScavenge old gen heap
    via by Ranadeep Bhattacharya,
  • Using 3.1.0-826 I have a join that run in a transformation. The sorts get completed and then the process just hangs for some time and then I get the following error: INFO 26-01 20:28:35,323 - Sort rows 2.0 - Linenr 24350000 INFO 26-01 20:28:47,578 - Device.0 - Finished processing (I=24375026, O=0, R=0, W=24375026, U=24375026, E=0) INFO 26-01 20:28:51,160 - Sort rows 2.0 - Opening 17 tmp-files... ERROR 26-01 21:05:38,848 - Sort rows 2.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:05:38,851 - Sort rows 2.0 - java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.ValueMeta.readString(ValueMeta.java:2114) at org.pentaho.di.core.row.ValueMeta.readData(ValueMeta.java:2042) at org.pentaho.di.core.row.RowMeta.readData(RowMeta.java:508) at org.pentaho.di.trans.steps.sort.SortRows.getBuffer(SortRows.java:323) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:447) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 26-01 21:05:38,860 - Sort rows 2.0 - Finished processing (I=0, O=0, R=24375026, W=3883590, U=3883590, E=1) INFO 26-01 21:05:38,864 - sorted_join - Transformation detected one or more steps with errors. ERROR 26-01 21:08:58,093 - Merge Join.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:08:58,093 - Sort rows.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:08:58,095 - Sort rows.0 - java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.RowMeta.readData(RowMeta.java:505) at org.pentaho.di.trans.steps.sort.SortRows.getBuffer(SortRows.java:323) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:447) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 26-01 21:08:58,101 - Sort rows.0 - Finished processing (I=0, O=0, R=6621023, W=10005, U=10005, E=1) INFO 26-01 21:08:58,105 - sorted_join - Transformation detected one or more steps with errors. INFO 26-01 21:08:58,108 - sorted_join - Transformation is killing the other steps! Two files are being joined, one having 10M other having 24M records. File sizes are 1655660206 and 2869424171 respectively. Both have a single key field. I initially tried with JAVAMAXMEM=2048 and then with JAVAMAXMEM=3072. That didn't complete sorting and gave me the following error - INFO 27-01 11:38:51,519 - Filter rows.0 - linenr 4100000 ERROR 27-01 11:50:23,359 - Subscriber.0 - UnexpectedError: java.lang.OutOfMemoryError: GC overhead limit exceeded ERROR 27-01 11:50:23,361 - Subscriber.0 - java.lang.OutOfMemoryError: GC overhead limit exceeded at java.nio.CharBuffer.wrap(CharBuffer.java:350) at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:291) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:158) at sun.nio.cs.StreamDecoder.read0(StreamDecoder.java:107) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:93) at java.io.InputStreamReader.read(InputStreamReader.java:151) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.getLine(TextFileInput.java:113) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.processRow(TextFileInput.java:850) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.run(TextFileInput.java:1440) INFO 27-01 11:50:23,388 - Filter rows.0 - Finished processing (I=0, O=0, R=4118124, W=2732863, U=2732863, E=0) INFO 27-01 11:50:23,389 - Subscriber.0 - Finished processing (I=4118280, O=0, R=0, W=4118280, U=4118280, E=1) INFO 27-01 11:50:23,396 - sorted_join - Transformation detected one or more steps with errors. INFO 27-01 11:50:23,399 - sorted_join - Transformation is killing the other steps! ERROR 27-01 11:50:23,429 - Sort rows.0 - UnexpectedError: java.lang.OutOfMemoryError: GC overhead limit exceeded ERROR 27-01 11:50:23,431 - Sort rows.0 - java.lang.OutOfMemoryError: GC overhead limit exceeded at java.lang.Object.clone(Native Method) at java.util.Arrays.sort(Arrays.java:1206) at java.util.Collections.sort(Collections.java:159) at org.pentaho.di.trans.steps.sort.SortRows.quickSort(SortRows.java:532) at org.pentaho.di.trans.steps.sort.SortRows.addBuffer(SortRows.java:117) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:406) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 27-01 11:50:23,436 - Device.0 - Finished processing (I=5245663, O=0, R=0, W=5245662, U=5245662, E=0) INFO 27-01 11:50:23,438 - Sort rows.0 - Finished processing (I=0, O=0, R=2732707, W=0, U=0, E=1) ERROR 27-01 11:51:05,434 - Sort rows 2.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 27-01 11:51:05,436 - Sort rows 2.0 - java.lang.OutOfMemoryError: Java heap space at java.lang.Object.clone(Native Method) at java.util.Arrays.sort(Arrays.java:1206) at java.util.Collections.sort(Collections.java:159) at org.pentaho.di.trans.steps.sort.SortRows.quickSort(SortRows.java:532) at org.pentaho.di.trans.steps.sort.SortRows.addBuffer(SortRows.java:117) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:406) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) If I try with JAVAMAXMEM=4096 I get the following error - Error occurred during initialization of VM Could not reserve enough space for ParallelScavenge old gen heap
    via by Ranadeep Bhattacharya,
  • [Mifos-developer] FW: mifos on 64-bit
    via by Adam Feuer,
  • OutOfMemoryError: Java heap space
    via by 843802,
    • java.lang.OutOfMemoryError: Java heap space at java.lang.Object.clone(Native Method) at java.util.Arrays.sort(Arrays.java:1206) at java.util.Collections.sort(Collections.java:157) at com.android.dx.dex.file.MixedItemSection.placeItems(MixedItemSection.java:301) at com.android.dx.dex.file.DexFile.toDex0(DexFile.java:541) at com.android.dx.dex.file.DexFile.toDex(DexFile.java:214) at com.android.dx.command.dexer.Main.writeDex(Main.java:856) at com.android.dx.command.dexer.Main.runMonoDex(Main.java:323) at com.android.dx.command.dexer.Main.run(Main.java:277) at com.android.dx.command.dexer.Main.main(Main.java:245) at com.android.dx.command.Main.main(Main.java:106)

    Users with the same issue

    Unknown visitor1 times, last one,