java.lang.OutOfMemoryError

There are no available Samebug tips for this exception. Do you have an idea how to solve this issue? A short tip would help users who saw this issue last week.

  • Build BISERVER-EE (252) There are two stack traces below. The first is on Windows trying to start BISERVER, the second is from running spoon on a Mac. Both of these ran out of memory. Rob was able to fix his by raising spoon memory to over a gig. I brought BISERVER memory up to 1536m and still ran out of memory. Windows/BISERVER-EE INFO 29-11 16:14:23,871 - Audit Transformation - Loading transformation from XML file [C:/env/biserver-ee/biserver-ee-2 52/pentaho-solutions//system/audit/dialects/h2/AuditTransformFileInput.ktr] ERROR 29-11 16:14:24,356 - PrepareAuditTransformFileInput - java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.ValueMeta.readString(ValueMeta.java:2249) at org.pentaho.di.core.row.ValueMeta.<init>(ValueMeta.java:2532) at org.pentaho.di.core.row.RowMeta.<init>(RowMeta.java:535) at org.pentaho.di.core.DBCache.<init>(DBCache.java:173) at org.pentaho.di.core.DBCache.getInstance(DBCache.java:261) at org.pentaho.di.trans.TransMeta.clear(TransMeta.java:749) at org.pentaho.di.trans.TransMeta.loadXML(TransMeta.java:2888) at org.pentaho.di.trans.TransMeta.<init>(TransMeta.java:2784) at org.pentaho.di.trans.TransMeta.<init>(TransMeta.java:2748) at org.pentaho.di.job.entries.trans.JobEntryTrans.getTransMeta(JobEntryTrans.java:1158) at org.pentaho.di.job.entries.trans.JobEntryTrans.execute(JobEntryTrans.java:621) at org.pentaho.di.job.Job.execute(Job.java:693) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:497) at org.pentaho.di.job.Job.run(Job.java:403) ===================================================================================== Mac/Spoon INFO 29-11 15:27:22,422 - Spoon - Logging goes to file:///var/folders/6z/hw0q2dg559lcqmb_vbpzm5k40000gp/T/spoon_2e1a8791-3a63-11e2-a01a-efbba3ac64fb.log java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.ValueMeta.readString(ValueMeta.java:2249) at org.pentaho.di.core.row.ValueMeta.<init>(ValueMeta.java:2532) at org.pentaho.di.core.row.RowMeta.<init>(RowMeta.java:535) at org.pentaho.di.core.DBCache.<init>(DBCache.java:173) at org.pentaho.di.core.DBCache.getInstance(DBCache.java:261) at org.pentaho.di.ui.spoon.Spoon.loadSettings(Spoon.java:6453) at org.pentaho.di.ui.spoon.Spoon.init(Spoon.java:711) at org.pentaho.di.ui.spoon.Spoon.createContents(Spoon.java:8376) at org.eclipse.jface.window.Window.create(Window.java:426) at org.eclipse.jface.window.Window.open(Window.java:785) at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:8407) at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:594) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.pentaho.commons.launcher.Launcher.main(Launcher.java:134) stopping
    via by Tim Kafalas,
  • Build BISERVER-EE (252) There are two stack traces below. The first is on Windows trying to start BISERVER, the second is from running spoon on a Mac. Both of these ran out of memory. Rob was able to fix his by raising spoon memory to over a gig. I brought BISERVER memory up to 1536m and still ran out of memory. Windows/BISERVER-EE INFO 29-11 16:14:23,871 - Audit Transformation - Loading transformation from XML file [C:/env/biserver-ee/biserver-ee-2 52/pentaho-solutions//system/audit/dialects/h2/AuditTransformFileInput.ktr] ERROR 29-11 16:14:24,356 - PrepareAuditTransformFileInput - java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.ValueMeta.readString(ValueMeta.java:2249) at org.pentaho.di.core.row.ValueMeta.<init>(ValueMeta.java:2532) at org.pentaho.di.core.row.RowMeta.<init>(RowMeta.java:535) at org.pentaho.di.core.DBCache.<init>(DBCache.java:173) at org.pentaho.di.core.DBCache.getInstance(DBCache.java:261) at org.pentaho.di.trans.TransMeta.clear(TransMeta.java:749) at org.pentaho.di.trans.TransMeta.loadXML(TransMeta.java:2888) at org.pentaho.di.trans.TransMeta.<init>(TransMeta.java:2784) at org.pentaho.di.trans.TransMeta.<init>(TransMeta.java:2748) at org.pentaho.di.job.entries.trans.JobEntryTrans.getTransMeta(JobEntryTrans.java:1158) at org.pentaho.di.job.entries.trans.JobEntryTrans.execute(JobEntryTrans.java:621) at org.pentaho.di.job.Job.execute(Job.java:693) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:497) at org.pentaho.di.job.Job.run(Job.java:403) ===================================================================================== Mac/Spoon INFO 29-11 15:27:22,422 - Spoon - Logging goes to file:///var/folders/6z/hw0q2dg559lcqmb_vbpzm5k40000gp/T/spoon_2e1a8791-3a63-11e2-a01a-efbba3ac64fb.log java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.ValueMeta.readString(ValueMeta.java:2249) at org.pentaho.di.core.row.ValueMeta.<init>(ValueMeta.java:2532) at org.pentaho.di.core.row.RowMeta.<init>(RowMeta.java:535) at org.pentaho.di.core.DBCache.<init>(DBCache.java:173) at org.pentaho.di.core.DBCache.getInstance(DBCache.java:261) at org.pentaho.di.ui.spoon.Spoon.loadSettings(Spoon.java:6453) at org.pentaho.di.ui.spoon.Spoon.init(Spoon.java:711) at org.pentaho.di.ui.spoon.Spoon.createContents(Spoon.java:8376) at org.eclipse.jface.window.Window.create(Window.java:426) at org.eclipse.jface.window.Window.open(Window.java:785) at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:8407) at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:594) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.pentaho.commons.launcher.Launcher.main(Launcher.java:134) stopping
    via by Tim Kafalas,
  • Using 3.1.0-826 I have a join that run in a transformation. The sorts get completed and then the process just hangs for some time and then I get the following error: INFO 26-01 20:28:35,323 - Sort rows 2.0 - Linenr 24350000 INFO 26-01 20:28:47,578 - Device.0 - Finished processing (I=24375026, O=0, R=0, W=24375026, U=24375026, E=0) INFO 26-01 20:28:51,160 - Sort rows 2.0 - Opening 17 tmp-files... ERROR 26-01 21:05:38,848 - Sort rows 2.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:05:38,851 - Sort rows 2.0 - java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.ValueMeta.readString(ValueMeta.java:2114) at org.pentaho.di.core.row.ValueMeta.readData(ValueMeta.java:2042) at org.pentaho.di.core.row.RowMeta.readData(RowMeta.java:508) at org.pentaho.di.trans.steps.sort.SortRows.getBuffer(SortRows.java:323) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:447) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 26-01 21:05:38,860 - Sort rows 2.0 - Finished processing (I=0, O=0, R=24375026, W=3883590, U=3883590, E=1) INFO 26-01 21:05:38,864 - sorted_join - Transformation detected one or more steps with errors. ERROR 26-01 21:08:58,093 - Merge Join.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:08:58,093 - Sort rows.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:08:58,095 - Sort rows.0 - java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.RowMeta.readData(RowMeta.java:505) at org.pentaho.di.trans.steps.sort.SortRows.getBuffer(SortRows.java:323) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:447) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 26-01 21:08:58,101 - Sort rows.0 - Finished processing (I=0, O=0, R=6621023, W=10005, U=10005, E=1) INFO 26-01 21:08:58,105 - sorted_join - Transformation detected one or more steps with errors. INFO 26-01 21:08:58,108 - sorted_join - Transformation is killing the other steps! Two files are being joined, one having 10M other having 24M records. File sizes are 1655660206 and 2869424171 respectively. Both have a single key field. I initially tried with JAVAMAXMEM=2048 and then with JAVAMAXMEM=3072. That didn't complete sorting and gave me the following error - INFO 27-01 11:38:51,519 - Filter rows.0 - linenr 4100000 ERROR 27-01 11:50:23,359 - Subscriber.0 - UnexpectedError: java.lang.OutOfMemoryError: GC overhead limit exceeded ERROR 27-01 11:50:23,361 - Subscriber.0 - java.lang.OutOfMemoryError: GC overhead limit exceeded at java.nio.CharBuffer.wrap(CharBuffer.java:350) at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:291) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:158) at sun.nio.cs.StreamDecoder.read0(StreamDecoder.java:107) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:93) at java.io.InputStreamReader.read(InputStreamReader.java:151) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.getLine(TextFileInput.java:113) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.processRow(TextFileInput.java:850) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.run(TextFileInput.java:1440) INFO 27-01 11:50:23,388 - Filter rows.0 - Finished processing (I=0, O=0, R=4118124, W=2732863, U=2732863, E=0) INFO 27-01 11:50:23,389 - Subscriber.0 - Finished processing (I=4118280, O=0, R=0, W=4118280, U=4118280, E=1) INFO 27-01 11:50:23,396 - sorted_join - Transformation detected one or more steps with errors. INFO 27-01 11:50:23,399 - sorted_join - Transformation is killing the other steps! ERROR 27-01 11:50:23,429 - Sort rows.0 - UnexpectedError: java.lang.OutOfMemoryError: GC overhead limit exceeded ERROR 27-01 11:50:23,431 - Sort rows.0 - java.lang.OutOfMemoryError: GC overhead limit exceeded at java.lang.Object.clone(Native Method) at java.util.Arrays.sort(Arrays.java:1206) at java.util.Collections.sort(Collections.java:159) at org.pentaho.di.trans.steps.sort.SortRows.quickSort(SortRows.java:532) at org.pentaho.di.trans.steps.sort.SortRows.addBuffer(SortRows.java:117) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:406) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 27-01 11:50:23,436 - Device.0 - Finished processing (I=5245663, O=0, R=0, W=5245662, U=5245662, E=0) INFO 27-01 11:50:23,438 - Sort rows.0 - Finished processing (I=0, O=0, R=2732707, W=0, U=0, E=1) ERROR 27-01 11:51:05,434 - Sort rows 2.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 27-01 11:51:05,436 - Sort rows 2.0 - java.lang.OutOfMemoryError: Java heap space at java.lang.Object.clone(Native Method) at java.util.Arrays.sort(Arrays.java:1206) at java.util.Collections.sort(Collections.java:159) at org.pentaho.di.trans.steps.sort.SortRows.quickSort(SortRows.java:532) at org.pentaho.di.trans.steps.sort.SortRows.addBuffer(SortRows.java:117) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:406) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) If I try with JAVAMAXMEM=4096 I get the following error - Error occurred during initialization of VM Could not reserve enough space for ParallelScavenge old gen heap
    via by Ranadeep Bhattacharya,
  • Using 3.1.0-826 I have a join that run in a transformation. The sorts get completed and then the process just hangs for some time and then I get the following error: INFO 26-01 20:28:35,323 - Sort rows 2.0 - Linenr 24350000 INFO 26-01 20:28:47,578 - Device.0 - Finished processing (I=24375026, O=0, R=0, W=24375026, U=24375026, E=0) INFO 26-01 20:28:51,160 - Sort rows 2.0 - Opening 17 tmp-files... ERROR 26-01 21:05:38,848 - Sort rows 2.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:05:38,851 - Sort rows 2.0 - java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.ValueMeta.readString(ValueMeta.java:2114) at org.pentaho.di.core.row.ValueMeta.readData(ValueMeta.java:2042) at org.pentaho.di.core.row.RowMeta.readData(RowMeta.java:508) at org.pentaho.di.trans.steps.sort.SortRows.getBuffer(SortRows.java:323) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:447) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 26-01 21:05:38,860 - Sort rows 2.0 - Finished processing (I=0, O=0, R=24375026, W=3883590, U=3883590, E=1) INFO 26-01 21:05:38,864 - sorted_join - Transformation detected one or more steps with errors. ERROR 26-01 21:08:58,093 - Merge Join.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:08:58,093 - Sort rows.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 26-01 21:08:58,095 - Sort rows.0 - java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.RowMeta.readData(RowMeta.java:505) at org.pentaho.di.trans.steps.sort.SortRows.getBuffer(SortRows.java:323) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:447) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 26-01 21:08:58,101 - Sort rows.0 - Finished processing (I=0, O=0, R=6621023, W=10005, U=10005, E=1) INFO 26-01 21:08:58,105 - sorted_join - Transformation detected one or more steps with errors. INFO 26-01 21:08:58,108 - sorted_join - Transformation is killing the other steps! Two files are being joined, one having 10M other having 24M records. File sizes are 1655660206 and 2869424171 respectively. Both have a single key field. I initially tried with JAVAMAXMEM=2048 and then with JAVAMAXMEM=3072. That didn't complete sorting and gave me the following error - INFO 27-01 11:38:51,519 - Filter rows.0 - linenr 4100000 ERROR 27-01 11:50:23,359 - Subscriber.0 - UnexpectedError: java.lang.OutOfMemoryError: GC overhead limit exceeded ERROR 27-01 11:50:23,361 - Subscriber.0 - java.lang.OutOfMemoryError: GC overhead limit exceeded at java.nio.CharBuffer.wrap(CharBuffer.java:350) at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:291) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:158) at sun.nio.cs.StreamDecoder.read0(StreamDecoder.java:107) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:93) at java.io.InputStreamReader.read(InputStreamReader.java:151) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.getLine(TextFileInput.java:113) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.processRow(TextFileInput.java:850) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.textfileinput.TextFileInput.run(TextFileInput.java:1440) INFO 27-01 11:50:23,388 - Filter rows.0 - Finished processing (I=0, O=0, R=4118124, W=2732863, U=2732863, E=0) INFO 27-01 11:50:23,389 - Subscriber.0 - Finished processing (I=4118280, O=0, R=0, W=4118280, U=4118280, E=1) INFO 27-01 11:50:23,396 - sorted_join - Transformation detected one or more steps with errors. INFO 27-01 11:50:23,399 - sorted_join - Transformation is killing the other steps! ERROR 27-01 11:50:23,429 - Sort rows.0 - UnexpectedError: java.lang.OutOfMemoryError: GC overhead limit exceeded ERROR 27-01 11:50:23,431 - Sort rows.0 - java.lang.OutOfMemoryError: GC overhead limit exceeded at java.lang.Object.clone(Native Method) at java.util.Arrays.sort(Arrays.java:1206) at java.util.Collections.sort(Collections.java:159) at org.pentaho.di.trans.steps.sort.SortRows.quickSort(SortRows.java:532) at org.pentaho.di.trans.steps.sort.SortRows.addBuffer(SortRows.java:117) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:406) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) INFO 27-01 11:50:23,436 - Device.0 - Finished processing (I=5245663, O=0, R=0, W=5245662, U=5245662, E=0) INFO 27-01 11:50:23,438 - Sort rows.0 - Finished processing (I=0, O=0, R=2732707, W=0, U=0, E=1) ERROR 27-01 11:51:05,434 - Sort rows 2.0 - UnexpectedError: java.lang.OutOfMemoryError: Java heap space ERROR 27-01 11:51:05,436 - Sort rows 2.0 - java.lang.OutOfMemoryError: Java heap space at java.lang.Object.clone(Native Method) at java.util.Arrays.sort(Arrays.java:1206) at java.util.Collections.sort(Collections.java:159) at org.pentaho.di.trans.steps.sort.SortRows.quickSort(SortRows.java:532) at org.pentaho.di.trans.steps.sort.SortRows.addBuffer(SortRows.java:117) at org.pentaho.di.trans.steps.sort.SortRows.processRow(SortRows.java:406) at org.pentaho.di.trans.step.BaseStep.runStepThread(BaseStep.java:2664) at org.pentaho.di.trans.steps.sort.SortRows.run(SortRows.java:566) If I try with JAVAMAXMEM=4096 I get the following error - Error occurred during initialization of VM Could not reserve enough space for ParallelScavenge old gen heap
    via by Ranadeep Bhattacharya,
    • java.lang.OutOfMemoryError: Java heap space at org.pentaho.di.core.row.ValueMeta.readString(ValueMeta.java:2249) at org.pentaho.di.core.row.ValueMeta.<init>(ValueMeta.java:2532) at org.pentaho.di.core.row.RowMeta.<init>(RowMeta.java:535) at org.pentaho.di.core.DBCache.<init>(DBCache.java:173) at org.pentaho.di.core.DBCache.getInstance(DBCache.java:261) at org.pentaho.di.trans.TransMeta.clear(TransMeta.java:749) at org.pentaho.di.trans.TransMeta.loadXML(TransMeta.java:2888) at org.pentaho.di.trans.TransMeta.<init>(TransMeta.java:2784) at org.pentaho.di.trans.TransMeta.<init>(TransMeta.java:2748) at org.pentaho.di.job.entries.trans.JobEntryTrans.getTransMeta(JobEntryTrans.java:1158) at org.pentaho.di.job.entries.trans.JobEntryTrans.execute(JobEntryTrans.java:621) at org.pentaho.di.job.Job.execute(Job.java:693) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:826) at org.pentaho.di.job.Job.execute(Job.java:497) at org.pentaho.di.job.Job.run(Job.java:403)
    No Bugmate found.