java.lang.OutOfMemoryError: Java heap space

Pentaho BI Platform Tracking | Thomas Rensing | 7 years ago
  1. 0

    Hi there, i read an huge amount of data (excel-import with 65000 rows and 10 columns) in a subtransformation and copy rows to result to process data in following jobentries of the parentjob. Then on each call of the following jobentries, the dataset is duplicated by calling the clone method. Thus the max amount of heap-space is quickly exceeded, dependend on the memory assigned by xmx-parameter and the number of following jobentries. The stack-trace is the following: - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : ja 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : java.lang.OutOfMemoryError: Java heap space 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : at java.lang.Object.clone(Native Method) 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : at java.util.Locale.clone(Unknown Source) 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : at org.pentaho.di.core.row.ValueMeta.clone(ValueMeta.java:207) 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : at org.pentaho.di.core.row.ValueMeta.clone(ValueMeta.java:44) 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : at org.pentaho.di.core.row.RowMeta.clone(RowMeta.java:55) 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : at org.pentaho.di.core.row.RowMeta.clone(RowMeta.java:37) 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : at org.pentaho.di.core.RowMetaAndData.clone(RowMetaAndData.java:49) 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : at org.pentaho.di.core.Result.clone(Result.java:97) 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : at org.pentaho.di.job.JobEntryResult.<init>(JobEntryResult.java:59) 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : at org.pentaho.di.job.Job.execute(Job.java:452) 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : at org.pentaho.di.job.Job.execute(Job.java:547) 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : at org.pentaho.di.job.Job.execute(Job.java:547) 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : at org.pentaho.di.job.Job.execute(Job.java:547) 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : at org.pentaho.di.job.Job.execute(Job.java:332) 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : at org.pentaho.di.job.Job.run(Job.java:253) 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : org.pentaho.di.core.exception.KettleException: 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : Unexpected error occurred while launching entry [Write To Log 1.0] 2009/12/08 09:20:55 - Thread[Job-Load data (Job-Load data (Thread-83)),5,main] - ERROR (version 3.2.0-GA, build 10572 from 2009-05-12 08.45.26 by buildguy) : Java heap space

    Pentaho BI Platform Tracking | 7 years ago | Thomas Rensing
    java.lang.OutOfMemoryError: Java heap space
  2. 0

    OutOfMemory Exception : java heap space

    Google Groups | 6 months ago | deepak singh
    java.lang.OutOfMemoryError: Java heap space* *java.lang.OutOfMemoryError: Java heap space*
  3. 0

    OutOfMemory Exception : java heap space

    Google Groups | 6 months ago | deepak singh
    java.lang.OutOfMemoryError: Java heap space* *java.lang.OutOfMemoryError: Java heap space*
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    [exoplatform] [explatform] Memory requirements

    ow2.org | 1 year ago
    java.lang.OutOfMemoryError: Java heap space>java.lang.OutOfMemoryError: Java heap space
  6. 0

    OutOfMemory Exception : java heap space

    Google Groups | 6 months ago | deepak singh
    java.lang.OutOfMemoryError: Java heap space* *java.lang.OutOfMemoryError: Java heap space*

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.OutOfMemoryError

      Java heap space

      at java.lang.Object.clone()
    2. Java RT
      Locale.clone
      1. java.lang.Object.clone(Native Method)
      2. java.util.Locale.clone(Unknown Source)
      2 frames
    3. org.pentaho.di
      Job.run
      1. org.pentaho.di.core.row.ValueMeta.clone(ValueMeta.java:207)
      2. org.pentaho.di.core.row.ValueMeta.clone(ValueMeta.java:44)
      3. org.pentaho.di.core.row.RowMeta.clone(RowMeta.java:55)
      4. org.pentaho.di.core.row.RowMeta.clone(RowMeta.java:37)
      5. org.pentaho.di.core.RowMetaAndData.clone(RowMetaAndData.java:49)
      6. org.pentaho.di.core.Result.clone(Result.java:97)
      7. org.pentaho.di.job.JobEntryResult.<init>(JobEntryResult.java:59)
      8. org.pentaho.di.job.Job.execute(Job.java:452)
      9. org.pentaho.di.job.Job.execute(Job.java:547)
      10. org.pentaho.di.job.Job.execute(Job.java:547)
      11. org.pentaho.di.job.Job.execute(Job.java:547)
      12. org.pentaho.di.job.Job.execute(Job.java:332)
      13. org.pentaho.di.job.Job.run(Job.java:253)
      13 frames