org.pentaho.di.core.exception.KettleException: Unexpected error occurred while launching entry [log_trans_14hours.ktr.0] Java heap space

Pentaho BI Platform Tracking | Jens Bleuel | 3 years ago
  1. 0

    Follow up from PDI-5374: An exception happens when a long running transformation finishes and is called form a job. See attached sample to reproduce (running 14 hours). Exception: 2013/06/21 09:07:07 - Write to log.0 - ------------> Linenr 504000------------------------------ 2013/06/21 09:07:07 - Write to log.0 - Log Test 2013/06/21 09:07:07 - Write to log.0 - 2013/06/21 09:07:07 - Write to log.0 - 504000 2013/06/21 09:07:07 - Write to log.0 - 2013/06/21 09:07:07 - Write to log.0 - ==================== 2013/06/21 09:07:07 - Delay row.0 - Finished processing (I=0, O=0, R=504000, W=504000, U=0, E=0) 2013/06/21 09:07:07 - Add sequence.0 - Finished processing (I=0, O=0, R=504000, W=504000, U=0, E=0) 2013/06/21 09:07:07 - Write to log.0 - Finished processing (I=0, O=0, R=504000, W=504000, U=0, E=0) 2013/06/21 09:07:08 - log_job_14hours - ERROR (version TRUNK-SNAPSHOT, build 1 from 2013-06-19 07.30.30 by tomcat) : java.lang.OutOfMemoryError: Java heap space 2013/06/21 09:07:08 - log_job_14hours - at java.util.Arrays.copyOf(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at java.lang.AbstractStringBuilder.expandCapacity(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at java.lang.AbstractStringBuilder.ensureCapacityInternal(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at java.lang.AbstractStringBuilder.append(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at java.lang.StringBuffer.append(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.core.logging.LoggingBuffer.getBuffer(LoggingBuffer.java:159) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.core.logging.LoggingBuffer.getBuffer(LoggingBuffer.java:170) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.core.logging.LoggingBuffer.getBuffer(LoggingBuffer.java:166) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.execute(Job.java:697) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.execute(Job.java:805) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.execute(Job.java:494) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.run(Job.java:403) 2013/06/21 09:07:08 - log_job_14hours - ERROR (version TRUNK-SNAPSHOT, build 1 from 2013-06-19 07.30.30 by tomcat) : A serious error occurred during job execution: 2013/06/21 09:07:08 - log_job_14hours - Unexpected error occurred while launching entry [log_trans_14hours.ktr.0] 2013/06/21 09:07:08 - log_job_14hours - Java heap space 2013/06/21 09:07:08 - log_job_14hours - ERROR (version TRUNK-SNAPSHOT, build 1 from 2013-06-19 07.30.30 by tomcat) : org.pentaho.di.core.exception.KettleException: 2013/06/21 09:07:08 - log_job_14hours - Unexpected error occurred while launching entry [log_trans_14hours.ktr.0] 2013/06/21 09:07:08 - log_job_14hours - Java heap space 2013/06/21 09:07:08 - log_job_14hours - 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.execute(Job.java:808) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.execute(Job.java:494) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.run(Job.java:403) 2013/06/21 09:07:08 - log_job_14hours - Caused by: java.lang.OutOfMemoryError: Java heap space 2013/06/21 09:07:08 - log_job_14hours - at java.util.Arrays.copyOf(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at java.lang.AbstractStringBuilder.expandCapacity(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at java.lang.AbstractStringBuilder.ensureCapacityInternal(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at java.lang.AbstractStringBuilder.append(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at java.lang.StringBuffer.append(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.core.logging.LoggingBuffer.getBuffer(LoggingBuffer.java:159) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.core.logging.LoggingBuffer.getBuffer(LoggingBuffer.java:170) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.core.logging.LoggingBuffer.getBuffer(LoggingBuffer.java:166) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.execute(Job.java:697) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.execute(Job.java:805) 2013/06/21 09:07:08 - log_job_14hours - ... 2 more 2013/06/21 09:07:08 - Kitchen - Finished! 2013/06/21 09:07:08 - Kitchen - ERROR (version TRUNK-SNAPSHOT, build 1 from 2013-06-19 07.30.30 by tomcat) : Finished with errors 2013/06/21 09:07:08 - Kitchen - Start=2013/06/20 19:05:56.659, Stop=2013/06/21 09:07:08.895 2013/06/21 09:07:08 - Kitchen - Processing ended after 14 hours, 1 minutes and 12 seconds (50472 seconds total).

    Pentaho BI Platform Tracking | 3 years ago | Jens Bleuel
    org.pentaho.di.core.exception.KettleException: Unexpected error occurred while launching entry [log_trans_14hours.ktr.0] Java heap space
  2. 0

    Follow up from PDI-5374: An exception happens when a long running transformation finishes and is called form a job. See attached sample to reproduce (running 14 hours). Exception: 2013/06/21 09:07:07 - Write to log.0 - ------------> Linenr 504000------------------------------ 2013/06/21 09:07:07 - Write to log.0 - Log Test 2013/06/21 09:07:07 - Write to log.0 - 2013/06/21 09:07:07 - Write to log.0 - 504000 2013/06/21 09:07:07 - Write to log.0 - 2013/06/21 09:07:07 - Write to log.0 - ==================== 2013/06/21 09:07:07 - Delay row.0 - Finished processing (I=0, O=0, R=504000, W=504000, U=0, E=0) 2013/06/21 09:07:07 - Add sequence.0 - Finished processing (I=0, O=0, R=504000, W=504000, U=0, E=0) 2013/06/21 09:07:07 - Write to log.0 - Finished processing (I=0, O=0, R=504000, W=504000, U=0, E=0) 2013/06/21 09:07:08 - log_job_14hours - ERROR (version TRUNK-SNAPSHOT, build 1 from 2013-06-19 07.30.30 by tomcat) : java.lang.OutOfMemoryError: Java heap space 2013/06/21 09:07:08 - log_job_14hours - at java.util.Arrays.copyOf(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at java.lang.AbstractStringBuilder.expandCapacity(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at java.lang.AbstractStringBuilder.ensureCapacityInternal(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at java.lang.AbstractStringBuilder.append(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at java.lang.StringBuffer.append(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.core.logging.LoggingBuffer.getBuffer(LoggingBuffer.java:159) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.core.logging.LoggingBuffer.getBuffer(LoggingBuffer.java:170) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.core.logging.LoggingBuffer.getBuffer(LoggingBuffer.java:166) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.execute(Job.java:697) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.execute(Job.java:805) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.execute(Job.java:494) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.run(Job.java:403) 2013/06/21 09:07:08 - log_job_14hours - ERROR (version TRUNK-SNAPSHOT, build 1 from 2013-06-19 07.30.30 by tomcat) : A serious error occurred during job execution: 2013/06/21 09:07:08 - log_job_14hours - Unexpected error occurred while launching entry [log_trans_14hours.ktr.0] 2013/06/21 09:07:08 - log_job_14hours - Java heap space 2013/06/21 09:07:08 - log_job_14hours - ERROR (version TRUNK-SNAPSHOT, build 1 from 2013-06-19 07.30.30 by tomcat) : org.pentaho.di.core.exception.KettleException: 2013/06/21 09:07:08 - log_job_14hours - Unexpected error occurred while launching entry [log_trans_14hours.ktr.0] 2013/06/21 09:07:08 - log_job_14hours - Java heap space 2013/06/21 09:07:08 - log_job_14hours - 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.execute(Job.java:808) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.execute(Job.java:494) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.run(Job.java:403) 2013/06/21 09:07:08 - log_job_14hours - Caused by: java.lang.OutOfMemoryError: Java heap space 2013/06/21 09:07:08 - log_job_14hours - at java.util.Arrays.copyOf(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at java.lang.AbstractStringBuilder.expandCapacity(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at java.lang.AbstractStringBuilder.ensureCapacityInternal(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at java.lang.AbstractStringBuilder.append(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at java.lang.StringBuffer.append(Unknown Source) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.core.logging.LoggingBuffer.getBuffer(LoggingBuffer.java:159) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.core.logging.LoggingBuffer.getBuffer(LoggingBuffer.java:170) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.core.logging.LoggingBuffer.getBuffer(LoggingBuffer.java:166) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.execute(Job.java:697) 2013/06/21 09:07:08 - log_job_14hours - at org.pentaho.di.job.Job.execute(Job.java:805) 2013/06/21 09:07:08 - log_job_14hours - ... 2 more 2013/06/21 09:07:08 - Kitchen - Finished! 2013/06/21 09:07:08 - Kitchen - ERROR (version TRUNK-SNAPSHOT, build 1 from 2013-06-19 07.30.30 by tomcat) : Finished with errors 2013/06/21 09:07:08 - Kitchen - Start=2013/06/20 19:05:56.659, Stop=2013/06/21 09:07:08.895 2013/06/21 09:07:08 - Kitchen - Processing ended after 14 hours, 1 minutes and 12 seconds (50472 seconds total).

    Pentaho BI Platform Tracking | 3 years ago | Jens Bleuel
    org.pentaho.di.core.exception.KettleException: Unexpected error occurred while launching entry [log_trans_14hours.ktr.0] Java heap space
  3. Speed up your debug routine!

    Automated exception search integrated into your IDE

  4. 0

    out of memory error occurs

    Stack Overflow | 1 year ago | Chungho Song
    java.lang.OutOfMemoryError: Java heap space

    3 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.OutOfMemoryError

      Java heap space

      at java.util.Arrays.copyOf()
    2. Java RT
      StringBuffer.append
      1. java.util.Arrays.copyOf(Unknown Source)
      2. java.lang.AbstractStringBuilder.expandCapacity(Unknown Source)
      3. java.lang.AbstractStringBuilder.ensureCapacityInternal(Unknown Source)
      4. java.lang.AbstractStringBuilder.append(Unknown Source)
      5. java.lang.StringBuffer.append(Unknown Source)
      5 frames
    3. org.pentaho.di
      Job.run
      1. org.pentaho.di.core.logging.LoggingBuffer.getBuffer(LoggingBuffer.java:159)
      2. org.pentaho.di.core.logging.LoggingBuffer.getBuffer(LoggingBuffer.java:170)
      3. org.pentaho.di.core.logging.LoggingBuffer.getBuffer(LoggingBuffer.java:166)
      4. org.pentaho.di.job.Job.execute(Job.java:697)
      5. org.pentaho.di.job.Job.execute(Job.java:805)
      6. org.pentaho.di.job.Job.execute(Job.java:494)
      7. org.pentaho.di.job.Job.run(Job.java:403)
      7 frames