org.pentaho.di.core.exception.KettleStepException: Field [CustomerID] is required and couldn't be found!

Stack Overflow | Megh Vidani | 4 months ago
  1. 0

    Map different number of fields between source and target steps in pentaho kettle

    Stack Overflow | 4 months ago | Megh Vidani
    org.pentaho.di.core.exception.KettleStepException: Field [CustomerID] is required and couldn't be found!
  2. 0

    Pentaho - Transformation is killing the other steps

    Stack Overflow | 1 year ago | Rahul Nadkarni
    org.pentaho.di.core.exception.KettleStepException: Error while running the step Unexpected conversion error while converting value [flag_SALES_WEEK Integer] to an Integer java.lang.String cannot be cast to java.lang.Long
  3. 0

    When creating a Regex Evaluation step with a regular expression like .*XXX(140110|145250)XXX.* and not checking 'Create fields for capture groups' and also not specifying any 'Capture Group Fields' then the transformation stops with an error like this: Regex Evaluation.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : The number of capture groups in the regular expression (3) does not match the number of fields specified (0)! Regex Evaluation.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : Unexpected error Regex Evaluation.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : org.pentaho.di.core.exception.KettleStepException: Regex Evaluation.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : Error in step Regex Evaluation.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : Regex Evaluation.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : The number of capture groups in the regular expression (3) does not match the number of fields specified (0)! Regex Evaluation.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : Regex Evaluation.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : Regex Evaluation.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : at org.pentaho.di.trans.steps.regexeval.RegexEval.processRow(RegexEval.java:208) Regex Evaluation.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : at org.pentaho.di.trans.step.RunThread.run(RunThread.java:40) Regex Evaluation.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : at java.lang.Thread.run(Thread.java:680) Regex Evaluation.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : Caused by: org.pentaho.di.core.exception.KettleStepException: Regex Evaluation.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : The number of capture groups in the regular expression (3) does not match the number of fields specified (0)! Regex Evaluation.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : Regex Evaluation.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : at org.pentaho.di.trans.steps.regexeval.RegexEval.processRow(RegexEval.java:161) Regex Evaluation.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : ... 2 more

    Pentaho BI Platform Tracking | 5 years ago | Axel Christ
    org.pentaho.di.core.exception.KettleStepException: Error in step The number of capture groups in the regular expression (3) does not match the number of fields specified (0)!
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    The calculator step can convert Timestamp fields to Date (see calculator1.ktr), and Date fields can be converted to Timestamp type. From a user's perspective this raises the expectation that we can in principle use Timestamp fields wherever it is appropriate for Date fields to appear. From a developer's perspective it also holds true since the ValueMeta interface for timestamps is a subclass of that of the one for Dates, and the internal data types are java.util.Date and java.sql.Timestamp, which are also proper subclasses of each other. However, this does not work as expected. When we create a new field (Calculator2.ktr) of the Date type having a "Date a + b days" calulation to add an integer (b) to a timestamp field (a) the error is: 2013/11/15 14:54:18 - Calculator.0 - ERROR (version TRUNK-SNAPSHOT, build 1 from 2013-11-13 09.29.02 by rbouman) : !Calculator.ErrorInStepRunning : 2013/11/15 14:54:18 - Calculator.0 - resultType: 9; targetMeta: 3 2013/11/15 14:54:18 - Calculator.0 - java.util.Date cannot be cast to java.sql.Timestamp 2013/11/15 14:54:18 - Calculator.0 - ! 2013/11/15 14:54:18 - Calculator.0 - ERROR (version TRUNK-SNAPSHOT, build 1 from 2013-11-13 09.29.02 by rbouman) : Unexpected error 2013/11/15 14:54:18 - Calculator.0 - ERROR (version TRUNK-SNAPSHOT, build 1 from 2013-11-13 09.29.02 by rbouman) : org.pentaho.di.core.exception.KettleStepException: 2013/11/15 14:54:18 - Calculator.0 - Error while running the step 2013/11/15 14:54:18 - Calculator.0 - 2013/11/15 14:54:18 - Calculator.0 - resultType: 9; targetMeta: 3 2013/11/15 14:54:18 - Calculator.0 - java.util.Date cannot be cast to java.sql.Timestamp 2013/11/15 14:54:18 - Calculator.0 - 2013/11/15 14:54:18 - Calculator.0 - 2013/11/15 14:54:18 - Calculator.0 - at org.pentaho.di.trans.steps.calculator.Calculator.processRow(Calculator.java:198) 2013/11/15 14:54:18 - Calculator.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:60) 2013/11/15 14:54:18 - Calculator.0 - at java.lang.Thread.run(Thread.java:722) 2013/11/15 14:54:18 - Calculator.0 - Caused by: org.pentaho.di.core.exception.KettleValueException: 2013/11/15 14:54:18 - Calculator.0 - resultType: 9; targetMeta: 3 2013/11/15 14:54:18 - Calculator.0 - java.util.Date cannot be cast to java.sql.Timestamp 2013/11/15 14:54:18 - Calculator.0 - 2013/11/15 14:54:18 - Calculator.0 - at org.pentaho.di.trans.steps.calculator.Calculator.calcFields(Calculator.java:793) 2013/11/15 14:54:18 - Calculator.0 - at org.pentaho.di.trans.steps.calculator.Calculator.processRow(Calculator.java:179) 2013/11/15 14:54:18 - Calculator.0 - ... 2 more 2013/11/15 14:54:18 - Calculator.0 - Caused by: java.lang.ClassCastException: java.util.Date cannot be cast to java.sql.Timestamp 2013/11/15 14:54:18 - Calculator.0 - at org.pentaho.di.core.row.value.ValueMetaTimestamp.getTimestamp(ValueMetaTimestamp.java:124) 2013/11/15 14:54:18 - Calculator.0 - at org.pentaho.di.core.row.value.ValueMetaTimestamp.getDate(ValueMetaTimestamp.java:66) 2013/11/15 14:54:18 - Calculator.0 - at org.pentaho.di.core.row.value.ValueMetaBase.convertData(ValueMetaBase.java:3495) 2013/11/15 14:54:18 - Calculator.0 - at org.pentaho.di.trans.steps.calculator.Calculator.calcFields(Calculator.java:791) 2013/11/15 14:54:18 - Calculator.0 - ... 3 more When we use the same calculation but set the result type to Timestamp, a different error occurs: 2013/11/15 14:56:54 - Calculator.0 - ERROR (version TRUNK-SNAPSHOT, build 1 from 2013-11-13 09.29.02 by rbouman) : !Calculator.ErrorInStepRunning : 2013/11/15 14:56:54 - Calculator.0 - resultType: 9; targetMeta: 9 2013/11/15 14:56:54 - Calculator.0 - 2013/11/15 14:56:54 - Calculator.0 - Timestamp : can't be converted to a timestamp 2013/11/15 14:56:54 - Calculator.0 - 2013/11/15 14:56:54 - Calculator.0 - ! 2013/11/15 14:56:54 - Calculator.0 - ERROR (version TRUNK-SNAPSHOT, build 1 from 2013-11-13 09.29.02 by rbouman) : Unexpected error 2013/11/15 14:56:54 - Calculator.0 - ERROR (version TRUNK-SNAPSHOT, build 1 from 2013-11-13 09.29.02 by rbouman) : org.pentaho.di.core.exception.KettleStepException: 2013/11/15 14:56:54 - Calculator.0 - Error while running the step 2013/11/15 14:56:54 - Calculator.0 - 2013/11/15 14:56:54 - Calculator.0 - resultType: 9; targetMeta: 9 2013/11/15 14:56:54 - Calculator.0 - 2013/11/15 14:56:54 - Calculator.0 - Timestamp : can't be converted to a timestamp 2013/11/15 14:56:54 - Calculator.0 - 2013/11/15 14:56:54 - Calculator.0 - 2013/11/15 14:56:54 - Calculator.0 - 2013/11/15 14:56:54 - Calculator.0 - at org.pentaho.di.trans.steps.calculator.Calculator.processRow(Calculator.java:198) 2013/11/15 14:56:54 - Calculator.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:60) 2013/11/15 14:56:54 - Calculator.0 - at java.lang.Thread.run(Thread.java:722) 2013/11/15 14:56:54 - Calculator.0 - Caused by: org.pentaho.di.core.exception.KettleValueException: 2013/11/15 14:56:54 - Calculator.0 - resultType: 9; targetMeta: 9 2013/11/15 14:56:54 - Calculator.0 - 2013/11/15 14:56:54 - Calculator.0 - Timestamp : can't be converted to a timestamp 2013/11/15 14:56:54 - Calculator.0 - 2013/11/15 14:56:54 - Calculator.0 - 2013/11/15 14:56:54 - Calculator.0 - at org.pentaho.di.trans.steps.calculator.Calculator.calcFields(Calculator.java:793) 2013/11/15 14:56:54 - Calculator.0 - at org.pentaho.di.trans.steps.calculator.Calculator.processRow(Calculator.java:179) 2013/11/15 14:56:54 - Calculator.0 - ... 2 more 2013/11/15 14:56:54 - Calculator.0 - Caused by: org.pentaho.di.core.exception.KettleValueException: 2013/11/15 14:56:54 - Calculator.0 - Timestamp : can't be converted to a timestamp 2013/11/15 14:56:54 - Calculator.0 - 2013/11/15 14:56:54 - Calculator.0 - at org.pentaho.di.core.row.value.ValueMetaTimestamp.convertData(ValueMetaTimestamp.java:401) 2013/11/15 14:56:54 - Calculator.0 - at org.pentaho.di.trans.steps.calculator.Calculator.calcFields(Calculator.java:791) 2013/11/15 14:56:54 - Calculator.0 - ... 3 more

    Pentaho BI Platform Tracking | 3 years ago | Roland Bouman
    org.pentaho.di.core.exception.KettleStepException: Error while running the step resultType: 9; targetMeta: 3 java.util.Date cannot be cast to java.sql.Timestamp

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.pentaho.di.core.exception.KettleStepException

      Field [CustomerID] is required and couldn't be found!

      at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow()
    2. org.pentaho.di
      RunThread.run
      1. org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow(TableOutput.java:98)
      2. org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
      2 frames
    3. Java RT
      Thread.run
      1. java.lang.Thread.run(Thread.java:745)
      1 frame