java.lang.Exception: java.lang.IllegalArgumentException: Input record does not contain the date field.

Google Groups | Peter Quirk | 2 months ago
  1. 0

    Error in Transforming your Data section of Introduction to CDAP

    Google Groups | 2 months ago | Peter Quirk
    java.lang.Exception: java.lang.IllegalArgumentException: Input record does not contain the date field.
  2. 0

    For supporting FTPBatchSource, we have to include a modified version of FTPInputStream since the call to seek to 0 by LineRecordReader throws an exception and hence the MR job fails. Including the stack trace below. This hack needs to be removed when the fix is no longer required. Relevant MapReduce JIRA : https://issues.apache.org/jira/browse/MAPREDUCE-3364 {code} 2016-03-24 10:32:44,225 - WARN [Thread-49:o.a.h.m.LocalJobRunnerWithFix@562] - Error cleaning up job: job_local399066587_0001 java.lang.Exception: java.io.IOException: Seek not supported at org.apache.hadoop.mapred.LocalJobRunnerWithFix$Job.runTasks(LocalJobRunnerWithFix.java:465) ~[cdap-app-fabric-3.4.0-SNAPSHOT.jar:na] at org.apache.hadoop.mapred.LocalJobRunnerWithFix$Job.run(LocalJobRunnerWithFix.java:524) ~[cdap-app-fabric-3.4.0-SNAPSHOT.jar:na] java.io.IOException: Seek not supported at org.apache.hadoop.fs.ftp.FTPInputStream.seek(FTPInputStream.java:62) ~[hadoop-common-2.3.0.jar:na] at org.apache.hadoop.fs.FSDataInputStream.seek(FSDataInputStream.java:63) ~[hadoop-common-2.3.0.jar:na] at org.apache.hadoop.mapreduce.lib.input.LineRecordReader.initialize(LineRecordReader.java:107) ~[hadoop-mapreduce-client-core-2.3.0.jar:na] at org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReaderWrapper.initialize(CombineFileRecordReaderWrapper.java:69) ~[hadoop-mapreduce-client-core-2.3.0.jar:na] at org.apache.hadoop.mapreduce.lib.input.CombineFileRecordReader.initialize(CombineFileRecordReader.java:63) ~[hadoop-mapreduce-client-core-2.3.0.jar:na] at co.cask.cdap.internal.app.runtime.batch.dataset.input.DelegatingRecordReader.initialize(DelegatingRecordReader.java:79) ~[cdap-app-fabric-3.4.0-SNAPSHOT.jar:na] at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) ~[hadoop-mapreduce-client-core-2.3.0.jar:na] at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) ~[hadoop-mapreduce-client-core-2.3.0.jar:na] at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) ~[hadoop-mapreduce-client-core-2.3.0.jar:na] at org.apache.hadoop.mapred.LocalJobRunnerWithFix$Job$MapTaskRunnable.run(LocalJobRunnerWithFix.java:243) ~[cdap-app-fabric-3.4.0-SNAPSHOT.jar:na] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_45] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_45] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[na:1.8.0_45] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[na:1.8.0_45] at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_45] {code}

    Cask Community Issue Tracker | 9 months ago | Gokul Gunasekaran
    java.lang.Exception: java.io.IOException: Seek not supported
  3. Speed up your debug routine!

    Automated exception search integrated into your IDE

  4. 0

    If there is a semi-colon in the import or count query, the mysql source doesn't work. {code} 2015-10-29 15:27:41,116 - WARN [Thread-35:o.a.h.m.LocalJobRunnerWithFix$Job@562] - Error cleaning up job: job_local11789101_0001 java.lang.Exception: java.io.IOException: SQLException in nextKeyValue at org.apache.hadoop.mapred.LocalJobRunnerWithFix$Job.runTasks(LocalJobRunnerWithFix.java:465) ~[co.cask.cdap.cdap-app-fabric-3.2.1.jar:na] at org.apache.hadoop.mapred.LocalJobRunnerWithFix$Job.run(LocalJobRunnerWithFix.java:524) ~[co.cask.cdap.cdap-app-fabric-3.2.1.jar:na] java.io.IOException: SQLException in nextKeyValue at org.apache.hadoop.mapreduce.lib.db.DBRecordReader.nextKeyValue(DBRecordReader.java:239) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na] at co.cask.cdap.etl.common.ETLDBInputFormat$1.nextKeyValue(ETLDBInputFormat.java:96) ~[1446157657892-0/:na] at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:533) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na] at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na] at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.j ar:na] at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.j ar:na] at co.cask.cdap.internal.app.runtime.batch.MapperWrapper$1.nextKeyValue(MapperWrapper.java:144) ~[co.cask.cdap.cdap-app-fabric-3.2.1.jar:na] at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na] at co.cask.cdap.internal.app.runtime.batch.MapperWrapper.run(MapperWrapper.java:102) ~[co.cask.cdap.cdap-app-fabric-3.2.1.jar:na] at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na] at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na] at org.apache.hadoop.mapred.LocalJobRunnerWithFix$Job$MapTaskRunnable.run(LocalJobRunnerWithFix.java:243) ~[co.cask.cdap.cdap-app-fabric-3.2.1.jar:na] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) ~[na:1.7.0_79] at java.util.concurrent.FutureTask.run(FutureTask.java:262) ~[na:1.7.0_79] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) ~[na:1.7.0_79] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ~[na:1.7.0_79] at java.lang.Thread.run(Thread.java:745) ~[na:1.7.0_79] Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'LIMIT 1 OFFSET 0' at line 1 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[na:1.7.0_79] at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) ~[na:1.7.0_79] at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[na:1.7.0_79] at java.lang.reflect.Constructor.newInstance(Constructor.java:526) ~[na:1.7.0_79] at com.mysql.jdbc.Util.handleNewInstance(Util.java:389) ~[1446157658664-0/:na] at com.mysql.jdbc.Util.getInstance(Util.java:372) ~[1446157658664-0/:na] at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:980) ~[1446157658664-0/:na] at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3835) ~[1446157658664-0/:na] at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3771) ~[1446157658664-0/:na] at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2435) ~[1446157658664-0/:na] at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2582) ~[1446157658664-0/:na] at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2535) ~[1446157658664-0/:na] at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1911) ~[1446157658664-0/:na] at com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:2034) ~[1446157658664-0/:na] {code}

    Cask Community Issue Tracker | 1 year ago | Sreevatsan Raman
    java.lang.Exception: java.io.IOException: SQLException in nextKeyValue
  5. 0

    This exception stops the pipeline but is being logged as a warning instead of an error. {code} 2016-05-11 21:55:19,720 - WARN [Thread-254:o.a.h.m.LocalJobRunnerWithFix@562] - Error cleaning up job: job_local1176050516_0008 java.lang.Exception: java.lang.IllegalArgumentException: Row key cannot be null. at org.apache.hadoop.mapred.LocalJobRunnerWithFix$Job.runTasks(LocalJobRunnerWithFix.java:465) ~[co.cask.cdap.cdap-app-fabric-3.4.0.jar:na] at org.apache.hadoop.mapred.LocalJobRunnerWithFix$Job.run(LocalJobRunnerWithFix.java:524) ~[co.cask.cdap.cdap-app-fabric-3.4.0.jar:na] java.lang.IllegalArgumentException: Row key cannot be null. at com.google.common.base.Preconditions.checkArgument(Preconditions.java:92) ~[guava-13.0.1.jar:na] at co.cask.cdap.format.RecordPutTransformer.createPut(RecordPutTransformer.java:147) ~[cdap-formats-3.4.0.jar:na] at co.cask.cdap.format.RecordPutTransformer.toPut(RecordPutTransformer.java:72) ~[cdap-formats-3.4.0.jar:na] at co.cask.hydrator.plugin.batch.sink.TableSink.transform(TableSink.java:98) ~[1463028914987-0/:na] at co.cask.hydrator.plugin.batch.sink.TableSink.transform(TableSink.java:43) ~[1463028914987-0/:na] at co.cask.cdap.etl.common.TrackedTransform.transform(TrackedTransform.java:59) ~[cdap-etl-core-3.4.0.jar:na] at co.cask.cdap.etl.common.TransformExecutor.executeTransformation(TransformExecutor.java:86) ~[cdap-etl-core-3.4.0.jar:na] at co.cask.cdap.etl.common.TransformExecutor.executeTransformation(TransformExecutor.java:90) ~[cdap-etl-core-3.4.0.jar:na] at co.cask.cdap.etl.common.TransformExecutor.executeTransformation(TransformExecutor.java:90) ~[cdap-etl-core-3.4.0.jar:na] at co.cask.cdap.etl.common.TransformExecutor.executeTransformation(TransformExecutor.java:90) ~[cdap-etl-core-3.4.0.jar:na] at co.cask.cdap.etl.common.TransformExecutor.runOneIteration(TransformExecutor.java:49) ~[cdap-etl-core-3.4.0.jar:na] at co.cask.cdap.etl.batch.mapreduce.TransformRunner.transform(TransformRunner.java:154) ~[cdap-etl-batch-3.4.0.jar:na] at co.cask.cdap.etl.batch.mapreduce.ETLMapReduce$ETLMapper.map(ETLMapReduce.java:299) ~[cdap-etl-batch-3.4.0.jar:na] at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na] at co.cask.cdap.internal.app.runtime.batch.MapperWrapper.run(MapperWrapper.java:117) ~[co.cask.cdap.cdap-app-fabric-3.4.0.jar:na] at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na] at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) ~[org.apache.hadoop.hadoop-mapreduce-client-core-2.3.0.jar:na] at org.apache.hadoop.mapred.LocalJobRunnerWithFix$Job$MapTaskRunnable.run(LocalJobRunnerWithFix.java:243) ~[co.cask.cdap.cdap-app-fabric-3.4.0.jar:na] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) ~[na:1.7.0_79] at java.util.concurrent.FutureTask.run(FutureTask.java:262) ~[na:1.7.0_79] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) ~[na:1.7.0_79] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ~[na:1.7.0_79] at java.lang.Thread.run(Thread.java:745) ~[na:1.7.0_79] {code}

    Cask Community Issue Tracker | 7 months ago | Russ Savage
    java.lang.Exception: java.lang.IllegalArgumentException: Row key cannot be null.

    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. java.lang.Exception

      java.lang.IllegalArgumentException: Input record does not contain the date field.

      at org.apache.hadoop.mapred.LocalJobRunnerWithFix$Job.runTasks()
    2. Hadoop
      LocalJobRunnerWithFix$Job.run
      1. org.apache.hadoop.mapred.LocalJobRunnerWithFix$Job.runTasks(LocalJobRunnerWithFix.java:465)[co.cask.cdap.cdap-app-fabric-4.0.0-SNAPSHOT.jar:na]
      2. org.apache.hadoop.mapred.LocalJobRunnerWithFix$Job.run(LocalJobRunnerWithFix.java:524)[co.cask.cdap.cdap-app-fabric-4.0.0-SNAPSHOT.jar:na]
      2 frames