com.mysql.jdbc.exceptions.jdbc4.MySQLDataException: '18385347166395843554' in column '2' is outside valid range for the datatype BIGINT.

sqoop-user | centerqi hu | 3 years ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    sqoop mysql to hive's ---split-by bug

    sqoop-user | 3 years ago | centerqi hu
    com.mysql.jdbc.exceptions.jdbc4.MySQLDataException: '18385347166395843554' in column '2' is outside valid range for the datatype BIGINT.

    Root Cause Analysis

    1. com.mysql.jdbc.exceptions.jdbc4.MySQLDataException

      '18385347166395843554' in column '2' is outside valid range for the datatype BIGINT.

      at org.apache.sqoop.mapreduce.db.DataDrivenDBInputFormat.getSplits()
    2. org.apache.sqoop
      DataDrivenDBInputFormat.getSplits
      1. org.apache.sqoop.mapreduce.db.DataDrivenDBInputFormat.getSplits(DataDrivenDBInputFormat.java:170)
      1 frame
    3. Hadoop
      JobClient$2.run
      1. org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:1024)
      2. org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1041)
      3. org.apache.hadoop.mapred.JobClient.access$700(JobClient.java:179)
      4. org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:959)
      5. org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:912)
      5 frames
    4. Java RT
      Subject.doAs
      1. java.security.AccessController.doPrivileged(Native Method)
      2. javax.security.auth.Subject.doAs(Subject.java:396)
      2 frames
    5. Hadoop
      UserGroupInformation.doAs
      1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
      1 frame
    6. Hadoop
      Job.waitForCompletion
      1. org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:912)
      2. org.apache.hadoop.mapreduce.Job.submit(Job.java:500)
      3. org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:530)
      3 frames
    7. org.apache.sqoop
      Sqoop.run
      1. org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:186)
      2. org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:159)
      3. org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:239)
      4. org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:600)
      5. org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:118)
      6. org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:413)
      7. org.apache.sqoop.tool.ImportTool.run(ImportTool.java:502)
      8. org.apache.sqoop.Sqoop.run(Sqoop.java:145)
      8 frames
    8. Hadoop
      ToolRunner.run
      1. org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
      1 frame
    9. org.apache.sqoop
      Sqoop.main
      1. org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
      2. org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
      3. org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
      4. org.apache.sqoop.Sqoop.main(Sqoop.java:238)
      4 frames