java.lang.IndexOutOfBoundsException: Index: 1, Size: 1

pig-user | Rohini Palaniswamy | 11 months ago
  1. 0

    Re: python UDF invocation or memory problem

    pig-user | 11 months ago | Rohini Palaniswamy
    java.lang.IndexOutOfBoundsException: Index: 1, Size: 1
  2. 0

    Re: python UDF invocation or memory problem

    pig-user | 11 months ago | Rohini Palaniswamy
    java.lang.IndexOutOfBoundsException: Index: 1, Size: 1
  3. 0

    Re: python UDF invocation or memory problem

    pig-user | 11 months ago | Rohini Palaniswamy
    java.lang.IndexOutOfBoundsException: Index: 1, Size: 1
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Re: python UDF invocation or memory problem

    pig-user | 11 months ago | Rohini Palaniswamy
    java.lang.IndexOutOfBoundsException: Index: 1, Size: 1
  6. 0

    {code:title=test1.txt} {(,A1111,A),(,B222,B),(,C333,C)} {code} {code:title=test2.txt} A Helloworld B Pig C Hive {code} {code:title=tt.pig} A = LOAD 'test1.txt' AS (mybag:bag{t:tuple(title:chararray,name:chararray, id:chararray)}); A1 = FOREACH A generate flatten(mybag) as (title:chararray,name:chararray, id:chararray); B = LOAD 'test2.txt' AS (id:chararray, content:chararray); C = JOIN A1 BY id LEFT OUTER, B BY id; dump C; {code} {code} $ pig -x local -f tt.pig .... java.lang.IndexOutOfBoundsException: Index: 1, Size: 1 at java.util.ArrayList.rangeCheck(ArrayList.java:604) at java.util.ArrayList.get(ArrayList.java:382) at org.apache.pig.data.DefaultTuple.get(DefaultTuple.java:115) at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage.getValueTuple(POPackage.java:350) at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage.getNext(POPackage.java:273) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.processOnePackageOutput(PigGenericMapReduce.java:425) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:416) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:256) at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:170) at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:636) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:396) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:441) [main] WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Ooops! Some job has failed! Specify -stop_on_failu re if you want Pig to stop immediately on failure. ============== {code} If we change the code into this one: {code:title=tt.pig} A = LOAD 'test1.txt' AS (mybag:bag{t:tuple(title:chararray,name:chararray, id:chararray)}); A1 = FOREACH A generate flatten(mybag) as (title:chararray,name:chararray, id:chararray); A1 = FOREACH A1 generate title,name,id; B = LOAD 'test2.txt' AS (id:chararray, content:chararray); C = JOIN A1 BY id LEFT OUTER, B BY id; dump C; {code} The job succeed, and here is the result of execution. {code} ======== (,A1111,A,A,Helloworld) (,B222,B,B,Pig) (,C333,C,C,Hive) (,,,,) ======== {code}

    Apache's JIRA Issue Tracker | 3 years ago | Bing Jiang
    java.lang.IndexOutOfBoundsException: Index: 1, Size: 1

  1. bmacedo 4 times, last 4 days ago
  2. mhicauber 1 times, last 4 days ago
  3. filpgame 2 times, last 1 week ago
  4. tvrmsmith 1 times, last 1 week ago
  5. Indri Yunita 12 times, last 1 week ago
67 more registered users
28 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.lang.IndexOutOfBoundsException

    Index: 1, Size: 1

    at java.util.ArrayList.rangeCheck()
  2. Java RT
    ArrayList.get
    1. java.util.ArrayList.rangeCheck(ArrayList.java:638)
    2. java.util.ArrayList.get(ArrayList.java:414)
    2 frames
  3. org.apache.pig
    PigGenericMapReduce$Reduce.reduce
    1. org.apache.pig.data.DefaultTuple.get(DefaultTuple.java:118)
    2. org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage.getValueTuple(POPackage.java:348)
    3. org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage.getNextTuple(POPackage.java:269)
    4. org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.processOnePackageOutput(PigGenericMapReduce.java:421)
    5. org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:412)
    6. org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:256)
    6 frames
  4. Hadoop
    YarnChild$2.run
    1. org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171)
    2. org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)
    3. org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)
    4. org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
    4 frames
  5. Java RT
    Subject.doAs
    1. java.security.AccessController.doPrivileged(Native Method)
    2. javax.security.auth.Subject.doAs(Subject.java:422)
    2 frames
  6. Hadoop
    UserGroupInformation.doAs
    1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
    1 frame
  7. Hadoop
    YarnChild.main
    1. org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
    1 frame