java.lang.NullPointerException

JIRA | Henry Saputra | 3 years ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    The MapReduce support seems broken in master branch, now when I run map reduce with tachyon as input I got NPE: hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-SNAPSHOT.jar wordcount -libjars /Users/hsaputra/open/github/tachyon/core/target/tachyon-0.6.0-SNAPSHOT-jar-with-dependencies.jar tachyon://localhost:19998/user/hsaputra/input outpu9 Listening for transport dt_socket at address: 7004 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/Users/hsaputra/hadoop-installs/hadoop-3.0.0-SNAPSHOT/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/Users/hsaputra/open/github/tachyon/core/target/tachyon-0.6.0-SNAPSHOT-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 14/08/26 11:05:00 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 14/08/26 11:05:00 INFO : initialize(tachyon://localhost:19998/user/hsaputra/input, Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml). Connecting to Tachyon: tachyon://localhost:19998/user/hsaputra/input 14/08/26 11:05:00 INFO : Tachyon client (version 0.6.0-SNAPSHOT) is trying to connect master @ localhost/127.0.0.1:19998 14/08/26 11:05:00 INFO : User registered at the master localhost/127.0.0.1:19998 got UserId 3 14/08/26 11:05:00 INFO : tachyon://localhost:19998 tachyon://localhost:19998 hdfs://localhost:9000 14/08/26 11:05:00 INFO : getWorkingDirectory: / 14/08/26 11:05:01 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032 14/08/26 11:05:01 INFO : getFileStatus(tachyon://localhost:19998/user/hsaputra/input): HDFS Path: hdfs://localhost:9000/user/hsaputra/input TPath: tachyon://localhost:19998/user/hsaputra/input 14/08/26 11:05:01 INFO : listStatus(tachyon://localhost:19998/user/hsaputra/input): HDFS Path: hdfs://localhost:9000/user/hsaputra/input 14/08/26 11:05:01 INFO input.FileInputFormat: Total input paths to process : 1 14/08/26 11:05:01 INFO mapreduce.JobSubmitter: number of splits:1 14/08/26 11:05:01 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1409076190098_0002 14/08/26 11:05:02 INFO impl.YarnClientImpl: Submitted application application_1409076190098_0002 14/08/26 11:05:02 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1409076190098_0002/ 14/08/26 11:05:02 INFO mapreduce.Job: Running job: job_1409076190098_0002 14/08/26 11:05:07 INFO mapreduce.Job: Job job_1409076190098_0002 running in uber mode : false 14/08/26 11:05:07 INFO mapreduce.Job: map 0% reduce 0% 14/08/26 11:05:10 INFO mapreduce.Job: Task Id : attempt_1409076190098_0002_m_000000_0, Status : FAILED Error: java.lang.NullPointerException at tachyon.client.TachyonFile.getInStream(TachyonFile.java:126) at tachyon.hadoop.HdfsFileInputStream.<init>(HdfsFileInputStream.java:58) at tachyon.hadoop.AbstractTFS.open(AbstractTFS.java:374) at tachyon.hadoop.TFS.open(TFS.java:10) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:764) at org.apache.hadoop.mapreduce.lib.input.LineRecordReader.initialize(LineRecordReader.java:85) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:173) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1626) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168) 14/08/26 11:05:14 INFO mapreduce.Job: Task Id : attempt_1409076190098_0002_m_000000_1, Status : FAILED Error: java.lang.NullPointerException at tachyon.client.TachyonFile.getInStream(TachyonFile.java:126) at tachyon.hadoop.HdfsFileInputStream.<init>(HdfsFileInputStream.java:58) at tachyon.hadoop.AbstractTFS.open(AbstractTFS.java:374) at tachyon.hadoop.TFS.open(TFS.java:10) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:764) at org.apache.hadoop.mapreduce.lib.input.LineRecordReader.initialize(LineRecordReader.java:85) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:173) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1626) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168) 14/08/26 11:05:19 INFO mapreduce.Job: Task Id : attempt_1409076190098_0002_m_000000_2, Status : FAILED Error: java.lang.NullPointerException at tachyon.client.TachyonFile.getInStream(TachyonFile.java:126) at tachyon.hadoop.HdfsFileInputStream.<init>(HdfsFileInputStream.java:58) at tachyon.hadoop.AbstractTFS.open(AbstractTFS.java:374) at tachyon.hadoop.TFS.open(TFS.java:10) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:764) at org.apache.hadoop.mapreduce.lib.input.LineRecordReader.initialize(LineRecordReader.java:85) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:173) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1626) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168) 14/08/26 11:05:24 INFO mapreduce.Job: map 100% reduce 100% 14/08/26 11:05:24 INFO mapreduce.Job: Job job_1409076190098_0002 failed with state FAILED due to: Task failed task_1409076190098_0002_m_000000 Job failed as tasks failed. failedMaps:1 failedReduces:0 14/08/26 11:05:24 INFO mapreduce.Job: Counters: 8 Job Counters Failed map tasks=4 Launched map tasks=4 Other local map tasks=4 Total time spent by all maps in occupied slots (ms)=9120 Total time spent by all reduces in occupied slots (ms)=0 Total time spent by all map tasks (ms)=9120 Total vcore-seconds taken by all map tasks=9120 Total megabyte-seconds taken by all map tasks=9338880

    JIRA | 3 years ago | Henry Saputra
    java.lang.NullPointerException
  2. 0

    The MapReduce support seems broken in master branch, now when I run map reduce with tachyon as input I got NPE: hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-SNAPSHOT.jar wordcount -libjars /Users/hsaputra/open/github/tachyon/core/target/tachyon-0.6.0-SNAPSHOT-jar-with-dependencies.jar tachyon://localhost:19998/user/hsaputra/input outpu9 Listening for transport dt_socket at address: 7004 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/Users/hsaputra/hadoop-installs/hadoop-3.0.0-SNAPSHOT/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/Users/hsaputra/open/github/tachyon/core/target/tachyon-0.6.0-SNAPSHOT-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 14/08/26 11:05:00 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 14/08/26 11:05:00 INFO : initialize(tachyon://localhost:19998/user/hsaputra/input, Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml). Connecting to Tachyon: tachyon://localhost:19998/user/hsaputra/input 14/08/26 11:05:00 INFO : Tachyon client (version 0.6.0-SNAPSHOT) is trying to connect master @ localhost/127.0.0.1:19998 14/08/26 11:05:00 INFO : User registered at the master localhost/127.0.0.1:19998 got UserId 3 14/08/26 11:05:00 INFO : tachyon://localhost:19998 tachyon://localhost:19998 hdfs://localhost:9000 14/08/26 11:05:00 INFO : getWorkingDirectory: / 14/08/26 11:05:01 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032 14/08/26 11:05:01 INFO : getFileStatus(tachyon://localhost:19998/user/hsaputra/input): HDFS Path: hdfs://localhost:9000/user/hsaputra/input TPath: tachyon://localhost:19998/user/hsaputra/input 14/08/26 11:05:01 INFO : listStatus(tachyon://localhost:19998/user/hsaputra/input): HDFS Path: hdfs://localhost:9000/user/hsaputra/input 14/08/26 11:05:01 INFO input.FileInputFormat: Total input paths to process : 1 14/08/26 11:05:01 INFO mapreduce.JobSubmitter: number of splits:1 14/08/26 11:05:01 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1409076190098_0002 14/08/26 11:05:02 INFO impl.YarnClientImpl: Submitted application application_1409076190098_0002 14/08/26 11:05:02 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1409076190098_0002/ 14/08/26 11:05:02 INFO mapreduce.Job: Running job: job_1409076190098_0002 14/08/26 11:05:07 INFO mapreduce.Job: Job job_1409076190098_0002 running in uber mode : false 14/08/26 11:05:07 INFO mapreduce.Job: map 0% reduce 0% 14/08/26 11:05:10 INFO mapreduce.Job: Task Id : attempt_1409076190098_0002_m_000000_0, Status : FAILED Error: java.lang.NullPointerException at tachyon.client.TachyonFile.getInStream(TachyonFile.java:126) at tachyon.hadoop.HdfsFileInputStream.<init>(HdfsFileInputStream.java:58) at tachyon.hadoop.AbstractTFS.open(AbstractTFS.java:374) at tachyon.hadoop.TFS.open(TFS.java:10) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:764) at org.apache.hadoop.mapreduce.lib.input.LineRecordReader.initialize(LineRecordReader.java:85) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:173) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1626) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168) 14/08/26 11:05:14 INFO mapreduce.Job: Task Id : attempt_1409076190098_0002_m_000000_1, Status : FAILED Error: java.lang.NullPointerException at tachyon.client.TachyonFile.getInStream(TachyonFile.java:126) at tachyon.hadoop.HdfsFileInputStream.<init>(HdfsFileInputStream.java:58) at tachyon.hadoop.AbstractTFS.open(AbstractTFS.java:374) at tachyon.hadoop.TFS.open(TFS.java:10) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:764) at org.apache.hadoop.mapreduce.lib.input.LineRecordReader.initialize(LineRecordReader.java:85) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:173) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1626) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168) 14/08/26 11:05:19 INFO mapreduce.Job: Task Id : attempt_1409076190098_0002_m_000000_2, Status : FAILED Error: java.lang.NullPointerException at tachyon.client.TachyonFile.getInStream(TachyonFile.java:126) at tachyon.hadoop.HdfsFileInputStream.<init>(HdfsFileInputStream.java:58) at tachyon.hadoop.AbstractTFS.open(AbstractTFS.java:374) at tachyon.hadoop.TFS.open(TFS.java:10) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:764) at org.apache.hadoop.mapreduce.lib.input.LineRecordReader.initialize(LineRecordReader.java:85) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:173) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1626) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168) 14/08/26 11:05:24 INFO mapreduce.Job: map 100% reduce 100% 14/08/26 11:05:24 INFO mapreduce.Job: Job job_1409076190098_0002 failed with state FAILED due to: Task failed task_1409076190098_0002_m_000000 Job failed as tasks failed. failedMaps:1 failedReduces:0 14/08/26 11:05:24 INFO mapreduce.Job: Counters: 8 Job Counters Failed map tasks=4 Launched map tasks=4 Other local map tasks=4 Total time spent by all maps in occupied slots (ms)=9120 Total time spent by all reduces in occupied slots (ms)=0 Total time spent by all map tasks (ms)=9120 Total vcore-seconds taken by all map tasks=9120 Total megabyte-seconds taken by all map tasks=9338880

    JIRA | 3 years ago | Henry Saputra
    java.lang.NullPointerException

    Root Cause Analysis

    1. java.lang.NullPointerException

      No message provided

      at tachyon.client.TachyonFile.getInStream()
    2. Tachyon Project Core
      TFS.open
      1. tachyon.client.TachyonFile.getInStream(TachyonFile.java:126)
      2. tachyon.hadoop.HdfsFileInputStream.<init>(HdfsFileInputStream.java:58)
      3. tachyon.hadoop.AbstractTFS.open(AbstractTFS.java:374)
      4. tachyon.hadoop.TFS.open(TFS.java:10)
      4 frames
    3. Hadoop
      FileSystem.open
      1. org.apache.hadoop.fs.FileSystem.open(FileSystem.java:764)
      1 frame
    4. Hadoop
      YarnChild$2.run
      1. org.apache.hadoop.mapreduce.lib.input.LineRecordReader.initialize(LineRecordReader.java:85)
      2. org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525)
      3. org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)
      4. org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
      5. org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:173)
      5 frames
    5. Java RT
      Subject.doAs
      1. java.security.AccessController.doPrivileged(Native Method)
      2. javax.security.auth.Subject.doAs(Subject.java:415)
      2 frames
    6. Hadoop
      UserGroupInformation.doAs
      1. org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1626)
      1 frame
    7. Hadoop
      YarnChild.main
      1. org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)
      1 frame