java.io.NotSerializableException: org.apache.hadoop.io.Text Serialization stack: - object not serializable (class: org.apache.hadoop.io.Text, value: Hadoop) - field (class: scala.Tuple2, name: _1, type: class java.lang.Object) - object (class scala.Tuple2, (Hadoop,1)) - element of array (index: 0) - array (class [Lscala.Tuple2;, size 1)

Stack Overflow | srinivas amara | 2 months ago
tip
Do you know that we can give you better hits? Get more relevant results from Samebug’s stack trace search.
  1. 0

    Getting error on getting the sequence file content with rdd.collect() where as with rdd.foreach(println) not getting error in spark

    Stack Overflow | 2 months ago | srinivas amara
    java.io.NotSerializableException: org.apache.hadoop.io.Text Serialization stack: - object not serializable (class: org.apache.hadoop.io.Text, value: Hadoop) - field (class: scala.Tuple2, name: _1, type: class java.lang.Object) - object (class scala.Tuple2, (Hadoop,1)) - element of array (index: 0) - array (class [Lscala.Tuple2;, size 1)
  2. 0

    hadoop writables NotSerializableException with Apache Spark API

    Stack Overflow | 2 years ago | Vijay Innamuri
    java.io.NotSerializableException: org.apache.hadoop.io.LongWritable Serialization stack: - object not serializable (class: org.apache.hadoop.io.LongWritable, value: 15227295) - field (class: scala.Tuple2, name: _1, type: class java.lang.Object) - object (class scala.Tuple2, (15227295,)) - element of array (index: 0) - array (class [Lscala.Tuple2;, size 1153163)
  3. 0

    Spark, mail # user - Re: How to read sequence File. - 2015-06-02, 12:52

    search-hadoop.com | 2 years ago
    java.io.NotSerializableException: org.apache.hadoop.io.Text Serialization stack: - object not serializable (class: org.apache.hadoop.io.Text, value: 290090268£2013112699) - field (class: scala.Tuple2, name: _1, type: class java.lang.Object) - object (class scala.Tuple2, (290090268£2013112699,2900902682000-04-012000-03-221969-12-3110111-9925370390166893734173-9991.000000000000001.0000000000000019.00.00.0020.0020.0020.00113NY0000000000000000000-99902000-04-01 05:02:21-992000-07-01DW_BATCH2005-01-13 12:09:50DW_BATCH)) - element of array (index: 0) - array (class [Lscala.Tuple2;, size 10) at org.apache.spark.serializer.SerializationDebugger$.improveException(SerializationDebugger.scala:38) at org.apache.spark.serializer.JavaSerializationStream.writeObject(JavaSerializer.scala:47) at org.apache.spark.serializer.JavaSerializerInstance.serialize(JavaSerializer.scala:80)
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    notserializable error in spark while processing a file

    Stack Overflow | 1 month ago | suri
    java.io.NotSerializableException: scala.util.matching.Regex$$anon$4 Serialization stack: - object not serializable (class: scala.util.matching.Regex$$anon$4, value: empty iterator) - field (class: scala.Tuple5, name: _2, type: class java.lang.Object) - object (class scala.Tuple5, ([Ljava.lang.String;@75f043bd,empty iterator,empty iterator,empty iterator,empty iterator)) - element of array (index: 0) - array (class [Lscala.Tuple5;, size 30)

  1. tyson925 22 times, last 4 months ago
  2. johnxfly 14 times, last 1 month ago
2 unregistered visitors
Not finding the right solution?
Take a tour to get the most out of Samebug.

Tired of useless tips?

Automated exception search integrated into your IDE

Root Cause Analysis

  1. java.io.NotSerializableException

    org.apache.hadoop.io.Text Serialization stack: - object not serializable (class: org.apache.hadoop.io.Text, value: Hadoop) - field (class: scala.Tuple2, name: _1, type: class java.lang.Object) - object (class scala.Tuple2, (Hadoop,1)) - element of array (index: 0) - array (class [Lscala.Tuple2;, size 1)

    at org.apache.spark.serializer.SerializationDebugger$.improveException()
  2. Spark
    Executor$TaskRunner.run
    1. org.apache.spark.serializer.SerializationDebugger$.improveException(SerializationDebugger.scala:40)
    2. org.apache.spark.serializer.JavaSerializationStream.writeObject(JavaSerializer.scala:47)
    3. org.apache.spark.serializer.JavaSerializerInstance.serialize(JavaSerializer.scala:84)
    4. org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:240)
    4 frames
  3. Java RT
    Thread.run
    1. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    2. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    3. java.lang.Thread.run(Thread.java:744)
    3 frames