org.apache.pig.backend.executionengine.ExecException: Failed to create DataStorage

hadoop-pig-user | Travis Brady | 9 years ago
tip
Click on the to mark the solution that helps you, Samebug will learn from it.
As a community member, you’ll be rewarded for you help.
  1. 0

    Re: Error with Getting Started

    hadoop-pig-user | 9 years ago | Travis Brady
    org.apache.pig.backend.executionengine.ExecException: Failed to create DataStorage
  2. 0

    Following exception happens when users run Pig queries over large data. Brought up this with Hadoop team and this is follow-up JIRA. java.net.SocketTimeoutException: timed out waiting for rpc response at org.apache.hadoop.ipc.Client.call(Client.java:484) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:184) at $Proxy1.getJobStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59) at $Proxy1.getJobStatus(Unknown Source) at org.apache.hadoop.mapred.JobClient$NetworkedJob.ensureFreshStatus(JobClient.java:182) at org.apache.hadoop.mapred.JobClient$NetworkedJob.isComplete(JobClient.java:237) at org.apache.pig.impl.mapreduceExec.MapReduceLauncher.launchPig(MapReduceLauncher.java:189) at org.apache.pig.impl.physicalLayer.POMapreduce.open(POMapreduce.java:136) at org.apache.pig.impl.physicalLayer.PhysicalPlan.exec(PhysicalPlan.java:39) at org.apache.pig.impl.physicalLayer.IntermedResult.exec(IntermedResult.java:122) at org.apache.pig.PigServer.store(PigServer.java:445) at org.apache.pig.PigServer.store(PigServer.java:413) at org.apache.pig.tools.grunt.GruntParser.processStore(GruntParser.java:135) at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:327) at org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:64) at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:48) at org.apache.pig.Main.main(Main.java:246) timed out waiting for rpc response Is this a bug or we have a time-out setting directly related to this in Hadoop?

    Apache's JIRA Issue Tracker | 9 years ago | Amir Youssefi
    java.net.SocketTimeoutException: timed out waiting for rpc response
  3. 0

    ±¾µØeclipseÁ¬½ÓÔ¶³Ìhadoopʱ·¢Éú´íÎó - Hadoop×ÛºÏ - Hadoop¼¼ÊõÂÛ̳-´óÊý¾Ý½â¾ö·½°¸ hadoop,spark,storm,·Ö²¼Ê½,´óÊý¾Ý£¬big data - Powered by Discuz!

    hadoopor.com | 2 years ago
    java.net.SocketTimeoutException: Call to /ip:8020 failed on socket timeout exception: java.net.SocketTimeoutException: 20000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=/ip:8020]
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    Hive/hadoop retrying to connect on an unknown address

    Stack Overflow | 1 year ago | GermainGum
    java.net.SocketTimeoutException: Call to ec2-XX-XXX-XXX-XX.compute-1.amazonaws.com/10.123.212.217:9010 failed on socket timeout exception: java.net.SocketTimeoutException: 20000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=ec2-XX-XXX-XXX-XX.compute-1.amazonaws.com/10.123.212.217:9010]

    Root Cause Analysis

    1. java.net.SocketTimeoutException

      timed out waiting for rpc response

      at org.apache.hadoop.ipc.Client.call()
    2. Hadoop
      RPC$Invoker.invoke
      1. org.apache.hadoop.ipc.Client.call(Client.java:484)
      2. org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:184)
      2 frames
    3. org.apache.hadoop
      $Proxy0.getProtocolVersion
      1. org.apache.hadoop.dfs.$Proxy0.getProtocolVersion(Unknown Source)
      1 frame
    4. Hadoop
      RPC.getProxy
      1. org.apache.hadoop.ipc.RPC.getProxy(RPC.java:269)
      1 frame
    5. org.apache.hadoop
      DistributedFileSystem.initialize
      1. org.apache.hadoop.dfs.DFSClient.createNamenode(DFSClient.java:147)
      2. org.apache.hadoop.dfs.DFSClient.<init>(DFSClient.java:161)
      3. org.apache.hadoop.dfs.DistributedFileSystem.initialize(DistributedFileSystem.java:65)
      3 frames
    6. Hadoop
      FileSystem.get
      1. org.apache.hadoop.fs.FileSystem.get(FileSystem.java:159)
      2. org.apache.hadoop.fs.FileSystem.getNamed(FileSystem.java:118)
      3. org.apache.hadoop.fs.FileSystem.get(FileSystem.java:90)
      3 frames
    7. org.apache.pig
      Main.main
      1. org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:36)
      2. org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:140)
      3. org.apache.pig.impl.PigContext.connect(PigContext.java:182)
      4. org.apache.pig.PigServer.<init>(PigServer.java:123)
      5. org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:37)
      6. org.apache.pig.Main.main(Main.java:245)
      6 frames