org.apache.hadoop.hbase.MasterNotRunningException: Retried 10 times

SpringSource Issue Tracker | Yifeng Xiao | 4 years ago
  1. 0

    Reproduce step: 1) Deploy a Serengeti M4 vApp (0.8.0.0 Build 1063738) and power on the vApp 2) Login Serengeti Server in this vApp as user serengeti 3) Download the attached patch file (we can put it on public website, e.g. our IssueTracker Serengeti-1566 Deploy a MapR HBase cluster) 4) Execute the following commands to apply this patch: tar xzf patch-1566.tgz cd patch-1566-M4-for-mapr-hbase/ ./install.sh 5)Add MapR distro with hbase roles(mapr_hbase_master,mapr_hbase_regionserver, mapr_hbase_client) in manifest and restart tomcat; 6)Run below command in SERENGETI: cluster create --name maprhbase --distro mapr --specFile /opt/serengeti/samples/default_mapr_hbase_cluster.json 7)SSH to client with mapr/mapr 8)Run HBASE benchmark job: hbase org.apache.hadoop.hbase.PerformanceEvaluation --nomapred --rows=10000 randomWrite 20 Expected result: Job runs successfully; Actual result:Same error message goes around. at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) 13/04/12 08:53:09 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181 13/04/12 08:53:09 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration. 13/04/12 08:53:09 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) 13/04/12 08:53:09 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181 13/04/12 08:53:09 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration. 13/04/12 08:53:09 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) 13/04/12 08:53:09 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181 13/04/12 08:53:09 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration. 13/04/12 08:53:09 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) org.apache.hadoop.hbase.MasterNotRunningException: Retried 10 times at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:130) at org.apache.hadoop.hbase.PerformanceEvaluation.runNIsMoreThanOne(PerformanceEvaluation.java:491) at org.apache.hadoop.hbase.PerformanceEvaluation.runTest(PerformanceEvaluation.java:1161) at org.apache.hadoop.hbase.PerformanceEvaluation.doCommandLine(PerformanceEvaluation.java:1269) at org.apache.hadoop.hbase.PerformanceEvaluation.main(PerformanceEvaluation.java:1294) Thanks, Hong

    SpringSource Issue Tracker | 4 years ago | Yifeng Xiao
    org.apache.hadoop.hbase.MasterNotRunningException: Retried 10 times
  2. 0

    Reproduce step: 1) Deploy a Serengeti M4 vApp (0.8.0.0 Build 1063738) and power on the vApp 2) Login Serengeti Server in this vApp as user serengeti 3) Download the attached patch file (we can put it on public website, e.g. our IssueTracker Serengeti-1566 Deploy a MapR HBase cluster) 4) Execute the following commands to apply this patch: tar xzf patch-1566.tgz cd patch-1566-M4-for-mapr-hbase/ ./install.sh 5)Add MapR distro with hbase roles(mapr_hbase_master,mapr_hbase_regionserver, mapr_hbase_client) in manifest and restart tomcat; 6)Run below command in SERENGETI: cluster create --name maprhbase --distro mapr --specFile /opt/serengeti/samples/default_mapr_hbase_cluster.json 7)SSH to client with mapr/mapr 8)Run HBASE benchmark job: hbase org.apache.hadoop.hbase.PerformanceEvaluation --nomapred --rows=10000 randomWrite 20 Expected result: Job runs successfully; Actual result:Same error message goes around. at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) 13/04/12 08:53:09 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181 13/04/12 08:53:09 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration. 13/04/12 08:53:09 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) 13/04/12 08:53:09 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181 13/04/12 08:53:09 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration. 13/04/12 08:53:09 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) 13/04/12 08:53:09 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181 13/04/12 08:53:09 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration. 13/04/12 08:53:09 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) org.apache.hadoop.hbase.MasterNotRunningException: Retried 10 times at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:130) at org.apache.hadoop.hbase.PerformanceEvaluation.runNIsMoreThanOne(PerformanceEvaluation.java:491) at org.apache.hadoop.hbase.PerformanceEvaluation.runTest(PerformanceEvaluation.java:1161) at org.apache.hadoop.hbase.PerformanceEvaluation.doCommandLine(PerformanceEvaluation.java:1269) at org.apache.hadoop.hbase.PerformanceEvaluation.main(PerformanceEvaluation.java:1294) Thanks, Hong

    SpringSource Issue Tracker | 4 years ago | Yifeng Xiao
    org.apache.hadoop.hbase.MasterNotRunningException: Retried 10 times
  3. 0

    can't connect to zookeeper and then hbase master shuts down

    Stack Overflow | 4 years ago | raff0z
    org.apache.hadoop.hbase.MasterNotRunningException: Retried 10 times
  4. Speed up your debug routine!

    Automated exception search integrated into your IDE

  5. 0

    can not load page: MasterNotRunningException

    GitHub | 4 years ago | chenhsiu
    play.core.ActionInvoker$$anonfun$receive$1$$anon$1: Execution exception [[MasterNotRunningException: Retried 10 times]]
  6. 0

    GitHub comment 19#29797809

    GitHub | 3 years ago | keyboardfann
    org.apache.hadoop.hbase.MasterNotRunningException: Retried 10 times

    2 unregistered visitors
    Not finding the right solution?
    Take a tour to get the most out of Samebug.

    Tired of useless tips?

    Automated exception search integrated into your IDE

    Root Cause Analysis

    1. org.apache.hadoop.hbase.MasterNotRunningException

      Retried 10 times

      at org.apache.hadoop.hbase.client.HBaseAdmin.<init>()
    2. HBase - Client
      HBaseAdmin.<init>
      1. org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:130)
      1 frame
    3. HBase
      PerformanceEvaluation.main
      1. org.apache.hadoop.hbase.PerformanceEvaluation.runNIsMoreThanOne(PerformanceEvaluation.java:491)
      2. org.apache.hadoop.hbase.PerformanceEvaluation.runTest(PerformanceEvaluation.java:1161)
      3. org.apache.hadoop.hbase.PerformanceEvaluation.doCommandLine(PerformanceEvaluation.java:1269)
      4. org.apache.hadoop.hbase.PerformanceEvaluation.main(PerformanceEvaluation.java:1294)
      4 frames