hadoop2.2.0的HA问题

zhaopingzi · 发表于 2014-3-3 17:01

才发现，还有这东西
-bash-3.2$ ls -l /bin/false
-rwxr-xr-x 1 root root 19304 Feb 23 2010 /bin/false

zhaopingzi · 发表于 2014-3-3 17:17

本帖最后由 zhaopingzi 于 2014-3-3 17:19 编辑

waityou81 发表于 2014-3-3 16:49
你为啥要配/hadoop/hadoop/hadoop-2.2.0/bin/hadoop这个命令到shell fencing中，虽然成功但会让人迷惑？配/ ...

再请教个问题，在HA环境下，hbase-site.xml的这个怎么配
<property>
<name>hbase.rootdir</name>
<value>hdfs://testcluster/hbase</value> <---testcluster是集群的fs.defaultFS的值，是集群的名字；这样配置
</property> 貌似有问题，
<property>

waityou81 · 发表于 2014-3-3 17:23

我的hbase-site.xml.你贴出整个文件内容及错误日志
<configuration>
<property>
  <name>hbase.cluster.distributed</name>
  <value>true</value>
</property>
<property>
  <name>hbase.rootdir</name>
  <value>hdfs://mycluster/hbase</value>
</property>
<property>
  <name>hbase.zookeeper.quorum</name>
  <value>zk1,zk2,zk3</value>
</property>
</configuration>

zhaopingzi · 发表于 2014-3-3 17:36

本帖最后由 zhaopingzi 于 2014-3-4 09:21 编辑

waityou81 发表于 2014-3-3 17:23
我的hbase-site.xml.你贴出整个文件内容及错误日志

我这设置的话，./start-hbase.sh时，regionserver启不来，报：
2014-03-03 17:19:35,429 FATAL [regionserver60020] regionserver.HRegionServer: RegionServer abort: loaded coprocessors are: []
2014-03-03 17:19:35,445 INFO  [regionserver60020] regionserver.HRegionServer: STOPPED: Unhandled: Failed on local exception: java.io.IOException: Couldn't set up IO st
reams; Host Details : local host is: "PC81/192.168.7.81"; destination host is: "testcluster":8020;
2014-03-03 17:19:35,445 INFO  [regionserver60020] ipc.RpcServer: Stopping server on 60020
2014-03-03 17:19:35,446 INFO  [regionserver60020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager abruptly.
2014-03-03 17:19:35,446 INFO  [regionserver60020] regionserver.HRegionServer: aborting server PC81,60020,1393838289601
2014-03-03 17:19:35,446 DEBUG [regionserver60020] catalog.CatalogTracker: Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@73874578
2014-03-03 17:19:35,446 INFO  [regionserver60020] client.HConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x14486e9ec660003
2014-03-03 17:19:35,451 INFO  [regionserver60020] regionserver.HRegionServer: stopping server PC81,60020,1393838289601; all regions closed.
2014-03-03 17:19:35,554 INFO  [regionserver60020] regionserver.Leases: regionserver60020 closing leases
2014-03-03 17:19:35,554 INFO  [regionserver60020] regionserver.Leases: regionserver60020 closed leases
2014-03-03 17:19:35,554 INFO  [regionserver60020] regionserver.CompactSplitThread: Waiting for Split Thread to finish...
2014-03-03 17:19:35,554 INFO  [regionserver60020] regionserver.CompactSplitThread: Waiting for Merge Thread to finish...
2014-03-03 17:19:35,554 INFO  [regionserver60020] regionserver.CompactSplitThread: Waiting for Large Compaction Thread to finish...
2014-03-03 17:19:35,554 INFO  [regionserver60020] regionserver.CompactSplitThread: Waiting for Small Compaction Thread to finish...
2014-03-03 17:19:35,568 INFO  [regionserver60020] regionserver.HRegionServer: stopping server PC81,60020,1393838289601; zookeeper connection closed.
2014-03-03 17:19:35,568 INFO  [regionserver60020] regionserver.HRegionServer: regionserver60020 exiting
2014-03-03 17:19:35,568 ERROR [main] regionserver.HRegionServerCommandLine: Region server exiting
java.lang.RuntimeException: HRegionServer Aborted                            <--命令有问题？？？
      at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:66)
      at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:85)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
      at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
      at org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:2313)
2014-03-03 17:19:35,570 INFO  [Thread-5] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Ca
che$ClientFinalizer@682f78a8
2014-03-03 17:19:35,570 INFO  [Thread-5] regionserver.HRegionServer: STOPPED: Shutdown hook

./hbase-daemon.sh start regionserver这样起就没问题

<property>
<name>hbase.rootdir</name>
<value>hdfs://testcluster/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>

<property>
<name>hbase.zookeeper.quorum</name>
<value>pc81,pc82,pc84</value>
</property>
<property>
<name>hbase.zookeeper.property.dataDir</name>
<value>/hadoop/zookeeper</value>
</property>
</configuration>

waityou81 · 发表于 2014-3-3 21:23

觉得应该是hbase master起不来或者hdfs ha有问题，建议还是通读文档吧。

zhaopingzi · 发表于 2014-3-4 08:58

本帖最后由 zhaopingzi 于 2014-3-4 09:00 编辑

waityou81 发表于 2014-3-3 21:23
觉得应该是hbase master起不来或者hdfs ha有问题，建议还是通读文档吧。

单独起都能起来
直接用/start-hbase.sh这个脚本带不起来，请注意上面帖子的红色部分，

zhaopingzi · 发表于 2014-3-4 09:15

waityou81 发表于 2014-3-3 21:23
觉得应该是hbase master起不来或者hdfs ha有问题，建议还是通读文档吧。

今天又试了一下，发现start-hbase.sh只能把本机的hmaster和regionserver起来，另两台的regionserver起不来：报：
okeeper.ZooKeeper: Initiating client connection, connectString=pc82:2181,pc81:2181,pc84:2181 sessionTimeout=90000 watcher=regionserver:60020, quorum=pc82:2181,pc81:2181,pc84:2181, baseZNode=/hbase
2014-03-04 09:18:37,296 INFO  [regionserver60020] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:60020 connecting to ZooKeeper ensemble=pc82:2181,pc81:2181,pc84:2181
2014-03-04 09:18:37,298 INFO  [regionserver60020-SendThread(PC82:2181)] zookeeper.ClientCnxn: Opening socket connection to server PC82/192.168.7.82:2181. Will not attempt to authenticate using SASL (unknown error)
2014-03-04 09:18:37,301 INFO  [regionserver60020-SendThread(PC82:2181)] zookeeper.ClientCnxn: Socket connection established to PC82/192.168.7.82:2181, initiating session
2014-03-04 09:18:37,309 INFO  [regionserver60020-SendThread(PC82:2181)] zookeeper.ClientCnxn: Session establishment complete on server PC82/192.168.7.82:2181, sessionid = 0x244873ad1700012, negotiated timeout = 40000
2014-03-04 09:18:37,364 INFO  [main] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver60020
2014-03-04 09:18:37,676 INFO  [regionserver60020] zookeeper.ZooKeeper: Initiating client connection, connectString=pc82:2181,pc81:2181,pc84:2181 sessionTimeout=90000 watcher=hconnection-0x28c6c7bd, quorum=pc82:2181,pc81:2181,pc84:2181, baseZNode=/hbase
2014-03-04 09:18:37,677 INFO  [regionserver60020] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x28c6c7bd connecting to ZooKeeper ensemble=pc82:2181,pc81:2181,pc84:2181
2014-03-04 09:18:37,677 INFO  [regionserver60020-SendThread(PC84:2181)] zookeeper.ClientCnxn: Opening socket connection to server PC84/192.168.7.84:2181. Will not attempt to authenticate using SASL (unknown error)
2014-03-04 09:18:37,677 INFO  [regionserver60020-SendThread(PC84:2181)] zookeeper.ClientCnxn: Socket connection established to PC84/192.168.7.84:2181, initiating session
2014-03-04 09:18:37,680 INFO  [regionserver60020-SendThread(PC84:2181)] zookeeper.ClientCnxn: Session establishment complete on server PC84/192.168.7.84:2181, sessionid = 0x34486e9e52f0017, negotiated timeout = 40000
2014-03-04 09:18:37,783 INFO  [regionserver60020] ipc.RpcServer: Stopping server on 60020
2014-03-04 09:18:37,784 FATAL [regionserver60020] regionserver.HRegionServer: ABORTING region server PC82,60020,1393895917063: Initialization of RS failed.  Hence aborting RS.
java.io.IOException: java.lang.reflect.InvocationTargetException
      at org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:389)
      at org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:366)
      at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:247)
      at org.apache.hadoop.hbase.catalog.CatalogTracker.<init>(CatalogTracker.java:149)
      at org.apache.hadoop.hbase.regionserver.HRegionServer.initializeZooKeeper(HRegionServer.java:681)
      at org.apache.hadoop.hbase.regionserver.HRegionServer.preRegistrationInitialization(HRegionServer.java:644)
      at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:772)
      at java.lang.Thread.run(Thread.java:724)