本章介绍hbase完全分布式安装。
1. 依赖环境及版本选择
hbase在hadoop2.x的依赖,参考官网版本要求 https://hbase.apache.org/book.html#quickstart 选择一下版本:
- JDK1.8
- Hadoop-2.7.6(见hadoop安装)
- Zookeeper-3.4.5(见zookeeper安装)
- hbase2.0.0(到hbase官网看版本匹配关系)
2. 安装hbase
参考:https://blog.csdn.net/fishinhouse/article/details/81062272
https://blog.csdn.net/weixin_42003671/article/details/86539250
https://blog.csdn.net/qq_37677519/article/details/78996667
1.下载、解压、软链接
wget https://archive.apache.org/dist/hbase/2.0.0/hbase-2.0.0-bin.tar.gz
tar -zxvf hbase-2.0.0-bin.tar.gz
ln -s bigdata/hbase-2.0.0 hbase-current
2.配置 hbase-env.sh
(配置文件在conf目录下)
# 打开注释并修改
export JAVA_HOME=/home/hadoop/java-current
export HBASE_MANAGES_ZK=false
# 启动hbase的时候我发现只要启动正常就会生成pids文件,当hbase出问题关闭的时候这个文件就自动删除了,所以通过这个可以直观的判断运行情况。所以可以把这个路径设置到自己比较方便看到的地方
export HBASE_PID_DIR=/home/hadoop/hbase-current/pids
3.配置hbase-site.xml
<property>
<name>hbase.rootdir</name>
<value>hdfs://hadoop1:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>hadoop2,hadoop3,hadoop4</value>
</property>
4.修改regionservers
完全分布式模式的还需要修改conf/regionservers
. “regionservers” 列出了你希望运行的全部 HRegionServer,一行写一个host (就像Hadoop里面的 slaves 一样). 列在这里的server会随着集群的启动而启动,集群的停止而停止.
# 要删除之前的localhost
hadoop2
hadoop3
hadoop4
5.分发并设软链接
scp -r bigdata/hbase-2.0.0 hadoop3:~/bigdata/
scp -r bigdata/hbase-2.0.0 hadoop4:~/bigdata/
ln -s bigdata/hbase-2.0.0 hbase-current
6.加环境变量
# vim /etc/profile
export HBASE_HOME=/home/hadoop/hbase-current
export PATH=$PATH:$HBASE_HOME
7.启动hbase
# 确保hadoop已经启动和zookeeper已经启动
hadoop: start-all.sh
zookeep: zkServer.sh start
# 启动hbase
start-hbase.sh
注:在哪一台机器上输入此 start-hbase.sh
启动命令,那一台机器就是HMaster
jps查看进程情况:
[hadoop@hadoop2 bin]$ jps
2537 DataNode
2696 NodeManager
4173 HMaster
3447 QuorumPeerMain
4803 Jps
4413 HRegionServer
另外机器上就会有HRegionServer
进程。
8.web端查看hbaseMaster(默认16010端口)
http://hadoop2:16010/master-status
9.关闭hbase: stop-hbase.sh
关闭zookeeper:zkServer.sh stop
关闭hadoop: stop-all.sh
3. 测试hbase
在任意目录下输入hbase shell
进入hbase
[hadoop@hadoop2 ~]$ hbase shell
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/hadoop/bigdata/hbase-2.0.0/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop/bigdata/hadoop-2.7.6/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
HBase Shell
Use "help" to get list of supported commands.
Use "exit" to quit this interactive shell.
Version 2.0.0, r7483b111e4da77adbfc8062b3b22cbe7c2cb91c1, Sun Apr 22 20:26:55 PDT 2018
Took 0.0032 seconds
hbase(main):003:0> list_namespace
NAMESPACE
default
hbase
2 row(s)
Took 0.6266 seconds
说明:
本文配置参考官网。