Ubuntu16.04 安装配置HBase详细步骤（单机版）

淡淡的烟草味﹌ 2022-03-08 05:20 456阅读 0赞

### 前题条件 ###

（1）Ubuntu16.04 机子一台，最好可以联网

（2）已安装Hadoop，推荐安装2.7.7版本，因为它比较稳定，并且和Habse的兼容性最好。

### Hadoop和HBase版本对照表 ###

*   √ = 完全可以兼容
 *   ？= 存在未知的兼容问题
 *    × = 不兼容

<table> 
 <thead> 
  <tr> 
   <th>&nbsp;</th> 
   <th>HBase-1.2.x, HBase-1.3.x</th> 
   <th style="width:167px;">HBase-1.4.x</th> 
   <th style="width:162px;">HBase-2.0.x</th> 
   <th style="width:167px;">HBase-2.1.x</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td> <p>Hadoop-2.4.x</p> </td> 
   <td>√</td> 
   <td style="width:167px;">×</td> 
   <td style="width:162px;">×</td> 
   <td style="width:167px;">×</td> 
  </tr> 
  <tr> 
   <td> <p>Hadoop-2.5.x</p> </td> 
   <td>√</td> 
   <td style="width:167px;">×</td> 
   <td style="width:162px;">×</td> 
   <td style="width:167px;">×</td> 
  </tr> 
  <tr> 
   <td> <p>Hadoop-2.6.0</p> </td> 
   <td>×</td> 
   <td style="width:167px;">×</td> 
   <td style="width:162px;">×</td> 
   <td style="width:167px;">×</td> 
  </tr> 
  <tr> 
   <td> <p>Hadoop-2.6.1+</p> </td> 
   <td>√</td> 
   <td style="width:167px;">×</td> 
   <td style="width:162px;">√</td> 
   <td style="width:167px;">×</td> 
  </tr> 
  <tr> 
   <td>Hadoop的2.7.0</td> 
   <td>×</td> 
   <td style="width:167px;">×</td> 
   <td style="width:162px;">×</td> 
   <td style="width:167px;">×</td> 
  </tr> 
  <tr> 
   <td> <p>Hadoop-2.7.1+</p> </td> 
   <td>√</td> 
   <td style="width:167px;">√</td> 
   <td style="width:162px;">√</td> 
   <td style="width:167px;">√</td> 
  </tr> 
  <tr> 
   <td> <p>Hadoop-2.8.[0-1]</p> </td> 
   <td>×</td> 
   <td style="width:167px;">×</td> 
   <td style="width:162px;">×</td> 
   <td style="width:167px;">×</td> 
  </tr> 
  <tr> 
   <td> <p>Hadoop-2.8.2</p> </td> 
   <td>？</td> 
   <td style="width:167px;">？</td> 
   <td style="width:162px;">？</td> 
   <td style="width:167px;">？</td> 
  </tr> 
  <tr> 
   <td> <p>Hadoop-2.8.3+</p> </td> 
   <td>？</td> 
   <td style="width:167px;">？</td> 
   <td style="width:162px;">√</td> 
   <td style="width:167px;">√</td> 
  </tr> 
  <tr> 
   <td> <p>Hadoop-2.9.0</p> </td> 
   <td>×</td> 
   <td style="width:167px;">×</td> 
   <td style="width:162px;">×</td> 
   <td style="width:167px;">×</td> 
  </tr> 
  <tr> 
   <td> <p>Hadoop-2.9.1+</p> </td> 
   <td>？</td> 
   <td style="width:167px;">？</td> 
   <td style="width:162px;">？</td> 
   <td style="width:167px;">？</td> 
  </tr> 
  <tr> 
   <td> <p>Hadoop-3.0.[0-2]</p> </td> 
   <td>×</td> 
   <td style="width:167px;">×</td> 
   <td style="width:162px;">×</td> 
   <td style="width:167px;">×</td> 
  </tr> 
  <tr> 
   <td> <p>Hadoop-3.0.3+</p> </td> 
   <td>×</td> 
   <td style="width:167px;">×</td> 
   <td style="width:162px;">√</td> 
   <td style="width:167px;">√</td> 
  </tr> 
  <tr> 
   <td> <p>Hadoop-3.1.0</p> </td> 
   <td>×</td> 
   <td style="width:167px;">×</td> 
   <td style="width:162px;">×</td> 
   <td style="width:167px;">×</td> 
  </tr> 
  <tr> 
   <td> <p>Hadoop-3.1.1+</p> </td> 
   <td>×</td> 
   <td style="width:167px;">×</td> 
   <td style="width:162px;">√</td> 
   <td style="width:167px;">√</td> 
  </tr> 
 </tbody> 
</table>

相信我，一定要严格按照版本对照表安装HBase，不然你会遇见很多的问题。

### 下载HBase ###

本次安装的是HBase2.0.4版本，Hadoop为2.7.7版本。

清华镜像下载地址：[https://mirrors.tuna.tsinghua.edu.cn/apache/hbase/2.0.4/hbase-2.0.4-bin.tar.gz][https_mirrors.tuna.tsinghua.edu.cn_apache_hbase_2.0.4_hbase-2.0.4-bin.tar.gz]

使用wget命令下载：

root@master:/# mkdir HBase
    root@master:/# cd HBase/
    root@master:/HBase# wget https://mirrors.tuna.tsinghua.edu.cn/apache/hbase/2.0.4/hbase-2.0.4-bin.tar.gz

解压：

root@master:/HBase# ls
    hbase-2.0.4-bin.tar.gz
    root@master:/HBase# tar -xzvf hbase-2.0.4-bin.tar.gz

移动文件：

root@master:/HBase# ls
    hbase-2.0.4  hbase-2.0.4-bin.tar.gz
    root@master:/HBase# mv hbase-2.0.4/* ./

删除安装包：

root@master:/HBase# ls
    bin  CHANGES.md  conf  docs  hbase-2.0.4  hbase-2.0.4-bin.tar.gz  hbase-webapps  LEGAL  lib  LICENSE.txt  NOTICE.txt  README.txt  RELEASENOTES.md
    root@master:/HBase# rm -rf hbase-*

### 配置HBase ###

配置etc/profile,添加如下内容：

export HBASE_HOME=/HBase
    export PATH=$PATH:$HBASE_HOME/bin

使配置文件生效

source /etc/profile

HBase的配置文件全在conf这个文件夹下，需要配置的有三个文件：

**1.hbase-env.sh**

**2.hbase-site.xml**

**3.regionservers**

配置**hbase-env.sh**

root@master:/HBase# cd conf/
    root@master:/HBase/conf# ls
    hadoop-metrics2-hbase.properties  hbase-env.cmd  hbase-env.sh  hbase-policy.xml  hbase-site.xml  log4j.properties  regionservers
    root@master:/HBase/conf# vim hbase-env.sh

添加如下内容

#true为单机版，false为集群版
    export HBASE_MANAGES_ZK=true
    #jdk目录
    export JAVA_HOME=/Java/jdk1.8
    #hadoop 目录
    export HADOOP_HOME=/Hadoop
    #hbase目录
    export HBASE_HOME=/HBase

配置**hbase-site.xml**,修改<configuration></configuration>为：

<configuration>
     
      <property>
        <name>hbase.rootdir</name>
        <value>hdfs://master:9000/hbase</value>
      </property>
      
      <property>
         <name>hbase.cluster.distributed</name>
         <value>true</value>
      </property>
      
      <property>
          <name>hbase.master</name>
          <value>master:60010</value>
      </property>
      
       <property>
        <name>hbase.zookeeper.property.dataDir</name>
        <value>/Zookeeper/temp</value>
      </property>
     
      <property>
        <name>hbase.zookeeper.quorum</name>
        <value>master</value>
      </property>
      
      <property>
        <name>hbase.zookeeper.property.clientPort</name>
        <value>2181</value>
      </property>
    </configuration>

配置**regionservers**

添加

master

### 安装Zookeeper ###

zookeeper的作用主要是当集群中的master挂掉之后，它会重新选一位master，本次安装的是单机版的HBase，因此安装zookeeper可以省略。

下载地址：[https://mirrors.tuna.tsinghua.edu.cn/apache/zookeeper/zookeeper-3.4.13/zookeeper-3.4.13.tar.gz][https_mirrors.tuna.tsinghua.edu.cn_apache_zookeeper_zookeeper-3.4.13_zookeeper-3.4.13.tar.gz]

使用wget下载zookeeper

root@master:/# mkdir Zookeeper
    root@master:/# cd Zookeeper/
    root@master:/Zookeeper# wget https://mirrors.tuna.tsinghua.edu.cn/apache/zookeeper/zookeeper-3.4.13/zookeeper-3.4.13.tar.gz

解压

root@master:/Zookeeper# ls
    zookeeper-3.4.13.tar.gz
    root@master:/Zookeeper# tar -xzvf zookeeper-3.4.13.tar.gz

删除安装包：

root@master:/Zookeeper# ls
    zookeeper-3.4.13  zookeeper-3.4.13.tar.gz
    root@master:/Zookeeper# mv zookeeper-3.4.13/* ./
    root@master:/Zookeeper# rm -rf zookeeper-3.4.13
    root@master:/Zookeeper# rm -rf zookeeper-3.4.13.tar.gz 
    root@master:/Zookeeper# ls
    bin        contrib     ivysettings.xml  LICENSE.txt  README_packaging.txt  zookeeper-3.4.13.jar      zookeeper-3.4.13.jar.sha1
    build.xml  dist-maven  ivy.xml          NOTICE.txt   recipes               zookeeper-3.4.13.jar.asc
    conf       docs        lib              README.md    src                   zookeeper-3.4.13.jar.md5

### 配置Zookeeper ###

配置 /etc/peofile，添加如下内容：

export ZOOKEEPER_HOME=/Zookeeper
    export PATH=$PATH:$ZOOKEEPER_HOME/bin

使配置文件生效：

source /etc/profile

Zookeeper的配置文件只有一个，在conf文件夹下，名为：zoo\_sample.cfg（修改后需复制一份为zoo.cfg才行）

修改zoo\_sample.cfg为：

# The number of milliseconds of each tick
    tickTime=2000
    # The number of ticks that the initial 
    # synchronization phase can take
    initLimit=10
    # The number of ticks that can pass between 
    # sending a request and getting an acknowledgement
    syncLimit=5
    # the directory where the snapshot is stored.
    # do not use /tmp for storage, /tmp here is just 
    # example sakes.
    dataDir=/Zookeeper/data
    dataLogDir=/Zookeeper/logs
    # the port at which the clients will connect
    clientPort=2181
    # the maximum number of client connections.
    # increase this if you need to handle more clients
    #maxClientCnxns=60
    #
    # Be sure to read the maintenance section of the 
    # administrator guide before turning on autopurge.
    #
    # http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
    #
    # The number of snapshots to retain in dataDir
    #autopurge.snapRetainCount=3
    # Purge task interval in hours
    # Set to "0" to disable auto purge feature
    #autopurge.purgeInterval=1
    server.0=master:2888:3888

复制一份：

root@master:/Zookeeper/conf# cp zoo_sample.cfg zoo.cfg

最后，还需在zookeeper的dataDir内新建一个myid文件，内容为zoo.cfg中server.后面的数字，这里为0

root@master:/Zookeeper/data# echo "0">>myid

启动zookeeper：

root@master:/Zookeeper/conf# zkServer.sh start
    ZooKeeper JMX enabled by default
    Using config: /Zookeeper/bin/../conf/zoo.cfg
    Starting zookeeper ... STARTED
    root@master:/Zookeeper/conf# jps
    22995 QuorumPeerMain
    8309 NameNode
    8421 DataNode
    23014 Jps
    8798 ResourceManager
    8911 NodeManager

可以看到zookeeper的进程QuorumPeerMain启动成功了。

### 启动HBase ###

启动HBase的过程遇到了一些问题，下面一一指出：

root@master:/HBase/logs# jps
    22995 QuorumPeerMain
    8309 NameNode
    8421 DataNode
    23405 Jps
    8798 ResourceManager
    8911 NodeManager
    root@master:/HBase/logs# start-hbase.sh 
    SLF4J: Class path contains multiple SLF4J bindings.
    SLF4J: Found binding in [jar:file:/HBase/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: Found binding in [jar:file:/Hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
    SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
    running master, logging to /HBase/logs/hbase-root-master-master.out
    root@master:/HBase/logs# jps
    23536 HMaster
    22995 QuorumPeerMain
    8309 NameNode
    8421 DataNode
    23611 Jps
    8798 ResourceManager
    8911 NodeManager
    root@master:/HBase/logs# jps
    22995 QuorumPeerMain
    8309 NameNode
    8421 DataNode
    23638 Jps
    8798 ResourceManager
    8911 NodeManager

**问题1**

Class path contains multiple SLF4J bindings警告。

**解决办法**

上面提示HBase的**slf4j-log4j12-1.7.25.jar**包和Hadoop的**slf4j-log4j12-1.7.10.jar**包起冲突了，因此只需删除其中的一个即可，为了防止误删，这里只是将**slf4j-log4j12-1.7.25.jar**更改了一下名称

mv /HBase/lib/slf4j-log4j12-1.7.25.jar /HBase/lib/slf4j-log4j12-1.7.25.jar_cp

之后再启动HBase就不会报警告啦。

**问题2**

HBase启动后HMaster进程过一会儿就消失了。

**解决办法**

查看HBase的日志文件，在/HBase/logs目录下，提示：

2019-03-14 18:15:05,156 ERROR [main] master.HMasterCommandLine: Master exiting
    java.io.IOException: Could not start ZK at requested port of 2181.  ZK was started at port: 2182.  Aborting as clients (e.g. shell) will not be able to find this ZK quorum.
            at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:217)
            at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:140)
            at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
            at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:149)
            at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:3073)
    2019-03-14 18:15:05,171 INFO  [Thread-2] server.NIOServerCnxn: Closed socket connection for client /127.0.0.1:38288 (no session established for client)

提示zookeeper启动的端口为2182，而不是2181，因此这里将/HBase/conf/hbase-site.xml内的zookeeper请求端口设置改为了：

<property>
        <name>hbase.zookeeper.property.clientPort</name>
        <value>2182</value>
      </property>

启动HBase

root@master:/HBase/conf# start-hbase.sh 
    running master, logging to /HBase/logs/hbase-root-master-master.out
    root@master:/HBase/conf# jps
    32995 Jps
    32053 HQuorumPeer
    29574 DataNode
    29463 NameNode
    29962 ResourceManager
    32154 HMaster
    30076 NodeManager
    32268 HRegionServer

到此HBase就安装成功啦。

[https_mirrors.tuna.tsinghua.edu.cn_apache_hbase_2.0.4_hbase-2.0.4-bin.tar.gz]: https://mirrors.tuna.tsinghua.edu.cn/apache/hbase/2.0.4/hbase-2.0.4-bin.tar.gz
[https_mirrors.tuna.tsinghua.edu.cn_apache_zookeeper_zookeeper-3.4.13_zookeeper-3.4.13.tar.gz]: https://mirrors.tuna.tsinghua.edu.cn/apache/zookeeper/zookeeper-3.4.13/zookeeper-3.4.13.tar.gz