linux安装kudu环境变量,Linux安装Kudu+Impala(RedHat or CentOS)

￡神魔★判官ぃ 2023-01-20 12:54 39阅读 0赞

首先查看系统的版本，RedHat和CentOs通过

cat /etc/redhat-release

查看版本，这里我的系统版本是CentOS Linux release 7.3.1611 (Core)

其他系统查看版本参考：https://www.cnblogs.com/wzk-0000/p/7483262.html

一、安装Kudu

1. 下载cloudera-kudu.repo

地址：https://kudu.apache.org/docs/installation.html

参考地址：https://cwiki.apache.org/confluence/display/IMPALA/Building+Impala

这里我的linux版本是7.3.1，所以选择CentOs7版本的库，将cloudera-kudu.repo放到/etc/yum.repos.d目录下

2.执行安装命令

sudo yum install kudu                         \# Base Kudu files

sudo yum install kudu-master                  \# Kudu master init.d service script and default configuration

(如果是集群安装的话，仅在master运行)

sudo yum install kudu-tserver                 \# Kudu tablet server init.d service script and default configuration

(如果是集群安装，tserver仅在table服务的机器安装)

sudo yum install kudu-client0                 \# Kudu C++ client shared library

sudo yum install kudu-client-devel            \# Kudu C++ client SDK

3.安装Kudu RPMs(可选)

如果需要安装Kudu RPMs，先手动下载下来，然后使用命令sudo rpm -ivh 来安装。

4.启动服务

$ sudo service kudu-master start

$ sudo service kudu-tserver start

我在启动Kudu的时候报错了(日志路径/var/log/kudu/)：

F0124 15:35:50.682546 306685 master\_main.cc:68\] Check failed: \_s.ok() Bad status: Service unavailable: Cannot initialize clock: Error reading clock. Clock considered unsynchronized

看样子像是时钟服务的问题，错误的解决：

sudo yum install ntp

sudo /etc/init.d/ntpd restart(ntp服务重启)或者 sudo service ntpd restart

如果重启有错：

sudo /bin/systemctl start ntpd.service

如果/etc/init.d/ntpd不是ntpd的服务目录，可以使用whereis ntpd查找一下目录

有任何启动的错误，参考：

https://kudu.apache.org/docs/troubleshooting.html

http://community.cloudera.com/t5/Beta-Releases-RecordService/Kudu-service-failed-to-start-on-Cannot-initialize-clock/td-p/47303

5.关闭服务

$ sudo service kudu-master stop

$ sudo service kudu-tserver stop

6.如果需要设置系统启动的时候启动kudu

$ sudo chkconfig kudu-master on                \# RHEL / CentOS / SLES

$ sudo chkconfig kudu-tserver on               \# RHEL / CentOS / SLES

$ sudo update-rc.d kudu-master defaults        \# Debian / Ubuntu

$ sudo update-rc.d kudu-tserver defaults       \# Debian / Ubuntu

~~~~~~~~~~~~~~~~~~~~分割线~~~~~~~~~~~~~~~~~~~~~~~~~

安装Impala

参考：http://lxw1234.com/archives/2017/06/862.htm

版本：2.7.0+cdh5.9.0

sudo wget http://archive.cloudera.com/beta/impala-kudu/redhat/7/x86\_64/impala-kudu/0/RPMS/x86\_64/impala-kudu-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64.rpm

sudo wget http://archive.cloudera.com/beta/impala-kudu/redhat/7/x86\_64/impala-kudu/0/RPMS/x86\_64/impala-kudu-catalog-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64.rpm

sudo wget http://archive.cloudera.com/beta/impala-kudu/redhat/7/x86\_64/impala-kudu/0/RPMS/x86\_64/impala-kudu-state-store-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64.rpm

sudo wget http://archive.cloudera.com/beta/impala-kudu/redhat/7/x86\_64/impala-kudu/0/RPMS/x86\_64/impala-kudu-server-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64.rpm

sudo wget http://archive.cloudera.com/cdh5/redhat/7/x86\_64/cdh/5/RPMS/noarch/bigtop-utils-0.7.0+cdh5.16.1+0-1.cdh5.16.1.p0.3.el7.noarch.rpm

sudo wget http://archive.cloudera.com/beta/impala-kudu/redhat/7/x86\_64/impala-kudu/0/RPMS/x86\_64/impala-kudu-shell-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64.rpm

sudo wget http://archive.cloudera.com/beta/impala-kudu/redhat/7/x86\_64/impala-kudu/0/RPMS/x86\_64/impala-kudu-udf-devel-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64.rpm

sudo wget http://archive.cloudera.com/beta/impala-kudu/redhat/7/x86\_64/impala-kudu/0/RPMS/x86\_64/impala-kudu-debuginfo-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64.rpm

1.执行安装

sudo yum install -y python-setuptools

sudo rpm -ivh bigtop-utils-0.7.0+cdh5.12.0+0-1.cdh5.12.0.p0.37.el6.noarch.rpm

sudo rpm -ivh impala-kudu-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64.rpm --nodeps

(这里--nodeps代表了取消hadoop的一些依赖安装，否则会报错

error: Failed dependencies:

hadoop is needed by impala-kudu-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64

hadoop-hdfs is needed by impala-kudu-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64

hadoop-yarn is needed by impala-kudu-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64

hadoop-mapreduce is needed by impala-kudu-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64

hbase is needed by impala-kudu-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64

hive >= 0.12.0+cdh5.1.0 is needed by impala-kudu-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64

zookeeper is needed by impala-kudu-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64

hadoop-libhdfs is needed by impala-kudu-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64

avro-libs is needed by impala-kudu-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64

parquet is needed by impala-kudu-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64

sentry >= 1.3.0+cdh5.1.0 is needed by impala-kudu-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64

sentry is needed by impala-kudu-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64

)

sudo rpm -ivh impala-kudu-catalog-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64.rpm

sudo rpm -ivh impala-kudu-state-store-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64.rpm

sudo rpm -ivh impala-kudu-server-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64.rpm

sudo rpm -ivh impala-kudu-shell-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64.rpm

sudo rpm -ivh impala-kudu-udf-devel-2.7.0+cdh5.9.0+0-1.cdh5.9.0.p0.11.el7.x86\_64.rpm

2.配置

sudo vim /etc/default/bigtop-utils

export JAVA\_HOME=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.151-1.b12.el7\_4.x86\_64

这里如果找不到JAVA\_HOME，可以通过whereis java或者which java，要是再找不到，去/usr/lib/jvm下看看吧

单机安装的话不需要其他的配置了

如果是集群的话，需要配置

vim /etc/default/impala

IMPALA\_CATALOG\_SERVICE\_HOST=10.255.206.155

IMPALA\_STATE\_STORE\_HOST=10.255.206.155

这里两个host是指master的地址

3.hdfs和hive对接配置

cd /etc/impala/conf.dist

sudo cp /etc/hadoop/conf/core-site.xml core-site.xml

sudo cp /etc/hadoop/conf/hdfs-site.xml hdfs-site.xml

sudo cp /etc/hadoop/conf/hive-site.xml hive-site.xml

sudo cp /etc/hive/hive-env.sh hive-env.sh

修改hdfs-site.xml，添加

dfs.datanode.hdfs-blocks-metadata.enabled

true

dfs.client.use.legacy.blockreader.local

false

dfs.datanode.data.dir.perm

750

dfs.block.local-path-access.user

hadoop

dfs.client.file-block-storage-locations.timeout

10000

4.启动服务

sudo service impala-state-store start

sudo service impala-catalog start

sudo service impala-server start

测试impala的环境：

http://host:25020 (catalog)

http://host:25000 (impala server)

http://host:25010 (state-store)

执行impala-shell 进入impala命令行

如果现实not connected, 尝试使用connect localhost:8051

\-------OK----享受其中吧

linux安装kudu环境变量,Linux安装Kudu+Impala(RedHat or CentOS)

发表评论取消回复

还没有评论，来说两句吧...

相关阅读

相关 linux jdk安装，配置环境变量

相关 Linux环境CentOS7安装Git环境

相关安装java配置环境变量_linux安装java配置环境变量

相关 linux安装kudu环境变量,Linux安装Kudu+Impala(RedHat or CentOS)

相关 Linux安装tomcat，配置环境变量

相关 linux 安装java 配置环境变量

相关 Linux安装tomcat，配置环境变量

相关 Linux安装Ruby环境，Linux中Ruby环境变量配置

相关 Linux JDK安装&环境变量配置

相关 Linux安装jdk配置环境变量