OpenStack 运维 - 环境部署 | 报错排查 [T版]

落日映苍穹つ 2023-01-22 10:52 26阅读 0赞

### OpenStack 运维 - 环境部署 ###

*  一、环境配置
 *  二、基础配置
 *   *  1. 配置国内YUM源
     *  2. 修改主机名及关闭防火墙
     *  3. 安装相关环境依赖包
     *  4. 调优 NAT 网卡及配置 DNS 和 映射
     *  5. 配置免交护
     *  6. 配置时间同步
     *   *  所有节点安装
         *  控制节点ct
         *  计算节点c1/2
 *  三、系统环境配置
 *   *  1. 安装及配置 MariaDB
     *  2. 安装 RabbitMQ
     *  3. 安装 memcached
     *  4. 安装etcd
     *  5. 安装OpenStack组件
 *  四、报错解决
 *   *  Error: unable to connect to node rabbit@localhost: nodedown

# 一、环境配置 #

<table> 
 <thead> 
  <tr> 
   <th>主机</th> 
   <th>CPU</th> 
   <th>内存</th> 
   <th>双网卡</th> 
   <th>操作系统</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td>控制节点-ct</td> 
   <td>2C4T</td> 
   <td>8G</td> 
   <td>NAT：192.168.0.100 VMnet：192.168.1.100</td> 
   <td>CentOS 7-9 最小化安装</td> 
  </tr> 
  <tr> 
   <td>计算节点-c1</td> 
   <td>2C4T</td> 
   <td>8G</td> 
   <td>NAT：192.168.0.200 VMnet：192.168.1.200</td> 
   <td>CentOS 7-9 最小化安装</td> 
  </tr> 
  <tr> 
   <td>计算节点-c2</td> 
   <td>2C4T</td> 
   <td>8G</td> 
   <td>NAT：192.168.0.250 VMnet：192.168.1.250</td> 
   <td>CentOS 7-9 最小化安装</td> 
  </tr> 
 </tbody> 
</table>

# 二、基础配置 #

## 1. 配置国内YUM源 ##

NAT网卡用于下载工具 VM网卡用于内部连接

mv *.repo repo_bak;
    curl -o /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-7.repo
    #建议在线源多下载两次，有时可能不是最新状态
    
    yum clean all && yum makecache fast

## 2. 修改主机名及关闭防火墙 ##

hostnamectl set-hostname ct #c1/c2
    su -
    
    systemctl stop firewalld
    systemctl disable firewalld
    setenforce 0
    
    vim /etc/sysconfig/selinux 
    SELINUX=disabled

## 3. 安装相关环境依赖包 ##

多下载安装几次，一直到看到出现软件包已安装并且是最新版本为止，因为有时可能会漏装！

yum -y install net-tools bash-completion vim gcc gcc-c++ make pcre  pcre-devel expat-devel cmake bzip2 lrzsz net-tools
    #EXPAT是C语言发开库
    
    yum -y install centos-release-openstack-train python-openstackclient openstack-selinux openstack-utils
    #OpenStack的train版本仓库源安装包、OpenStack客户端及openstack-selinux安装包

## 4. 调优 NAT 网卡及配置 DNS 和 映射 ##

修改主网卡（NAT）
    IPV4_ROUTE_METRIC=90		#增加此配置，调优优先级，NAT网卡优先

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNDI3OTcx_size_16_color_FFFFFF_t_70][]

echo "192.168.1.100 ct
    192.168.1.200 c1
    192.168.1.250 c2" >> /etc/hosts
    
    echo "nameserver 114.114.114.114
    nameserver 114.114.115.115" >> /etc/resolv.conf

## 5. 配置免交护 ##

#全部按回车
    ssh-keygen -t rsa
    
    #节点之间互相免交护
    ssh-copy-id ct
    ssh-copy-id c1
    ssh-copy-id c2

## 6. 配置时间同步 ##

### 所有节点安装 ###

yum install chrony -y

### 控制节点ct ###

vim /etc/chrony.conf
    
    #server 0.centos.pool.ntp.org iburst
    #server 1.centos.pool.ntp.org iburst
    #server 2.centos.pool.ntp.org iburst
    #server 3.centos.pool.ntp.org iburst
    server ntp6.aliyun.com iburst 
    #iburst表示尽快同步
    allow 192.168.1.0/24
    #允许1.0网段同步

查看时间同步

chronyc sources

### 计算节点c1/2 ###

vim /etc/chrony.conf 
    #server 0.centos.pool.ntp.org iburst
    #server 1.centos.pool.ntp.org iburst
    #server 2.centos.pool.ntp.org iburst
    #server 3.centos.pool.ntp.org iburst
    server ct iburst	
    
    ----
    systemctl enable chronyd.service
    systemctl restart chronyd.service
    chronyc sources
    
    crontab -e
    */5 * * * * /usr/bin/chronyc sources >>/var/log/chronyc.log

# 三、系统环境配置 #

**控制节点ct**

## 1. 安装及配置 MariaDB ##

yum -y install mariadb mariadb-server python2-PyMySQL
    #此包用于openstack的控制端连接mysql所需要的模块，如果不安装，则无法连接数据库
    
    yum -y install libibverbs
    
    --
    
    vim /etc/my.cnf.d/openstack.cnf
    #添加MySQL子配置文件，增加如下内容
    [mysqld]
    bind-address = 192.168.1.100
    default-storage-engine = innodb
    innodb_file_per_table = on
    max_connections = 4096
    collation-server = utf8_general_ci
    character-set-server = utf8
    
    #详解：
    [mysqld] 
    bind-address = 192.168.1.100			//控制节点局域网地址
    default-storage-engine = innodb 		//默认存储引擎 
    innodb_file_per_table = on 				//每张表独立表空间文件
    max_connections = 4096 					//最大连接数 
    collation-server = utf8_general_ci 		//默认字符集 
    character-set-server = utf8				//字符集类型，避免乱码
    
    --
    systemctl enable mariadb
    systemctl start mariadb
    
    --
    mysql_secure_installation
    #执行MariaDB安全配置脚本
    Enter current password for root (enter for none):			//回车
    OK, successfully used password, moving on...
    Set root password? [Y/n] Y									//设置root密码？
    Remove anonymous users? [Y/n] Y								//删除匿名用户？
     ... Success!
    Disallow root login remotely? [Y/n] N						//是否不允许root用户远程登陆？
     ... skipping.
    Remove test database and access to it? [Y/n] Y 				//是否删除test测试库？
    Reload privilege tables now? [Y/n] Y 						//现在重新加载特权表？

## 2. 安装 RabbitMQ ##

yum -y install rabbitmq-server
    
    systemctl enable rabbitmq-server.service
    systemctl start rabbitmq-server.service
    
    --
    rabbitmqctl add_user openstack RABBIT_PASS
    #创建消息队列用户,用于controler和计算节点连接rabbitmq的认证（关联）
    
    rabbitmqctl set_permissions openstack ".*" ".*" ".*"
    #配置openstack用户的操作权限(正则，配置读写权限）
    
    --
    netstat -natp | grep 25672
    #567是Rabbitmq默认端口
    netstat -natp | grep 5672
    #25672是Rabbit的测试工具CLI的端口
    
    --
    rabbitmq-plugins list
    #查看rabbitmq插件列表
    
    rabbitmq-plugins enable rabbitmq_management
    #开启rabbitmq的web管理界面的插件，端口为15672
    
    --
    netstat -natp | grep 5672
    #检查端口

![20210519162616262.png][]

浏览器访问"192.168.0.100:15672"[NAT]
    账号密码默认均为"guest"

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNDI3OTcx_size_16_color_FFFFFF_t_70 1][]

## 3. 安装 memcached ##

yum install -y memcached python-memcached
    #python-*模块在OpenStack中起到连接数据库的作用
    
    cat /etc/sysconfig/memcached
    #查看Memcached配置文件
    
    --
    
    systemctl enable memcached
    systemctl start memcached
    
    netstat -nautp | grep 11211

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNDI3OTcx_size_16_color_FFFFFF_t_70 2][]

## 4. 安装etcd ##

yum -y install etcd
    
    cd /etc/etcd/
    vim etcd.conf 
    删除所有内容，复制粘贴以下内容并进行修改
    
    ETCD_DATA_DIR="/var/lib/etcd/default.etcd"
    ETCD_LISTEN_PEER_URLS="http://192.168.1.100:2380"
    ETCD_LISTEN_CLIENT_URLS="http://192.168.1.100:2379"	
    ETCD_NAME="ct"	
    ETCD_INITIAL_ADVERTISE_PEER_URLS="http://192.168.1.100:2380"
    ETCD_ADVERTISE_CLIENT_URLS="http://192.168.1.100:2379"
    ETCD_INITIAL_CLUSTER="ct=http://192.168.1.100:2380"	
    ETCD_INITIAL_CLUSTER_TOKEN="etcd-cluster-01"
    ETCD_INITIAL_CLUSTER_STATE="new"
    
    #设置开机自启并检测端口开放
    systemctl enable etcd.service
    systemctl start etcd.service
    netstat -anutp |grep 2379
    netstat -anutp |grep 2380

![20210519163916890.png][]

## 5. 安装OpenStack组件 ##

**计算节点c1/c2**

yum -y install centos-release-openstack-train python-openstackclient openstack-selinux openstack-utils

# 四、报错解决 #

## Error: unable to connect to node rabbit@localhost: nodedown ##

DIAGNOSTICS  
===========

attempted to contact: \[rabbit@localhost\]

rabbit@localhost:

*  connected to epmd (port 4369) on localhost
 *  epmd reports node ‘rabbit’ running on port 25672
 *  TCP connection succeeded but Erlang distribution failed
 *  Hostname mismatch: node “rabbit@ct” believes its host is different. Please ensure that hostnames resolve the same way locally and on “rabbit@ct”

current node details:

*  node name: ‘rabbitmq-cli-12@ct’
 *  home dir: /var/lib/rabbitmq
 *  cookie hash: oV+N20QLBoBQrAgHFUTACg==

**解决办法**：修改host名字只是零时的，需要使用su -才能正真生效

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNDI3OTcx_size_16_color_FFFFFF_t_70]: /images/20221020/84c2d81aa3b749739a917fed720595ea.png
[20210519162616262.png]: /images/20221020/06e5e54c69c34338a8c9ecef1330127e.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNDI3OTcx_size_16_color_FFFFFF_t_70 1]: /images/20221020/173b0f4f90714d50874c1bc4a165b9bd.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQyNDI3OTcx_size_16_color_FFFFFF_t_70 2]: /images/20221020/cfc5566483824dad97e987467925df30.png
[20210519163916890.png]: /images/20221020/b4b1185e7661455ab297cf32d2a2c387.png