RocketMQ安装过程以及遇到的坑总结

迈不过友情╰ 2022-04-10 12:46 499阅读 0赞

RocketMQ安装过程遇到的坑以及解决方案

周末,按照网上教程安装了rocketMQ集群,期间遇到一些小问题,导致耽误不少时间

记录下来

本文只涉及安装过程,原理不涉及

下图是环境要求

![18824][]

环境:

centos 6 64位

jdk:1.8

rocketMQ版本:4.3.2

模式:两 master 两 slave 同步双写模式

IP 部署服务 角色

192.168.168.101 NameServer –

192.168.168.102 NameServer –

192.168.168.101 broker-a master

192.168.168.101 broker-b-s slave

192.168.168.102 broker-b master

192.168.168.102 broker-a-s slave

1.首先安装好jdk并配置好环境变量(其它文章有,不再详述)

2.下载安装rocketMQ

不要选择先配置一个机器,直接拷贝到第二台机器这种方式!!!

要配置好第一个,再去配置第二个,因为总共就两台,直接复制容易出错(当然熟练的也可以复制后修改文件内容和文件名,初学者还是一步一个脚印)

官网下载链接:[http://mirror.bit.edu.cn/apache/rocketmq/4.3.2/rocketmq-all-4.3.2-bin-release.zip][http_mirror.bit.edu.cn_apache_rocketmq_4.3.2_rocketmq-all-4.3.2-bin-release.zip]

2.1下载后解压(两台机器都需要下载解压,如果linux没有安装.zip格式解压压缩软件的话,安装一个,安装命令:yum -y install zip unzip)

![18835][]

![18833][]

2.1.1解压后配置rocketMQ环境变量(两台都需要配置)

命令:vi /etc/profile

追加如下内容:

\#set rocketMQ environment

export ROCKETMQ\_HOME=/usr/local/src/rocketmq/rocketmq-all-4.3.2-bin-release

export PATH=$PATH:$ROCKETMQ\_HOME/bin

![18990][]

使修改生效

命令:source /etc/profile

![18999][]

2.1.2修改rocketMQ内存配置(两台都需要修改)

进入到rocketMQ的bin目录修改

命令:vi runserver.sh

将内存修改如下(默认分别是4g 8g,如果电脑配置达到那么高可以不用修改,否则启动不了,提示内存不足)

![19006][]

命令:vi runbroker.sh

将内存修改如下

![19012][]

2.2配置

2.2.1先配置192.168.168.101这台机器

进入配置文件目录

cd rocketmq-all-4.3.2-bin-release/conf/2m-2s-sync/

![18850][]

看一下都有哪些文件

![18854][]

2.2.1.1修改broker-a.properties文件内容如下(其中ip要替换为你的服务器对应ip)

具体配置文字版:

\#Below 7 lines is default config

\#brokerClusterName=DefaultCluster

\#brokerName=broker-a

\#brokerId=0

\#deleteWhen=04

\#fileReservedTime=48

\#brokerRole=SYNC\_MASTER

\#flushDiskType=ASYNC\_FLUSH

\#add time=2019-01-06 16:59

\#所属集群名称，如果多个master，那么每个master配置的名称应该一致，要不然识别不了

brokerClusterName=rocketmq-cluster

\#broker名称

brokerName=broker-a

\#0 表示master，>0 表示slave

brokerId=0

\#nameServer地址，分号隔开

namesrvAddr=192.168.168.101:9876;192.168.168.102:9876

\#在发送消息时，自动创建服务器不存在的topic，默认创建的队列数

defaultTopicQueueNums=4

\#是否允许broker自动创建topic，建议线下开启，线上关闭

autoCreateTopicEnable=true

\#是否允许broker自动创建订阅组，建议线下开始，线上关闭

autoCreateSubscriptionGroup=true

\#broker对外服务的监听端口，

\#同一台机器部署多个broker，端口号要不同，且端口号之间要相距大些

listenPort=10911

\#删除文件的时间节点，默认凌晨4点

deleteWhen=04

\#文件保留时间，默认48小时

fileReservedTime=120

\#commitLog每个文件的大小，默认大小1g

mapedFileSizeCommitLog=1073741824

\#consumeQueue每个文件默认存30w条，根据自身业务进行调整

mapedFileSizeConsumeQueue=300000

destroyMapedFileInterval=120000

redeleteHangedFileInterval=120000

\#检查物理文件磁盘空间

diskMaxUsedSpaceRatio=88

\#store存储路径，master与slave目录要不同

storePathRootDir=/usr/local/src/rocketmq/rocketmq-all-4.3.2-bin-release/data/store

\#commitLog存储路径

storePathCommitLog=/usr/local/src/rocketmq/rocketmq-all-4.3.2-bin-release/data/store/commitlog

\#限制的消息大小

maxMessageSize=65536

flushCommitLogLeastPages=4

flushConsumeQueueLeastPages=2

flushCommitLogThoroughInterval=10000

flushConsumeQueueThoroughInterval=60000

checkTransactionMessageEnable=false

\#发消息线程池数

sendMessageThreadPoolNums=128

\#拉去消息线程池数

pullMessageThreadPoolNums=128

\#broker角色：

\#ASYSC\_MASTER 异步复制master

\#SYSC\_MASTER 同步复制master

\#SLAVE 从

brokerRole=SYSC\_MASTER

\#刷盘方式

\#ASYNC\_FLUSH 异步刷盘

\#SYNC\_FLUSH 同步刷盘

flushDiskType=ASYNC\_FLUSH

具体配置图片版:

![18861][]

2.2.1.2修改broker-b-s.properties文件内容如下(其中ip要替换为你的服务器对应ip)

配置文字版:

\#Below 7 lines is default config

\#brokerClusterName=DefaultCluster

\#brokerName=broker-b

\#brokerId=1

\#deleteWhen=04

\#fileReservedTime=48

\#brokerRole=SLAVE

\#flushDiskType=ASYNC\_FLUSH

\#add time=2019-01-06 17:01

brokerClusterName=rocketmq-cluster

brokerName=broker-b

brokerId=1

namesrvAddr=192.168.168.101:9876;192.168.168.102:9876

defaultTopicQueueNums=4

autoCreateTopicEnable=true

autoCreateSubscriptionGroup=true

listenPort=10950

deleteWhen=04

fileReservedTime=120

mapedFileSizeCommitLog=1073741824

mapedFileSizeConsumeQueue=300000

destroyMapedFileInterval=120000

redeleteHangedFileInterval=120000

diskMaxUsedSpaceRatio=88

storePathRootDir=/usr/local/src/rocketmq/rocketmq-all-4.3.2-bin-release/data/store/slave

storePathCommitLog=/usr/local/src/rocketmq/rocketmq-all-4.3.2-bin-release/data/store/slave/commitlog

maxMessageSize=65536

flushCommitLogLeastPages=4

flushConsumeQueueLeastPages=2

flushCommitLogThoroughInterval=10000

flushConsumeQueueThoroughInterval=60000

checkTransactionMessageEnable=false

sendMessageThreadPoolNums=128

pullMessageThreadPoolNums=128

brokerRole=SLAVE

flushDiskType=ASYNC\_FLUSH

配置图片版:

![18870][]

2.2.1.3上面配置中用到了几个目录,需要创建下目录

命令:mkdir -p /usr/local/src/rocketmq/rocketmq-all-4.3.2-bin-release/data/store/slave/commitlog

![18875][]

2.2.2配置192.168.168.102

进入配置文件目录

cd rocketmq-all-4.3.2-bin-release/conf/2m-2s-sync/

![18884][]

再看看有什么配置文件,加深一下印象

![18891][]

2.2.2.1修改broker-b.properties内容,这里看清楚文件名

配置文字版:

\#Below 7 lines is default config

\#brokerClusterName=DefaultCluster

\#brokerName=broker-b

\#brokerId=0

\#deleteWhen=04

\#fileReservedTime=48

\#brokerRole=SYNC\_MASTER

\#flushDiskType=ASYNC\_FLUSH

\#add time=2019-01-06 17:06

brokerClusterName=rocketmq-cluster

brokerName=broker-b

brokerId=0

namesrvAddr=192.168.168.101:9876;192.168.168.102:9876

defaultTopicQueueNums=4

autoCreateTopicEnable=true

autoCreateSubscriptionGroup=true

listenPort=10911

deleteWhen=04

fileReservedTime=120

配置图片版:

![18897][]

2.2.2修改broker-a-s.properties文件内容

配置文字版:

\#Below 7 lines is default config

\#brokerClusterName=DefaultCluster

\#brokerName=broker-a

\#brokerId=1

\#deleteWhen=04

\#fileReservedTime=48

\#brokerRole=SLAVE

\#flushDiskType=ASYNC\_FLUSH

\#add time=2019-01-06 17:04

brokerClusterName=rocketmq-cluster

brokerName=broker-a

brokerId=1

namesrvAddr=192.168.168.101:9876;192.168.168.102:9876

defaultTopicQueueNums=4

autoCreateTopicEnable=true

autoCreateSubscriptionGroup=true

listenPort=10950

deleteWhen=04

fileReservedTime=120

mapedFileSizeCommitLog=1073741824

mapedFileSizeConsumeQueue=300000

destroyMapedFileInterval=120000

redeleteHangedFileInterval=120000

diskMaxUsedSpaceRatio=88

storePathRootDir=/usr/local/src/rocketmq/rocketmq-all-4.3.2-bin-release/data/store/slave

storePathCommitLog=/usr/local/src/rocketmq/rocketmq-all-4.3.2-bin-release/data/store/slave/commitlog

maxMessageSize=65536

flushCommitLogLeastPages=4

flushConsumeQueueLeastPages=2

flushCommitLogThoroughInterval=10000

flushConsumeQueueThoroughInterval=60000

checkTransactionMessageEnable=false

sendMessageThreadPoolNums=128

pullMessageThreadPoolNums=128

brokerRole=SLAVE

flushDiskType=ASYNC\_FLUSH

配置图片版:

![18909][]

2.2.2.3上面配置中用到了几个目录,需要创建下目录

命令:mkdir -p /usr/local/src/rocketmq/rocketmq-all-4.3.2-bin-release/data/store/slave/commitlog

![18912][]

3.启动

3.1先启动192.168.168.101

3.1.1启动nameserver

进入到rocketMQ的bin目录

命令:cd ../../bin

![18921][]

看一下都有什么命令

命令:ll

![18925][]

启动nameserver

命令:nohup sh mqnamesrv &

![18931][]

3.1.2启动broker-a Master

命令:nohup sh mqbroker -c /usr/local/src/rocketmq/rocketmq-all-4.3.2-bin-release/conf/2m-2s-sync/broker-a.properties &

![18935][]

3.1.3启动broker-b Slave

命令:nohup sh mqbroker -c /usr/local/src/rocketmq/rocketmq-all-4.3.2-bin-release/conf/2m-2s-sync/broker-b-s.properties &

![18939][]

3.2启动启动192.168.168.102

3.2.1启动nameserver

进入到rocketMQ的bin目录

cd ../../bin

![18952][]

启动nameserver

命令:nohup sh mqnamesrv &

![18960][]

3.2.2启动broker-b Master

命令:

nohup sh mqbroker -c /usr/local/src/rocketmq/rocketmq-all-4.3.2-bin-release/conf/2m-2s-sync/broker-b.properties &

![18970][]

3.2.3启动broker-a Slave

命令:

nohup sh mqbroker -c /usr/local/src/rocketmq/rocketmq-all-4.3.2-bin-release/conf/2m-2s-sync/broker-a-s.properties &

![18973][]

4.查看状态

进入192.168.168.101的rocketMQ的bin目录后输入命令查看集群状态(进入到192.168.168.102的bin目录输入下面的命令效果一样;将rocketmq的bin配置到path后任意目录输入下面的命令均可)

命令:sh mqadmin clusterlist -n 192.168.168.101:9876

![18982][]

5.遇到的坑

坑1:

其实不算坑

就是安装的时候先安装好一个,另外一个直接scp复制第一个安装目录到第二台机器导致的问题

所以,不熟练的时候,一定要一个安装好再安装另一个,以防止出错,不要眼高手低,犯低级错误!

坑2.直接将Master的配置复制到Slave,只修改brokerId

这样会导致Slave无法启动,因为Slave的storePathRootDir会和另一个broker的Master冲突,错误提示是:lock failed, MQ already started

这个只需要保证Master和Slave的storePathRootDir不一样即可(broker-x 的Slave和broker-y的Master不能一致,本例中broker-a的Master不能和broker-b Slave一样)

6.可以使用rocketmq-console来更直观查看rocketmq信息

![19052][]

把rocketmq-console的war包放在192.168.168.101的tomcat下,启动tomcat即可

访问地址:[http://192.168.168.101:8080/rocketmq\_console-0.0.1-SNAPSHOT][http_192.168.168.101_8080_rocketmq_console-0.0.1-SNAPSHOT]

war包地址:[https://note.youdao.com/share/?id=34a49baab8606ac2cde7533e395afb1c&type=note\#/][https_note.youdao.com_share_id_34a49baab8606ac2cde7533e395afb1c_type_note](由于百度云上传下载太慢,放了一个有道云笔记的分享链接,下载很快,该war包是下载的源码,但是源码无法导入eclipse,所以新建的项目,将源码中内容加入后打包的)

[18824]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/53798385C14543A3866802E1A059EBAF/18824
[http_mirror.bit.edu.cn_apache_rocketmq_4.3.2_rocketmq-all-4.3.2-bin-release.zip]: http://mirror.bit.edu.cn/apache/rocketmq/4.3.2/rocketmq-all-4.3.2-bin-release.zip
[18835]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/034A5D9C428642D8A8EEC27ED52C1C35/18835
[18833]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/C81F745DB49A4C45B20E01113A43619C/18833
[18990]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/C57451D834774FC98B1479F0E4166C2A/18990
[18999]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/41FC98DF3D984723BBC2E9244559837A/18999
[19006]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/157780A9690C44D8A75423C72F6A41B4/19006
[19012]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/1EACE5A555D8492BA6E299AAA34E28DA/19012
[18850]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/CAD3B92F412A4A49B2899D8DB8E77E0F/18850
[18854]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/C24423139F80464091AC085E276D7FBB/18854
[18861]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/654A8A7EC390477FA490801D875A2110/18861
[18870]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/A83647E91CBE4E6F88DD870C1A57C5AE/18870
[18875]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/A992A99BBD2A4020913F483042111F62/18875
[18884]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/F23C06799615489F8AFD1854A67FBECD/18884
[18891]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/999B0F1261CE495EA71F600F5148929D/18891
[18897]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/FECEFB96625E47EF83A40E0A80E37B1F/18897
[18909]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/9B9FBCC8EAA94270BB18FFB476066E26/18909
[18912]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/A834AD9AF1A64882BE628EEC003436EF/18912
[18921]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/D9E749475B4543F784AF465F0DEA303A/18921
[18925]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/2620EFC63DCA47FDA7EE57D16CEFB002/18925
[18931]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/00F448B3047F4AAE9E362122488A794B/18931
[18935]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/54893D275320421B9E347F53B88D7DE5/18935
[18939]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/44EBC56672184AC5A4E6FE9054A62DF8/18939
[18952]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/A01DD5A933F34F929782A3BE6AF2BA0E/18952
[18960]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/764D3E4141AA42D59ABEEB117BD1A63D/18960
[18970]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/E802F0C2AF1D43B4B15DFDE4A2F347D8/18970
[18973]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/DFBC986FD79546AE895426AEED6A134B/18973
[18982]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/43FCED4B05CA467D8FAB041165B79D26/18982
[19052]: https://note.youdao.com/yws/public/resource/72e99820700b03355e89a7f15fbdbb1f/xmlnote/50BAEA7FE4864D13B1546A228F0BBB53/19052
[http_192.168.168.101_8080_rocketmq_console-0.0.1-SNAPSHOT]: http://192.168.168.101:8080/rocketmq_console-0.0.1-SNAPSHOT
[https_note.youdao.com_share_id_34a49baab8606ac2cde7533e395afb1c_type_note]: https://note.youdao.com/share/?id=34a49baab8606ac2cde7533e395afb1c&type=note#/