activeMQ主从高可用(zookeeper故障转移)+持久化策略(可复制的leveldb-stores)

你的名字 2023-10-09 12:29 1阅读 0赞

准备阶段：activemq.apache.org官网下载apache-activemq-5.15.9-bin.tar

jdk1.8

zk集群：三个zookeeper节点

borker节点  一个节点上启用6个activemq实例

说明：networkConnectors+nginx负载尽量不要使用，A集群队列aqueue中有1000条message，通过A集群消费600条，此时通过B集群去消费aqueue，集群B也是先去消费A集群剩余的400条到B集群本地再转发给消费端，所以还是通过A集群消费了1000条，根本就无法做到负载削峰来增加吞吐量，而且从整体集群的层面上看，反而增加了集群的压力，因为B集群的转发这一步是多余的。

所以 nginx / lvs 动态代理，来配合networkConnectors做负载均衡，就不演示了，因为根本没用

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzIyMDQ5Nzcz_size_16_color_FFFFFF_t_70][]

#    HA1     my-activemq-clust           #

1、解压apache-activemq-5.15.9-bin.tar到/opt下

![20190925190909249.png][]

2、修改activemq.xml文件，目录/opt/apache-activemq-5.15.9/conf

修改brokerName，所有节点要保持一致

![20190925191635292.png][]

3、配置持久化策略：使用levelDB

提前创建好leveldb目录：/opt/apache-activemq-5.15.9/data/leveldb

<persistenceAdapter>
     
        
        <replicatedLevelDB
              directory="${activemq.data}/leveldb"
              replicas="3"
              bind="tcp://0.0.0.0:63631"
              zkAddress="job-dangdai-node-2:2181,job-dangdai-node-3:2181,job-dangdai-node-4:2181"
              zkPath="/activemq/leveldb-stores"
              sync="local_disk"
              hostname="my-activemq-clust"/>
    </persistenceAdapter>

4、全的activemq.xml

<beans
      xmlns="http://www.springframework.org/schema/beans"
      xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
      xsi:schemaLocation="http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans.xsd
      http://activemq.apache.org/schema/core http://activemq.apache.org/schema/core/activemq-core.xsd">
    
        
        <bean class="org.springframework.beans.factory.config.PropertyPlaceholderConfigurer">
            <property name="locations">
                <value>file:${activemq.conf}/credentials.properties</value>
            </property>
        </bean>
    
       
        <bean id="logQuery" class="io.fabric8.insight.log.log4j.Log4jLogQuery"
              lazy-init="false" scope="singleton"
              init-method="start" destroy-method="stop">
        </bean>
    
        
    	 
    	 
    	 
        <broker xmlns="http://activemq.apache.org/schema/core" brokerName="my-activemq-clust" dataDirectory="${activemq.data}" schedulerSupport="true">
    
            <destinationPolicy>
                <policyMap>
                  <policyEntries>
                    <policyEntry topic=">" >
                        
                      <pendingMessageLimitStrategy>
                        <constantPendingMessageLimitStrategy limit="1000"/>
                      </pendingMessageLimitStrategy>
                    </policyEntry>
                  </policyEntries>
                </policyMap>
            </destinationPolicy>
    
    
            
            <managementContext>
                <managementContext createConnector="false"/>
            </managementContext>
    
            
    	
            <persistenceAdapter>
              
    	
                
    	 	
    		
     
                    
                    
                    <replicatedLevelDB
                            directory="${activemq.data}/leveldb"
                            replicas="3"
                            bind="tcp://0.0.0.0:63631"
                            zkAddress="job-dangdai-node-2:2181,job-dangdai-node-3:2181,job-dangdai-node-4:2181"
                            zkPath="/activemq/leveldb-stores"
                            sync="local_disk"
                            hostname="my-activemq-clust"/>
    
            </persistenceAdapter>
    
    
              
              <systemUsage>
                <systemUsage>
                    <memoryUsage>
                        <memoryUsage percentOfJvmHeap="70" />
                    </memoryUsage>
                    <storeUsage>
                        <storeUsage limit="100 gb"/>
                    </storeUsage>
                    <tempUsage>
                        <tempUsage limit="50 gb"/>
                    </tempUsage>
                </systemUsage>
            </systemUsage>
    
            
            <transportConnectors>
                
                <transportConnector name="openwire" uri="tcp://0.0.0.0:61616?maximumConnections=1000&wireFormat.maxFrameSize=104857600"/>
                <transportConnector name="amqp" uri="amqp://0.0.0.0:5672?maximumConnections=1000&wireFormat.maxFrameSize=104857600"/>
                <transportConnector name="stomp" uri="stomp://0.0.0.0:61613?maximumConnections=1000&wireFormat.maxFrameSize=104857600"/>
                <transportConnector name="mqtt" uri="mqtt://0.0.0.0:1883?maximumConnections=1000&wireFormat.maxFrameSize=104857600"/>
                <transportConnector name="ws" uri="ws://0.0.0.0:61614?maximumConnections=1000&wireFormat.maxFrameSize=104857600"/>
    
    
    <transportConnector name="auto+nio" uri="auto+nio://0.0.0.0:61608?maximumConnections=1000&wireFormat.maxFrameSize=104857600&org.apache.activemq.transport.nio.SelectorManager.corePoolSize=20&org.apache.activemq.transport.nio.SelectorManager.maximumPoolSize=50" />
            </transportConnectors>
    
            
            <shutdownHooks>
                <bean xmlns="http://www.springframework.org/schema/beans" class="org.apache.activemq.hooks.SpringContextHook" />
            </shutdownHooks>
    
        </broker>
        
        <bean id="mysql-ds" class="org.apache.commons.dbcp2.BasicDataSource" destroy-method="close">
            <property name="driverClassName" value="com.mysql.jdbc.Driver"/>
            <property name="url" value="jdbc:mysql://192.168.164.25:3306/activemq?relaxAutoCommit=true"/>
            <property name="username" value="root"/>
            <property name="password" value="123456"/>
            <property name="poolPreparedStatements" value="true"/>
        </bean>
        
        <import resource="jetty.xml"/>
    
    </beans>

5、将activemq分发到两外两个节点之上

6、首先启动zk集群，然后依次启动activemq

目录：/opt/apache-activemq-5.15.9/bin

启动命令：./activemq start

启动完成后，查看ZK目录数据

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzIyMDQ5Nzcz_size_16_color_FFFFFF_t_70 1][]

# HA2     my-activemq-clust2 #

重复HA1操作

# 两个cluster负载均衡 #

HA1配置HA2的集群中的主从所有节点

<networkConnectors>
         	<networkConnector uri="static:(tcp://192.168.164.255:61608,tcp://192.168.164.255:51515,tcp://192.168.164.255:51516)" duplex="false"/>
    </networkConnectors>

HA2配置HA1的集群中的主从所有节点

<networkConnectors>
         	<networkConnector uri="static:(tcp://192.168.164.255:61605,tcp://192.168.164.255:61604,tcp://192.168.164.255:61603)" duplex="false"/>
    </networkConnectors>

### 说明：networkConnectors+nginx负载尽量不要使用，A集群队列aqueue中有1000条message，通过A集群消费600条，此时通过B集群去消费aqueue，集群B也是先去消费A集群剩余的400条到B集群本地再转发给消费端，所以还是通过A集群消费了1000条，根本就无法做到负载削峰来增加吞吐量，而且从整体集群的层面上看，反而增加了集群的压力，因为B集群的转发这一步是多余的。 ###

### 最终集群方案为： ###

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzIyMDQ5Nzcz_size_16_color_FFFFFF_t_70 2][]

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzIyMDQ5Nzcz_size_16_color_FFFFFF_t_70]: https://img-blog.csdnimg.cn/20200518110441824.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzIyMDQ5Nzcz,size_16,color_FFFFFF,t_70
[20190925190909249.png]: https://img-blog.csdnimg.cn/20190925190909249.png
[20190925191635292.png]: https://img-blog.csdnimg.cn/20190925191635292.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzIyMDQ5Nzcz_size_16_color_FFFFFF_t_70 1]: https://img-blog.csdnimg.cn/20190925195022833.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzIyMDQ5Nzcz,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzIyMDQ5Nzcz_size_16_color_FFFFFF_t_70 2]: https://img-blog.csdnimg.cn/20200518110844347.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzIyMDQ5Nzcz,size_16,color_FFFFFF,t_70