rocketmq 日志操作

缺乏、安全感 2022-12-08 12:56 214阅读 0赞

--------------------

### rocketmq 日志操作 ###

**官网：[http://rocketmq.apache.org/docs/logappender-example/][http_rocketmq.apache.org_docs_logappender-example]**

**应用：将程序日志输出到rocketmq，消费端可读取日志数据进行相应处理**

### \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\* ###

**导入 jar 包**

<dependency>
        <groupId>org.apache.rocketmq</groupId>
        <artifactId>rocketmq-logappender</artifactId>
        <version>4.7.1</version>
    </dependency>

### \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\* ###

**相关类**

**RocketmqLogbackAppender：发送到rocketmq**

public class RocketmqLogbackAppender extends AppenderBase<ILoggingEvent> {
        private String tag;                   //标签
        private String topic;                 //发送的topic
        private String nameServerAddress;     //namesrv地址
        private String producerGroup;         //发送群组
        private MQProducer producer;
        private Layout layout;                //布局方式
        private PreSerializationTransformer<ILoggingEvent> pst = new LoggingEventPreSerializationTransformer();

**AsyncAppender：异步发送**

public class AsyncAppender extends AsyncAppenderBase<ILoggingEvent> {
    
        boolean includeCallerData = false;

**AsyncAppenderBase**

public class AsyncAppenderBase<E> extends UnsynchronizedAppenderBase<E> implements AppenderAttachable<E> {
    
        AppenderAttachableImpl<E> aai = new AppenderAttachableImpl<E>();
        BlockingQueue<E> blockingQueue;
    
        public static final int DEFAULT_QUEUE_SIZE = 256;
        int queueSize = DEFAULT_QUEUE_SIZE;
    
        int appenderCount = 0;
    
        static final int UNDEFINED = -1;
        int discardingThreshold = UNDEFINED;
        boolean neverBlock = false;
    
        Worker worker = new Worker();
    
        public static final int DEFAULT_MAX_FLUSH_TIME = 1000;
        int maxFlushTime = DEFAULT_MAX_FLUSH_TIME;

**AppenderAttachable：引用、删除appender**

public interface AppenderAttachable<E> {
    
        void addAppender(Appender<E> newAppender);
        boolean isAttached(Appender<E> appender);
    
        Iterator<Appender<E>> iteratorForAppenders();
        Appender<E> getAppender(String name);
    
        void detachAndStopAllAppenders();
        boolean detachAppender(Appender<E> appender);
        boolean detachAppender(String name);
    }

### \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\* ###

**日志配置**

**logback.xml：放在resources目录下**

<?xml version="1.0" encoding="UTF-8"?>
    <configuration debug="false">
        <conversionRule conversionWord="clr" converterClass="org.springframework.boot.logging.logback.ColorConverter"/>
        <conversionRule conversionWord="wex" converterClass="org.springframework.boot.logging.logback.WhitespaceThrowableProxyConverter"/>
        <conversionRule conversionWord="wEx" converterClass="org.springframework.boot.logging.logback.ExtendedWhitespaceThrowableProxyConverter"/>
    
        <property name="log.path" value="e:/hhhh/"/>
        <property name="console.pattern" value="%clr(%d{${LOG_DATEFORMAT_PATTERN:-yyyy-MM-dd HH:mm:ss.SSS}}){faint} %clr(${LOG_LEVEL_PATTERN:-%5p}) %clr(${PID:- }){magenta} %clr(---){faint} %clr([%15.15t]){faint} %clr(%-40.40logger{39}){cyan} %clr(:){faint} %m%n${LOG_EXCEPTION_CONVERSION_WORD:-%wEx}"/>
        <property name="file.pattern" value="%d{${LOG_DATEFORMAT_PATTERN:-yyyy-MM-dd HH:mm:ss.SSS}} ${LOG_LEVEL_PATTERN:-%5p} ${PID:- } --- [%t] %-40.40logger{39} : %m%n${LOG_EXCEPTION_CONVERSION_WORD:-%wEx}"/>
    
        <appender name="console" class="ch.qos.logback.core.ConsoleAppender">
            <encoder>
                <pattern>${console.pattern}</pattern>
            </encoder>
        </appender>
    
        <appender name="mqAppender1" class="org.apache.rocketmq.logappender.logback.RocketmqLogbackAppender">
            <tag>tag</tag>
            <topic>topic-log</topic>
            <producerGroup>log-group</producerGroup>
            <nameServerAddress>172.18.0.10:9876</nameServerAddress>
            <layout>
                <pattern>%date %p %t - %m%n</pattern>
            </layout>
        </appender>
    
        
        <appender name="mqAsyncAppender1" class="ch.qos.logback.classic.AsyncAppender">
            <queueSize>1024</queueSize>
            <discardingThreshold>80</discardingThreshold>
            <maxFlushTime>2000</maxFlushTime>
            <neverBlock>true</neverBlock>
            <appender-ref ref="mqAppender1"/>
        </appender>
    
        <root level="info">
            <appender-ref ref="console"/>
            <appender-ref ref="mqAsyncAppender1"/>
        </root>
    </configuration>

**将springboot应用打包，发布成docker容器**

### \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\* ###

**创建容器**

#namesrv
    docker run -it -d --net fixed --ip 172.18.0.10 -p 9876:9876 \
    -e JAVA_OPT="-server -Xms256m -Xmx256m -Xmn128m" \
    --name namesrv lihu12344/rocketmq:4.7.1 bash bin/mqnamesrv
    
    #broker
    docker run -it -d --net fixed --ip 172.18.0.20 \
    -e NAMESRV_ADDR="172.18.0.10:9876" \
    -e JAVA_OPT="-server -Xms512m -Xmx512m -Xmn256m" \
    -v /usr/rocketmq/single/broker.conf:/home/rocketmq/rcketmq-4.7.1/conf/broker.conf \
    --name broker lihu12344/rocketmq:4.7.1 \
    bash bin/mqbroker autoCreateTopicEnable=true -c conf/broker.conf
    
    #应用程序
    docker run -it -d --net fixed --ip 172.18.0.21 -p 8080:8080 --name rocketmq-log rocketmq-log

**rocketmq监控**

docker run -it -d --net fixed --ip 172.18.0.4 -p 8008:8080 \
    -e "JAVA_OPTS=-Drocketmq.namesrv.addr=172.18.0.10:9876 -Dcom.rocketmq.sendMessageWithVIPChannel=false" \
    --name rocketmq-console styletang/rocketmq-console-ng

## ##

### \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\* ###

**使用测试**

**192.168.57.127:8008**

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzkzMTYyNQ_size_16_color_FFFFFF_t_70][]

**查看topic**

**      **![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzkzMTYyNQ_size_16_color_FFFFFF_t_70 1][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzkzMTYyNQ_size_16_color_FFFFFF_t_70 2][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzkzMTYyNQ_size_16_color_FFFFFF_t_70 3][]

**查看topic-log message信息**

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzkzMTYyNQ_size_16_color_FFFFFF_t_70 4][]

[http_rocketmq.apache.org_docs_logappender-example]: http://rocketmq.apache.org/docs/logappender-example/
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzkzMTYyNQ_size_16_color_FFFFFF_t_70]: /images/20221123/f4e6ca577adc4ac5b23ace6693526213.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzkzMTYyNQ_size_16_color_FFFFFF_t_70 1]: /images/20221123/2789c756f2f642cba0c9a08d78f789fd.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzkzMTYyNQ_size_16_color_FFFFFF_t_70 2]: /images/20221123/47c24b16352945959a25cf74fb4def92.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzkzMTYyNQ_size_16_color_FFFFFF_t_70 3]: /images/20221123/da4a1090737f4509918a473bc6ed51ca.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzkzMTYyNQ_size_16_color_FFFFFF_t_70 4]: /images/20221123/fee09cc7278546d8ac00ce304673c3fb.png