RabbitMQ开发总结.20200219

向右看齐 2023-07-07 03:36 5阅读 0赞

*  [RabbitMQ开发20200219总结][RabbitMQ_20200219]
    
     *  [URI的规范的百分比编码][URI]
        
         *  [背景][Link 1]
         *  [解决过程][Link 2]
     *  [RabbitMQ如何保证消息的可靠性传递，要是消息丢失如何处理][RabbitMQ]
        
         *  [方法][Link 3]
            
             *  [改进][Link 4]
             *  [比较][Link 5]
         *  [MQ中丢失][MQ]
            
             *  [步骤][Link 6]
         *  [消费端丢失][Link 7]
     *  [定时任务][Link 8]
     *  [RabbitMQ使用URI方式设置资源][RabbitMQ_URI]
        
         *  [背景][Link 9]
         *  [解决方法][Link 10]
         *  [参考链接][Link 11]

# RabbitMQ开发20200219总结 #

## URI的规范的百分比编码 ##

### 背景 ###

> RabbitMQ使用URI方式代替host,port,virtualhost,username,password等参数方式时，设置virtual host 为"/" 的时候，直接这样写会报错，所以进行查阅资料

### 解决过程 ###

> 首先查阅RabbitMQ官网，查看相关资料，官网中说明了，"/" 需要使用百分比编码 ![image][]

![image][image 1]

> 第一次听说这种编码，然后又进行查阅URI的百分比编码，果然看到 /->`%2F` 代替 ![image][image 2]

在查阅官网中，再次进行验证得到答案，所以应该就是这样没错了。 ![image][image 3]

## RabbitMQ如何保证消息的可靠性传递，要是消息丢失如何处理 ##

### 方法 ###

> 数据的丢失问题，可能出现在生产者，MQ,消费者中

生产者丢失： 生产者将数据发送到RabbitMQ的时候，可能数据在半路搞丢，RabbitMQ提供了事务功能，在生茶这发送数据之前开启RabbitMQ事务channel.txSelect,然后发送消息，如果没有被成功接收到，生产者就会收到异常报错，此时就可以回滚事务`channel.txRollback`,然后重试，如果收到消息，那么就可以提交事务`channel.txCommit`

事务的缺点：性能消耗太大

改进

开启confirm模式，在生产者开启confirm模式之后，你每次写的消息都会分配一个唯一的id, 如果写入RabbitMQ中，RabbitMQ会给你回传一个ack消息，如果RabbitMQ没能处理这个消息，回调传一个nack接口，告诉你消息接受失败，可以重试，`而且可以结合这个机制自己在内存中维护每个消息id的状态，如果超过一定时间还没接收到消息的回调，可以重发`

比较

事务机制是同步的，你提交一个事物之后会在阻塞在那里，但是`confim`机制是异步的，你发这个消息之后就可以发送下一个消息，然后这个消息RabbitMQ接收到了之后会异步回调通知你这个消息接收到了，所以一般在生产者那块避免数据丢失，都是用`confirm机制的`

### MQ中丢失 ###

RabbitMQ自己丢失了数据，这个必须开启RabbitMQ的时就华，消息写入之后会持久化到磁盘，哪怕RabbitMQ挂掉，也可以自动读取之前存储的数据

步骤

1.  创建queue的时候设置持久化，可以保证RabbitMQ持久化queue元数据
2.  发送消息的时候讲消息的deliveryMode设置为2， 消息设置为持久化的

### 消费端丢失 ###

> 关闭自动的ack,通过一个api调用就行，每次在自己的代码中确保处理完的时候，再在程序里ack一下

消费端丢失：你消费的时候，刚消费到，还没处理，结果进程挂了，比如重启了，那么就尴尬了，RabbitMQ 认为你都消费了，这数据就丢了。这个时候得用 RabbitMQ 提供的ack机制，简单来说，就是你关闭 RabbitMQ 的自动ack，可以通过一个 api 来调用就行，然后每次你自己代码里确保处理完的时候，再在程序里ack一把。这样的话，如果你还没处理完，不就没有ack？那 RabbitMQ 就认为你还没处理完，这个时候 RabbitMQ 会把这个消费分配给别的 consumer 去处理，消息是不会丢的。

## 定时任务 ##

[https://www.cnblogs.com/zhangbin1989/p/9294114.html][https_www.cnblogs.com_zhangbin1989_p_9294114.html]

## RabbitMQ使用URI方式设置资源 ##

### 背景 ###

> 代码中原本使用host,port,virtualhost,username,password等设置RabbitMQ资源，但是如果存储在已有的表结构中，没有涉及这么多的字段，就因此查看是否有好的办法，不用涉及如此多的字段

### 解决方法 ###

> 使用URI方式

![image][image 4] 可以代替很多参数，只需要一个字段即可满足所有需求，所以就是用了这种方式

注： 如果virtual host 是"/"的话，官网中有说，需要使用百分制编码，也就是%2f替代，图中其实也有对应的，可以仔细看下

### 参考链接 ###

*  [https://www.rabbitmq.com/uri-spec.html][https_www.rabbitmq.com_uri-spec.html]
 *  [https://www.jianshu.com/p/206c2bdcaa04][https_www.jianshu.com_p_206c2bdcaa04]
 *  [https://www.cnblogs.com/smallJunJun/p/10846893.html][https_www.cnblogs.com_smallJunJun_p_10846893.html]
 *  [https://www.jianshu.com/p/4aa95905aad3][https_www.jianshu.com_p_4aa95905aad3]
 *  [https://mp.weixin.qq.com/s/Jma6M4DS9PO5Y1Y7z5D2IA][https_mp.weixin.qq.com_s_Jma6M4DS9PO5Y1Y7z5D2IA]
 *  [https://www.cnblogs.com/starof/p/4173413.html][https_www.cnblogs.com_starof_p_4173413.html]
 *  [http://www.luyixian.cn/news\_show\_261866.aspx][http_www.luyixian.cn_news_show_261866.aspx]
 *  [https://blog.csdn.net/nuoWei\_SenLin/article/details/81457891][https_blog.csdn.net_nuoWei_SenLin_article_details_81457891]

[RabbitMQ_20200219]: https://note.youdao.com/md/preview.html?file=%2Fyws%2Fapi%2Fpersonal%2Ffile%2FB0999F9A15A34308A1B4C1B7094F7CF8%3Fmethod%3Ddownload%26read%3Dtrue%26shareKey%3Daf53b2a27182e9079854fbc07340dc9c#rabbitmq%E5%BC%80%E5%8F%9120200219%E6%80%BB%E7%BB%93
[URI]: https://note.youdao.com/md/preview.html?file=%2Fyws%2Fapi%2Fpersonal%2Ffile%2FB0999F9A15A34308A1B4C1B7094F7CF8%3Fmethod%3Ddownload%26read%3Dtrue%26shareKey%3Daf53b2a27182e9079854fbc07340dc9c#uri%E7%9A%84%E8%A7%84%E8%8C%83%E7%9A%84%E7%99%BE%E5%88%86%E6%AF%94%E7%BC%96%E7%A0%81
[Link 1]: https://note.youdao.com/md/preview.html?file=%2Fyws%2Fapi%2Fpersonal%2Ffile%2FB0999F9A15A34308A1B4C1B7094F7CF8%3Fmethod%3Ddownload%26read%3Dtrue%26shareKey%3Daf53b2a27182e9079854fbc07340dc9c#%E8%83%8C%E6%99%AF
[Link 2]: https://note.youdao.com/md/preview.html?file=%2Fyws%2Fapi%2Fpersonal%2Ffile%2FB0999F9A15A34308A1B4C1B7094F7CF8%3Fmethod%3Ddownload%26read%3Dtrue%26shareKey%3Daf53b2a27182e9079854fbc07340dc9c#%E8%A7%A3%E5%86%B3%E8%BF%87%E7%A8%8B
[RabbitMQ]: https://note.youdao.com/md/preview.html?file=%2Fyws%2Fapi%2Fpersonal%2Ffile%2FB0999F9A15A34308A1B4C1B7094F7CF8%3Fmethod%3Ddownload%26read%3Dtrue%26shareKey%3Daf53b2a27182e9079854fbc07340dc9c#rabbitmq%E5%A6%82%E4%BD%95%E4%BF%9D%E8%AF%81%E6%B6%88%E6%81%AF%E7%9A%84%E5%8F%AF%E9%9D%A0%E6%80%A7%E4%BC%A0%E9%80%92%E8%A6%81%E6%98%AF%E6%B6%88%E6%81%AF%E4%B8%A2%E5%A4%B1%E5%A6%82%E4%BD%95%E5%A4%84%E7%90%86
[Link 3]: https://note.youdao.com/md/preview.html?file=%2Fyws%2Fapi%2Fpersonal%2Ffile%2FB0999F9A15A34308A1B4C1B7094F7CF8%3Fmethod%3Ddownload%26read%3Dtrue%26shareKey%3Daf53b2a27182e9079854fbc07340dc9c#%E6%96%B9%E6%B3%95
[Link 4]: https://note.youdao.com/md/preview.html?file=%2Fyws%2Fapi%2Fpersonal%2Ffile%2FB0999F9A15A34308A1B4C1B7094F7CF8%3Fmethod%3Ddownload%26read%3Dtrue%26shareKey%3Daf53b2a27182e9079854fbc07340dc9c#%E6%94%B9%E8%BF%9B
[Link 5]: https://note.youdao.com/md/preview.html?file=%2Fyws%2Fapi%2Fpersonal%2Ffile%2FB0999F9A15A34308A1B4C1B7094F7CF8%3Fmethod%3Ddownload%26read%3Dtrue%26shareKey%3Daf53b2a27182e9079854fbc07340dc9c#%E6%AF%94%E8%BE%83
[MQ]: https://note.youdao.com/md/preview.html?file=%2Fyws%2Fapi%2Fpersonal%2Ffile%2FB0999F9A15A34308A1B4C1B7094F7CF8%3Fmethod%3Ddownload%26read%3Dtrue%26shareKey%3Daf53b2a27182e9079854fbc07340dc9c#mq%E4%B8%AD%E4%B8%A2%E5%A4%B1
[Link 6]: https://note.youdao.com/md/preview.html?file=%2Fyws%2Fapi%2Fpersonal%2Ffile%2FB0999F9A15A34308A1B4C1B7094F7CF8%3Fmethod%3Ddownload%26read%3Dtrue%26shareKey%3Daf53b2a27182e9079854fbc07340dc9c#%E6%AD%A5%E9%AA%A4
[Link 7]: https://note.youdao.com/md/preview.html?file=%2Fyws%2Fapi%2Fpersonal%2Ffile%2FB0999F9A15A34308A1B4C1B7094F7CF8%3Fmethod%3Ddownload%26read%3Dtrue%26shareKey%3Daf53b2a27182e9079854fbc07340dc9c#%E6%B6%88%E8%B4%B9%E7%AB%AF%E4%B8%A2%E5%A4%B1
[Link 8]: https://note.youdao.com/md/preview.html?file=%2Fyws%2Fapi%2Fpersonal%2Ffile%2FB0999F9A15A34308A1B4C1B7094F7CF8%3Fmethod%3Ddownload%26read%3Dtrue%26shareKey%3Daf53b2a27182e9079854fbc07340dc9c#%E5%AE%9A%E6%97%B6%E4%BB%BB%E5%8A%A1
[RabbitMQ_URI]: https://note.youdao.com/md/preview.html?file=%2Fyws%2Fapi%2Fpersonal%2Ffile%2FB0999F9A15A34308A1B4C1B7094F7CF8%3Fmethod%3Ddownload%26read%3Dtrue%26shareKey%3Daf53b2a27182e9079854fbc07340dc9c#rabbitmq%E4%BD%BF%E7%94%A8uri%E6%96%B9%E5%BC%8F%E8%AE%BE%E7%BD%AE%E8%B5%84%E6%BA%90
[Link 9]: https://note.youdao.com/md/preview.html?file=%2Fyws%2Fapi%2Fpersonal%2Ffile%2FB0999F9A15A34308A1B4C1B7094F7CF8%3Fmethod%3Ddownload%26read%3Dtrue%26shareKey%3Daf53b2a27182e9079854fbc07340dc9c#%E8%83%8C%E6%99%AF-2
[Link 10]: https://note.youdao.com/md/preview.html?file=%2Fyws%2Fapi%2Fpersonal%2Ffile%2FB0999F9A15A34308A1B4C1B7094F7CF8%3Fmethod%3Ddownload%26read%3Dtrue%26shareKey%3Daf53b2a27182e9079854fbc07340dc9c#%E8%A7%A3%E5%86%B3%E6%96%B9%E6%B3%95
[Link 11]: https://note.youdao.com/md/preview.html?file=%2Fyws%2Fapi%2Fpersonal%2Ffile%2FB0999F9A15A34308A1B4C1B7094F7CF8%3Fmethod%3Ddownload%26read%3Dtrue%26shareKey%3Daf53b2a27182e9079854fbc07340dc9c#%E5%8F%82%E8%80%83%E9%93%BE%E6%8E%A5
[image]: https://imgconvert.csdnimg.cn/aHR0cHM6Ly9ub3RlLnlvdWRhby5jb20veXdzL3B1YmxpYy9yZXNvdXJjZS9hZjUzYjJhMjcxODJlOTA3OTg1NGZiYzA3MzQwZGM5Yy9ERTQ3Njk1NjI0RTc0NTRBOTRFRUQzNEQ2OTJDN0ZCMA?x-oss-process=image/format,png
[image 1]: https://imgconvert.csdnimg.cn/aHR0cHM6Ly9ub3RlLnlvdWRhby5jb20veXdzL3B1YmxpYy9yZXNvdXJjZS9hZjUzYjJhMjcxODJlOTA3OTg1NGZiYzA3MzQwZGM5Yy82OEFFOThGQThCREE0REM4OUFGRDE2NjIzNzdBQUY4OQ?x-oss-process=image/format,png
[image 2]: https://imgconvert.csdnimg.cn/aHR0cHM6Ly9ub3RlLnlvdWRhby5jb20veXdzL3B1YmxpYy9yZXNvdXJjZS9hZjUzYjJhMjcxODJlOTA3OTg1NGZiYzA3MzQwZGM5Yy9FQzk5MDNENTNDRjQ0MUJCQkYwOUJBRUJGQzhDRkIxNA?x-oss-process=image/format,png
[image 3]: https://imgconvert.csdnimg.cn/aHR0cHM6Ly9ub3RlLnlvdWRhby5jb20veXdzL3B1YmxpYy9yZXNvdXJjZS9hZjUzYjJhMjcxODJlOTA3OTg1NGZiYzA3MzQwZGM5Yy9BRjRDMjgwQ0Y0QUE0QzAzQUJFQkQwOTdERkU1MTM0NA?x-oss-process=image/format,png
[https_www.cnblogs.com_zhangbin1989_p_9294114.html]: https://www.cnblogs.com/zhangbin1989/p/9294114.html
[image 4]: https://imgconvert.csdnimg.cn/aHR0cHM6Ly9ub3RlLnlvdWRhby5jb20veXdzL3B1YmxpYy9yZXNvdXJjZS9hZjUzYjJhMjcxODJlOTA3OTg1NGZiYzA3MzQwZGM5Yy8zNDM5RUExMDE4NDA0OTFEOTY3NUU3QTFDNjI4ODFCRg?x-oss-process=image/format,png
[https_www.rabbitmq.com_uri-spec.html]: https://www.rabbitmq.com/uri-spec.html
[https_www.jianshu.com_p_206c2bdcaa04]: https://www.jianshu.com/p/206c2bdcaa04
[https_www.cnblogs.com_smallJunJun_p_10846893.html]: https://www.cnblogs.com/smallJunJun/p/10846893.html
[https_www.jianshu.com_p_4aa95905aad3]: https://www.jianshu.com/p/4aa95905aad3
[https_mp.weixin.qq.com_s_Jma6M4DS9PO5Y1Y7z5D2IA]: https://mp.weixin.qq.com/s/Jma6M4DS9PO5Y1Y7z5D2IA
[https_www.cnblogs.com_starof_p_4173413.html]: https://www.cnblogs.com/starof/p/4173413.html
[http_www.luyixian.cn_news_show_261866.aspx]: http://www.luyixian.cn/news_show_261866.aspx
[https_blog.csdn.net_nuoWei_SenLin_article_details_81457891]: https://blog.csdn.net/nuoWei_SenLin/article/details/81457891