6.【kafka运维】删除Topic消息+查看Broker磁盘信息

矫情吗；* 2022-09-03 12:28 393阅读 0赞

### 文章目录 ###

*   *  1.删除指定分区的消息kafka-delete-records.sh
     *  2. 查看Broker磁盘信息kafka-log-dirs.sh
     *  More

> **日常运维** 、**问题排查** 怎么能够少了滴滴开源的  
> [滴滴开源LogiKM一站式Kafka监控与管控平台][LogiKM_Kafka]

## 1.删除指定分区的消息kafka-delete-records.sh ##

**删除指定topic的某个分区的消息删除至offset为1024**

先配置json文件`offset-json-file.json`

{ "partitions":
    [{ "topic": "test1", "partition": 0,
      "offset": 1024}],
      "version":1
    }

在执行命令

> sh bin/kafka-delete-records.sh --bootstrap-server 172.23.250.249:9090 --offset-json-file config/offset-json-file.json

验证 通过 [LogIKM][] 查看发送的消息

![在这里插入图片描述][08234209a08be71d6c2875bd20670f85.png]  
**从这里可以看出来,配置`"offset": 1024` 的意思是从最开始的地方删除消息到 1024的offset; 是从最前面开始删除的**

## 2. 查看Broker磁盘信息kafka-log-dirs.sh ##

**查询指定topic磁盘信息`--topic-list topic1,topic2`**

> sh bin/kafka-log-dirs.sh --bootstrap-server xxxx:9090 --describe --topic-list test2

**查询指定Broker磁盘信息`--broker-list 0 broker1,broker2`**

> sh bin/kafka-log-dirs.sh --bootstrap-server xxxxx:9090 --describe --topic-list test2 --broker-list 0

例如我一个3分区3副本的Topic的查出来的信息  
`logDir` Broker中配置的`log.dir`

{ 
    	"version": 1,
    	"brokers": [{ 
    		"broker": 0,
    		"logDirs": [{ 
    			"logDir": "/Users/xxxx/work/IdeaPj/ss/kafka/kafka-logs-0",
    			"error": null,
    			"partitions": [{ 
    				"partition": "test2-1",
    				"size": 0,
    				"offsetLag": 0,
    				"isFuture": false
    			}, { 
    				"partition": "test2-0",
    				"size": 0,
    				"offsetLag": 0,
    				"isFuture": false
    			}, { 
    				"partition": "test2-2",
    				"size": 0,
    				"offsetLag": 0,
    				"isFuture": false
    			}]
    		}]
    	}, { 
    		"broker": 1,
    		"logDirs": [{ 
    			"logDir": "/Users/xxxx/work/IdeaPj/ss/kafka/kafka-logs-1",
    			"error": null,
    			"partitions": [{ 
    				"partition": "test2-1",
    				"size": 0,
    				"offsetLag": 0,
    				"isFuture": false
    			}, { 
    				"partition": "test2-0",
    				"size": 0,
    				"offsetLag": 0,
    				"isFuture": false
    			}, { 
    				"partition": "test2-2",
    				"size": 0,
    				"offsetLag": 0,
    				"isFuture": false
    			}]
    		}]
    	}, { 
    		"broker": 2,
    		"logDirs": [{ 
    			"logDir": "/Users/xxxx/work/IdeaPj/ss/kafka/kafka-logs-2",
    			"error": null,
    			"partitions": [{ 
    				"partition": "test2-1",
    				"size": 0,
    				"offsetLag": 0,
    				"isFuture": false
    			}, { 
    				"partition": "test2-0",
    				"size": 0,
    				"offsetLag": 0,
    				"isFuture": false
    			}, { 
    				"partition": "test2-2",
    				"size": 0,
    				"offsetLag": 0,
    				"isFuture": false
    			}]
    		}]
    	}, { 
    		"broker": 3,
    		"logDirs": [{ 
    			"logDir": "/Users/xxxx/work/IdeaPj/ss/kafka/kafka-logs-3",
    			"error": null,
    			"partitions": []
    		}]
    	}]
    }

如果你觉得通过命令查询磁盘信息比较麻烦，你也可以通过 [LogIKM][] 查看  
![在这里插入图片描述][7b068dc83ba6e0cec63c04939bd8e6d9.png]

## More ##

Kafka专栏持续更新中…(源码、原理、实战、运维、视频、面试视频)

--------------------

[【kafka运维】Kafka全网最全最详细运维命令合集(精品强烈建议收藏!!!)\_石臻臻的杂货铺-CSDN博客][kafka_Kafka_-CSDN]

[【kafka实战】分区重分配可能出现的问题和排查问题思路(生产环境实战,干货!!!非常干!!!建议收藏)][kafka]

[【kafka异常】kafka 常见异常处理方案(持续更新! 建议收藏)][kafka_kafka _]

[【kafka运维】分区从分配、数据迁移、副本扩缩容 (附教学视频)][kafka_]

[【kafka源码】ReassignPartitionsCommand源码分析(副本扩缩、数据迁移、副本重分配、副本跨路径迁移][kafka_ReassignPartitionsCommand]

[【kafka】点击更多…][kafka 1]

[LogiKM_Kafka]: https://github.com/didi/LogiKM
[LogIKM]: https://github.com/didi/Logi-KafkaManager
[08234209a08be71d6c2875bd20670f85.png]: /images/20220829/c67143894f524551ba45f2bae104fc95.png
[7b068dc83ba6e0cec63c04939bd8e6d9.png]: /images/20220829/ba5f7351baa94b68aefa19ff7e953932.png
[kafka_Kafka_-CSDN]: https://blog.csdn.net/u010634066/article/details/118215928?spm=1001.2014.3001.5501
[kafka]: https://blog.csdn.net/u010634066/article/details/118631272?spm=1001.2014.3001.5501
[kafka_kafka _]: https://blog.csdn.net/u010634066/article/details/118105676?spm=1001.2014.3001.5501
[kafka_]: https://blog.csdn.net/u010634066/article/details/118028403?spm=1001.2014.3001.5501
[kafka_ReassignPartitionsCommand]: https://blog.csdn.net/u010634066/article/details/118051963
[kafka 1]: https://mp.weixin.qq.com/mp/appmsgalbum?__biz=Mzg4ODY1NTcxNg==&action=getalbum&album_id=1966026980307304450#wechat_redirect