Kafka Zookeeper 单节点测试

客官°小女子只卖身不卖艺 2021-09-23 16:30 358阅读 0赞

> 启动单节点Zookeeper Kafka，主要用来做测试使用。

# #

## 1. Zookeeper ##

[阿里镜像站][Link 1]

这里以 zookeeper-3.4.14 为例

### 1. 下载、上传、解压 ###

tar -zxvf zookeeper-3.4.14.tar.gz
    mv zookeeper-3.4.14 /opt/apps/

### 2. 配置环境变量 ###

vim ~/.bashrc
    
    #zookeeper
    export ZOOKEEPER_HOME=/opt/apps/zookeeper-3.4.14
    export PATH=$PATH:$ZOOKEEPER_HOME/bin
    
    source ~/.bashrc

### 3. 修改 datadir ###

cd /zookeeper-3.4.14/conf
    cp zoo_sample.cfg zoo.cfg
    vim zoo.cfg
    
    dataDir=/opt/apps/zookeeper-3.4.14/data

### 4. 启动 ###

# start、status、stop
    zkServer.sh start
    
    jps
    zkServer.sh status

![20200113132308775.png][]

## 2. Kafka ##

[阿里镜像站][Link 2]

这里以kafka\_2.11-2.1.1为例。Kafka 有自带 Zookeeper，可以使用单独安装的 Zookeeper。

### 1. 下载、上传、解压 ###

tar -zxvf kafka_2.11-2.1.1.tgz
    mv kafka_2.11-2.1.1 /opt/apps/

### 2. 配置环境变量 ###

vim ~/.bashrc
    
    #zookeeper
    export KAFKA_HOME=/opt/apps/kafka_2.11-2.1.1
    export PATH=$PATH:$KAFKA_HOME/bin
    
    source ~/.bashrc

### 3. 启动内置 Zookeeper ###

vim $KAFKA_HOME/config/zookeeper.properties
    
    # 修改 Zookeeper 文件目录,端口可以不修改,或根绝实际情况修改
    dataDir=/opt/apps/kafka_2.11-2.1.1/zookeeper/data
    
    
    # 开启 Kafka 内置 Zookeeper
    zookeeper-server-start.sh $KAFKA_HOME/config/zookeeper.properties
    # 后台
    nohup zookeeper-server-start.sh $KAFKA_HOME/config/zookeeper.properties > $KAFKA_HOME/logs/zookeeper.log 2>&1 &

###  4. 修改配置 ###

vim server.properties
    
    # 修改日志目录
    log.dirs=/opt/apps/kafka_2.11-2.1.1/kafka-logs

### 5. 启动 ###

kafka-server-start.sh config/server.properties
    
    # 后台
    nohup kafka-server-start.sh $KAFKA_HOME/config/server.properties > $KAFKA_HOME/logs/kafka.log 2>&1 &

### 6. Kafka-shell ###

# 创建 topic
    kafka-topics.sh \
    --create \
    --zookeeper hadoop-master:2181 \
    --replication-factor 1 \
    --partitions 1 \
    --topic topic_sdk_log
    
    # 显示 topic 详细
    kafka-topics.sh \
    --describe \
    --zookeeper hadoop-master:2181 \
    --topic topic_sdk_log
    
    # 显示所有 topic 
    kafka-topics.sh \
    --list \
    --zookeeper hadoop-master:2181
    
    # 创建 producer
    kafka-console-producer.sh \
    --broker-list localhost:9092 \
    --topic topic_sdk_log
    
    #创建 consumer
    kafka-console-consumer.sh \
    --zookeeper hadoop-master:2181 \
    --topic topic_sdk_log\
    --from-beginning

[Flume单节点安装连接Kafka][Flume_Kafka]

[Link 1]: https://mirrors.aliyun.com/apache/zookeeper/
[20200113132308775.png]: /images/20210923/fec031e2acb947d9b52f8142648e92a9.png
[Link 2]: https://mirrors.aliyun.com/apache/kafka/
[Flume_Kafka]: https://blog.csdn.net/lingeio/article/details/104838062