在Ubuntu上配置Kafka时,有几个关键要点需要注意:
zoo.cfg
配置文件,设置dataDir
和dataLogDir
为Zookeeper的数据和日志存储路径,设置clientPort
为Zookeeper的客户端连接端口(默认为2181)。sudo apt update
sudo apt install openjdk-8-jdk
验证Java安装:java -version
wget https://downloads.apache.org/kafka/3.5.2/kafka_2.13-3.5.2.tgz
tar -xzvf kafka_2.13-3.5.2.tgz -C /usr/local
cd /usr/local/kafka_2.13-3.5.2
/usr/local/kafka_2.13-3.5.2/config
,编辑server.properties
文件,设置以下关键配置项:
broker.id
:每个Kafka broker的唯一标识符。listeners
:Kafka监听的地址和端口。advertised.listeners
:对外暴露的地址和端口。log.dirs
:Kafka日志存储的目录。zookeeper.connect
:Zookeeper的连接字符串。/etc/profile
或~/.bashrc
文件,添加Kafka和Zookeeper的环境变量:export KAFKA_HOME=/usr/local/kafka_2.13-3.5.2
export PATH=$PATH:$KAFKA_HOME/bin
export ZOOKEEPER_HOME=/path/to/zookeeper
export PATH=$PATH:$ZOOKEEPER_HOME/bin
使环境变量生效:source /etc/profile
/usr/local/kafka_2.13-3.5.2/bin/zookeeper-server-start.sh /usr/local/kafka_2.13-3.5.2/config/zookeeper.properties
/usr/local/kafka_2.13-3.5.2/bin/kafka-server-start.sh /usr/local/kafka_2.13-3.5.2/config/server.properties
netstat -tulnp | grep 9092
/usr/local/kafka_2.13-3.5.2/bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test
/usr/local/kafka_2.13-3.5.2/bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
/usr/local/kafka_2.13-3.5.2/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic test --from-beginning
sudo ufw allow 9092
sudo ufw allow 2181
sudo ufw reload
/usr/local/kafka_2.13-3.5.2/log
目录下。通过以上步骤,可以在Ubuntu上成功配置Kafka,并确保其正常运行。根据具体需求,可能还需要进行更多的高级配置,如集群搭建、安全设置等。