在Ubuntu上搭建Kafka集群是一个相对复杂的过程,需要仔细配置多个组件。以下是一个详细的步骤解析,基于多个来源的信息:
安装Java:
sudo apt update
sudo apt install openjdk-8-jdk
java -version
安装Zookeeper:
wget https://downloads.apache.org/zookeeper/zookeeper-3.8.0/zookeeper-3.8.0.tar.gz
tar -xzvf zookeeper-3.8.0.tar.gz
sudo mv zookeeper-3.8.0 /usr/local/zookeeper
sudo cp /usr/local/zookeeper/conf/zoo.cfg /usr/local/zookeeper/conf/zoo.cfg.samples
sudo vi /usr/local/zookeeper/conf/zoo.cfg
tickTime=2000
dataDir=/var/lib/zookeeper
clientPort=2181
sudo /usr/local/zookeeper/bin/zkServer.sh start
sudo netstat -nap | grep 2181
下载Kafka:
wget https://downloads.apache.org/kafka/3.6.2/kafka_2.12-3.6.2.tgz
tar -xzvf kafka_2.12-3.6.2.tgz -C /usr/local
配置Kafka:
cd /usr/local/kafka_2.12-3.6.2/config
server.properties
文件:sudo cp server.properties server.properties.template
server.properties
文件:sudo vi server.properties
broker.id=0
listeners=PLAINTEXT://:9092
advertised.listeners=PLAINTEXT://your_server_ip:9092
log.dirs=/tmp/kafka-logs
zookeeper.connect=localhost:2181
启动Kafka:
sudo /usr/local/kafka_2.12-3.6.2/bin/kafka-server-start.sh config/server.properties
创建Topic:
sudo /usr/local/kafka_2.12-3.6.2/bin/kafka-topics.sh --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1 --topic test
发送和接收消息:
sudo /usr/local/kafka_2.12-3.6.2/bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
sudo /usr/local/kafka_2.12-3.6.2/bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --from-beginning
broker.id
不同。server.properties
文件,确保listeners
和advertised.listeners
指向正确的地址。/usr/local/kafka_2.12-3.6.2/bin/kafka-storage.sh random-uuid
以上步骤应该可以帮助你在Ubuntu上成功部署Kafka。如果在安装过程中遇到问题,请检查日志文件以获取更多信息。