在Ubuntu上高效搭建Kafka集群可以参考以下步骤:
安装Java:
sudo apt update
sudo apt install openjdk-8-jdk
java -version
下载并解压Kafka:
wget https://downloads.apache.org/kafka/3.6.2/kafka_2.12-3.6.2.tgz
tar -xzf kafka_2.12-3.6.2.tgz
sudo mv kafka_2.12-3.6.2 /usr/local/kafka
下载并解压Zookeeper:
wget https://archive.apache.org/dist/zookeeper/zookeeper-3.4.6/zookeeper-3.4.6.tar.gz
tar xvfz zookeeper-3.4.6.tar.gz
sudo mv zookeeper-3.4.6 /usr/local/zookeeper
配置Zookeeper:
编辑 /usr/local/zookeeper/conf/zoo.cfg
文件:
tickTime=2000
dataDir=/var/lib/zookeeper
clientPort=2181
启动Zookeeper:
sudo /usr/local/zookeeper/bin/zkServer.sh start
配置Kafka:
编辑 /usr/local/kafka/config/server.properties
文件:
broker.id=0
listeners=PLAINTEXT://:9092
advertised.listeners=PLAINTEXT://your_server_ip:9092
zookeeper.connect=localhost:2181
启动Kafka:
sudo /usr/local/kafka/bin/kafka-server-start.sh -daemon /usr/local/kafka/config/server.properties
创建Topic:
sudo /usr/local/kafka/bin/kafka-topics.sh --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1 --topic test
发布和消费消息:
sudo /usr/local/kafka/bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
sudo /usr/local/kafka/bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --from-beginning