Kafka_zookeeper_commands

##To list the topics /opt/kafka/bin/kafka-topics.sh --list --zookeeper localhost:2181

##To run the console consumer opt/kafka/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic /opt/kafka/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic ntpprod.learning.events.failed --from-beginning

##To get the topics offset /opt/kafka/bin/kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list localhost:9092 --topic --time -1

##To describe the topic /opt/kafka/bin/kafka-topics.sh --describe --zookeeper localhost:2181 --topic

##To alter the topic or To increase the partion /opt/kafka/bin/kafka-topics.sh --zookeeper localhost:2181 --alter --topic --partitions 6

##To reassign the partion or increase the replication of topics /opt/kafka/bin/kafka-reassign-partitions.sh --zookeeper localhost:2181 --reassignment-json-file ~/sample.json --execute /opt/kafka/bin/kafka-reassign-partitions.sh --zookeeper localhost:2181 --reassignment-json-file ~/sample.json --verify

To consume the events from specific offset

/opt/kafka/bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --partition --offset --topic

Load the data to specific topic

/opt/kafka/bin/kafka-console-producer.sh --broker-list localhost:9092 --topic < pipeline_test_data.json

To describe the consumer group

/opt/kafka/bin/kafka-consumer-groups.sh --zookeeper localhost:2181 --describe --group

TO update the retention hours

/opt/kafka/bin/kafka-topics.sh --zookeeper localhost:2181 --alter --topic --config retention.ms=<>

To delete the topics from zookeeper level forcefully

rmr /brokers/topics/{topic_name} rmr /admin/delete_topics/{topic_name} OR sudo ./zookeeper-shell.sh localhost:2181 rmr /brokers/topics/your_topic

To updated the retention period

/opt/kafka/bin/kafka-topics.sh --zookeeper localhost:2181 --alter --topic --config retention.ms=0