Kafka CLI commands

Kafka CLI commands#

To start a Zookeeper instance with config zookeeper.properties:

zookeeper-server-start config/zookeeper.properties

To start a Kafka server with config server.properties:

kafka-server-start config/server.properties

Connect to a Kafka server and create a topic using:

kafka-topics --bootstrap-server kafka:9092 --create  --topic <topic-name>  --partitions $PART  --replication-factor $REP

Then view active Kafka topics using the --list command: `

kafka-topics --bootstrap-server kafka:9092 --list

To produce data use the kafka-console-producer command to add data (optionally with a key):

kafka-console-producer --broker-list kafka:9092  --topic sample-topic --property parse.key=true  --property key.separator=,

View the produced data using the kafka-console-consumer command:

$ kafka-console-consumer --bootstrap-server kafka:9092 --topic sample-topic --from-beginning --property print.key=true

Similarly, to view consumer groups, we can use kafka-consumer-groups:

kafka-consumer-groups --bootstrap-server kafka:9092 --group vp-consumer --describe

or to continuously watch the process, use watch:

watch kafka-consumer-groups --bootstrap-server kafka:9092 --group vp-consumer --describe

Add an ACL to existing user myuser:

kafka-acls --authorizer-properties zookeeper.connect=localhost:2181 --add --allow-principal User:myuser --operation write --topic acl-test

To start a connector (standalone source):

./bin/connect-standalone.sh config/connect-standalone.properties config/connect-file-source.properties