In the step, you perform two tasks. The first task is to create an Amazon EC2 instance to use as an Apache Kafka client machine. The second task is to install Java and Apache Kafka tools on the machine.
To create a client machineOpen the Amazon EC2 console at https://console.aws.amazon.com/ec2/.
Choose Launch instance.
Enter a descriptive Name for your client machine, such as msk-serverless-tutorial-client.
Leave the Amazon Linux 2 AMI (HVM) - Kernel 5.10, SSD Volume Type selected for Amazon Machine Image (AMI) type.
Leave the t2.micro instance type selected.
Under Key pair (login), choose Create a new key pair. Enter MSKServerlessKeyPair for Key pair name. Then choose Download Key Pair. Alternatively, you can use an existing key pair.
For Network settings, choose Edit.
Under VPC, enter the ID of the virtual private cloud (VPC) for your serverless cluster . This is the VPC based on the Amazon VPC service whose ID you saved after you created the cluster.
For Subnet, choose the subnet whose ID you saved after you created the cluster.
For Firewall (security groups), select the security group associated with the cluster. This value works if that security group has an inbound rule that allows traffic from the security group to itself. With such a rule, members of the same security group can communicate with each other. For more information, see Security group rules in the Amazon VPC Developer Guide.
Expand the Advanced details section and choose the IAM role that you created in Create an IAM role for topics on MSK Serverless cluster.
Choose Launch.
In the left navigation pane, choose Instances. Then choose the check box in the row that represents your newly created Amazon EC2 instance. From this point forward, we call this instance the client machine.
Choose Connect and follow the instructions to connect to the client machine.
To install Java, run the following command on the client machine:
sudo yum -y install java-11To get the Apache Kafka tools that we need to create topics and send data, run the following commands:
wget https://archive.apache.org/dist/kafka/2.8.1/kafka_2.12-2.8.1.tgztar -xzf kafka_2.12-2.8.1.tgzAfter extracting the Kafka archive, make sure that the scripts in the bin directory have proper execute permissions. To do this, run the following command.
chmod +x kafka_2.12-2.8.1/bin/*.shGo to the kafka_2.12-2.8.1/libs directory, then run the following command to download the Amazon MSK IAM JAR file. The Amazon MSK IAM JAR makes it possible for the client machine to access the cluster.
wget https://github.com/aws/aws-msk-iam-auth/releases/download/v2.3.0/aws-msk-iam-auth-2.3.0-all.jarUsing this command, you can also download other or newer versions of Amazon MSK IAM JAR file.
Go to the kafka_2.12-2.8.1/bin directory. Copy the following property settings and paste them into a new file. Name the file client.properties and save it.
security.protocol=SASL_SSL
sasl.mechanism=AWS_MSK_IAM
sasl.jaas.config=software.amazon.msk.auth.iam.IAMLoginModule required;
sasl.client.callback.handler.class=software.amazon.msk.auth.iam.IAMClientCallbackHandlerNext Step
Create an IAM role
Create a topic
Did this page help you? - Yes
Thanks for letting us know we're doing a good job!
If you've got a moment, please tell us what we did right so we can do more of it.
Did this page help you? - No
Thanks for letting us know this page needs work. We're sorry we let you down.
If you've got a moment, please tell us how we can make the documentation better.
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4