Step by step approach for creation of AWS Managed Kafka Service(MKS)

What is Amazon MSK ?

• Amazon Managed Streaming for Apache Kafka (Amazon MSK) is a streaming data service
• Manages to run Apache Kafka applications and Apache Kafka Connect connectors on AWS—without becoming experts in operating Apache Kafka.
• Amazon MSK operates, maintains, and scales Apache Kafka clusters, provides enterprise-grade security features out of the box, and has built-in AWS integrations that accelerate development of streaming data applications.

Step by step approach for creation of MKS
Step1:

Step2: We have a option for easy create and custom configuration

Step3: For this blog, we are going with easy create
and enter the cluster name as demo-cluster-1

Step4: General Cluster properties we can go with two options
- Serverless
- Provisioned

Step5: For this blog i am going with Provisioned option and
selected the kafka version recommended

• Apache Kafka version : 3.6.0

Step6: There are two Broker types
1.Express brokers
2.Standard brokers

• Express brokers provide up to three times more throughput per broker, scale up to 20 times faster, and offer fully managed virtual storage capacity.
• Standard brokers and its typical brokers for all versions of Apache Kafka.

Note : Express Brokers are more costly based on project requirement Brokers will be selected accordingly

Step 7: For this blog, I have selected Standard broker and EBS Volume size of 30 GB

Step 8: All Cluster settings will be generated in readonly mode as below

Step 9: Click on create cluster

Note: The amount of time required to create a provisioned cluster depends on the size of the cluster. A typical provisioned cluster takes up to 15 minutes to create.

Step10: MSK created successfully

Step11: Deletion of MKS

Conclusion: Step by approach for creation of AWS Managed Kafka service using aws console & deletion of AWS MKS. Next blog will be creation of MKS using terraform

💬 If you enjoyed reading this blog post and found it informative, please take a moment to share your thoughts by leaving a review and liking it 😀 and follow me in dev.to , linkedin