This is a collecton of Amazon CDK projects to show how to directly ingest streaming data from Amazon Mananged Service for Apache Kafka (MSK) and MSK Serverless into Apache Iceberg table in S3 with AWS Glue Streaming.
- Updated
Sep 10, 2024 - Python
#
aws-msk-serverless
Here are 5 public repositories matching this topic...
Stream CDC into an Amazon S3 data lake in Apache Iceberg format with AWS Glue Streaming using Amazon MSK Serverless and MSK Connect (Debezium)
- Updated
Feb 15, 2025 - Python
Data Pipeline for CDC data from MySQL DB to Amazon S3 through Amazon MSK Serverless using Amazon MSK Connect (Debezium).
- Updated
Feb 15, 2025 - Python
Streaming data pipeline to continuously load data from an Amazon MSK or MSK Serverless cluster to Amazon S3 using Amazon Kinesis Data Firehose.
- Updated
Aug 6, 2024 - Python
Kafka S3 Connector kaf-s3: A Python library that offloads Kafka messages to S3, with a producer and consumer using lightweight references and IAM-based access 🐙
python aws kafka big-data aws-s3 s3 s3-bucket message-queue data-engineering kafka-consumer kafka-connect kafka-producer kafka-client debezium aws-kinesis-firehose kafka-connect-plugin aws-msk-serverless large-messages
- Updated
Nov 2, 2025 - Python
Improve this page
Add a description, image, and links to the aws-msk-serverless topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the aws-msk-serverless topic, visit your repo's landing page and select "manage topics."