Amazon Managed Streaming for Kafka (MSK)
Amazon MSK: stream processing
26/Jan/2021
Amazon Managed Streaming for Kafka (MSK)
-
Mocagon: Movement area, Internet scope [AWS Poster]
-
Full-name: Amazon Managed Streaming for Kafka
-
Short-name: Amazon MSK
-
Provides: stream processing
-
Resource: cluster
-
Year: 2018
Birds of a feather
flock together!
Products that are often seen with Amazon MSK, descending order of frequency:
| Prefix | Name | Description |
| Amazon | Simple Storage Service (S3) | object storage |
| Amazon | CloudWatch | monitoring |
| Amazon | Elastic Compute Cloud (EC2) | virtual machine |
| Amazon | Kinesis | stream processing |
| AWS | CloudFormation | infra as code (decl) |
| AWS | CloudTrail | operations planes audit log |
| Amazon | CloudWatch Logs (CW Logs) | monitor and store logs |
| AWS | Database Migration Service (DMS) | Database migration |
| Amazon | DynamoDB | key-value/document db |
| Amazon | Virtual Private Cloud (VPC) | virtual network |
Products that are related in Moca:
| Prefix | Name | Description |
| Amazon | Chime | video conferencing/chat |
| Amazon | Connect | customer contact center |
| Amazon | EventBridge | event bus |
| AWS | Internet of Things Core (IoT Core) | internet of things |
| AWS | IoT 1-Click ⧗ | button triggers lambda |
| AWS | IoT Device Defender (IoT Defender) | IoT device audits/monitor |
| AWS | IoT device management (IoT device mgmt) | IoT fleet management |
| AWS | IoT Events | IoT event bus |
| AWS | IoT Things Graph | IoT message broker |
| Amazon | Kinesis | stream processing |
| Amazon | Kinesis Data Analytics | analyze streaming data |
| Amazon | MQ | message broker |
| Amazon | Managed Streaming for Kafka (MSK) | stream processing |
| Amazon | Pinpoint | user messaging |
| AWS | RoboMaker | robotics |
| Amazon | SES | email send/receive |
| Amazon | Simple Notification Service (SNS) | pub/sub messaging |
| Amazon | Simple Queue Service (SQS) | message queue |
| Amazon | WorkMail | email/calendar |
News
-
2020/11/23: Amazon MSK now offers consumer lag metrics and select topic-level metrics for free
-
2020/11/20: Amazon Kinesis Data Analytics now supports Apache Flink v1.11
-
2020/11/19: Amazon Kinesis Data Analytics now supports the Apache Flink Dashboard
-
2020/11/19: Control the evolution of data streams using the AWS Glue Schema Registry
-
2020/10/21: Amazon Kinesis Data Analytics is now available in the US West (California) AWS region
-
2020/10/21: Amazon MSK adds support for Apache Kafka version 2.6.0
-
2020/10/13: AWS Glue supports reading from self-managed Apache Kafka
-
2020/10/08: Amazon Kinesis Data Analytics now supports Force Stop and a new Autoscaling status
-
2020/10/07: Apache Flink Kinesis Consumer supports EFO and HTTP/2 data retrieval
-
2020/10/05: Amazon Kinesis Data Analytics for Java is now Amazon Kinesis Data Analytics for Apache Flink
-
2020/10/02: Amazon MSK launches new education classes and labs
-
2020/09/30: Amazon MSK adds supports for Apache Kafka version 2.5.1
-
2020/09/30: Amazon MSK can now automatically expand cluster storage
-
2020/09/16: Amazon Kinesis Data Analytics is now available in the Europe (Milan) AWS region
-
2020/09/15: Amazon Kinesis Data Analytics now supports Java-based Apache Beam streaming workloads
-
2020/09/15: Amazon Kinesis Data Analytics now supports Apache Flink Kinesis Data Firehose Producer v2.0.0
-
2020/09/09: Amazon MSK now offers version 2.4.1.1, fixing a perpetual rebalance bug in Apache Kafka 2.4.1
-
2020/08/28: Amazon MSK is now available in Europe (Milan)
-
2020/08/17: AWS Certificate Manager Private Certificate Authority now supports Private CA sharing
-
2020/08/13: AWS Lambda now supports Amazon Managed Streaming for Apache Kafka as an event source
-
2020/06/26: Amazon MSK provides additional EC2 M5 broker sizes for more flexibility and cost optimization
-
2020/06/26: Amazon MSK now supports 3 AWS Availability Zones in São Paulo and Canada regions
-
2020/05/28: Amazon MSK now supports Apache Kafka version upgrades
-
2020/05/06: Amazon MSK is now available in AWS GovCloud (US) Regions
-
2020/04/08: Create Amazon MSK clusters with T3 brokers for less than $2.50/day
-
2020/04/02: Amazon MSK adds support for Apache Kafka version 2.4.1
-
2020/03/30: AWS Database Migration Service now supports replicating data to Apache Kafka streaming platform