Amazon Managed Streaming for Kafka (MSK)
Amazon MSK: stream processing
14/Oct/2020
Amazon Managed Streaming for Kafka (MSK)
-
Mocagon: Data-Execution area, Internet scope [AWS Poster]
-
Full-name: Amazon Managed Streaming for Kafka
-
Short-name: Amazon MSK
-
Provides: stream processing
-
Resource: cluster
-
Year: 2018
Birds of a feather
flock together!
Products that are often seen with Amazon MSK, descending order of frequency:
| Prefix | Name | Description |
| Amazon | Simple Storage Service (S3) | object storage |
| Amazon | Elastic Compute Cloud (EC2) | virtual machine |
| Amazon | CloudWatch | monitoring |
| Amazon | Kinesis | stream processing |
| AWS | CloudFormation | infra as code (decl) |
| AWS | CloudTrail | operations planes audit log |
| Amazon | CloudWatch Logs (CW Logs) | monitor and store logs |
| AWS | Database Migration Service (DMS) | Database migration |
| Amazon | DynamoDB | key-value/document db |
| Amazon | Virtual Private Cloud (VPC) | virtual network |
Products that are related in Moca:
| Prefix | Name | Description |
| Amazon | Athena | SQL queries over storage |
| Amazon | Elastic MapReduce (EMR) | distributed data processing |
| Amazon | Kinesis | stream processing |
| Amazon | Kinesis Data Analytics | analyze streaming data |
| Amazon | Managed Streaming for Kafka (MSK) | stream processing |
| Amazon | QuickSight | business intelligence |
News
-
2020/10/13: AWS Glue supports reading from self-managed Apache Kafka
-
2020/10/08: Amazon Kinesis Data Analytics now supports Force Stop and a new Autoscaling status
-
2020/10/07: Apache Flink Kinesis Consumer supports EFO and HTTP/2 data retrieval
-
2020/10/05: Amazon Kinesis Data Analytics for Java is now Amazon Kinesis Data Analytics for Apache Flink
-
2020/10/02: Amazon MSK launches new education classes and labs
-
2020/09/30: Amazon MSK adds supports for Apache Kafka version 2.5.1
-
2020/09/30: Amazon MSK can now automatically expand cluster storage
-
2020/09/16: Amazon Kinesis Data Analytics is now available in the Europe (Milan) AWS region
-
2020/09/15: Amazon Kinesis Data Analytics now supports Java-based Apache Beam streaming workloads
-
2020/09/15: Amazon Kinesis Data Analytics now supports Apache Flink Kinesis Data Firehose Producer v2.0.0
-
2020/09/09: Amazon MSK now offers version 2.4.1.1, fixing a perpetual rebalance bug in Apache Kafka 2.4.1
-
2020/08/28: Amazon MSK is now available in Europe (Milan)
-
2020/08/17: AWS Certificate Manager Private Certificate Authority now supports Private CA sharing
-
2020/08/13: AWS Lambda now supports Amazon Managed Streaming for Apache Kafka as an event source
-
2020/06/26: Amazon MSK provides additional EC2 M5 broker sizes for more flexibility and cost optimization
-
2020/06/26: Amazon MSK now supports 3 AWS Availability Zones in São Paulo and Canada regions
-
2020/05/28: Amazon MSK now supports Apache Kafka version upgrades
-
2020/05/06: Amazon MSK is now available in AWS GovCloud (US) Regions
-
2020/04/08: Create Amazon MSK clusters with T3 brokers for less than $2.50/day
-
2020/04/02: Amazon MSK adds support for Apache Kafka version 2.4.1
-
2020/03/30: AWS Database Migration Service now supports replicating data to Apache Kafka streaming platform
-
2020/02/26: Amazon MSK can now stream broker logs to CloudWatch Logs, Amazon S3, or Amazon Elasticsearch Service
-
2020/02/13: Amazon MSK increases the default broker limit per cluster to 30 brokers
-
2020/01/23: Amazon MSK is now available in Middle East (Bahrain)
-
2019/12/19: Amazon MSK adds support for Apache Kafka version 2.3.1
-
2019/12/09: Introducing Open Monitoring with Prometheus for Amazon MSK
-
2019/11/25: Access resources within your Amazon Virtual Private Cloud using Amazon Kinesis Data Analytics
-
2019/10/16: You can now expand your Amazon MSK clusters and deploy new clusters across 2-AZs