{"id":69272,"date":"2024-02-05T12:00:00","date_gmt":"2024-02-05T03:00:00","guid":{"rendered":"https:\/\/www.creationline.com\/?p=69272"},"modified":"2024-02-05T13:02:30","modified_gmt":"2024-02-05T04:02:30","slug":"lambda%e3%81%ae%e3%82%a4%e3%83%99%e3%83%b3%e3%83%89%e3%82%bd%e3%83%bc%e3%82%b9%e3%81%a8%e3%81%97%e3%81%a6amazon-msk%e3%82%92%e4%bd%bf%e7%94%a8%e3%81%99%e3%82%8b","status":"publish","type":"post","link":"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272","title":{"rendered":"Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9\u3068\u3057\u3066Amazon MSK\u3092\u4f7f\u7528\u3059\u308b"},"content":{"rendered":"\n

\u306f\u3058\u3081\u306b<\/h1>\n\n\n\n

\u4eca\u56de\u306e\u8a18\u4e8b\u3067\u306f\u3001Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9(Trigger)\u3068\u3057\u3066Amazon MSK\u3092\u4f7f\u7528\u3059\u308b\u65b9\u6cd5\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002\u3053\u308c\u306f\u3001\u8a00\u3044\u63db\u3048\u308c\u3070\u3001Lambda\u3092Amazon MSK\u306eConsumer\u3068\u3057\u3066\u4f7f\u7528\u3059\u308b\u65b9\u6cd5\u3067\u3059\u3002\u30a4\u30d9\u30f3\u30c8\u30bd\u30fc\u30b9\u3068\u3057\u3066MSK\u3092\u5229\u7528\u3059\u308b\u3068\u3001\u4e00\u822c\u7684\u306aConsumer\u306e\u5b9f\u88c5\u3067\u307f\u3089\u308c\u308b\u3088\u3046\u306a\u7169\u96d1\u306a\u30b3\u30fc\u30c7\u30a3\u30f3\u30b0\u304c\u4e0d\u8981\u3067\u3059\u3002MSK\u304b\u3089\u306e\u30c7\u30fc\u30bf\u306f\u3001Lambda\u306e\u30a4\u30d9\u30f3\u30c8\u30c7\u30fc\u30bf\u3068\u3057\u3066\u53d7\u3051\u53d6\u308b\u304b\u3089\u3067\u3059\u3002<\/p>\n\n\n\n

<\/p>\n\n\n\n

\n
\"\"<\/figure>\n<\/figure>\n\n\n\n

\u4e8b\u524d\u6e96\u5099<\/h1>\n\n\n\n

Lambda\u306e\u305f\u3081\u306e\u30ed\u30fc\u30eb\u3092\u7528\u610f\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n\n\n\n

[MskLambdaRole] <\/p>\n\n\n\n

{\n    Version: \"2012-10-17\",\n    Statement: [\n    {\n           Effect: \"Allow\",\n           Action: [\n               kafka-cluster:Connect,\n               kafka-cluster:AlterCluster,\n               kafka-cluster:DescribeCluster,\n               kafka-cluster:*Topic*,\n               kafka-cluster:WriteData,\n               kafka-cluster:ReadData,\n               kafka-cluster:AlterGroup,\n               kafka-cluster:DescribeGroup,\n               kafka-cluster:DescribeClusterDynamicConfiguration,\n               kafka:DescribeClusterV2,\n               kafka:GetBootstrapBrokers,\n               ec2:CreateNetworkInterface,\n               ec2:DescribeNetworkInterfaces,\n               ec2:DescribeVpcs,\n               ec2:DeleteNetworkInterface,\n               ec2:DescribeSubnets,\n               ec2:DescribeSecurityGroups,\n               logs:CreateLogGroup,\n               logs:CreateLogStream,\n               logs:PutLogEvents,\n               secretsmanager:GetSecretValue,\n               secretsmanager:DescribeSecret,\n               glue:GetSchemaVersion,\n               glue:GetSchemaVersionsDiff,\n               glue:GetSchema,\n               glue:GetRegistry\n               ],\n           Resource: [ * ]\n    }\n    ]\n}\n<\/code><\/pre>\n\n\n\n
[Trusted Policy]<\/p>\n\n\n\n
{\n    \"Version\": \"2012-10-17\",\n    \"Statement\": [\n        {\n            \"Effect\": \"Allow\",\n            \"Principal\": {\n                \"Service\": \"lambda.amazonaws.com\"\n            },\n            \"Action\": \"sts:AssumeRole\"\n        }\n    ]\n}<\/code><\/pre>\n\n\n\n
\u30cd\u30c3\u30c8\u30ef\u30fc\u30af\u74b0\u5883\u3084MSK\u306b\u3064\u3044\u3066\u306f\u3001\u59c9\u59b9\u8a18\u4e8b:\u30b5\u30fc\u30d0\u30ec\u30b9\u306eAmazon MSK\u30af\u30e9\u30b9\u30bf\u30fc<\/a>\u3092\u3054\u53c2\u7167\u304f\u3060\u3055\u3044\u3002<\/p>\n\n\n\n
Lambda\u4f5c\u6210<\/h1>\n\n\n\n
Lambda\u3092\u4f5c\u6210\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n\n\n\n
1.\u30bf\u30a4\u30d7\u306e\u9078\u629e:Auther from scrach<\/p>\n\n\n\n
\"\"<\/figure>\n\n\n\n
2.Function Name: EdaMskTestLambda<\/p>\n\n\n\n
3.Runtime: Python3.10<\/p>\n\n\n\n
4.Architecture: x86_64<\/p>\n\n\n\n
5.Execution role: User an existing role<\/p>\n\n\n\n
6.Existing role: MskLambdaRole<\/p>\n\n\n\n
7.Advanced setting :Enable VPC<\/p>\n\n\n\n
8.VPC: eda-vpc<\/p>\n\n\n\n
9.Subnets: eda-subnet-private-northeast-{1a,1c,1d}<\/p>\n\n\n\n
10.Security groups: eda-security-g-private<\/p>\n\n\n\n
11.Create Function\u3092\u30af\u30ea\u30c3\u30af<\/p>\n\n\n\n
Lambda\u3092\u4f5c\u6210\u3057\u305f\u3089\u3001lambda_function.py\u306e\u30bd\u30fc\u30b9\u30b3\u30fc\u30c9\u3092\u7de8\u96c6\u3057\u3066\u304f\u3060\u3055\u3044\u3002\u521d\u671f\u72b6\u614b\u3067\u306f\u3001\u6b21\u306e\u3088\u3046\u306b\u306a\u3063\u3066\u3044\u308b\u306f\u305a\u3067\u3059\u3002<\/p>\n\n\n\n
import json

def lambda_handler(event, context):
    # TODO implement
    return {
        'statusCode': 200,
        'body': json.dumps('Hello from Lambda!')
    }
\u3000<\/code><\/pre>\n\n\n\n
\u6b21\u306e\u3088\u3046\u306b\u30a4\u30d9\u30f3\u30c8\u30bd\u30fc\u30b9\u304b\u3089\u53d7\u3051\u53d6\u3063\u305f\u30e1\u30c3\u30bb\u30fc\u30b8\u306e\u30d0\u30ea\u30e5\u30fc\u3092\u8868\u793a\u3057\u3066\u307f\u307e\u3059\u3002<\/p>\n\n\n\n
import json\n\ndef lambda_handler(event, context):\n    # \u5168\u30a4\u30d9\u30f3\u30c8\u30c7\u30fc\u30bf\u3092\u8868\u793a\n    print(\"Received event:\", json.dumps(event, indent=2))\n\n    # \u5404\u30ec\u30b3\u30fc\u30c9\u3092\u51e6\u7406\n    for record in event['records']:\n        # \u30ad\u30fc\u3068\u5024\u3092\u30c7\u30b3\u30fc\u30c9\n        key = record['key']\n        value = record['value']\n        \n        # \u30ec\u30b3\u30fc\u30c9\u306e\u8a73\u7d30\u3092\u8868\u793a\n        print(f\"Key: {key}, Value: {value}\")\n\n    # \u51e6\u7406\u7d50\u679c\u3092\u8fd4\u3059\n    return {\n        'statusCode': 200,\n        'body': json.dumps('Event processed successfully!')\n    }\n<\/code><\/pre>\n\n\n\n
\u30a4\u30d9\u30f3\u30c8\u30bd\u30fc\u30b9\u8a2d\u5b9a(Add Trigger)<\/h1>\n\n\n\n
+Add trigger\u3092\u30af\u30ea\u30c3\u30af\u3057\u3001\u30a4\u30d9\u30f3\u30c8\u30bd\u30fc\u30b9\u3092\u8a2d\u5b9a\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n\n\n\n
\"\"<\/figure>\n\n\n\n
1.Select a source: MSK<\/p>\n\n\n\n
\"\"<\/figure>\n\n\n\n
2.MSK cluster: test-msk-cluster-1<\/p>\n\n\n\n
3.Authentication: -<\/p>\n\n\n\n
4.Secret Manager key: -<\/p>\n\n\n\n
5.Active trigger: checked<\/p>\n\n\n\n
6.Batch size: 100<\/p>\n\n\n\n
7.String postion: Trim horizon(earlest\u76f8\u5f53)<\/p>\n\n\n\n
8.Batch windows: -<\/p>\n\n\n\n
9.Topic Name: testTopic<\/p>\n\n\n\n
10.Consumer group ID(Option):testTopic-g1<\/p>\n\n\n\n
11.Add\u30dc\u30bf\u30fc\u30f3\u3092\u30af\u30ea\u30c3\u30af<\/p>\n\n\n\n
\u30a4\u30d9\u30f3\u30c8\u30c7\u30fc\u30bf\u306e\u53d7\u4fe1\u3092\u78ba\u8a8d<\/h1>\n\n\n\n
\u59c9\u59b9\u8a18\u4e8b:Amazon MSK\u3092\u4f7f\u7528\u3057\u305f\u30c7\u30fc\u30bf\u9001\u53d7\u4fe1\u30d7\u30ed\u30b0\u30e9\u30e0\u306e\u958b\u767a<\/a>\u3092\u53c2\u7167\u3057\u3001\u30e1\u30c3\u30bb\u30fc\u30b8\u3092\u9001\u4fe1\u3057\u3066\u307f\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n\n\n\n
$ python procedure.py\u3000\nProduced: {'orderId': 04b15cb6-afb0-4288-a197-7244c75884f7', 'time': '2024-01-03T10:50:06.282572', 'bookName': 'Book F', 'price': 48.72}<\/code><\/pre>\n\n\n\n
\u7d50\u679c\u306f\u3001Cloud Watch\u306eLog Group\u304b\u3089\u78ba\u8a8d\u3067\u304d\u307e\u3059\u3002<\/p>\n\n\n\n
\/aws\/lambda\/EdaMskTestLambd\u30ed\u30b0\u3092\u78ba\u8a8d\u3057\u3066\u304f\u3060\u3055\u3044\u3002\u6b21\u306e\u3088\u3046\u306a\u30e1\u30c3\u30bb\u30fc\u30b8\u304c\u8868\u793a\u3055\u308c\u3066\u3044\u308b\u306f\u305a\u3067\u3059\u3002<\/p>\n\n\n\n
 Partition: testTopic-1, Offset: 2948, Value: {\n    \"orderId\": \"04b15cb6-afb0-4288-a197-7244c75884f7\",\n    \"time\": \"2024-01-03T10:50:06.282572\",\n    \"bookName\": \"Book F\",\n    \"price\": 48.72\n<\/code><\/pre>\n\n\n\n
\u307e\u3068\u3081<\/h1>\n\n\n\n
\u3053\u306e\u3088\u3046\u306bLambda\u3067MSK\u3092\u30a4\u30d9\u30f3\u30c8\u30bd\u30fc\u30b9\u3068\u3057\u3066\u4f7f\u7528\u3059\u308b\u5834\u5408\u3001\u4e00\u822c\u7684\u306aConsumer\u306e\u958b\u767a\u306b\u6bd4\u3079\u3001\u30b3\u30fc\u30c7\u30a3\u30f3\u30b0\u304c\u3068\u3066\u3082\u7c21\u5358\u3067\u3059\u3002\u958b\u767a\u8005\u306f\u3001\u7279\u306bConsumer\u3067\u3042\u308b\u3053\u3068\u3092\u610f\u8b58\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u305b\u3093\u3002\u307e\u305f\u3001\u30b5\u30fc\u30d0\u30fc\u30ec\u30b9\u30d7\u30e9\u30c3\u30c8\u30d5\u30a9\u30fc\u30e0\u3067\u904b\u7528\u3067\u304d\u308b\u30e1\u30ea\u30c3\u30c8\u3082\u975e\u5e38\u306b\u5927\u304d\u3044\u3067\u3059\u3002Consumer\u3092\u958b\u767a\u3057\u3001EC2\u3084\u30b3\u30f3\u30c6\u30ca\u30fc\u3067\u904b\u7528\u3059\u308b\u5834\u5408\u3068\u6bd4\u8f03\u3057\u3066\u307f\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"
\u306f\u3058\u3081\u306b \u4eca\u56de\u306e\u8a18\u4e8b\u3067\u306f\u3001Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9(Trigger)\u3068\u3057\u3066Amazon MSK\u3092\u4f7f\u7528\u3059\u308b\u65b9\u6cd5\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002\u3053\u308c\u306f\u3001\u8a00\u3044\u63db\u3048\u308c\u3070\u3001Lambda\u3092Amazon MSK\u306eConsumer\u3068\u3057\u3066\u4f7f\u7528\u3059\u308b\u65b9\u6cd5\u3067 […]<\/p>\n","protected":false},"author":13,"featured_media":70030,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","footnotes":""},"categories":[98,750,477,61,323],"tags":[978,982,411,977,991],"class_list":["post-69272","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-aws","category-event-driven","category-kafka","category-lee","category-python","tag-eda","tag-kakfa","tag-lambda","tag-msk","tag-trigger"],"acf":[],"yoast_head":"\nLambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9\u3068\u3057\u3066Amazon MSK\u3092\u4f7f\u7528\u3059\u308b - Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3<\/title>\n<meta name=\"description\" content=\"AWS, event-driven, Kafka, lee, Python |\u306f\u3058\u3081\u306b \u4eca\u56de\u306e\u8a18\u4e8b\u3067\u306f\u3001Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9(Trigger)\u3068\u3057\u3066Amazon\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272\" \/>\n<meta property=\"og:locale\" content=\"ja_JP\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9\u3068\u3057\u3066Amazon MSK\u3092\u4f7f\u7528\u3059\u308b - Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3\" \/>\n<meta property=\"og:description\" content=\"AWS, event-driven, Kafka, lee, Python |\u306f\u3058\u3081\u306b \u4eca\u56de\u306e\u8a18\u4e8b\u3067\u306f\u3001Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9(Trigger)\u3068\u3057\u3066Amazon\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272\" \/>\n<meta property=\"og:site_name\" content=\"Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/creationline\" \/>\n<meta property=\"article:published_time\" content=\"2024-02-05T03:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-02-05T04:02:30+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.creationline.com\/tech-blog\/cms_x3GWkuX\/wp-content\/uploads\/2024\/02\/msk-lambda-0.png\" \/>\n\t<meta property=\"og:image:width\" content=\"958\" \/>\n\t<meta property=\"og:image:height\" content=\"379\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"lee\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@awk256\" \/>\n<meta name=\"twitter:site\" content=\"@creationline\" \/>\n<meta name=\"twitter:label1\" content=\"\u57f7\u7b46\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"lee\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u63a8\u5b9a\u8aad\u307f\u53d6\u308a\u6642\u9593\" \/>\n\t<meta name=\"twitter:data2\" content=\"1\u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272\"},\"author\":{\"name\":\"lee\",\"@id\":\"https:\/\/www.creationline.com\/tech-blog\/#\/schema\/person\/7a9c09b6fc036bd56d9a7f7264389616\"},\"headline\":\"Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9\u3068\u3057\u3066Amazon MSK\u3092\u4f7f\u7528\u3059\u308b\",\"datePublished\":\"2024-02-05T03:00:00+00:00\",\"dateModified\":\"2024-02-05T04:02:30+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272\"},\"wordCount\":117,\"image\":{\"@id\":\"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.creationline.com\/tech-blog\/cms_x3GWkuX\/wp-content\/uploads\/2024\/02\/msk-lambda-0.png\",\"keywords\":[\"EDA\",\"Kakfa\",\"Lambda\",\"MSK\",\"trigger\"],\"articleSection\":[\"AWS\",\"event-driven\",\"Kafka\",\"lee\",\"Python\"],\"inLanguage\":\"ja\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272\",\"url\":\"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272\",\"name\":\"Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9\u3068\u3057\u3066Amazon MSK\u3092\u4f7f\u7528\u3059\u308b - Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3\",\"isPartOf\":{\"@id\":\"https:\/\/www.creationline.com\/tech-blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.creationline.com\/tech-blog\/cms_x3GWkuX\/wp-content\/uploads\/2024\/02\/msk-lambda-0.png\",\"datePublished\":\"2024-02-05T03:00:00+00:00\",\"dateModified\":\"2024-02-05T04:02:30+00:00\",\"author\":{\"@id\":\"https:\/\/www.creationline.com\/tech-blog\/#\/schema\/person\/7a9c09b6fc036bd56d9a7f7264389616\"},\"description\":\"AWS, event-driven, Kafka, lee, Python |\u306f\u3058\u3081\u306b \u4eca\u56de\u306e\u8a18\u4e8b\u3067\u306f\u3001Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9(Trigger)\u3068\u3057\u3066Amazon\",\"breadcrumb\":{\"@id\":\"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272#breadcrumb\"},\"inLanguage\":\"ja\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"ja\",\"@id\":\"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272#primaryimage\",\"url\":\"https:\/\/www.creationline.com\/tech-blog\/cms_x3GWkuX\/wp-content\/uploads\/2024\/02\/msk-lambda-0.png\",\"contentUrl\":\"https:\/\/www.creationline.com\/tech-blog\/cms_x3GWkuX\/wp-content\/uploads\/2024\/02\/msk-lambda-0.png\",\"width\":958,\"height\":379},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"HOME\",\"item\":\"https:\/\/www.creationline.com\/tech-blog\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"\u30af\u30e9\u30a6\u30c9\u30cd\u30a4\u30c6\u30a3\u30d6\",\"item\":\"https:\/\/www.creationline.com\/tech-blog\/cloudnative\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"AWS\",\"item\":\"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9\u3068\u3057\u3066Amazon MSK\u3092\u4f7f\u7528\u3059\u308b\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.creationline.com\/tech-blog\/#website\",\"url\":\"https:\/\/www.creationline.com\/tech-blog\/\",\"name\":\"Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3\",\"description\":\"\u30a2\u30b8\u30e3\u30a4\u30eb\uff06DevOps\u3001\u30af\u30e9\u30a6\u30c9\u30cd\u30a4\u30c6\u30a3\u30d6\u3001AI\uff06LLM\u306e\u5148\u7aef\u6280\u8853\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.creationline.com\/tech-blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"ja\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.creationline.com\/tech-blog\/#\/schema\/person\/7a9c09b6fc036bd56d9a7f7264389616\",\"name\":\"lee\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"ja\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/278a9c7ed6393635496209225c69f2d6caf4f4b360cf0c2a80ada723070d4f94?s=96&d=wp_user_avatar&r=g\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/278a9c7ed6393635496209225c69f2d6caf4f4b360cf0c2a80ada723070d4f94?s=96&d=wp_user_avatar&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/278a9c7ed6393635496209225c69f2d6caf4f4b360cf0c2a80ada723070d4f94?s=96&d=wp_user_avatar&r=g\",\"caption\":\"lee\"},\"description\":\"\u30e2\u30c0\u30f3\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u30fc\u57fa\u76e4\u306e\u30bd\u30ea\u30e5\u30fc\u30b7\u30e7\u30f3\u30a2\u30fc\u30ad\u30c6\u30af\u30c8\u3068\u3057\u3066\u6d3b\u52d5\u3057\u3066\u3044\u307e\u3059\u3002 [\u8457\u66f8] \u30fbAmazon Cloud\u30c6\u30af\u30cb\u30ab\u30eb\u30ac\u30a4\u30c9\u2015EC2\/S3\u304b\u3089VPC\u307e\u3067\u5fb9\u5e95\u89e3\u6790 \u30fbAmazon Elastic MapReduce\u30c6\u30af\u30cb\u30ab\u30eb\u30ac\u30a4\u30c9 \u2015\u30af\u30e9\u30a6\u30c9\u578bHadoop\u3067\u5b9f\u73fe\u3059\u308b\u5927\u898f\u6a21\u5206\u6563\u51e6\u7406 \u30fbCypher\u30af\u30a8\u30ea\u30fc\u8a00\u8a9e\u306e\u4e8b\u4f8b\u3067\u5b66\u3076\u30b0\u30e9\u30d5\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9Neo4j \u30fbNeo4j\u3092\u4f7f\u3046\u30b0\u30e9\u30d5\u578b\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u5165\u9580(\u5171\u8457) \u30fbRDB\u6280\u8853\u8005\u306e\u305f\u3081\u306eNoSQL\u30ac\u30a4\u30c9(\u5171\u8457)\",\"sameAs\":[\"https:\/\/x.com\/@awk256\"],\"url\":\"https:\/\/www.creationline.com\/tech-blog\/author\/lee\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9\u3068\u3057\u3066Amazon MSK\u3092\u4f7f\u7528\u3059\u308b - Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3","description":"AWS, event-driven, Kafka, lee, Python |\u306f\u3058\u3081\u306b \u4eca\u56de\u306e\u8a18\u4e8b\u3067\u306f\u3001Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9(Trigger)\u3068\u3057\u3066Amazon","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272","og_locale":"ja_JP","og_type":"article","og_title":"Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9\u3068\u3057\u3066Amazon MSK\u3092\u4f7f\u7528\u3059\u308b - Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3","og_description":"AWS, event-driven, Kafka, lee, Python |\u306f\u3058\u3081\u306b \u4eca\u56de\u306e\u8a18\u4e8b\u3067\u306f\u3001Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9(Trigger)\u3068\u3057\u3066Amazon","og_url":"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272","og_site_name":"Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3","article_publisher":"https:\/\/www.facebook.com\/creationline","article_published_time":"2024-02-05T03:00:00+00:00","article_modified_time":"2024-02-05T04:02:30+00:00","og_image":[{"width":958,"height":379,"url":"https:\/\/www.creationline.com\/tech-blog\/cms_x3GWkuX\/wp-content\/uploads\/2024\/02\/msk-lambda-0.png","type":"image\/png"}],"author":"lee","twitter_card":"summary_large_image","twitter_creator":"@awk256","twitter_site":"@creationline","twitter_misc":{"\u57f7\u7b46\u8005":"lee","\u63a8\u5b9a\u8aad\u307f\u53d6\u308a\u6642\u9593":"1\u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272#article","isPartOf":{"@id":"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272"},"author":{"name":"lee","@id":"https:\/\/www.creationline.com\/tech-blog\/#\/schema\/person\/7a9c09b6fc036bd56d9a7f7264389616"},"headline":"Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9\u3068\u3057\u3066Amazon MSK\u3092\u4f7f\u7528\u3059\u308b","datePublished":"2024-02-05T03:00:00+00:00","dateModified":"2024-02-05T04:02:30+00:00","mainEntityOfPage":{"@id":"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272"},"wordCount":117,"image":{"@id":"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272#primaryimage"},"thumbnailUrl":"https:\/\/www.creationline.com\/tech-blog\/cms_x3GWkuX\/wp-content\/uploads\/2024\/02\/msk-lambda-0.png","keywords":["EDA","Kakfa","Lambda","MSK","trigger"],"articleSection":["AWS","event-driven","Kafka","lee","Python"],"inLanguage":"ja"},{"@type":"WebPage","@id":"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272","url":"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272","name":"Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9\u3068\u3057\u3066Amazon MSK\u3092\u4f7f\u7528\u3059\u308b - Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3","isPartOf":{"@id":"https:\/\/www.creationline.com\/tech-blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272#primaryimage"},"image":{"@id":"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272#primaryimage"},"thumbnailUrl":"https:\/\/www.creationline.com\/tech-blog\/cms_x3GWkuX\/wp-content\/uploads\/2024\/02\/msk-lambda-0.png","datePublished":"2024-02-05T03:00:00+00:00","dateModified":"2024-02-05T04:02:30+00:00","author":{"@id":"https:\/\/www.creationline.com\/tech-blog\/#\/schema\/person\/7a9c09b6fc036bd56d9a7f7264389616"},"description":"AWS, event-driven, Kafka, lee, Python |\u306f\u3058\u3081\u306b \u4eca\u56de\u306e\u8a18\u4e8b\u3067\u306f\u3001Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9(Trigger)\u3068\u3057\u3066Amazon","breadcrumb":{"@id":"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272#breadcrumb"},"inLanguage":"ja","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272"]}]},{"@type":"ImageObject","inLanguage":"ja","@id":"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272#primaryimage","url":"https:\/\/www.creationline.com\/tech-blog\/cms_x3GWkuX\/wp-content\/uploads\/2024\/02\/msk-lambda-0.png","contentUrl":"https:\/\/www.creationline.com\/tech-blog\/cms_x3GWkuX\/wp-content\/uploads\/2024\/02\/msk-lambda-0.png","width":958,"height":379},{"@type":"BreadcrumbList","@id":"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws\/69272#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"HOME","item":"https:\/\/www.creationline.com\/tech-blog"},{"@type":"ListItem","position":2,"name":"\u30af\u30e9\u30a6\u30c9\u30cd\u30a4\u30c6\u30a3\u30d6","item":"https:\/\/www.creationline.com\/tech-blog\/cloudnative"},{"@type":"ListItem","position":3,"name":"AWS","item":"https:\/\/www.creationline.com\/tech-blog\/cloudnative\/aws"},{"@type":"ListItem","position":4,"name":"Lambda\u306e\u30a4\u30d9\u30f3\u30c9\u30bd\u30fc\u30b9\u3068\u3057\u3066Amazon MSK\u3092\u4f7f\u7528\u3059\u308b"}]},{"@type":"WebSite","@id":"https:\/\/www.creationline.com\/tech-blog\/#website","url":"https:\/\/www.creationline.com\/tech-blog\/","name":"Tech Blog\uff5c\u30af\u30ea\u30a8\u30fc\u30b7\u30e7\u30f3\u30e9\u30a4\u30f3","description":"\u30a2\u30b8\u30e3\u30a4\u30eb\uff06DevOps\u3001\u30af\u30e9\u30a6\u30c9\u30cd\u30a4\u30c6\u30a3\u30d6\u3001AI\uff06LLM\u306e\u5148\u7aef\u6280\u8853","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.creationline.com\/tech-blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"ja"},{"@type":"Person","@id":"https:\/\/www.creationline.com\/tech-blog\/#\/schema\/person\/7a9c09b6fc036bd56d9a7f7264389616","name":"lee","image":{"@type":"ImageObject","inLanguage":"ja","@id":"https:\/\/secure.gravatar.com\/avatar\/278a9c7ed6393635496209225c69f2d6caf4f4b360cf0c2a80ada723070d4f94?s=96&d=wp_user_avatar&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/278a9c7ed6393635496209225c69f2d6caf4f4b360cf0c2a80ada723070d4f94?s=96&d=wp_user_avatar&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/278a9c7ed6393635496209225c69f2d6caf4f4b360cf0c2a80ada723070d4f94?s=96&d=wp_user_avatar&r=g","caption":"lee"},"description":"\u30e2\u30c0\u30f3\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u30fc\u57fa\u76e4\u306e\u30bd\u30ea\u30e5\u30fc\u30b7\u30e7\u30f3\u30a2\u30fc\u30ad\u30c6\u30af\u30c8\u3068\u3057\u3066\u6d3b\u52d5\u3057\u3066\u3044\u307e\u3059\u3002 [\u8457\u66f8] \u30fbAmazon Cloud\u30c6\u30af\u30cb\u30ab\u30eb\u30ac\u30a4\u30c9\u2015EC2\/S3\u304b\u3089VPC\u307e\u3067\u5fb9\u5e95\u89e3\u6790 \u30fbAmazon Elastic MapReduce\u30c6\u30af\u30cb\u30ab\u30eb\u30ac\u30a4\u30c9 \u2015\u30af\u30e9\u30a6\u30c9\u578bHadoop\u3067\u5b9f\u73fe\u3059\u308b\u5927\u898f\u6a21\u5206\u6563\u51e6\u7406 \u30fbCypher\u30af\u30a8\u30ea\u30fc\u8a00\u8a9e\u306e\u4e8b\u4f8b\u3067\u5b66\u3076\u30b0\u30e9\u30d5\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9Neo4j \u30fbNeo4j\u3092\u4f7f\u3046\u30b0\u30e9\u30d5\u578b\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u5165\u9580(\u5171\u8457) \u30fbRDB\u6280\u8853\u8005\u306e\u305f\u3081\u306eNoSQL\u30ac\u30a4\u30c9(\u5171\u8457)","sameAs":["https:\/\/x.com\/@awk256"],"url":"https:\/\/www.creationline.com\/tech-blog\/author\/lee"}]}},"_links":{"self":[{"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/posts\/69272","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/comments?post=69272"}],"version-history":[{"count":18,"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/posts\/69272\/revisions"}],"predecessor-version":[{"id":70036,"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/posts\/69272\/revisions\/70036"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/media\/70030"}],"wp:attachment":[{"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/media?parent=69272"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/categories?post=69272"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.creationline.com\/tech-blog\/wp-json\/wp\/v2\/tags?post=69272"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}