AWS Step Functions를 이용한 마이크로서비스 개발하기 - 김현민 (4CSoft)
6 likes4,190 views
This document contains a summary of a presentation about AWS Step Functions. It discusses the key capabilities of AWS Step Functions including defining state machines as JSON, running state machines, different state types like tasks, choices and parallel processing. It also provides examples of using tasks, choices, parallel processing, input/output paths and retry/catch functionality.
!["ChoiceState": {
"Type" : "Choice",
"Choices": [
{
"Variable": "$.productSource",
"StringEquals": "screen-scrape",
"Next": "ScreenScrapeState"
},{
"Variable": "$.productSource",
"StringEquals": "vendor-a",
"Next": "VendorA"
},{
"Variable": "$.productSource",
"StringEquals": "vendor-b",
"Next": "VendorB"
},
{
"Variable": "$.productSource",
"StringEquals": "vendor-c",
"Next":"VendorC"
},{
"Variable": "$.productSource",
"StringEquals": "updateProduct",
"Next":"UpdateProduct"
}
],
"Default": "ScreenScrapeState”
}](https://image.slidesharecdn.com/awsstepfunctionsmicroservice-170131152705/85/AWS-Step-Functions-4CSoft-31-320.jpg)
![{
"Comment": "Call out to a RESTful service",
"StartAt": "Call out",
"States": {
"Call out": {
"Type": "Task",
"Resource":
"arn:aws:lambda:eu-central-1:123456789012:function:RestCallout",
"Retry": [
{ "ErrorEquals": [ "HandledError" ], "MaxAttempts": 10 }
],
"End": true
}
}
}](https://image.slidesharecdn.com/awsstepfunctionsmicroservice-170131152705/85/AWS-Step-Functions-4CSoft-34-320.jpg)
!["Send for OCR": {
"Type": "Parallel",
"Next": "Pick result",
"Branches": [
{
"StartAt": "Prep1",
"States": {
"Prep1": {
"Type": "Pass",
"Result": { "inputList": [ "OCR Provider 1" ] },
"Next": "Go1"
},
"Go1": {
"Type": "Task",
"Resource": "arn:aws:lambda:eu-central-1:123456789012:function:StatesBot",
"End": true
}
}](https://image.slidesharecdn.com/awsstepfunctionsmicroservice-170131152705/85/AWS-Step-Functions-4CSoft-38-320.jpg)
![Input processing
{
"title": "Numbers to add",
"numbers": [ 3, 4 ]
}
{
"Type": "Task",
"InputPath": "$.numbers",
"Resource": "arn:aws:lambda…"
…
[ 3, 4 ]
Raw input:
State spec:
Task input:](https://image.slidesharecdn.com/awsstepfunctionsmicroservice-170131152705/85/AWS-Step-Functions-4CSoft-41-320.jpg)
![Result placement
{
"title": "Numbers to add",
"numbers": [ 3, 4 ]
}
{
"Type": "Task",
"InputPath": "$.numbers",
"ResultPath": "$.sum”,
…
Raw input:
State spec:
Output: {
"title": "Numbers to add",
"numbers": [ 3, 4 ],
”sum": 7
}](https://image.slidesharecdn.com/awsstepfunctionsmicroservice-170131152705/85/AWS-Step-Functions-4CSoft-43-320.jpg)
!["Access Media": {
"Type": "Task",
"Resource": "arn:aws:lambda:eu-central-1:123456789012:function:FindMedia",
"TimeoutSeconds": 2,
"Next": "Graceful Exit",
"Retry": [
{
"ErrorEquals": [ "States.Timeout" ],
"IntervalSeconds": 2, "MaxAttempts": 2, "BackoffRate": 1.5
}
],
"Catch": [
{ "ErrorEquals": [ "States.ALL" ], "Next": "Clean Up" }
]
},](https://image.slidesharecdn.com/awsstepfunctionsmicroservice-170131152705/85/AWS-Step-Functions-4CSoft-48-320.jpg)
AWS Step Functions를 이용한 마이크로서비스 개발하기 - 김현민 (4CSoft)
- 1. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. , 4CSoft 2017.01.21 AWS Step Functions AWSKRUG re:Invent
- 2. • ([email protected]) • 4CSoft Inc. • iOS 4 • Node.js 1 • AWSKRUG • AWS : EC2, S3, Route53 … Lambda
- 5. λ
- 6. λλ λ
- 12. “ ” “ ” “ ” “try/catch/finally ” “ ” “ ”
- 14. λ λ λ λ λ λ λ
- 15. λ λ λ λ λλ λ
- 16. λ λ λ λ λλ λ
- 17. λ λ λ λ λλ λ
- 18. • • state • / • • ( )
- 20. “ ” AWS Step Functions, . AWS Step Functions .. Mathias Nitzsche, CTO “
- 23. var Twitter = require(‘twitter'); var client = new Twitter({ consumer_key: process.env.TWITTER_CONSUMER_KEY, consumer_secret: process.env.TWITTER_CONSUMER_SECRET, access_token_key: process.env.TWITTER_ACCESS_TOKEN_KEY, access_token_secret: process.env.TWITTER_ACCESS_TOKEN_SECRET }); exports.handler = (event, context, callback) => { var list = event.inputList; var textToTweet = list.shift(); var output = { inputList: list }; client.post('statuses/update', {status: textToTweet}, function(err, reply) { if (err) { console.log('error', err); context.fail(); } else { console.log('tweet', reply); callback(null, output); } }); };
- 24. (Demo)
- 25. – API-level Create State Machine – JSON DSL Run Machine – JSON blob , Execution ID . List Executions Describe Execution Stop Execution
- 29. “ ” AWS Step Function . AWS . Jared Browarnik, CTO, TheTake “
- 31. "ChoiceState": { "Type" : "Choice", "Choices": [ { "Variable": "$.productSource", "StringEquals": "screen-scrape", "Next": "ScreenScrapeState" },{ "Variable": "$.productSource", "StringEquals": "vendor-a", "Next": "VendorA" },{ "Variable": "$.productSource", "StringEquals": "vendor-b", "Next": "VendorB" }, { "Variable": "$.productSource", "StringEquals": "vendor-c", "Next":"VendorC" },{ "Variable": "$.productSource", "StringEquals": "updateProduct", "Next":"UpdateProduct" } ], "Default": "ScreenScrapeState” }
- 32. (Demo)
- 33. “ ” RESTful . 4~5 . , . “
- 34. { "Comment": "Call out to a RESTful service", "StartAt": "Call out", "States": { "Call out": { "Type": "Task", "Resource": "arn:aws:lambda:eu-central-1:123456789012:function:RestCallout", "Retry": [ { "ErrorEquals": [ "HandledError" ], "MaxAttempts": 10 } ], "End": true } } }
- 35. (Demo)
- 36. “I want to run functions in parallel” 3 OCR . “
- 38. "Send for OCR": { "Type": "Parallel", "Next": "Pick result", "Branches": [ { "StartAt": "Prep1", "States": { "Prep1": { "Type": "Pass", "Result": { "inputList": [ "OCR Provider 1" ] }, "Next": "Go1" }, "Go1": { "Type": "Task", "Resource": "arn:aws:lambda:eu-central-1:123456789012:function:StatesBot", "End": true } }
- 39. (Demo)
- 40. ? , JSON .A: Q:
- 41. Input processing { "title": "Numbers to add", "numbers": [ 3, 4 ] } { "Type": "Task", "InputPath": "$.numbers", "Resource": "arn:aws:lambda…" … [ 3, 4 ] Raw input: State spec: Task input:
- 42. Input processing Q: InputPath ? A: State raw . Q: InputPath null ? A: State JSON : {} Q: InputPath ? A: State JSON .
- 43. Result placement { "title": "Numbers to add", "numbers": [ 3, 4 ] } { "Type": "Task", "InputPath": "$.numbers", "ResultPath": "$.sum”, … Raw input: State spec: Output: { "title": "Numbers to add", "numbers": [ 3, 4 ], ”sum": 7 }
- 44. Result placement Q: ResultPath ? A: , raw . Q: ResultPath null ? A: State state . Q: ResultPath ? A: . .
- 45. “try/catch/finally ” AWS Step Functions Platform as a Service . With AWS Step Functions, 60 % . Pedro Pimenta, VP R&D, OutSystems “
- 46. 13 AWS Lambda Task States 6 Choice States 1 Fail State “try/catch/finally ”
- 48. "Access Media": { "Type": "Task", "Resource": "arn:aws:lambda:eu-central-1:123456789012:function:FindMedia", "TimeoutSeconds": 2, "Next": "Graceful Exit", "Retry": [ { "ErrorEquals": [ "States.Timeout" ], "IntervalSeconds": 2, "MaxAttempts": 2, "BackoffRate": 1.5 } ], "Catch": [ { "ErrorEquals": [ "States.ALL" ], "Next": "Clean Up" } ] },
- 49. (Demo)
- 50. “ ” 8 . “
- 51. APIs Register Activity Task - Returns ARN Poll For task (by ARN) Report Success Report Failure Report Heartbeat (Inside the Activity)
- 52. "NextShift": { "Type": "Wait", "TimestampPath": "$.ShiftStart", "Next": "Gather Plant Data" }, "Gather Plant Data": { "Type": "Task", "Resource": "arn:aws:states:ap-northeast-1:123456789012:activity:PlWatch", "TimeoutSeconds": 30000, "HeartBeatSeconds": 120, "Next": "Clean up" }
- 53. “ ” “ ” “ ” “try/catch/finally ” ? “ ” “ ”
- 56. AWS Step Functions ? Region Region Code US East (N. Virginia) us-east-1 US East (Ohio) us-east-2 US West (Oregon) us-west-2 EU (Dublin) eu-west-1 Asia Pacific (Tokyo) ap-northeast-1
- 57. • SVR201: Serverless Apps with AWS Step Functions - https://www.youtube.com/watch?v=75MRve4nv8s • CMP319: Building Distributed Applications with AWS Step Functions - https://www.youtube.com/watch?v=-qCFLXY1xa8 • Announcing AWS Step Functions - December 2016 Monthly Webinar Series - https://www.youtube.com/watch?v=vi0q9bODbTE