AWS Community Day 2022 Dhiraj Mahapatro_AWS Lambda under the hood _ Best Practices
1 like157 views
The document provides an in-depth overview of AWS Lambda, including: - What AWS Lambda is and how it works under the hood. - The three invocation modes: synchronous, asynchronous, and event source mapping. - Details on the Lambda execution environment like sizing, concurrency, and architectures. - Other notable Lambda features like code signing and Amazon EFS integration. - Best practices like using AWS Lambda Powertools for observability and optimizing functions.
AWS Community Day 2022 Dhiraj Mahapatro_AWS Lambda under the hood _ Best Practices
- 1. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. © 2022, Amazon Web Services, Inc. or its affiliates. AWS Lambda Deep Dive Dhiraj Mahapatro Principal Specialist SA, Serverless AWS
- 2. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Agenda • What is AWS Lambda? • Lambda invocation modes • The Execution Environment • Other notable features • Quotas & best practices 2
- 3. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. © 2022, Amazon Web Services, Inc. or its affiliates. What is AWS Lambda? 3
- 4. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. The high-level view 4 Events AWS Services Databases Etc. Python Javascript Java C# Golang BYOL Container images
- 5. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. The customer view 5 IAM or Lambda Permissions Event Source Mapping AWS Lambda Functions IAM Execution Role Execution Environments Execution Environments Alias: Prod Alias: Stage Version 1 Version 2 Code Config Zip + Layers Container images 80% 100% 20% or and more and more
- 6. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. AWS Lambda under the hood 6 Event Source Mapping AWS Lambda or and more and more Internal Queue Workers microVM microVM microVM microVM Sandbox Sandbox Sandbox Sandbox Sync Async Frontend
- 7. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. © 2022, Amazon Web Services, Inc. or its affiliates. Lambda invocation modes 7
- 8. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Lambda invocation modes 8 Event Source Mapping Internal Queue Sync Async Frontend
- 9. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. When the caller expects a response from the function. Three invocation modes Synchronous Asynchronous When the caller doesn't expect a response from the function. Event Source Mapping Integration with specific event sources. (Synchronous under the hood) 9 event response event Internal queue
- 10. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Synchronous invocation mode 10 or and more microVM Sandbox Sync Frontend • Useful when you need an immediate response from the function. • Errors are returned to the caller. • Returns throttles when you hit the concurrency limit.
- 11. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Asynchronous invocation mode 11 or and more Internal Queue microVM Sandbox Async Frontend • Caller only gets an acknowledgement from the Lambda service. • Internal queue that can persist messages for up to 6 hours. • Support retries (up to 2 retries, or 3 invokes total), destinations and DLQ.
- 12. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Event Source Mapping 12 Event Source Mapping and more microVM Sandbox Frontend • Event Source Mapping pulls messages from the source, then does synchronous invokes. • Can do batching, error handling, and more. The exact capabilities differ by event source.
- 13. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. © 2022, Amazon Web Services, Inc. or its affiliates. The Lambda Execution Environment (a.k.a. Sandbox) 13
- 14. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Lambda execution environments 14 Workers microVM microVM microVM microVM Sandbox Sandbox Sandbox Sandbox
- 15. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Lambda execution environments 15 Workers microVM microVM microVM microVM Sandbox Sandbox Sandbox Sandbox • Execution Environment (EE): where your code actually runs. One EE handles one request at a time. • Concurrency: number of EEs actively serving traffic for a given Function/Version/Alias. Concurrency ≈ RPS × Duration Concurrency ≤ number of EEs
- 16. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Execution environment lifecycle 16 Execution Environment Initialization Invoke Invoke Invoke Invoke Invoke Shutdown Initialization Execution Environment Invoke Invoke Shutdown Time
- 17. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Measuring Lambda concurrency Concurrency = TPS * Duration (in seconds) TPS = 100 Duration = 500 ms or ½ second Concurrency 100 * (500/1000) = 50 TPS = 100 Duration = 2,000 ms or 2 seconds Concurrency 100 * (2) = 200 Optimize for durations < 1 second Monitor ConcurrentExecutions Metric 17
- 18. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Sizing the Execution Environment More memory = more CPU resources From 128MB to 10GB Up to 6 vCPUs 18 https://github.com/alexcasalboni/aws-lambda-power- tuning
- 19. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Understanding Lambda performance CloudWatch Logs Insights query that breaks down cold start and warm start performances at different percentiles. filter @type="REPORT" | fields greatest(@initDuration, 0) + @duration as duration, ispresent(@initDuration) as coldStart | stats count(*) as count, pct(duration, 50) as p50, pct(duration, 90) as p90, pct(duration, 99) as p99, max(duration) as max by coldStart 19
- 20. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. CPU Architectures Two architecture options: • x86_64 • Arm64 (powered by graviton2) Why Arm64? Up to 19% better performance, and 20% lower cost. Things to keep in mind Binaries need to be compiled for Arm64. Some libraries/tools might not be optimized for Arm64 yet. 20
- 21. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. © 2022, Amazon Web Services, Inc. or its affiliates. Other notable features 21
- 22. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Other notable features Lambda Function URL Create & configure dedicated HTTPS endpoint for your Lambda function. Amazon EFS Integration Mount an EFS file system to a local directory. Code Signing Ensure only trusted code runs in your Lambda functions. Up to 10GB Ephemeral Storage Configure /tmp storage between 512MB and 10GB. Amazon RDS Proxy Pool database connections to reach high concurrency without exhausting DB connections. 22
- 23. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. © 2022, Amazon Web Services, Inc. or its affiliates. Quotas & best practices 23
- 24. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Important quotas • Concurrent executions: 1000, can be increased to hundreds of thousands • Burst capacity limit: 500-3000, hard limit • Invocation payload: 6MB sync, 256KB async • Deployment package: • Zip file: 50MB zipped, 250MB unzipped • Container image: 10GB • Temporary storage: 512MB – Free (can go up to 10GB with additional cost) • Invocations per second: • Sync/Async non-AWS: 10x concurrent execution quota • Async AWS: unlimited • Provisioned concurrency: 10x provisioned concurrency • ENIs per VPC: 100 24
- 25. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. AWS Lambda Powertools • Tracing with AWS X-Ray For end-to-end observability • Structured logging for search and aggregation • Custom metrics with CloudWatch Logs EMF Python: https://github.com/awslabs/aws-lambda- powertools-python Java: https://github.com/awslabs/aws-lambda- powertools-java Typescript: https://github.com/awslabs/aws-lambda- powertools-typescript 25
- 26. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Error handling Synchronous: The function returns an error to the caller. Asynchronous: Configure destination on the function to alert and store failures. Event Source Mapping (SQS): Setup a dead-letter queue (DLQ) on the queue. Event Source Mapping (other sources): Configure destination on the event source mapping to alert and store failures. 26
- 27. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Function optimizations • Take advantage of EE reuse by initializing resources outside of the function handler. • Minimize the size of your deployment package to its runtime necessities. • Opt for dependencies that load quickly when possible. 27
- 28. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Well-Architected Framework Serverless Lens: Well-architected questions and guidance for serverless workloads. https://docs.aws.amazon.com/ wellarchitected/latest/serverless-applications- lens/welcome.html Serverless Rules: Infrastructure-as-code linter to validate against best practices. E.g.: • Function with tracing disabled • Asynchronous function without failure destination https://github.com/aws- samples/serverless-rules
- 29. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Serverless demos in various languages Go https://github.com/aws-samples/serverless-go- demo Groovy https://github.com/aws-samples/serverless- groovy-demo Java (GraalVM) https://github.com/aws-samples/serverless- graalvm-demo Kotlin https://github.com/aws-samples/serverless- kotlin-demo Micronaut/Quarkus/SpringBoot https://github.com/aws-samples/serverless- java-frameworks-samples .NET https://github.com/aws-samples/serverless- dotnet-demo Rust https://github.com/aws- samples/serverless-rust-demo Typescript https://github.com/aws- samples/serverless-typescript-demo 29
- 30. AWS LAMBDA DEEP DIVE © 2022, Amazon Web Services, Inc. or its affiliates. Thank you! © 2022, Amazon Web Services, Inc. or its affiliates. 30 Dhiraj Mahapatro [email protected] Twitter: @dhirajmahapatro LinkedIn: dmahapatro