Serverless Architectures with AWS Lambda and MongoDB Atlas by Sig Narvaez
0 likes493 views
Abstract:- It's easier than ever to power serverless architectures with managed database services like MongoDB Atlas. In this session, we will explore the rise of serverless architectures and how they've rapidly integrated into public and private cloud offerings. We will demonstrate how to build a simple REST API using AWS Lambda functions, create a highly available cluster in MongoDB Atlas, and connect both via VCP Peering. We will then simulate load and use the monitoring and scale features of MongoDB Atlas and use MongoDB Compass to browse our database.
Ad
More Related Content
What's hot (20)
Similar to Serverless Architectures with AWS Lambda and MongoDB Atlas by Sig Narvaez (19)
Ad
More from Data Con LA (20)
Ad
Recently uploaded (20)
Serverless Architectures with AWS Lambda and MongoDB Atlas by Sig Narvaez
- 1. @SigNarvaez | @MongoDB | @BigDataDayLA On-Prem, IaaS, etc. Serverless
- 2. Serverless Architectures with AWS Lambda and MongoDB Atlas Sig Narváez Sr. Solutions Architect [email protected] @SigNarvaez
- 3. Serverless
- 4. Big Iron Commodity Hardware Virtualized Containers Functions Where will my code run? @SigNarvaez | @MongoDB | @BigDataDayLA
- 5. 1. Cloud services have matured 2. BaaS à “SaaS-ification” 3. API’s are the glue 4. Containers – now per function 5. SysOps à DevOps à NoOps Less Ops, More Engineering Forbes: 5 factors fuelling Serverless Computing https://www.forbes.com/sites/janakirammsv/2016/02/28/five-factors-that-are-fueling-serverless-computing-part-1 @SigNarvaez | @MongoDB | @BigDataDayLA
- 6. EVERYCOMPANYISASOFTWARECOMPANY DEVELOPERSAREVALUABLERESOURCE BUILDVALUE-NOTOPERATIONS @SigNarvaez | @MongoDB | @BigDataDayLA WE LIVE IN A SOFTWARE DEFINED ECONOMY
- 8. AWS re:Invent 2016: The State of Serverless Computing (SVR311)
- 9. AWS re:Invent 2016: The State of Serverless Computing (SVR311)
- 11. Microservices
- 12. Serverless Microservice @SigNarvaez | @MongoDB | @BigDataDayLA
- 13. Shape • Person • Insurance Policies • Shape changes per policy type • Addresses Operations via API • GET Customers with soon-to-expire policies, within a geo radius • GET Customers / by SSN, id, etc. • PATCH Update basic contact info (cell, email, …) Customer Single View - Insurance Industry (hypothetical) High-level architecture of a single view platform @SigNarvaez | @MongoDB | @BigDataDayLA
- 14. CQRS on Serverless Microservices COMMAND Update basic info QUERY Soon to Expire GEO By SSN, ID, … CUD API Key Read API Key Lambda Function(s) Majority Writes Secondary Reads Lambda Function(s) VPC Peering @SigNarvaez | @MongoDB | @BigDataDayLA
- 15. MongoDB Atlas & AWS Build it!
- 16. Automated Service On-demand DBaaS Secure Highly Available Disaster Recovery Elastic Scalability MongoDB Atlas
- 17. Setup MongoDB Atlas - M10+ Need assigned AWS region @SigNarvaez | @MongoDB | @BigDataDayLA
- 18. mgeneratejs • https://github.com/rueckstiess/mgeneratejs • npm install -g mgeneratejs • Create template – generate data • Upload to Atlas via mongoimport • Hint: get connection string from Atlas UI! • Browse with Compass Generate dataset (optional) Template (CustomerSingleView.json) mgeneratejs -n 100 CustomerSingleView.json | mongoimport --host ”YOUR ATLAS CLUSTER" --numInsertionWorkers 4 --db SingleView--collection Customers --authenticationDatabase admin -- ssl --username YOURUSER --password YOURPASSWORD @SigNarvaez | @MongoDB | @BigDataDayLA
- 19. IAM • Role with Lambda execute policies VPC • VPC Peering Connection • Security Group Required AWS Services Lambda • Set VPC, Security Group and IAM role • Upload deployment package (.zip) API Gateway • API definition (Resources & HTTP Methods) • Map Routes to Lambda functions • API Keys & Usage Plans @SigNarvaez | @MongoDB | @BigDataDayLA
- 20. VPC Peering
- 27. Lambda
- 28. Connections & Containers http://docs.aws.amazon.com/lambda/latest/dg/lambda-introduction.html … AWS Lambda maintains the container for some time in anticipation of another Lambda function invocation. … the service freezes the container after a function completes, and thaws the container for reuse. If AWS Lambda chooses to reuse the container, this has the following implications: - Any declarations in your Lambda function code (outside the handler code, see Programming Model) remains initialized, providing additional optimization when the function is invoked again. For example, if your Lambda function establishes a database connection, instead of reestablishing the connection, the original connection is used in subsequent invocations. You can add logic in your code to check if a connection already exists before creating one. @SigNarvaez | @MongoDB | @BigDataDayLA
- 29. Python lambda function skeleton @SigNarvaez | @MongoDB | @BigDataDayLA
- 30. Node.js lambda function skeleton @SigNarvaez | @MongoDB | @BigDataDayLA
- 31. Local Emulators : Test on EC2 instance against Atlas python-lambda-local at https://pypi.python.org/pypi/python-lambda-local lambda-local (node.js) at https://www.npmjs.com/package/lambda-local
- 32. Code packaging http://docs.aws.amazon.com/lambd a/latest/dg/deployment-package- v2.html @SigNarvaez | @MongoDB | @BigDataDayLA
- 33. Lambda functions @SigNarvaez | @MongoDB | @BigDataDayLA
- 34. Upload & configure function The handler function The role with lambda permissions The VPC (peered with Atlas) The security group that allows traffic At least 2 subnets
- 35. API Gateway
- 36. Read API – GET /api/v1/customers
- 37. CUD API - PATCH /api/v1/customers
- 39. Access and throttling via API Keys
- 40. Test!
- 41. Test with Postman @SigNarvaez | @MongoDB | @BigDataDayLA
- 42. Load test too!
- 43. AWS CloudWatch @SigNarvaez | @MongoDB | @BigDataDayLA
- 44. MongoDB Atlas Monitoring and Alerts @SigNarvaez | @MongoDB | @BigDataDayLA
- 45. MongoDB Compass @SigNarvaez | @MongoDB | @BigDataDayLA
- 47. RetroPie – Old-school games, killer tiny hardware @SigNarvaez | @MongoDB | @BigDataDayLA
- 48. Retro Web App based on aws-serverless-express https://github.com/snarvaez/bddla17/t ree/master/singleViewWebApp https://github.com/awslabs/aws- serverless-express @SigNarvaez | @MongoDB | @BigDataDayLA
- 50. Scaling? Scaling Lambda No user intervention required - Default safety throttle of 100 concurrent executions per account per region. Functions invoked synchronously throw 429 error code. Functions invoked asynchronously can absorb reasonable bursts for approx. 15-30 minutes. If exhausted, consider using Simple Queue Service (SQS) or Simple Notification Service (SNS) as the Dead Letter Queue (DLQ). Read more at https://aws.amazon.com/lambda/faqs/ Scaling MongoDB Atlas On-Demand Zero downtime Upscale/Downscale: • Instance size • Storage size • IOPS • Replication factor. @SigNarvaez | @MongoDB | @BigDataDayLA
- 51. Serverless Architectures with AWS Lambda and MongoDB Atlas Sig Narváez Sr. Solutions Architect [email protected] @SigNarvaez Q & A https://github.com/snarvaez/bddla17 https://resources.mongodb.com/serverles s-architectures @SigNarvaez | @MongoDB | @BigDataDayLA