Serverless Architectures on AWS in practice - OSCON 2018

Jul 19, 20180 likes561 views

From functions to containers to databases, serverless is a huge paradigm shift. The ability to only pay for what we use and not worry about underlying infrastructure is very tempting to developers and DevOps engineers, and the rate of innovation in this area has been very rapid across all major public cloud providers. Serverless architectures are the natural evolution of microservices design. While Lambda has become synonymous with serverless in AWS, there are several new and upcoming patterns that take serverless architectures to the next level. Manish Pandit explains how to identify these patterns and put them to use. Using Marqeta’s efforts to move its payments infrastructure to the public cloud as an example, Manish explores the services that Marqeta considered, customized, hacked around, and successfully implemented as a part of this move.

Serverless
Architectures on AWS
in practice
Manish Pandit
07/19/2018

Serverless Architectures on AWS in practice - OSCON 2018

If I had asked people what they wanted, they would have said: “faster horses”
-Henry Ford

About Me
Manish Pandit
Director of Platform Engineering @marqeta
@lobster1234
lobster1234.github.io

Why?
Scale technology to support the growing business
Use public cloud capabilities so we can focus on product innovation

Cloud-Native-First Mindset
..and many more

Microservices
Independent development, deployment, and scaling of functionally isolated
services.

Microservices
“Loosely coupled, yet highly aligned”

Microservices
You can have microservices without containers and serverless!
Containers and Serverless are the most optimal way to package and deploy
microservices.

Abstractions
Bare Metal
O/S
Application
Fn
Serverless
Containers
VMs
Hardware

Containers
Distributed Applications/Services
Economics of Scale - Optimal Resource Utilization
Being lightweight, they’re fast to deploy and run

Serverless
Function as a unit of deployment (FaaS)
Pay for what you use, never for idle resources
100% abstraction from underlying resources

Serverless Components
1. Functions themselves
2. Events that trigger these functions, or handlers
Event driven programming - Functions are event handlers
You only pay when the handler runs

Lambda
Amazon’s FaaS
Supports Node, Python, Java 8, C#, Go
Billed as GB-seconds

Lambda Pricing
First 1M requests per month are free
400,000 GB-seconds per month are free
START RequestId: 6bd9cf60-7e2b-11e8-9f4a-ebdea81e794d Version: $LATEST
END RequestId: 6bd9cf60-7e2b-11e8-9f4a-ebdea81e794d
REPORT RequestId: 6bd9cf60-7e2b-11e8-9f4a-ebdea81e794d Duration: 646.26 ms Billed Duration: 700 ms
Memory Size: 128 MB Max Memory Used: 31 MB

Consul Backups
GET /v1/catalog/service/mqapi
PutObject
trigger

Database Replication Jobs
Get updates
PutObject
trigger apply

Async Events
publish
publish
trigger
trigger
Service A
Service B
Service C
ECS

File Processing Pipeline
Split PGP &
Transfer
Payment
Networks
Banks
trigger
trigger
N 1
Object + Metadata

Lambda limits
Memory : 128-3008 MB with 64 MB increments
Time : 300 seconds

AWS Batch : Managed Compute
https://.. Submitter
Job
Job
Job
Batch
Cloudwatch Event

Containers not Serverless Enough?
= ECS minus the Cluster

Logging
For Lambdas, Cloudwatch logs
For ECS, filebeat agent on the host
For Fargate, LogStashTcpSocketAppender

Testing
Docker Compose
Localstack
Use environment variables for configuration (12-Factor App)

Gotchas..
- Lambda Cold start on both Python and Java
- Due to VPC and ENI
- Be aware of the retries
- Async invocation gets two retries
- Sync invocation gets no retries
- Apply the Principle of Least Privilege to the Lambda and ECS Roles
- S3 triggers - source and destination buckets

Tips
- Declare connection pools outside of the handler’s scope
- Write tests!
- Test locally - the only error you should be expecting is IAM Permissions error.
<role> is not authorized to perform: <operation> on resource: <resource>
- Do not create Microliths
- Set up billing alerts

Tips
- Pick the best tool for the job
- Do not pick the tool and try to fit the job into it
- Beware of the shiny object syndrome
- Take measured risks
- Production is (mostly) unforgiving

“You’re free to choose, but you’re not free from the consequences of your choice”
- Universal Paradox

Fin
Manish Pandit
Director of Platform Engineering @marqeta
@lobster1234
lobster1234.github.io

This document discusses disaster recovery, including definitions of key terms like RTO, RPO, availability, and reliability. It explains that disaster recovery plans aim to minimize data loss (RPO) and downtime (RTO) in the event of failures or disasters. Common approaches to disaster recovery include backup and restore, pilot light, warm standby, and multi-site/cloud configurations, with varying costs and abilities to reduce RTO and RPO. The document stresses testing disaster recovery plans through failure simulation, designing for fault tolerance, and monitoring systems to ensure plans can be executed successfully.

Solving Problems At Scale With RedisRedis Labs

This document summarizes how Braze optimized their in-app messaging architecture using Redis. Originally, Braze experienced performance issues when a large customer canvas generated over 110 million jobs to run at the same time. Each job processed a single user, leading to inefficient database access. Braze addressed this by buffering users in Redis sets to process multiple users per job. They also added random jitter to job timestamps to avoid a thundering herd when consuming jobs. These changes reduced job count from 110 million to 1.4 million and processing time from over 90 minutes to just 14 minutes.

Redis Reliability, Performance & InnovationRedis Labs

The document discusses Redis and its capabilities for high performance, reliability, and new use cases. Redis can provide linear scalability and handle over 200 million operations per second through its shared-nothing architecture, multi-threaded proxy, and NUMA optimizations. It offers strong reliability with features like pure in-memory replication and multi-availability zone deployment. Redis also enables new use cases through capabilities like active-active replication using CRDTs, time series storage and querying with RedisTimeSeries, and serving AI models close to data with RedisAI.

Svc 202-netflix-open-sourceRuslan Meshenberg

Cloud cost optimization (AWS, GCP)Szabolcs Zajdó

Reports from the field azure functions in practiceParticular Software

Virtualization - Is It Right For You?Aventis Systems, Inc.

This document discusses virtualization and outlines factors to consider in determining if virtualization is right for an organization. It identifies benefits of virtualization like reducing data center footprint and faster server provisioning. It also lists potential challenges such as uncertain workloads to virtualize and lack of staff expertise. The document proposes that Aventis Systems can help organizations through services like conducting an environment review, providing unbiased advice, and assisting with deployment of virtualization.

Windows Azure Versioning StrategiesPavel Revenkov

This document discusses different versioning strategies for cloud services. It presents strategies for versioning production and staging environments, isolating environments for different roles like QA and developers, using separate subscriptions to isolate environments and billing, and approaches for versioning SQL databases and WCF contracts. The key strategies covered include using slots or instances to separate environments, federating SQL databases by tenant or version, and supporting multiple versions of WCF contracts through single or multiple endpoints. References are provided for further reading on managing cloud services, versioning SQL databases, and WCF versioning strategies.

Introduction to IAC and Terraform Venkat NaveenKashyap Devulapally

This document introduces infrastructure as code (IaC) and the tool Terraform. It defines IaC as using code to describe, create, and manage infrastructure. The key benefits of IaC are the ability to rebuild infrastructure at any time, ensure consistency, and have a repeatable process. Terraform is then introduced as an open-source tool for building, changing, and versioning infrastructure safely and efficiently across various cloud providers and SaaS services. The document outlines Terraform's workflow of writing configuration files, planning changes, and applying changes to infrastructure.

Characterizing Network Paths in and out of the Cloudsinside-BigData.com

In this deck from CHEP 2019, Igor Sfiligoi from UCSD presents: Characterizing Network Paths in and out of the Clouds. "Cloud computing is becoming mainstream, with funding agencies moving beyond prototyping and starting to fund production campaigns, too. An important aspect of any production computing campaign is data movement, both incoming and outgoing. And while the performance and cost of VMs is relatively well understood, the network performance and cost is not. We thus embarked on a network characterization campaign, documenting traceroutes, latency and throughput in various regions of Amazon AWS, Microsoft Azure and Google GCP Clouds, both between Cloud resources and major DTNs in the Pacific Research Platform, including OSG data federation caches in the network backbone, and inside the clouds themselves. We also documented the incurred cost while doing so. Along the way we discovered that network paths were often not what the major academic network providers thought they were, and we helped them in improving the situation, thus improving peering between academia and commercial cloud. In this talk we present the observed results, both during the initial test runs and the latest state of the art, as well as explain what it took to get there." Watch the video: https://wp.me/p3RLHQ-lbO Learn more: https://indico.cern.ch/event/773049/contributions/3473824/ Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter

Characterizing network paths in and out of the CloudsIgor Sfiligoi

Cloud computing is becoming mainstream, with funding agencies moving beyond prototyping and starting to fund production campaigns, too. An important aspect of any production computing campaign is data movement, both incoming and outgoing. And while the performance and cost of VMs is relatively well understood, the network performance and cost is not. We thus embarked on a network characterization campaign, documenting traceroutes, latency and throughput in various regions of Amazon AWS, Microsoft Azure and Google GCP Clouds, both between Cloud resources and major DTNs in the Pacific Research Platform, including OSG data federation caches in the network backbone, and inside the clouds themselves. We also documented the incurred cost while doing so. Presented at CHEP 2019.

Dip into prometheusZaar Hai

High Performance Computing (HPC) in cloudAccubits Technologies

Cassandra Summit 2014: Cassandra Compute Cloud: An elastic Cassandra Infrastr...DataStax Academy

Presenter: Gurashish Brar, Member of Technical Staff at Bloomreach Dynamically scaling Cassandra to serve hundreds of map-reduce jobs that come at an unpredictable rate and at the same time providing access to the data in real time to front-end application with strict TP95 latency guarantees is a hard problem. We present a system for managing Cassandra clusters which provide following functionality: 1) Dynamic scaling of capacity to serve high throughput map-reduce jobs 2) Provide access to data generated by map-reduce jobs in realtime to front-end applications while providing latency SLAs for TP95 3) Maintain a low cost by leveraging Amazon Spot Instances and through demand based scaling. At the heart of this infrastructure lies a custom data replication service that makes it possible to stream data to new nodes as needed.

Ten^H^H^H Many Cloud App Design PatternsShlomo Swidler

Disaster recovery and the cloudJason Dea

This document summarizes the need for disaster recovery and how cloud computing can help address that need. It discusses how downtime from disasters costs businesses billions annually. More companies now prioritize improving disaster recovery capabilities. Traditional approaches like backups and duplicate infrastructure are costly and complex. Virtualization allows workloads to be replicated to virtual machines in the cloud for fast recovery. PlateSpin Protect and Forge products help businesses replicate workloads to hosted virtual recovery hosts in the cloud, enabling one-click testing and recovery of workloads within minutes in the event of a disaster.

1 Million Writes per second on 60 nodes with Cassandra and EBSJim Plush

This document summarizes a presentation about achieving 1 million writes per second on Cassandra using 60 nodes with Amazon EBS storage. It discusses how CrowdStrike tested Cassandra on EBS and achieved higher performance than anticipated by optimizing configurations, using larger instance types with more CPUs and storage, and tweaking Cassandra settings. It provides examples of testing methodology and results showing high throughput and low latency even with large volumes of data and I/O.

Orange developers day-Application CachingGamal Shaban

This document discusses caching strategies for web applications and ORM caching. It begins with an overview of why caching is important and how it can speed up applications based on Amdahl's law. It then discusses two levels of ORM caching - first level session caching and second level caching using various cache providers like EhCache. The caching strategies covered are read-only, read-write, transactional and nonstrict read-write. Memory, disk, clustered and server caching types are also mentioned.

OpenNebulaConf2015 1.03 Private, Public, Hybrid: The Real Economics of Open S...OpenNebula Project

With all the debate on public, private and hybrid clouds one of the main missing points is hard data: what is the actual, real economic impact of choosing a specific cloud model. We will present the results of an extensive survey of cost models, what is the impact of choosing an open source cloud platform like OpenNebula, the difference between planning for “cattle or cows” and how to compare different clouds using reliable performance metrics. We will also present a small sample of potentially relevant open source project that may help in deployment and management of ad-hoc cloud platforms. Author Biography Carlo Daffara the Technical director of Cloudweavers, a company that developed the first hyperconverged appliance based on OpenNebula; Italian member of the European Working Group on Libre Software and co-coordinator of the working group on SMEs of the EU ICT task force on competitiveness. Since 1999, works as evaluator for IST programme submissions in the field of component-based software engineering, GRIDs and international cooperation. Coordinator of the open source platforms technical area of the IEEE technical committee on scalable computing, co-chair of the SIENA EU cloud initiative roadmap editorial board and part of the editorial review board of the International Journal of Open Source Software & Processes (IJOSSP). Has worked as a researcher in the field of collaborative development and open source business models; working with international entitities to promote the development of economic networks through open source software, recently worked with public authorities like UK JISC and CENATIC on estimating the economic impact of cloud computing and the adoption of open source development models. For OpenForum Europe has developed the first Europe-wide macroeconomic analysis of the economic value introduced by the adoption of open source software.

Lessons learned from writing over 300,000 lines of infrastructure codeYevgeniy Brikman

This talk is a concise masterclass on how to write infrastructure code. I share key lessons from the “Infrastructure Cookbook” we developed at Gruntwork while creating and maintaining a library of over 300,000 lines of infrastructure code that’s used in production by hundreds of companies. Come and hear our war stories, laugh about all the mistakes we’ve made along the way, and learn what Terraform, Packer, Docker, and Go look like in the wild.

openstack, devops and peopleAndrew Yongjoon Kong

The document discusses DevOps practices at Kakaocorp. It provides background on Andrew Yongjoon Kong and describes some key metrics of Kakaocorp's OpenStack deployment. It then covers concepts like collaboration, affinity, tools, and scaling in a DevOps context. Specific examples at Kakaocorp include using GitHub, Jira, Chef, and Jenkins. It also introduces initiatives like KEMI for integration and DKOS for container management.

deep learning in production cff 2017Ari Kamlani

This document provides an overview and agenda for a presentation on Skymind and the Deeplearning4j (DL4J) framework. The key points covered include: - An introduction to Skymind and their focus on deep learning solutions for enterprises. - An overview of the DL4J suite of tools, including its core components like ND4J and DataVec, and how they fit into the machine learning workflow. - Details on setting up the DL4J development environment in IntelliJ, configuring Maven dependencies, and installing example projects. - A breakdown of the responsibilities of each DL4J component and how they migrate models from other frameworks like Keras. - The

Embracing cloudsAndrew Yongjoon Kong

1) The document discusses Kakao's journey with cloud computing from a CMMI perspective, ranging from CMMI levels 0 to 5. 2) At CMMI level 1, Kakao produced Krane (OpenStack cloud) to provide self-service developer resources. At level 2, KEMI (monitoring platform) provided limited production resources. 3) Kakao achieved CMMI level 3 automation with DKOS (container as a service platform) that deployed containers and services across 4000 compute nodes.

MANTL Data Platform, Microservices and BigData ServicesCisco DevNet

The document discusses using Mantl, an open source platform, to deploy multiple services together in a shared cluster for better utilization and data sharing. It describes how Mesos provides resource isolation and scalability to run both complex services and microservices together. Examples are given of deploying Riak, Zoomdata, Streamsets, and other services on Mantl to take advantage of shared infrastructure and data. The goal is to maximize efficiency through a unified service platform that can run in hybrid cloud environments.

Managing Multiple Clouds in an Enteprise - A Heterogenous LensMayur Shintre

This document provides perspectives on managing multiple clouds in an enterprise setting. It begins by defining key terms like heterogeneous and cloud management platform. It then rationalizes the different layers involved in managing clouds from native cloud APIs and UIs to abstraction libraries and cloud management platforms. It characterizes workloads on different lifecycles and recommends strategies for different types. The document advocates starting with infrastructure as code and investing in open source options before a unified management platform. It emphasizes including all stakeholders and using culture and developer enablement in cloud management.

Enabling Microservices Frameworks to Solve Business ProblemsKen Owens

Serverless AWS reInvent 2019 recapDaniel Zivkovic

Lambda and DynamoDB best practicesYan Cui

This document contains a summary of best practices for using Lambda and DynamoDB presented by Yan Cui. Some key recommendations include implementing observability from the start by using metrics and alerts to monitor performance, creating separate AWS accounts for each team and environment, loading secrets securely from SSM Parameter Store at runtime, following the principle of least privilege with IAM policies, parallelizing functions where possible, and various DynamoDB optimizations like using DocumentClient and PAY_PER_REQUEST billing. The document emphasizes that best practices depend on individual contexts and situations.

Serverless ComputingAnand Gupta

Serverless computing provides several key benefits including no need to provision or manage servers, automatic scaling with usage, only paying for resources used, and built-in high availability and fault tolerance. Some common use cases for serverless include backend services and apps, data processing, voice and chat bots, and web applications. When building serverless applications, developers should consider factors like repository structure, cold starts, package size and dependencies, timeouts and errors, performance optimization, and security practices.

The Future is Now: Leveraging the Cloud with RubyRobert Dempsey

More Related Content

What's hot (15)

Introduction to IAC and Terraform Venkat NaveenKashyap Devulapally

Characterizing Network Paths in and out of the Cloudsinside-BigData.com

Characterizing network paths in and out of the CloudsIgor Sfiligoi

Dip into prometheusZaar Hai

High Performance Computing (HPC) in cloudAccubits Technologies

Cassandra Summit 2014: Cassandra Compute Cloud: An elastic Cassandra Infrastr...DataStax Academy

Ten^H^H^H Many Cloud App Design PatternsShlomo Swidler

Disaster recovery and the cloudJason Dea

1 Million Writes per second on 60 nodes with Cassandra and EBSJim Plush

Orange developers day-Application CachingGamal Shaban

OpenNebulaConf2015 1.03 Private, Public, Hybrid: The Real Economics of Open S...OpenNebula Project

Lessons learned from writing over 300,000 lines of infrastructure codeYevgeniy Brikman

openstack, devops and peopleAndrew Yongjoon Kong

deep learning in production cff 2017Ari Kamlani

Embracing cloudsAndrew Yongjoon Kong

Introduction to IAC and Terraform Venkat NaveenKashyap Devulapally

Characterizing Network Paths in and out of the Cloudsinside-BigData.com

Characterizing network paths in and out of the CloudsIgor Sfiligoi

Dip into prometheusZaar Hai

High Performance Computing (HPC) in cloudAccubits Technologies

Cassandra Summit 2014: Cassandra Compute Cloud: An elastic Cassandra Infrastr...DataStax Academy

Ten^H^H^H Many Cloud App Design PatternsShlomo Swidler

Disaster recovery and the cloudJason Dea

1 Million Writes per second on 60 nodes with Cassandra and EBSJim Plush

Orange developers day-Application CachingGamal Shaban

OpenNebulaConf2015 1.03 Private, Public, Hybrid: The Real Economics of Open S...OpenNebula Project

Lessons learned from writing over 300,000 lines of infrastructure codeYevgeniy Brikman

openstack, devops and peopleAndrew Yongjoon Kong

deep learning in production cff 2017Ari Kamlani

Embracing cloudsAndrew Yongjoon Kong

Similar to Serverless Architectures on AWS in practice - OSCON 2018 (20)

MANTL Data Platform, Microservices and BigData ServicesCisco DevNet

Managing Multiple Clouds in an Enteprise - A Heterogenous LensMayur Shintre

Enabling Microservices Frameworks to Solve Business ProblemsKen Owens

Serverless AWS reInvent 2019 recapDaniel Zivkovic

Lambda and DynamoDB best practicesYan Cui

Serverless ComputingAnand Gupta

The Future is Now: Leveraging the Cloud with RubyRobert Dempsey

Accelerate Digital Transformation with IBM Cloud PrivateMichael Elder

Enterprise Application on AWSfurbing

[DevDay 2016] OpenStack and approaches for new users - Speaker: Chi Le – Head...DevDay Da Nang

AWS AWSome Day London October 2015 Ian Massingham

Microservices Architecture with AWS @ AnyMind GroupGiang Tran

AnyMind Group Tech Talk - Microservices architecture with AWSNhân Nguyễn

Introduction to MANTL Data PlatformCisco DevNet

A session in the DevNet Zone at Cisco Live, Berlin. Big data and the Internet of Things (IoT) are two of the hottest categories in information technology today, yet there are significant challenges when trying to create an end-to-end solution. The worlds of "IT" and “IoT" differ in terms of programming interfaces, protocols, security frameworks, and application lifecycle management. In this talk we will describe proven ways to overcome challenges when deploying a complete “device to datacenter” system, including how to stream IoT telemetry into big data repositories; how to perform real-time analytics on machine data; and how to close the loop with reliable, secure command and control back out to remote control systems and other devices.

Serverless / FaaS / Lambda and how it relates to MicroservicesFrank Munz

The document discusses serverless architectures and function as a service (FaaS) platforms. It provides an overview of FaaS implementations from Amazon, Google, Microsoft and Oracle. Key benefits of FaaS include pay per use pricing, automatic scaling, and eliminating the need to manage servers. Challenges include limitations on runtimes and resource usage as well as vendor lock-in. The document argues that FaaS fulfills the definition of microservices and could replace traditional container-based microservice architectures.

[Capitole du Libre] #serverless -  mettez-le en oeuvre dans votre entreprise...Ludovic Piot

Tout comme le Cloud IaaS avant lui, le serverless promet de faciliter le succès de vos projets en accélérant le Time to Market et en fluidifiant les relations entre Devs et Ops. Mais sa mise en œuvre au sein d’une entreprise reste complexe et coûteuse. Après 2 ans à mettre en place des plateformes managées de ce type, nous partagons nos expériences de ce qu’il faut faire pour mettre en œuvre du serverless en entreprise, en évitant les douleurs et en limitant les contraintes au maximum. Tout d’abord l’architecture technique, avec 2 implémentations très différentes : Kubernetes et Helm d’un côté, Clever Cloud on-premise de l’autre. Ensuite, la mise en place et l’utilisation d’OpenFaaS. Comment tester et versionner du Function as a Service. Mais aussi les problématiques de blue/green deployment, de rolling update, d’A/B testing. Comment diagnostiquer rapidement les dépendances et les communications entre services. Enfin, en abordant les sujets chers à la production : * vulnerability management et patch management, * hétérogénéïté du parc, * monitoring et alerting, * gestion des stacks obsolètes, etc.

[AWSKRUG 아키텍처 모임] 세일즈부스트 인프라스트럭처 사례 공유Soowan Lee

- The document discusses Salesboost's infrastructure architecture using AWS. - Terraform is used to provision and manage all AWS resources including VPCs, Lambda functions, ECS clusters, and more across multiple environments and regions. - Most services are delivered using serverless architectures with Lambda and containerized microservices running on ECS/Fargate. - The infrastructure is designed to maximize use of serverless services for scalability and cost efficiency while meeting performance requirements.

GreatLearning Webinar - Microservices and Event-Driven Architecture.pdfDhaval Nagar

CloudStack DC Meetup - Apache CloudStack Overview and 4.1/4.2 PreviewChip Childers

Chip Childers is the VP of Apache CloudStack and Principal Engineer at SunGard Availability Services. Apache CloudStack is open source software that can deploy and manage large networks of virtual machines as a scalable IaaS cloud platform. It is a top-level project at the Apache Software Foundation. CloudStack enables cloud operators to design, install, support, upgrade and scale diverse cloud environments. It also allows application owners to easily consume infrastructure services so that infrastructure does not get in the way of delivering applications to end users.

20211028 ADDO Adapting to Covid with Serverless Craeg Strong Ariel PartnersCraeg Strong

This case study describes how we leveraged serverless technology and the AWS serverless application model (SAM) to support the needs of virtual training classes for a major US Federal agency. Our firm was excited to be selected as the main training partner to help a major US Federal government agency roll out Agile and DevOps processes across an organization comprising more than 1500 people. And then the pandemic hit—and what was to have been a series of in-person classes turned 100% virtual! We created a set of fully populated docker images containing all of the test data, plugins, and scenarios required for the student exercises. For our initial implementation, we simply pre-loaded our docker images into elastic beanstalk and then replicated them as many times as needed to provide the necessary number of instances for a given class. While this worked out fine at first, we found a number of shortcomings as we scaled up to more students and more classes. Eventually we came up with a much easier solution using serverless technology: we stood up a single page application that could kickoff tasks using AWS step functions to run docker images in elastic container service, all running under AWS Fargate. This application is a perfect fit for serverless technology and describing our evolution to serverless and SAM may help you gain insights into how these technologies may be beneficial in your situation.

MANTL Data Platform, Microservices and BigData ServicesCisco DevNet

Managing Multiple Clouds in an Enteprise - A Heterogenous LensMayur Shintre

Enabling Microservices Frameworks to Solve Business ProblemsKen Owens

Serverless AWS reInvent 2019 recapDaniel Zivkovic

Lambda and DynamoDB best practicesYan Cui

Serverless ComputingAnand Gupta

The Future is Now: Leveraging the Cloud with RubyRobert Dempsey

Accelerate Digital Transformation with IBM Cloud PrivateMichael Elder

Enterprise Application on AWSfurbing

[DevDay 2016] OpenStack and approaches for new users - Speaker: Chi Le – Head...DevDay Da Nang

AWS AWSome Day London October 2015 Ian Massingham

Microservices Architecture with AWS @ AnyMind GroupGiang Tran

AnyMind Group Tech Talk - Microservices architecture with AWSNhân Nguyễn

Introduction to MANTL Data PlatformCisco DevNet

Serverless / FaaS / Lambda and how it relates to MicroservicesFrank Munz

[Capitole du Libre] #serverless -  mettez-le en oeuvre dans votre entreprise...Ludovic Piot

[AWSKRUG 아키텍처 모임] 세일즈부스트 인프라스트럭처 사례 공유Soowan Lee

GreatLearning Webinar - Microservices and Event-Driven Architecture.pdfDhaval Nagar

CloudStack DC Meetup - Apache CloudStack Overview and 4.1/4.2 PreviewChip Childers

20211028 ADDO Adapting to Covid with Serverless Craeg Strong Ariel PartnersCraeg Strong

More from Manish Pandit (20)

Disaster Recovery and ReliabilityManish Pandit

Disaster recovery aims to minimize downtime and data loss in the event of a disaster. Key metrics for disaster recovery include: RPO (Recovery Point Objective) is the maximum tolerable data loss measured backwards from the present. A lower RPO means less potential data loss. RTO (Recovery Time Objective) is the maximum downtime tolerated before business impact. A lower RTO means faster restoration of services. The business determines acceptable RTO and RPO based on their needs. Options to reduce RTO and RPO include backup/restore, pilot light, warm standby and multi-site configurations but with increasing costs. Regular testing of disaster recovery plans is important to measure readiness.

OAuth2 primerManish Pandit

Immutable AWS Deployments with Packer and JenkinsManish Pandit

This document discusses using Packer and Jenkins to create immutable AWS deployments. Packer is used to build machine images from the ground up with all necessary software and code pre-installed. Provisioners further configure and customize the images. Jenkins automates building the images with Packer whenever code is committed. The immutable images prevent drift and ensure consistency. The process allows fully automated deployments through launching instances from the pre-built images.

AWS Lambda with Serverless Framework and JavaManish Pandit

Serverless is a node.js based framework that makes creating, deploying, and managing serverless functions a breeze. We will use AWS Lambda as our FaaS (Function-as-a-Service) provider, although Serverless supports IBM OpenWhisk and Microsoft Azure as well. In this session, we will talk about Serverless Applications, and Create and deploy a java-maven based AWS Lambda API. We will also explore the command line interface to manage lambda, which is provided out of the box by serverless framework.

AWS Primer and QuickstartManish Pandit

This document provides an introduction and overview of key AWS services, including: - Infrastructure as a Service (IaaS) offerings like EC2, EBS, S3, and regions/availability zones. - Platform as a Service (PaaS) like RDS, DynamoDB, Lambda, and analytics services. - Software as a Service (SaaS) examples. It discusses architecture principles of availability, fault tolerance, and scalability that AWS supports. Brief histories of AWS and its evolution are also presented.

Securing your APIs with OAuth, OpenID, and OpenID ConnectManish Pandit

As products and companies move towards IoT model, users and machines alike need to interact with various APIs. Securing these APIs in a connected world can be a challenge faced by many. Fortunately, there are open standards addressing even the most complex of use cases - OAuth, OpenID and OpenID Connect happen to be widely adopted and have a growing support across many API and Identity Providers. In this session I'll talk about these standards, and walk through common use cases/flows from an API Provider as well as consumer's side. We will explore how these standards come together to not only secure the APIs, but also manage identity.

Silicon Valley 2014 - API AntipatternsManish Pandit

This document discusses API anti-patterns, which are commonly occurring solutions to problems that seem good on the surface but are not actually good solutions. It provides examples of anti-patterns related to request parameters, response codes, and organizational structure of APIs. The document advocates for RESTful design practices and using HTTP methods and status codes as intended to clearly represent operations.

Scalabay - API Design AntipatternsManish Pandit

OSCON 2014 - API Ecosystem with Scala, Scalatra, and Swagger at NetflixManish Pandit

This document discusses Netflix's API ecosystem built using Scala, Scalatra, and Swagger. It summarizes Netflix's use of these technologies to build APIs that power their consumer electronics partner portal and enable certification of Netflix ready devices. It describes how the APIs provide a single source of truth for all device data at Netflix and correlate streaming quality metrics. It then discusses aspects of the architecture including the manager layer containing business logic, HTTP layer for handling requests/responses, and use of Scala, Scalatra, Swagger, and deployment process including immutable infrastructure.

API Design Antipatterns - APICon SFManish Pandit

APIs have become a part of the product ecosystem - and help the businesses by extending their developer base, and offering seamless integration with other services or products. Sometimes, the APIs themselves are the product. However, with so many APIs around, patterns emerge. Patterns are repeatable, reusable solutions to commonly occurring problems. Where there are patterns, there are also antipatterns. While APIs are not a new paradigm - there are no set standards or specifications formed by a committees or governing bodies for APIs. On top of this, the APIs are often built at various stages of the product, and have a good chance of being disjoint as more are added. In this talk Netflix engineers will discuss various antipatterns that creep into the API design and implementation, and how to identify and avoid them. They will also share their experiences with building APIs. While the antipatterns do not pose as big a functional challenge, they can and do impact integration efforts, scalability and performance among other things. After this session, you should be able to get familiar with the best practices around solving the most common patterns, and make your engineers and API consumers happy!

Motivation : it MattersManish Pandit

The document discusses motivation in the workplace. It notes that motivation creates a better work environment and encourages leadership, communication, innovation and growth. Motivation can come from intrinsic factors like personal satisfaction or extrinsic factors like pay. Different people are motivated by different things such as solving problems, passion, or recognition. Company culture also impacts motivation. Highly motivated employees are important for knowledge work especially. Organizations should find ways to improve motivation through communication, rewards, and leading by example.

Building Apis in Scala with Playframework2Manish Pandit

My talk at Silicon Valley Code Camp 2013. Two years ago I gave a talk on PlayFramework with Java at SVCC. As with everything, PlayFramework has evolved into a far mature ecosystem with native Scala support, and Typesafe backing. PlayFramework 2 is a simple, MVC-based, convention over configuration web application framework for Java and Scala. It is rapidly gaining popularity as more and more companies are adopting it for building scalable, performant, share-nothing architectures. In this talk I'll cover the fundamentals of Play! Framework2, a brief overview of Scala, and demonstrate building a simple, RESTful API. This will be a very interactive, and hands-on session. It'd be awesome if you have played around with Scala, but if you have not, the scope of this talk does not require you to be a Scala expert. It will however be very useful if you've worked with other Web Application Frameworks like Jersey, CXF, etc. so you can cross-relate the concepts.

Scala at NetflixManish Pandit

Introducing Scala to your Ruby/Java Shop : My experiences at IGNManish Pandit

With the move to SOA, IGN's API engineering became a traditional Java/Ruby shop. We introduced Scala to the team in August '11. As of April '12 we have our major services running on Scala, and we could not be happier. I'll talk about the strategic & tactical rationale, gradual introduction to the new language, cultivating experts and mentoring junior developers. We will also cover the common roadblocks the leaders may run into, addressing the concerns of engineers and stakeholders, and building an engineering culture that facilitates innovation and talent growth. Please note that this talk is not a Ruby/Java/Scala religious debate - we believe in using the best tool for the job; and what works for us may not work for every org (which is where the culture comes in). My team's journey from "Holy crap! This looks academic and scary!" to "Let me whip out a service by EOD today" in a matter of months is something I am very proud of, and would love to share it with fellow developer community.

Evolving IGN’s New APIs with ScalaManish Pandit

IGN's V3 APIManish Pandit

Java and the JVMManish Pandit

Object Oriented ProgrammingManish Pandit

This document discusses object-oriented principles and design. It begins by explaining procedural code versus object-oriented code, then discusses key OO concepts like classes, objects, encapsulation, inheritance, polymorphism, interfaces, and design patterns. Specific examples are provided like modeling a game application. Overall it provides a high-level introduction to fundamental concepts in object-oriented programming and design.

Silicon Valley Code Camp 2011: Play! as you RESTManish Pandit

This document summarizes a presentation about using the Play! framework to build RESTful services. It includes an agenda that covers REST principles, traditional Java web development, the benefits of frameworks like Play!, an overview of Play! components and architecture, and a demonstration of building a RESTful API with Play! and MongoDB. The presentation promotes Play! as a developer-friendly framework that allows for rapid prototyping through features like hot reloading and convention over configuration.

Silicon Valley Code Camp: 2011 Introduction to MongoDBManish Pandit

This document provides an introduction and overview of MongoDB, a document-oriented NoSQL database. It discusses how MongoDB differs from relational databases, its support for schemaless documents and easy querying. Key concepts covered include collections, documents, inserting and querying data, and replication and scaling architectures like master-slave and replica sets. The document also touches on accessing MongoDB programmatically, object-document mappers, internal architecture details, administration, and comparisons to other NoSQL solutions.

Disaster Recovery and ReliabilityManish Pandit

OAuth2 primerManish Pandit

Immutable AWS Deployments with Packer and JenkinsManish Pandit

AWS Lambda with Serverless Framework and JavaManish Pandit

AWS Primer and QuickstartManish Pandit

Securing your APIs with OAuth, OpenID, and OpenID ConnectManish Pandit

Silicon Valley 2014 - API AntipatternsManish Pandit

Scalabay - API Design AntipatternsManish Pandit

OSCON 2014 - API Ecosystem with Scala, Scalatra, and Swagger at NetflixManish Pandit

API Design Antipatterns - APICon SFManish Pandit

Motivation : it MattersManish Pandit

Building Apis in Scala with Playframework2Manish Pandit

Scala at NetflixManish Pandit

Introducing Scala to your Ruby/Java Shop : My experiences at IGNManish Pandit

Evolving IGN’s New APIs with ScalaManish Pandit

IGN's V3 APIManish Pandit

Java and the JVMManish Pandit

Object Oriented ProgrammingManish Pandit

Silicon Valley Code Camp 2011: Play! as you RESTManish Pandit

Silicon Valley Code Camp: 2011 Introduction to MongoDBManish Pandit

Recently uploaded (20)

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, presentation slides, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Heap, Types of Heap, Insertion and DeletionJaydeep Kale

Mobile App Development Company in Saudi ArabiaSteve Jonas

EmizenTech is a globally recognized software development company, proudly serving businesses since 2013. With over 11+ years of industry experience and a team of 200+ skilled professionals, we have successfully delivered 1200+ projects across various sectors. As a leading Mobile App Development Company In Saudi Arabia we offer end-to-end solutions for iOS, Android, and cross-platform applications. Our apps are known for their user-friendly interfaces, scalability, high performance, and strong security features. We tailor each mobile application to meet the unique needs of different industries, ensuring a seamless user experience. EmizenTech is committed to turning your vision into a powerful digital product that drives growth, innovation, and long-term success in the competitive mobile landscape of Saudi Arabia.

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-und-verwaltung-von-multiuser-umgebungen/ HCL Nomad Web wird als die nächste Generation des HCL Notes-Clients gefeiert und bietet zahlreiche Vorteile, wie die Beseitigung des Bedarfs an Paketierung, Verteilung und Installation. Nomad Web-Client-Updates werden “automatisch” im Hintergrund installiert, was den administrativen Aufwand im Vergleich zu traditionellen HCL Notes-Clients erheblich reduziert. Allerdings stellt die Fehlerbehebung in Nomad Web im Vergleich zum Notes-Client einzigartige Herausforderungen dar. Begleiten Sie Christoph und Marc, während sie demonstrieren, wie der Fehlerbehebungsprozess in HCL Nomad Web vereinfacht werden kann, um eine reibungslose und effiziente Benutzererfahrung zu gewährleisten. In diesem Webinar werden wir effektive Strategien zur Diagnose und Lösung häufiger Probleme in HCL Nomad Web untersuchen, einschließlich - Zugriff auf die Konsole - Auffinden und Interpretieren von Protokolldateien - Zugriff auf den Datenordner im Cache des Browsers (unter Verwendung von OPFS) - Verständnis der Unterschiede zwischen Einzel- und Mehrbenutzerszenarien - Nutzung der Client Clocking-Funktion

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

This is a Quick Research Guide (QRG). QRGs include the following: - A brief, high-level overview of the QRG topic. - A milestone timeline for the QRG topic. - Links to various free online resource materials to provide a deeper dive into the QRG topic. - Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic. QRGs planned for the series: - Artificial Intelligence QRG - Quantum Computing QRG - Big Data Analytics QRG - Spacecraft Guidance, Navigation & Control QRG (coming 2026) - UK Home Computing & The Birth of ARM QRG (coming 2027) Any questions or comments? - Please contact Arthur Morgan at [email protected]. 100% human made.

Electronic_Mail_Attacks-1-35.pdf by xploitniftliyevhuseyn

HCL Nomad Web – Best Practices and Managing Multiuser Environmentspanagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-and-managing-multiuser-environments/ HCL Nomad Web is heralded as the next generation of the HCL Notes client, offering numerous advantages such as eliminating the need for packaging, distribution, and installation. Nomad Web client upgrades will be installed “automatically” in the background. This significantly reduces the administrative footprint compared to traditional HCL Notes clients. However, troubleshooting issues in Nomad Web present unique challenges compared to the Notes client. Join Christoph and Marc as they demonstrate how to simplify the troubleshooting process in HCL Nomad Web, ensuring a smoother and more efficient user experience. In this webinar, we will explore effective strategies for diagnosing and resolving common problems in HCL Nomad Web, including - Accessing the console - Locating and interpreting log files - Accessing the data folder within the browser’s cache (using OPFS) - Understand the difference between single- and multi-user scenarios - Utilizing Client Clocking

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.

Cyber Awareness overview for 2025 month of securityriccardosl1

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock

Building 10x Organizations with Modern Productivity Metrics 10x developers may be a myth, but 10x organizations are very real, as proven by the influential study performed in the 1980s, ‘The Coding War Games.’ Right now, here in early 2025, we seem to be experiencing YAPP (Yet Another Productivity Philosophy), and that philosophy is converging on developer experience. It seems that with every new method we invent for the delivery of products, whether physical or virtual, we reinvent productivity philosophies to go alongside them. But which of these approaches actually work? DORA? SPACE? DevEx? What should we invest in and create urgency behind today, so that we don’t find ourselves having the same discussion again in a decade?

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark? At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍 Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Heap, Types of Heap, Insertion and DeletionJaydeep Kale

Mobile App Development Company in Saudi ArabiaSteve Jonas

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

Electronic_Mail_Attacks-1-35.pdf by xploitniftliyevhuseyn

HCL Nomad Web – Best Practices and Managing Multiuser Environmentspanagenda

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Cyber Awareness overview for 2025 month of securityriccardosl1

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Serverless Architectures on AWS in practice - OSCON 2018

1. Serverless Architectures on AWS in practice Manish Pandit 07/19/2018

6. If I had asked people what they wanted, they would have said: “faster horses” -Henry Ford

7. The Journey

8. About Me Manish Pandit Director of Platform Engineering @marqeta @lobster1234 lobster1234.github.io

12. Why? Scale technology to support the growing business Use public cloud capabilities so we can focus on product innovation

13. Break down the monolith

14. Shrink the Infrastructure

15. Cloud-Native-First Mindset ..and many more

16. Microservices Independent development, deployment, and scaling of functionally isolated services.

17. Microservices “Loosely coupled, yet highly aligned”

18. Microservices You can have microservices without containers and serverless! Containers and Serverless are the most optimal way to package and deploy microservices.

19. Abstractions Bare Metal O/S Application Fn Serverless Containers VMs Hardware

20. Containers Distributed Applications/Services Economics of Scale - Optimal Resource Utilization Being lightweight, they’re fast to deploy and run

21. Serverless Function as a unit of deployment (FaaS) Pay for what you use, never for idle resources 100% abstraction from underlying resources

22. Serverless Components 1. Functions themselves 2. Events that trigger these functions, or handlers Event driven programming - Functions are event handlers You only pay when the handler runs

23. Lambda Amazon’s FaaS Supports Node, Python, Java 8, C#, Go Billed as GB-seconds

24. Lambda Pricing First 1M requests per month are free 400,000 GB-seconds per month are free START RequestId: 6bd9cf60-7e2b-11e8-9f4a-ebdea81e794d Version: $LATEST END RequestId: 6bd9cf60-7e2b-11e8-9f4a-ebdea81e794d REPORT RequestId: 6bd9cf60-7e2b-11e8-9f4a-ebdea81e794d Duration: 646.26 ms Billed Duration: 700 ms Memory Size: 128 MB Max Memory Used: 31 MB

25. Use Cases

26. Consul Backups GET /v1/catalog/service/mqapi PutObject trigger

27. Database Replication Jobs Get updates PutObject trigger apply

28. Async Events publish publish trigger trigger Service A Service B Service C ECS

29. File Processing Pipeline Split PGP & Transfer Payment Networks Banks trigger trigger N 1 Object + Metadata

30. Lambda limits Memory : 128-3008 MB with 64 MB increments Time : 300 seconds

31. Batch Jobs

32. AWS Batch : Managed Compute https://.. Submitter Job Job Job Batch Cloudwatch Event

33. Containers not Serverless Enough? = ECS minus the Cluster

34. Logging For Lambdas, Cloudwatch logs For ECS, filebeat agent on the host For Fargate, LogStashTcpSocketAppender

35. Monitoring and Alerting

36. Testing Docker Compose Localstack Use environment variables for configuration (12-Factor App)

37. Gotchas.. - Lambda Cold start on both Python and Java - Due to VPC and ENI - Be aware of the retries - Async invocation gets two retries - Sync invocation gets no retries - Apply the Principle of Least Privilege to the Lambda and ECS Roles - S3 triggers - source and destination buckets

39. Tips - Declare connection pools outside of the handler’s scope - Write tests! - Test locally - the only error you should be expecting is IAM Permissions error. <role> is not authorized to perform: <operation> on resource: <resource> - Do not create Microliths - Set up billing alerts

40. Tips - Pick the best tool for the job - Do not pick the tool and try to fit the job into it - Beware of the shiny object syndrome - Take measured risks - Production is (mostly) unforgiving

42. “You’re free to choose, but you’re not free from the consequences of your choice” - Universal Paradox

43. Fin Manish Pandit Director of Platform Engineering @marqeta @lobster1234 lobster1234.github.io

Serverless Architectures on AWS in practice - OSCON 2018

Recommended

More Related Content

What's hot (15)

Similar to Serverless Architectures on AWS in practice - OSCON 2018 (20)

More from Manish Pandit (20)

Recently uploaded (20)

Serverless Architectures on AWS in practice - OSCON 2018