Amazon EC2 to Amazon VPC: A case study

Nov 15, 2013Download as PPTX, PDF5 likes3,777 views

Matthew Barlocker

Originally presented at AWS re:Invent 2013 in Las Vegas, NV with Eric Shultze, product manager of VPC.

About Me
•
•
•

Chief Architect at Lucid
Software Inc
Bachelors degree from BYU in
Computer Science
I love to
•
•
•
•

•

play board games
go 4-wheeling
wrestle my sons
fly airplanes

Follow me on
nineofclouds.blogspot.com

Lucid Software
•
•
•
•
•
•
•

Online Diagram Software
Online Print & Digital Publishing
Large Documents
Real-time Collaboration
All Changes Tracked
Vector Graphics
High Quality Images

Tech at Lucid
•
•
•
•
•
•

Google Closure
Javascript
PHP
Sharded MongoDB
Sharded MySQL
NodeJS

•
•
•
•
•
•

SOA
Scala
Play!
Chef
Zabbix, Graphite
AWS

Lucid on AWS
•
•
•
•
•
•
•
•

Elastic Compute Cloud
Virtual Private Cloud
Elastic Block Store
Auto Scaling
Elastic Load Balancing
Simple Storage Service
CloudFront
Export/Import

• Relational Database
Service
• Route53
• Simple Notification
Service
• Simple Email Service
• Availability Zones
• Regions

Why Lucid Chose Amazon VPC
•
•
•
•

Pricing
Interoperability
Enhanced Features
Security

Other Benefits
•
•
•
•
•

ELB security groups
Network ACLs
Elastic IP associations
VPN support
Reserved instance transfers

Drawbacks
•
•
•
•
•

NAT cost and maintenance
Setup time
New terminology
Private subnet accessibility
Internal DNS names defaults

Things You Should Know
• EIPs or Public IPs in public subnets
• NAT
• Not special
• Public subnet

• Subnets
• Route tables
• Network ACLs
• DHCP

Migration Constraints
• EC2 & VPC
communication
• NAT traffic
• Not Shared:
–
–
–
–
–

Security groups
Load balancers
Auto Scale groups
Elastic IPs
EIP Limits

• Shared:
–
–
–
–
–
–

Instance Limit
EBS volumes
Snapshots
Instance Sizes
Zones
Regions

Migration Plan
•
•
•
•

Move top layer first
Move one layer at a time
Meticulously manage security groups
Move monitoring/utility servers last

• http://nineofclouds.blogspot.com/search/label/VPC

5. Setup & Terminology
•
•
•
•
•
•

Subnets
DHCP
Network ACLs
Routes
Internet Gateway
Unavoidable

4. Security Groups
•
•
•
•

Groups Not Shared
EC2 open to NAT
Use Scripts
Avoidable using
public subnets

3. Access Private Subnets
•
•
•
•

OpenVPN
High Availability
SSH Tunnels
Unavoidable

2. MongoDB Migration
• Election Algorithm
• Intermediate Move to
Public Subnet
• 15 min Downtime

1. NAT Bandwidth
•
•
•
•

NAT was t1.micro
Databases in EC2
Applications in VPC
Not enough
bandwidth through
NAT
• Avoidable

Please give us your feedback on this
presentation

CPN301
As a thank you, we will select prize
winners daily for completed surveys!

Join the Team!
•
•
•
•
•
•

Building the next generation of
collaborative web applications
VC funded
High growth rate
Profitable
Graduates from Harvard, MIT,
Stanford
Former Google, Amazon,
Microsoft employees

https://www.lucidchart.com/jobs

We are now witnessing a new wave of IT revolution and its effect is very similar to the Cloud and Virtualization revolutions that started in the last decade. This new wave, called Containerization, is related to technologies such as Docker and Kubernetes, which now fuel large scale solutions including Big Data and IoT. Learn about: - Typical DevOps challenges and modern solutions - Using Docker as Amazon EC2 Container Service Evolution of Enterprise Architecture (Containers, IoT, Machine Learning and technologies of tomorrow) - Business value of using advances DevOps technologies with real-life case study

Blue Chip Tek AWS Connect and Protect Presentation #2Kimberly Macias

Deploying microservices on AWSMichael Haberman

This document discusses deploying microservices on AWS. It begins by explaining what microservices are and then discusses hosting options on AWS including EC2, ECS, and Lambda. ECS is identified as the preferred option since it allows hosting containers with Docker. The document then covers deployment aspects like using source control with Git for multiple environments, building and testing code, deploying single services or entire clusters, live testing, and monitoring with alerts.

Serverless with Azure FunctionsAndreas Willich

Serverless architectures rely on third-party services and remote procedure calls rather than maintaining servers. Azure Functions is a serverless computing service that allows developers to write code without managing infrastructure. Functions can be triggered by events and connected to other Azure services through bindings. Functions scale automatically based on demand and only charge for execution time and resources used.

DevOpsCon Cloud Workshop Sascha Möllering

Sascha Möllering gave a presentation on deploying applications to the AWS cloud. He began with an overview of AWS services like EC2, S3, RDS and explained how to initially create a simple cloud service with one instance each for a web application and database. He then described how to improve the architecture by separating components, adding redundancy and elasticity using services like ELB, autoscaling and read replicas. Sascha demonstrated deploying a sample application built with JHipster and Docker to AWS Elastic Beanstalk, which handles running the containers and mapping environment variables for the database connection.

Securing Containers From Day One | null Ahmedabad MeetupKumar Ashwin

Kumar Ashwin gives a presentation on securing containers from day one. The presentation covers what containers are, why we need them, the difference between virtual machines and containers, cgroups and namespaces, Docker basics, building optimized Docker images, and best practices for Dockerfile security. Some key points discussed include using minimal base images, ignoring unnecessary files, creating "golden images" as hardened base templates, not running as root, avoiding secrets in Dockerfiles, and using tools like Hadolint and Dockle to scan for issues.

Infrastructure Automation on AWS using a Real-World Customer ExampleAPI Talent

This technical session focuses on a customer use case and how using the AWS Cloud together with automation has enabled them to standardise and automate their systems. This talk will describe how this is achieved with two tools, Cloud formation and Puppet. Cloud formation is a declarative templating language that enables the deployment of environments in a standardised way. Combined with a configuration management tool like Puppet allows for the automation of ongoing software deployments and maintenance in a low overhead manner. Puppet is a Configuration Management tool that installs and configures software on instances. Taken together a complete system can be built from the ground up.

Azure functionsvivek p s

This document provides an overview of serverless computing using Azure Functions. It discusses the benefits of serverless such as increased server utilization, instant scaling, and reduced time to market. Serverless allows developers to focus on business logic rather than managing servers. Azure Functions is introduced as a way to develop serverless applications using triggers and bindings in languages like C#, Node.js, Python and more. Common serverless patterns are also presented.

Sas 2015 event_drivenSascha Möllering

This document summarizes an event-driven architecture presentation using Java. It discusses using Apache Kafka/Amazon Kinesis for messaging, Docker for containerization, Vert.x for reactive applications, Apache Camel/AWS Lambda for integration, and Google Protocol Buffers for data serialization. It covers infrastructure components, software frameworks, local and AWS deployment, and integration testing between Kinesis and Kafka. The presentation provides resources for code samples and Docker images discussed.

Azure Functions Real World Examples Yochay Kiriaty

Serverless data processing with Data PipelineRadek Miazio

Ph.D. DefenseChris Bunch

How Serverless Changes DevOpsRichard Donkin

What does Serverless mean for DevOps, in practical terms? While Serverless does reduce the need for server-centric DevOps, it poses new challenges in many areas including security, app deployment and cloud resource provisioning, partly due to an explosion of "nanoservices". Based on a current project using AWS, we cover relevant tools, techniques and tips to deliver a smooth serverless experience for development through to production. Delivered at Bristol DevOps meetup, 27 Jun 2018. To see detailed notes covering extra points not on slides, click the Notes link just below (or download the Powerpoint). Update: here's the correct link for Gojko Adzic talk on the Backendless slide - https://www.youtube.com/watch?v=w7X4gAQTk2E

SQL Server: Now It's Everywhere You Want to BeEd Leighton-Dick

Have you heard the news? SQL Server is coming to Linux! What? That can't be right... or can it? With the release of SQL Server 2017, Microsoft really is bringing SQL Server to the Linux platform. They've also added support for running SQL Server in Docker containers. How does it work? And how well does it work? In this session, we'll answer these questions (and more!), and we'll talk about how this enables some interesting new possibilities for DevOps.

Kubernetes and elixirJeffrey Chan

This document discusses Kubernetes and Elixir. It provides an overview of Kubernetes, including what it is, basic concepts like pods and services, and how it can manage containerized workloads. It also compares Kubernetes to Elixir's BEAM capabilities, noting they are orthogonal and can coexist. The document argues Kubernetes can provide benefits to Elixir applications like easier deployments and multi-tenancy, while acknowledging there may be some drawbacks around hot deployments and BEAM clustering within Kubernetes.

AWS Lambda + AWS CloudformationJordi Miguel

AWS Lambda allows running code without provisioning or managing servers. It is a compute service that runs code in response to events and scales automatically. AWS CloudFormation provides templates to deploy and manage AWS resources in a declarative and repeatable way. Templates define resources and parameters and CloudFormation provisions and deploys resources based on the template. Custom resources can also be defined to provision custom infrastructure not supported natively by CloudFormation templates.

Managing V Sphere With The VesiEric Sloof

Serverless Application Model - Executing Lambdas LocallyAlex

This document discusses using the Serverless Application Model (SAM) to develop serverless applications locally. It describes how SAM templates allow defining Lambda functions and APIs that can then be run locally using the SAM CLI. This avoids needing an internet connection to test functions and allows using local tools like debuggers. Examples are provided for local development workflows involving APIs, Lambda functions, DynamoDB, and S3 event processing. Key links are also provided to learn more about SAM templates, the SAM CLI, and running DynamoDB locally.

Inrastructure as CodeCharles Anderson

Serverless sparkMamathaBusi

NDev Talk - Serverless Design PatternsRyan Green

This document summarizes serverless design patterns and tools. It begins with a brief history of cloud computing and an introduction to serverless computing. Common serverless use cases like event-driven applications and stream processing are described. Several serverless patterns are then outlined, such as hosting a static website or REST API using AWS Lambda and API Gateway. Finally, the document demonstrates a serverless application and discusses future directions for serverless technologies.

AppScale Talk at SBonRailsChris Bunch

Serverless in azureVeresh Jain

AWS Lambda Function with KotlinTroy Miles

Kotlin is a language from the tool gurus at JetBrains. In 2016, after about six years of development, Kotlin reached version 1.0. In 2017 it won the hearts of developers and became an officially supported language for Android. Kotlin, like Java, is for more than creating Android applications. It can replace or enhance Java most places it is used today including on AWS. AWS Lambda functions sometimes called Serverless Computing, is a service which lets us developers build web services without worrying about configuring servers. In this session, we will create a lambda service on AWS using Kotlin. Along the way, we will learn what a makes Kotlin an excellent replacement for Java and how simple it is to construct an AWS Lambda function.

MJ Berends talk from AWS Chicago SummitAWS Chicago

This document discusses using LocalStack and Moto for local AWS development. LocalStack runs AWS services locally to allow developing and testing code against real services. Moto allows mocking AWS services in Python tests. The document recommends using these tools to explore services, create prototypes and tests, then gradually transitioning to real AWS for production. Local development tools help bridge differences between local and AWS environments.

DevOps with AWS in 2016Lorenzo Aiello

Five Years of EC2 DistilledGrig Gheorghiu

Case Study: Lucidchart's Migration to VPCMatthew Barlocker

This document summarizes Lucidchart's migration from EC2 Classic to VPC. Some key points: - Lucidchart chose to migrate to VPC for improved security, interoperability with other AWS services, and new features like internal ELBs and dynamic security groups. - Benefits of VPC included enhanced security from private IPs and network ACLs, easier ELB and reserved instance management. Drawbacks included extra cost and maintenance of NAT instances and more complex networking configuration. - Lucidchart's migration plan moved servers layer by layer starting with web servers, then applications, then databases, with monitoring servers moved last. Managing security groups carefully during the phased migration was important. - The top

Get Started with AWSAsanka Nissanka

This document provides an overview and introduction to Amazon Web Services (AWS). It discusses AWS' mission to enable businesses and developers to build scalable applications using web services. Statistics are presented showing AWS' dominance in the cloud computing market, with over 1 million active customers. The core AWS services across compute, storage, databases, networking, administration and more are outlined. The document also reviews AWS regions and availability zones, common concerns around cloud adoption, and provides a case study of how one company migrated their infrastructure to AWS to gain performance improvements, automation benefits and reduce costs.

More Related Content

What's hot (20)

Azure functionsvivek p s

Sas 2015 event_drivenSascha Möllering

Azure Functions Real World Examples Yochay Kiriaty

Serverless data processing with Data PipelineRadek Miazio

Ph.D. DefenseChris Bunch

How Serverless Changes DevOpsRichard Donkin

SQL Server: Now It's Everywhere You Want to BeEd Leighton-Dick

Kubernetes and elixirJeffrey Chan

AWS Lambda + AWS CloudformationJordi Miguel

Managing V Sphere With The VesiEric Sloof

Serverless Application Model - Executing Lambdas LocallyAlex

Inrastructure as CodeCharles Anderson

Serverless sparkMamathaBusi

NDev Talk - Serverless Design PatternsRyan Green

AppScale Talk at SBonRailsChris Bunch

Serverless in azureVeresh Jain

AWS Lambda Function with KotlinTroy Miles

MJ Berends talk from AWS Chicago SummitAWS Chicago

DevOps with AWS in 2016Lorenzo Aiello

Five Years of EC2 DistilledGrig Gheorghiu

Azure functionsvivek p s

Sas 2015 event_drivenSascha Möllering

Azure Functions Real World Examples Yochay Kiriaty

Serverless data processing with Data PipelineRadek Miazio

Ph.D. DefenseChris Bunch

How Serverless Changes DevOpsRichard Donkin

SQL Server: Now It's Everywhere You Want to BeEd Leighton-Dick

Kubernetes and elixirJeffrey Chan

AWS Lambda + AWS CloudformationJordi Miguel

Managing V Sphere With The VesiEric Sloof

Serverless Application Model - Executing Lambdas LocallyAlex

Inrastructure as CodeCharles Anderson

Serverless sparkMamathaBusi

NDev Talk - Serverless Design PatternsRyan Green

AppScale Talk at SBonRailsChris Bunch

Serverless in azureVeresh Jain

AWS Lambda Function with KotlinTroy Miles

MJ Berends talk from AWS Chicago SummitAWS Chicago

DevOps with AWS in 2016Lorenzo Aiello

Five Years of EC2 DistilledGrig Gheorghiu

Viewers also liked (6)

Case Study: Lucidchart's Migration to VPCMatthew Barlocker

Get Started with AWSAsanka Nissanka

Meetup #3: Migrating an Oracle Application from on-premise to AWSAWS Vietnam Community

The document summarizes a case study of migrating an Oracle application from on-premise to AWS. It describes the existing on-premise architecture including hardware, software, network/security configuration, and disaster recovery requirements. It then discusses challenges of meeting the recovery time and point objectives on AWS. The first proposed solution is outlined along with its problems. Finally, the document proposes an improved solution on AWS and estimates it can save 70% on infrastructure costs.

OneHourTranslation - AWS Cloud Case StudyNewvewm

One Hour Translation provides High quality, Fast, 24x7 Professional Human Translation in more than 57 languages. We are able to provide high-quality translations around the clock, any day, thanks to a community of over 10000 professional translators from over 100 different countries. One Hour Translation serve tens of thousands of projects a month thanks to AWS cloud technologies which enables fast and transparent scaling of our service. In this session I will present a case study for IT architecture and deployment on AWS with security monitoring using Newvem's services. Oren Yagev Co-Founder, CTO at OneHourTranslation.com

Migrating Traditional Apps from On-Premises to the Hybrid CloudRackspace

Introduction to AWS VPC, Guidelines, and Best PracticesGary Silverman

Case Study: Lucidchart's Migration to VPCMatthew Barlocker

Get Started with AWSAsanka Nissanka

Meetup #3: Migrating an Oracle Application from on-premise to AWSAWS Vietnam Community

OneHourTranslation - AWS Cloud Case StudyNewvewm

Migrating Traditional Apps from On-Premises to the Hybrid CloudRackspace

Introduction to AWS VPC, Guidelines, and Best PracticesGary Silverman

Similar to Amazon EC2 to Amazon VPC: A case study (20)

Do you lose sleep at night?Nathan Van Gheem

Attendees will learn the best web application security practices used by major US government entities. The presentation will cover network configuration, caching, replication, common web application vulnerabilities, and how making these changes will result in better web site performance and user satisfaction. The five most common types of web application attacks will be explained, along with simple ways to prevent them.

Cloud and Windows AzureRadu Vunvulea

The document introduces cloud computing and cloud services. It defines cloud computing as using computing resources delivered over a network as a service. It then provides information about Radu Vunvulea and his background. The document outlines an agenda to cover cloud computing topics but does not fill in the agenda items. It also includes sections on cloud characteristics, cloud providers, market forecasts, Azure components, execution models, machine sizes, data management, queues, caching, and other Azure services.

Storage Requirements and Options for Running Spark on KubernetesDataWorks Summit

In a world of serverless computing users tend to be frugal when it comes to expenditure on compute, storage and other resources. Paying for the same when they aren’t in use becomes a significant factor. Offering Spark as service on cloud presents very unique challenges. Running Spark on Kubernetes presents a lot of challenges especially around storage and persistence. Spark workloads have very unique requirements of Storage for intermediate data, long time persistence, Share file system and requirements become very tight when it same need to be offered as a service for enterprise to mange GDPR and other compliance like ISO 27001 and HIPAA certifications. This talk covers challenges involved in providing Serverless Spark Clusters share the specific issues one can encounter when running large Kubernetes clusters in production especially covering the scenarios related to persistence. This talk will help people using Kubernetes or docker runtime in production and help them understand various storage options available and which is more suitable for running Spark workloads on Kubernetes and what more can be done

IaaS azure_vs_amazonUdaiappa Ramachandran

This document compares IaaS cloud services from Azure and Amazon. It provides an overview of key virtual machine components, pricing models, networking, load balancing, and cross-premises connectivity options from each provider. While both offer compute, storage, and networking services, the document notes Azure has better developer tools while Amazon provides more configurable performance options like IOPS. It concludes that which cloud is better depends on the specific needs and priorities of each application.

Architecting for AWS Cloud - let's do it right!Misha Hanin

ECS19 - Mustafa Toroman, Sasa Kranjac - SOUP TO NUTS: MICROSOFT AZURE POWERCLASSEuropean Collaboration Summit

Azure provides several options for security and identity management: - Azure Active Directory allows centralized management of user access and single sign-on across Azure, Office 365, and other cloud apps. It can extend on-premises directories to the cloud. - Multi-factor authentication protects access using additional verification beyond a password. It can leverage on-premises Active Directory when used with Azure Active Directory. - Encryption options in Azure help secure data at rest and in transit. These include BitLocker, storage encryption, and application-level encryption.

Introducing to serverless computing and AWS lambda - Israel Clouds MeetupBoaz Ziniman

Spark volume requirements 2018Rachit Arora

This document discusses storage requirements for running Spark workloads on Kubernetes. It recommends using a distributed file system like HDFS or DBFS for distributed storage and emptyDir or NFS for local temp scratch space. Logs can be stored in emptyDir or pushed to object storage. Features that would improve Spark on Kubernetes include image volumes, flexible PV to PVC mappings, encrypted volumes, and clean deletion for compliance. The document provides an overview of Spark, Kubernetes benefits, and typical Spark deployments.

Building a Platform-as-a-Service with Docker and Node.jsKevin Swiber

Microservices and Serverless for Mega Startups - DevOps IL MeetupBoaz Ziniman

1) The document discusses best practices for running microservices at scale, including breaking monolithic architectures into loosely coupled microservices, using the right tools for each job, securing services, focusing on organizational transformation, and automating everything. 2) Five principles for running microservices are outlined: microservices only rely on each other's public APIs, using the right tool for the job, securing services with defense-in-depth, focusing on cross-functional teams for alignment, and automating everything. 3) Examples of event-driven serverless architectures using AWS Lambda and other AWS services are provided.

Windows Azure introductionMicrosoft Iceland

The document introduces Microsoft's Windows Azure cloud platform. It summarizes that Windows Azure provides an operating system for the cloud that abstracts away hardware and provides services for automated management, scalable computing and storage. It allows developers to build applications and services that can easily scale across large, connected data centers. The talk demonstrates how Windows Azure allows building complex service architectures from simple components like web and worker roles that interact through a durable storage system. It emphasizes that the platform aims to provide a familiar development experience while handling all the complexities of highly scalable cloud services.

NetflixOSS for Triangle Devops Oct 2013aspyker

Benefits of an Open environment with WakandaAlexandre Morgaut

Wakanda is an open source platform that provides benefits of an open environment including freedom, adaptability, interoperability, portability, reusability, and community. It uses open source libraries and has open source and dual licensing. The Wakanda Studio includes tools like a model designer, GUI designer, and debugger. It supports add-ons, external widgets, and web components. The Wakanda backend integrates technologies like HTTP APIs, modules, and supports accessing external databases and technologies.

Write Once and REALLY Run Anywhere | OpenStack Summit HK 2013dotCloud

The document outlines the agenda for the OpenStack Summit in November 2013. The agenda includes sessions on Docker and its ecosystem, using Docker with OpenStack and Rackspace, and a cross-cloud deployment demo. Docker is presented as a solution for developing and deploying applications across multiple environments by encapsulating code and dependencies in portable containers. It can help eliminate inconsistencies between development, testing, and production environments.

What's New for the Windows Azure Developer? Lots!!Michael Collier

Grails in the Cloud (2013)Meni Lubetkin

This document discusses different cloud platforms for hosting Grails applications. It provides an overview of infrastructure as a service (IaaS) models like Amazon EC2 and shared/dedicated virtual private servers, as well as platform as a service (PaaS) options including Amazon Beanstalk, Google App Engine, Heroku, Cloud Foundry, and Jelastic. A comparison chart evaluates these platforms based on factors such as pricing, control, reliability, and scalability. The document emphasizes that competition and changes in the cloud space are rapid and recommends keeping applications loosely coupled and testing platforms using free trials.

Journey Towards Scaling Your Application to Million UsersAdrian Hornsby

The document discusses the steps and services needed to scale an application from initial development to supporting 10 million users on AWS. It recommends starting with high quality code, version control, CI/CD pipelines, and infrastructure as code from day one. As the application scales to support more users, it recommends adding services like S3 for static assets, Route53 for DNS, CloudFront for caching, auto scaling groups, database read replicas and sharding, asynchronous processing with SQS, event-driven architecture using Lambda, and microservices. The goal is to build operational excellence and architect the application for availability, redundancy, and scale from the start.

Serverless Node.jsThe Software House

Mariusz Richtscheid: Architektura typu serverless wraz z terminem "Function as a Service" zyskują coraz większą popularność. To całkiem odmienne podejście do tworzenia aplikacji oraz ich wdrażania ma wiele zalet, ale musimy być też świadomi problemów, jakie się z nim wiążą. W trakcie prezentacji pokażę, w jaki sposób można zmodyfikować istniejącą aplikację Node.js tak, by wykorzystać zalety tej architektury.

Deploying asp.net and mvc applications to azureGlyn Darkin

This document discusses considerations for deploying ASP.NET and MVC applications to Microsoft Azure. It compares Azure Websites and Cloud Services, noting that Websites are easier to use as they don't require Azure SDK tools but lack features like staging environments. It also covers Azure SQL, noting it supports most but not all T-SQL and has different backup strategies than on-premises SQL Server. The document recommends starting with Azure Websites and migrating to Cloud Services only if needed, and keeping in mind that Azure is continuously evolving.

Why Kubernetes as a container orchestrator is a right choice for running spar...DataWorks Summit

Building and deploying an analytic service on Cloud is a challenge. A bigger challenge is to maintain the service. In a world where users are gravitating towards a model where cluster instances are to be provisioned on the fly, in order for these to be used for analytics or other purposes, and then to have these cluster instances shut down when the jobs get done, the relevance of containers and container orchestration is more important than ever. Container orchestrators like Kubernetes can be used to deploy and distribute modules quickly, easily, and reliably. The intent of this talk is to share the experience of building such a service and deploying it on a Kubernetes cluster. In this talk, we will discuss all the requirements which an enterprise grade Hadoop/Spark cluster running on containers bring in for a container orchestrator. This talk will cover in details how Kubernetes orchestrator can be used to meet all our needs of resource management, scheduling, networking, and network isolation, volume management, etc. We will discuss how we have replaced our home grown container orchestrator with Kubernetes which used to manage the container lifecycle and manage resources in accordance to our requirements. We will also discuss the feature list as container orchestrator which is helping us deploy and patch 1000s of containers and also a list which we believe need improvement or can be enhanced in a container orchestrator. Speaker Rachit Arora, SSE, IBM

Do you lose sleep at night?Nathan Van Gheem

Cloud and Windows AzureRadu Vunvulea

Storage Requirements and Options for Running Spark on KubernetesDataWorks Summit

IaaS azure_vs_amazonUdaiappa Ramachandran

Architecting for AWS Cloud - let's do it right!Misha Hanin

ECS19 - Mustafa Toroman, Sasa Kranjac - SOUP TO NUTS: MICROSOFT AZURE POWERCLASSEuropean Collaboration Summit

Introducing to serverless computing and AWS lambda - Israel Clouds MeetupBoaz Ziniman

Spark volume requirements 2018Rachit Arora

Building a Platform-as-a-Service with Docker and Node.jsKevin Swiber

Microservices and Serverless for Mega Startups - DevOps IL MeetupBoaz Ziniman

Windows Azure introductionMicrosoft Iceland

NetflixOSS for Triangle Devops Oct 2013aspyker

Benefits of an Open environment with WakandaAlexandre Morgaut

Write Once and REALLY Run Anywhere | OpenStack Summit HK 2013dotCloud

What's New for the Windows Azure Developer? Lots!!Michael Collier

Grails in the Cloud (2013)Meni Lubetkin

Journey Towards Scaling Your Application to Million UsersAdrian Hornsby

Serverless Node.jsThe Software House

Deploying asp.net and mvc applications to azureGlyn Darkin

Why Kubernetes as a container orchestrator is a right choice for running spar...DataWorks Summit

More from Matthew Barlocker (9)

Getting Started on Amazon EKSMatthew Barlocker

Optimizing Uptime in SOAMatthew Barlocker

Initially presented at Software Architecture Conference in Boston, MA on 3/18/15. Distributed systems are complex beasts. Breaking your application into multiple services introduces new types of errors, cascading failures, and CAP theorem limitations. Unfortunately, your uptime and sanity both suffer. This session will focus on various tactics and learnings from Lucid Software's migration to a service oriented architecture.

RelateMatthew Barlocker

Highly Available GraphiteMatthew Barlocker

Initially presented at OpenWest 2014 conference. Graphite and StatsD gather line series data and offer a robust set of APIs to access that data. While the tools are robust, the dashboards are straight from 1992 and alerting off the data is nonexistent. Nark, an opensource project, solves both of these problems. It provides easy to use dashboards and readily available alerts and notifications to users. It has been used in production at Lucid Software for almost a year. Related to Nark are the tools required to make Graphite highly available.

Nark: Steroids for GraphiteMatthew Barlocker

Graphite has an amazing ability to scale horizontally and achieve high availability. What the community is missing is a single source for alerting and dashboards on top of this already amazing product. That's where Nark comes in. Nark is an open source project developed to provide alerting and dashboards for graphite. Developed by engineers at Lucid Software, Nark provides value to ops and product teams alike. Come learn about the project, how you can use it, and how to contribute.

ORM or SQL? A Better Way to Query in MySQLMatthew Barlocker

The problem with frameworks and ORMs is the lackadaisical manner with which they write queries. Their focus is to straddle multiple database engines, not to write queries in the optimal way. The database layer is always the hardest layer to scale. Why would you put additional strain on your database to avoid writing SQL? This session focuses on understanding indices, queries, and optimization in MySQL.

Your First Scala Web Application using Play 2.1Matthew Barlocker

This document provides an overview of building a Scala web application using the Play! framework. It begins with introductions to Scala and the Play! framework. It then covers topics like request handling, views, forms, database integration, the build system, internationalization, and testing. Exercises are provided to demonstrate creating routes, controllers, actions, views, forms, database models and more. The presenter is available to answer questions after the session and provides information on open positions at their company Lucid Software.

Git essentialsMatthew Barlocker

Magic methodsMatthew Barlocker

This document summarizes magic methods in PHP that allow for custom object behavior. It discusses methods for stringification (__toString()), object lifecycle (__construct(), __destruct()), property overloading (__get(), __set(), etc.), method overloading (__call(), __callStatic()), serialization (__sleep(), __wakeup()), cloning (__clone(), __set_state()), and object invocation (__invoke()). Examples are provided for each method. Performance benchmarks at the end show that magic methods have negligible overhead compared to normal method calls.

Getting Started on Amazon EKSMatthew Barlocker

Optimizing Uptime in SOAMatthew Barlocker

RelateMatthew Barlocker

Highly Available GraphiteMatthew Barlocker

Nark: Steroids for GraphiteMatthew Barlocker

ORM or SQL? A Better Way to Query in MySQLMatthew Barlocker

Your First Scala Web Application using Play 2.1Matthew Barlocker

Git essentialsMatthew Barlocker

Magic methodsMatthew Barlocker

Recently uploaded (20)

"PHP and MySQL CRUD Operations for Student Management System"Jainul Musani

#AdminHour presents: Hour of Code2018 slide deck from 12/6/2018Lynda Kane

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

How Can I use the AI Hype in my Business Context?Daniel Lehner

𝙄𝙨 𝘼𝙄 𝙟𝙪𝙨𝙩 𝙝𝙮𝙥𝙚? 𝙊𝙧 𝙞𝙨 𝙞𝙩 𝙩𝙝𝙚 𝙜𝙖𝙢𝙚 𝙘𝙝𝙖𝙣𝙜𝙚𝙧 𝙮𝙤𝙪𝙧 𝙗𝙪𝙨𝙞𝙣𝙚𝙨𝙨 𝙣𝙚𝙚𝙙𝙨? Everyone’s talking about AI but is anyone really using it to create real value? Most companies want to leverage AI. Few know 𝗵𝗼𝘄. ✅ What exactly should you ask to find real AI opportunities? ✅ Which AI techniques actually fit your business? ✅ Is your data even ready for AI? If you’re not sure, you’re not alone. This is a condensed version of the slides I presented at a Linkedin webinar for Tecnovy on 28.04.2025.

Asthma presentación en inglés abril 2025 pdfVanessaRaudez

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots. 📕 Here's what you can expect: - Modeling: Build end-to-end processes using BPMN. - Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes. - Operating: Control process instances with rewind, replay, pause, and stop functions. - Monitoring: Use dashboards and embedded analytics for real-time insights into process instances. This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes. 👨‍🏫 Speaker: Andrei Vintila, Principal Product Manager @UiPath This session streamed live on April 29, 2025, 16:00 CET. Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.

Rock, Paper, Scissors: An Apex Map Learning JourneyLynda Kane

Learn the Basics of Agile Development: Your Step-by-Step GuideMarcel David

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

This is a Quick Research Guide (QRG). QRGs include the following: - A brief, high-level overview of the QRG topic. - A milestone timeline for the QRG topic. - Links to various free online resource materials to provide a deeper dive into the QRG topic. - Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic. QRGs planned for the series: - Artificial Intelligence QRG - Quantum Computing QRG - Big Data Analytics QRG - Spacecraft Guidance, Navigation & Control QRG (coming 2026) - UK Home Computing & The Birth of ARM QRG (coming 2027) Any questions or comments? - Please contact Arthur Morgan at [email protected]. 100% human made.

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

Mobile App Development Company in Saudi ArabiaSteve Jonas

EmizenTech is a globally recognized software development company, proudly serving businesses since 2013. With over 11+ years of industry experience and a team of 200+ skilled professionals, we have successfully delivered 1200+ projects across various sectors. As a leading Mobile App Development Company In Saudi Arabia we offer end-to-end solutions for iOS, Android, and cross-platform applications. Our apps are known for their user-friendly interfaces, scalability, high performance, and strong security features. We tailor each mobile application to meet the unique needs of different industries, ensuring a seamless user experience. EmizenTech is committed to turning your vision into a powerful digital product that drives growth, innovation, and long-term success in the competitive mobile landscape of Saudi Arabia.

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Procurement Insights Cost To Value Guide.pptxJon Hansen

Leading AI Innovation As A Product Manager - Michael JidaelMichael Jidael

Unlike traditional product management, AI product leadership requires new mental models, collaborative approaches, and new measurement frameworks. This presentation breaks down how Product Managers can successfully lead AI Innovation in today's rapidly evolving technology landscape. Drawing from practical experience and industry best practices, I shared frameworks, approaches, and mindset shifts essential for product leaders navigating the unique challenges of AI product development. In this deck, you'll discover: - What AI leadership means for product managers - The fundamental paradigm shift required for AI product development. - A framework for identifying high-value AI opportunities for your products. - How to transition from user stories to AI learning loops and hypothesis-driven development. - The essential AI product management framework for defining, developing, and deploying intelligence. - Technical and business metrics that matter in AI product development. - Strategies for effective collaboration with data science and engineering teams. - Framework for handling AI's probabilistic nature and setting stakeholder expectations. - A real-world case study demonstrating these principles in action. - Practical next steps to begin your AI product leadership journey. This presentation is essential for Product Managers, aspiring PMs, product leaders, innovators, and anyone interested in understanding how to successfully build and manage AI-powered products from idea to impact. The key takeaway is that leading AI products is about creating capabilities (intelligence) that continuously improve and deliver increasing value over time.

"Client Partnership — the Path to Exponential Growth for Companies Sized 50-5...Fwdays

Drupalcamp Finland – Measuring Front-end Energy ConsumptionExove

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

Buckeye Dreamin 2024: Assessing and Resolving Technical DebtLynda Kane

Image processinglab image processing image processingRaghadHany

"PHP and MySQL CRUD Operations for Student Management System"Jainul Musani

#AdminHour presents: Hour of Code2018 slide deck from 12/6/2018Lynda Kane

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

How Can I use the AI Hype in my Business Context?Daniel Lehner

Asthma presentación en inglés abril 2025 pdfVanessaRaudez

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

Rock, Paper, Scissors: An Apex Map Learning JourneyLynda Kane

Learn the Basics of Agile Development: Your Step-by-Step GuideMarcel David

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

Mobile App Development Company in Saudi ArabiaSteve Jonas

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Procurement Insights Cost To Value Guide.pptxJon Hansen

Leading AI Innovation As A Product Manager - Michael JidaelMichael Jidael

"Client Partnership — the Path to Exponential Growth for Companies Sized 50-5...Fwdays

Drupalcamp Finland – Measuring Front-end Energy ConsumptionExove

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

Buckeye Dreamin 2024: Assessing and Resolving Technical DebtLynda Kane

Image processinglab image processing image processingRaghadHany

Amazon EC2 to Amazon VPC: A case study

1. EC2 to VPC: A case study Eric Schultze, AWS Matthew Barlocker, Lucid Software Inc November 14, 2013 © 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.

2. About Me • • • Chief Architect at Lucid Software Inc Bachelors degree from BYU in Computer Science I love to • • • • • play board games go 4-wheeling wrestle my sons fly airplanes Follow me on nineofclouds.blogspot.com

3. Lucid Software • • • • • • • Online Diagram Software Online Print & Digital Publishing Large Documents Real-time Collaboration All Changes Tracked Vector Graphics High Quality Images

4. Tech at Lucid • • • • • • Google Closure Javascript PHP Sharded MongoDB Sharded MySQL NodeJS • • • • • • SOA Scala Play! Chef Zabbix, Graphite AWS

5. Lucid on AWS • • • • • • • • Elastic Compute Cloud Virtual Private Cloud Elastic Block Store Auto Scaling Elastic Load Balancing Simple Storage Service CloudFront Export/Import • Relational Database Service • Route53 • Simple Notification Service • Simple Email Service • Availability Zones • Regions

6. Why Lucid Chose Amazon VPC • • • • Pricing Interoperability Enhanced Features Security

7. Other Benefits • • • • • ELB security groups Network ACLs Elastic IP associations VPN support Reserved instance transfers

8. Drawbacks • • • • • NAT cost and maintenance Setup time New terminology Private subnet accessibility Internal DNS names defaults

9. Things You Should Know • EIPs or Public IPs in public subnets • NAT • Not special • Public subnet • Subnets • Route tables • Network ACLs • DHCP

10. Migration Plan

11. Migration Constraints • EC2 & VPC communication • NAT traffic • Not Shared: – – – – – Security groups Load balancers Auto Scale groups Elastic IPs EIP Limits • Shared: – – – – – – Instance Limit EBS volumes Snapshots Instance Sizes Zones Regions

12. Migration Plan • • • • Move top layer first Move one layer at a time Meticulously manage security groups Move monitoring/utility servers last • http://nineofclouds.blogspot.com/search/label/VPC

13. Starting Layout

14. Move Webservers First

15. Move Services Next

16. Move Databases Last

17. Top 5 Pain Points

18. 5. Setup & Terminology • • • • • • Subnets DHCP Network ACLs Routes Internet Gateway Unavoidable

19. 4. Security Groups • • • • Groups Not Shared EC2 open to NAT Use Scripts Avoidable using public subnets

20. 3. Access Private Subnets • • • • OpenVPN High Availability SSH Tunnels Unavoidable

21. 2. MongoDB Migration • Election Algorithm • Intermediate Move to Public Subnet • 15 min Downtime

22. 1. NAT Bandwidth • • • • NAT was t1.micro Databases in EC2 Applications in VPC Not enough bandwidth through NAT • Avoidable

23. Please give us your feedback on this presentation CPN301 As a thank you, we will select prize winners daily for completed surveys!

24. Join the Team! • • • • • • Building the next generation of collaborative web applications VC funded High growth rate Profitable Graduates from Harvard, MIT, Stanford Former Google, Amazon, Microsoft employees https://www.lucidchart.com/jobs

Amazon EC2 to Amazon VPC: A case study

Recommended

More Related Content

What's hot (20)

Viewers also liked (6)

Similar to Amazon EC2 to Amazon VPC: A case study (20)

More from Matthew Barlocker (9)

Recently uploaded (20)

Amazon EC2 to Amazon VPC: A case study