Lessons Learnt from Guanyu

Apr 10, 2018Download as PPTX, PDF0 likes81 views

Guanyu is an in-house virus scanning service on top of AWS ECS, Sophos AV, and Spot Instances. These slides covers common issues scaling an cluster, on-demand or spot. Published 2018-03-10 at JAWS DAYS

Lessons learnt from Guanyu
-- ECS, Autoscaling, and Architecture
Cliff Chao-kuan Lu
呂昭寬 AWSUGTW
<clifflu@gmail.com>
Image by NASA JPL via Space Images

Cliff Chao-kuan Lu 呂昭寬
• Sr. Architect @ 104 Corp., #1 Job Bank in Taiwan
• Organizer to AWS User Group Taiwan
• AWS Community Hero
• Certified ALL-5 + Big Data

Guanyu
• Home-made security service on top of
Sophos AV and AWS ECS
• 6-9M scans per month at $100-200
• Developed June-August 2016

Architecture
POST
/scan/file
ALB
ECS
Response
Handler ParserSophos AV
Cache
DynamoDB

Architecture
POST
/scan/uri
ALB
ECS
Response
Fetch Cleanup
DynamoDB
Han
dler
Pa
rs
er
Sop
hos
AV
Cache

Architecture
POST
/scan/text
ALB
ECS
Response
DynamoDB
Fet
ch
Clea
nup
H
a
n
dl
e
r
P
a
r
s
e
r
So
ph
os
A
V
Cache
ScanUri

Architecture, In Short
• Node.js web project + Sophos-AV in 1 image
•Monolithic

Container Footprint
• At rest
• CPU: Minimal
• Memory: ~30mb
• Scanning
• CPU: ~50% (single core)
• Memory: ~300mb
• Default: 4 parallel scans
• Cache Hit
• CPU: Minimal
• Memory: ~30mb

Dilemma - Resource Availability
• Starting EC2 instances takes time
• Buffer with %Unreserved
• Upper bound to %Reserved

Taking Spot Instance into Play
• Takes longer to instantiate
• Not always available
• Lower price
• Targets 50% reserved
• Dual ASG (Spot + On-
Demand)

Gotcha: Overshoot
• Longer boot-up time means more buffer required
• Metrics reflects PAST status
• Grew to 17 when we needed 4
• Tuning complex scaling policies is an Art

Planned Scan Engines
• Malware
• Sophos AV
• BinaryAlert
https://www.binaryalert.io/
• Inappropriate Images
• AWS Rekognition
• OpenNSFW
https://github.com/yahoo/open_nsfw

Proposed Architecture
POST
/scan/*
ALB
ECS
Response
Handler
Cache
DynamoDB
SNSSQS
ParserSophos AV
ParserOpenNSFW
Lambda

Advantages
• Uniform workloads is easier to manage
• Synchronous -> Asynchronous
• Allows higher %Reserved
• Do more, cost less

Take Home Message
• Spot instance offers great performance per dollar
• Mind the platform gap
• Never too late to refactor
• Keep an eye on Auto Scaling
• Balance availability, cost, and performance

Terraform is a tool for provisioning and managing infrastructure as code. It allows defining and deploying infrastructure through configuration files rather than interactive console tools. The configuration files describe the components needed for an application and their relationships, and Terraform uses this information to provision and update infrastructure safely and efficiently. Terraform works by defining resources such as compute instances, storage, and networking components using a high-level configuration language, and then generates and executes the plans to build, change, and version those resources. It supports a variety of cloud platforms including Azure.

Go Serverless with Java and Azure FunctionsSandra Ahlgrimm

Let’s dive into the world of serverless and give you real world examples of how to get started. We will focus on Azure Functions in Java and discuss how to provision, deploy and test them in a productive environment. In my demos we will see the ease of local development leveraging from the great integration in Visual Studio Code. Finally, let’s ship our samples and scale them in Azure. If you are tired of server maintenance and want to achieve more with your java functions, check out the recording: https://www.youtube.com/watch?v=bZ_aewihpXA&feature=emb_logo

Operational challenges behind Serverless architecturesLaurent Bernaille

DevOps in real lifeDataArt

Александр Снеговой, DevOps Software Engineer в DataArt Kherson. Более шести лет в IT. Сертифицированный AWS Solutions Architect Associate. Докладчик на международных научных конференциях. Религиозный фанат Docker. Презентация: 1. Докеризация приложения. 2. Настройка CI/CD. 3. Развертывание инфраструктуры в AWS с помощью Terraform.

Autoscaling near-persistent EBSEmil Philips

Inrastructure as CodeCharles Anderson

Using Terraform for AWS as the IaC toolLay How

Infrastructure Automation on AWS using a Real-World Customer ExampleAPI Talent

This technical session focuses on a customer use case and how using the AWS Cloud together with automation has enabled them to standardise and automate their systems. This talk will describe how this is achieved with two tools, Cloud formation and Puppet. Cloud formation is a declarative templating language that enables the deployment of environments in a standardised way. Combined with a configuration management tool like Puppet allows for the automation of ongoing software deployments and maintenance in a low overhead manner. Puppet is a Configuration Management tool that installs and configures software on instances. Taken together a complete system can be built from the ground up.

Getting started with Laravel & ElasticsearchPeter Steenbergen

TerraformOtto Jongerius

Terraform is a tool used by Atlassian for building, changing, and versioning infrastructure safely and efficiently. It manages both popular cloud services and in-house solutions through its infrastructure-as-code approach. Atlassian uses Terraform for its build pipelines via a Python wrapper and fork of Terraform, taking advantage of its modular and extendable design as well as its large, active community for support.

Laravel and SOLRPeter Steenbergen

Infrastructure as code (iac) - Terraform for AWSJohanes Glenn

This document discusses infrastructure as code using Terraform on AWS. It introduces infrastructure as code and why it is important compared to traditional infrastructure deployment methods. Some key benefits highlighted are having code to represent infrastructure that can be version controlled, allowing infrastructure to be deployed in an automated and repeatable way. The document then demonstrates deploying AWS infrastructure like VPCs, subnets, security groups, load balancers etc. using Terraform code. It shows the workflow of initializing, planning and applying Terraform code to provision the AWS resources.

DevOpsCon Cloud Workshop Sascha Möllering

Sascha Möllering gave a presentation on deploying applications to the AWS cloud. He began with an overview of AWS services like EC2, S3, RDS and explained how to initially create a simple cloud service with one instance each for a web application and database. He then described how to improve the architecture by separating components, adding redundancy and elasticity using services like ELB, autoscaling and read replicas. Sascha demonstrated deploying a sample application built with JHipster and Docker to AWS Elastic Beanstalk, which handles running the containers and mapping environment variables for the database connection.

Cloudsolutionday 2016: DevOps workflow with Docker on AWSAWS Vietnam Community

The document discusses DevOps workflow with Docker on AWS. It describes using Docker to isolate application environments, increasing team productivity and decreasing development team size. Key elements include using Gitlab for source control and CI/CD, building Docker images via Gitlab runners, and deploying to Kubernetes clusters. The workflow allows writing applications once and running them anywhere and forever through continuous integration and delivery of Docker images to private container registries on AWS.

Meetup #3: Migrate a fast scale system to AWSAWS Vietnam Community

The document discusses migrating a fast scaling system from physical servers to AWS. It outlines the agenda which includes an overview of physical systems and virtualization, the Topica Edumall system design, applying DevOps practices, and a Q&A. The Topica Edumall hybrid system is described as using VPS, physical servers, and AWS for core video streaming. Benefits of migrating the auto-scaling system to Docker and Kubernetes on AWS include high availability, easy scaling, auto-healing, and saving 40% costs with full utilization of AWS services. DevOps practices like CI/CD workflows are also discussed.

Campus days Azure HDInsight automationKenneth Michael Nielsen

Atlantisで実現するTerraformのGitOps理弘山崎

The document discusses using Terraform and Atlantis for infrastructure as code on AWS. It provides an overview of Terraform and how it can be used to define AWS resources like S3 buckets. It then introduces Atlantis as a tool that integrates with version control systems like GitHub to run Terraform plans on pull requests and apply changes once approved. Key features of Atlantis mentioned are that it allows pull request based planning and applying of Terraform code.

AWS re:Invent 2016 Fast ForwardShuen-Huei Guan

Scaling WordPress - WP on AWSstk_jj

This document discusses scaling WordPress on AWS. It introduces AWS services like EC2, EFS, S3, RDS that can be used to deploy and scale a WordPress site. It explains different scaling approaches like vertical scaling by adding more resources, horizontal scaling by adding more machines, and global scaling across availability zones. An enhanced WordPress architecture using EC2 for the frontend and logic layers, RDS for the database, and S3 for file storage is proposed. Core and additional AWS services for development, operations, security and more that can help scale WordPress are also outlined.

Sas 2015 event_drivenSascha Möllering

This document summarizes an event-driven architecture presentation using Java. It discusses using Apache Kafka/Amazon Kinesis for messaging, Docker for containerization, Vert.x for reactive applications, Apache Camel/AWS Lambda for integration, and Google Protocol Buffers for data serialization. It covers infrastructure components, software frameworks, local and AWS deployment, and integration testing between Kinesis and Kafka. The presentation provides resources for code samples and Docker images discussed.

Beyond Heroku: Hosting Your Rails App Yourselfstcarpenter

This document discusses hosting a Rails application yourself as an alternative to Heroku. It recommends using Unicorn as the application server, nginx as a reverse proxy, and deploying with Capistrano. Affordable hosting options mentioned include Amazon, Windows Azure, Digital Ocean, and Linode. Configuration management software and the features of Unicorn, nginx, and Capistrano are also outlined.

Tech Week London 2017Runa Roy

Expedia runs hundreds of applications in production using Amazon EC2 Container Service (ECS). They use ECS to manage container clusters at scale across 5 regions and 20 VPCs. Expedia developed an internal cloud deployment tool called Primer that supports templates for common application types and integrates with Jenkins for continuous delivery of containers to ECS. They also automated the creation of ECS clusters using custom Ruby tooling and CloudFormation templates.

Migrating to awsIT Expert Club

Migrating enterprise workloads to AWSTom Laszewski

This document provides an overview of migrating applications and workloads to AWS. It discusses key considerations for different migration approaches including "forklift", "embrace", and "optimize". It also covers important AWS services and best practices for architecture design, high availability, disaster recovery, security, storage, databases, auto-scaling, and cost optimization. Real-world customer examples of migration lessons and benefits are also presented.

Cost Effectively Run Multiple Oracle Database Copies at Scale NetApp

Using JCache to speed up your appsVassilis Bekiaris

FOSS4G In The Cloud: Using Open Source to build Cloud based Spatial Infrastru...Mohamed Sayed

Journey Towards Scaling Your Application to Million UsersAdrian Hornsby

The document discusses the steps and services needed to scale an application from initial development to supporting 10 million users on AWS. It recommends starting with high quality code, version control, CI/CD pipelines, and infrastructure as code from day one. As the application scales to support more users, it recommends adding services like S3 for static assets, Route53 for DNS, CloudFront for caching, auto scaling groups, database read replicas and sharding, asynchronous processing with SQS, event-driven architecture using Lambda, and microservices. The goal is to build operational excellence and architect the application for availability, redundancy, and scale from the start.

從劍宗到氣宗－談AWS ECS與Serverless最佳實踐Pahud Hsieh

This document summarizes a presentation about best practices for AWS ECS and serverless architectures. It discusses the challenges of traditional infrastructures and benefits of containerization. It provides an overview of AWS ECS for container management and auto-scaling capabilities. It also introduces AWS Lambda and API Gateway for building serverless applications, including their advantages of being cloud-native and cost-effective with minimal infrastructure to manage. Some limitations of serverless architectures are also outlined. The conclusion encourages embracing immutable infrastructure, event-driven computing, and focusing on business logic over infrastructure when possible.

Dean Bryen: Scaling The Platform For Your Startuphuguk

More Related Content

What's hot (14)

Getting started with Laravel & ElasticsearchPeter Steenbergen

TerraformOtto Jongerius

Laravel and SOLRPeter Steenbergen

Infrastructure as code (iac) - Terraform for AWSJohanes Glenn

DevOpsCon Cloud Workshop Sascha Möllering

Cloudsolutionday 2016: DevOps workflow with Docker on AWSAWS Vietnam Community

Meetup #3: Migrate a fast scale system to AWSAWS Vietnam Community

Campus days Azure HDInsight automationKenneth Michael Nielsen

Atlantisで実現するTerraformのGitOps理弘山崎

AWS re:Invent 2016 Fast ForwardShuen-Huei Guan

Scaling WordPress - WP on AWSstk_jj

Sas 2015 event_drivenSascha Möllering

Beyond Heroku: Hosting Your Rails App Yourselfstcarpenter

Tech Week London 2017Runa Roy

Getting started with Laravel & ElasticsearchPeter Steenbergen

TerraformOtto Jongerius

Laravel and SOLRPeter Steenbergen

Infrastructure as code (iac) - Terraform for AWSJohanes Glenn

DevOpsCon Cloud Workshop Sascha Möllering

Cloudsolutionday 2016: DevOps workflow with Docker on AWSAWS Vietnam Community

Meetup #3: Migrate a fast scale system to AWSAWS Vietnam Community

Campus days Azure HDInsight automationKenneth Michael Nielsen

Atlantisで実現するTerraformのGitOps理弘山崎

AWS re:Invent 2016 Fast ForwardShuen-Huei Guan

Scaling WordPress - WP on AWSstk_jj

Sas 2015 event_drivenSascha Möllering

Beyond Heroku: Hosting Your Rails App Yourselfstcarpenter

Tech Week London 2017Runa Roy

Similar to Lessons Learnt from Guanyu (20)

Migrating to awsIT Expert Club

Migrating enterprise workloads to AWSTom Laszewski

Cost Effectively Run Multiple Oracle Database Copies at Scale NetApp

Using JCache to speed up your appsVassilis Bekiaris

FOSS4G In The Cloud: Using Open Source to build Cloud based Spatial Infrastru...Mohamed Sayed

Journey Towards Scaling Your Application to Million UsersAdrian Hornsby

從劍宗到氣宗－談AWS ECS與Serverless最佳實踐Pahud Hsieh

Dean Bryen: Scaling The Platform For Your Startuphuguk

Ceph Goes on Online at Qihoo 360 - Xuehan XuCeph Community

The document summarizes Qihoo 360's experience deploying Ceph for storage at scale. They use Ceph RBD for virtual machine images and CephFS for a shared file system. For Ceph RBD, they have over 500 nodes across 30+ clusters storing over 1000 object storage devices. They use both full SSD and hybrid SSD/HDD clusters depending on performance needs. Their experience highlights best practices for deployment, performance, stability and operations. For CephFS, they evaluated metadata performance and discussed considerations for a production deployment.

NLUUG print conference May 26 2016Igmar Palsenberg

[OpenInfra Days Korea 2018] Day 2 - E5-1: "Invited Talk: Kubicorn - Building ...OpenStack Korea Community

This document summarizes Seungkyu Ahn's experience working with various technologies over time including transitioning from JSP/Servlet to Spring and Hibernate, CVS to Git, Ant to Maven, and Waterfall to Agile methodologies. It also lists technologies he has worked with like OpenStack, Linux, Docker, Kubernetes, and is currently learning like Deep Learning, Spring Boot, and mobile development. It provides configuration details for installing a Kubernetes cluster using Kubespray including specifying host files, roles, and cluster configuration with options like Calico networking, Kubernetes version, and enabling/disabling addons.

Openstackoverview-DEC2013Michael Lessard

This document provides an introduction to OpenStack, including: - What OpenStack is and its key architectural components like Nova, Swift, Glance, Neutron, Cinder, and Horizon. - OpenStack's upstream development process and largest contributors. - Red Hat's involvement in OpenStack including the RDO community distribution and Red Hat Enterprise Linux OpenStack Platform. - Examples of OpenStack deployments at large scale like CERN and its use cases for both traditional and cloud native workloads.

16 months @ SoundCloudTobias Schmidt

SoundCloud is a social sound platform with 15 million users that allows users to record, upload, share and listen to sound. It has 133 employees across 6 locations working on 21 teams including engineering, product, and community. The engineering team uses technologies like Ruby on Rails, MySQL, Cassandra, Hadoop and works on the client apps, API, discovery, and analytics. The speaker's roles at SoundCloud included app engineer, service architect, fixing issues, and now site reliability engineer where they work on tools and infrastructure improvements.

Project RedDwarf - Database Services in the Cloud.pptxOpenStack Foundation

This document discusses Project RedDwarf, an OpenStack project that provides managed MySQL database services. It originated in 2011 at Rackspace and HP to build value-added services on top of OpenStack. RedDwarf uses Nova for provisioning and other OpenStack components. It provides a public API for managing MySQL instances and is used in production at both Rackspace and HP Cloud. Future plans include additional integration with OpenStack and language bindings.

Greetings from AWS User Group TaiwanCliff Chao-kuan Lu

Moving to the Cloud: AWS, Zend, RightScalemmoline

This document discusses moving a web application to Amazon Web Services (AWS) and managing it with RightScale. It outlines the challenges of the previous single-server deployment, including lack of scalability and single point of failure. The solution presented uses AWS services like EC2, S3, EBS and RDS combined with RightScale for management and Zend Server for the application architecture. This provides auto-scaling, high availability, backups and easier management compared to the previous setup. Alternatives to AWS and RightScale are also briefly discussed.

OpenStack 101 - All Things Open 2015Mark Voelker

[Presented at All Things Open 2015 in Raleigh, NC, USA] OpenStack is one of the fastest-growing and exciting open source projects of our time. OpenStack has drawn together technologists from all over the world to create a cloud operating system and a huge, diverse community behind it. This talk will provide an introduction to OpenStack for newcomers to the project of those who just want to know more. We’ll take a brief look at OpenStack’s history, get a technical overview of the project, learn how to contribute, and check out a few emerging trends and hot topics in the OpenStack world.

OpenStack 101All Things Open

The Netflix Open Source PlatformRuslan Meshenberg

SV Forum Platform Architecture SIG - Netflix Open Source PlatformAdrian Cockcroft

Migrating to awsIT Expert Club

Migrating enterprise workloads to AWSTom Laszewski

Cost Effectively Run Multiple Oracle Database Copies at Scale NetApp

Using JCache to speed up your appsVassilis Bekiaris

FOSS4G In The Cloud: Using Open Source to build Cloud based Spatial Infrastru...Mohamed Sayed

Journey Towards Scaling Your Application to Million UsersAdrian Hornsby

從劍宗到氣宗－談AWS ECS與Serverless最佳實踐Pahud Hsieh

Dean Bryen: Scaling The Platform For Your Startuphuguk

Ceph Goes on Online at Qihoo 360 - Xuehan XuCeph Community

NLUUG print conference May 26 2016Igmar Palsenberg

[OpenInfra Days Korea 2018] Day 2 - E5-1: "Invited Talk: Kubicorn - Building ...OpenStack Korea Community

Openstackoverview-DEC2013Michael Lessard

16 months @ SoundCloudTobias Schmidt

Project RedDwarf - Database Services in the Cloud.pptxOpenStack Foundation

Greetings from AWS User Group TaiwanCliff Chao-kuan Lu

Moving to the Cloud: AWS, Zend, RightScalemmoline

OpenStack 101 - All Things Open 2015Mark Voelker

OpenStack 101All Things Open

The Netflix Open Source PlatformRuslan Meshenberg

SV Forum Platform Architecture SIG - Netflix Open Source PlatformAdrian Cockcroft

More from Cliff Chao-kuan Lu (13)

EC2 Spot in 104Cliff Chao-kuan Lu

Serverless 網站監控Cliff Chao-kuan Lu

Serverless PatternsCliff Chao-kuan Lu

104 meets cloudCliff Chao-kuan Lu

Intro to ServerlessCliff Chao-kuan Lu

Interview Quiz w/o ServerCliff Chao-kuan Lu

那些 re:Invent 不怎麼技術的事Cliff Chao-kuan Lu

Cost Optimization Best Practices from Trend Micro Cliff Chao-kuan Lu

不談 IAMCliff Chao-kuan Lu

Networking in the cloudCliff Chao-kuan Lu

This document discusses networking in the AWS cloud. It covers VPC components like security groups, network ACLs, route tables and how they control traffic and routing. It also discusses connectivity options between on-premises networks and VPCs like Direct Connect, VPN connections and VPC peering. The document provides examples of routing and networking tricks that can be used with EC2 instances and VPC configurations.

Health, Platform, In The CloudCliff Chao-kuan Lu

**DRAFT** A short presentation I made to introduce essentials and potentials a electronic company have, in order to enter online healthcare platform industry. It's made for `friends to a friend`, and I don't expect it to be self-contained. Due to the absence of explanatory memo, I'd suggest an email confirmation prior to citation, so that I am not mistakenly addressed for. However, it's not an obligation, since the presentation (including draft) is released under CC-BY. Feel free to send me feedback, suggestion or PR.

AWS Solutions Architect 準備心得Cliff Chao-kuan Lu

無障礙網頁Cliff Chao-kuan Lu

EC2 Spot in 104Cliff Chao-kuan Lu

Serverless 網站監控Cliff Chao-kuan Lu

Serverless PatternsCliff Chao-kuan Lu

104 meets cloudCliff Chao-kuan Lu

Intro to ServerlessCliff Chao-kuan Lu

Interview Quiz w/o ServerCliff Chao-kuan Lu

那些 re:Invent 不怎麼技術的事Cliff Chao-kuan Lu

Cost Optimization Best Practices from Trend Micro Cliff Chao-kuan Lu

不談 IAMCliff Chao-kuan Lu

Networking in the cloudCliff Chao-kuan Lu

Health, Platform, In The CloudCliff Chao-kuan Lu

AWS Solutions Architect 準備心得Cliff Chao-kuan Lu

無障礙網頁Cliff Chao-kuan Lu

Recently uploaded (20)

AI and Data Privacy in 2025: Global TrendsInData Labs

In this infographic, we explore how businesses can implement effective governance frameworks to address AI data privacy. Understanding it is crucial for developing effective strategies that ensure compliance, safeguard customer trust, and leverage AI responsibly. Equip yourself with insights that can drive informed decision-making and position your organization for success in the future of data privacy. This infographic contains: -AI and data privacy: Key findings -Statistics on AI data privacy in the today’s world -Tips on how to overcome data privacy challenges -Benefits of AI data security investments. Keep up-to-date on how AI is reshaping privacy standards and what this entails for both individuals and organizations.

TrsLabs - Fintech Product & Business ConsultingTrs Labs

Hybrid Growth Mandate Model with TrsLabs Strategic Investments, Inorganic Growth, Business Model Pivoting are critical activities that business don't do/change everyday. In cases like this, it may benefit your business to choose a temporary external consultant. An unbiased plan driven by clearcut deliverables, market dynamics and without the influence of your internal office equations empower business leaders to make right choices. Getting things done within a budget within a timeframe is key to Growing Business - No matter whether you are a start-up or a big company Talk to us & Unlock the competitive advantage

Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.

AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB

I started my online journey with several hosting services before stumbling upon Ai EngineHost. At first, the idea of paying one fee and getting lifetime access seemed too good to pass up. The platform is built on reliable US-based servers, ensuring your projects run at high speeds and remain safe. Let me take you step by step through its benefits and features as I explain why this hosting solution is a perfect fit for digital entrepreneurs.

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark? At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍 Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

Build Your Own Copilot & Agents For DevsBrian McKeiver

Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul

Artificial intelligence is changing how businesses operate. Companies are using AI agents to automate tasks, reduce time spent on repetitive work, and focus more on high-value activities. Noah Loul, an AI strategist and entrepreneur, has helped dozens of companies streamline their operations using smart automation. He believes AI agents aren't just tools—they're workers that take on repeatable tasks so your human team can focus on what matters. If you want to reduce time waste and increase output, AI agents are the next move.

Greenhouse_Monitoring_Presentation.pptx.hpbmnnxrvb

How Can I use the AI Hype in my Business Context?Daniel Lehner

𝙄𝙨 𝘼𝙄 𝙟𝙪𝙨𝙩 𝙝𝙮𝙥𝙚? 𝙊𝙧 𝙞𝙨 𝙞𝙩 𝙩𝙝𝙚 𝙜𝙖𝙢𝙚 𝙘𝙝𝙖𝙣𝙜𝙚𝙧 𝙮𝙤𝙪𝙧 𝙗𝙪𝙨𝙞𝙣𝙚𝙨𝙨 𝙣𝙚𝙚𝙙𝙨? Everyone’s talking about AI but is anyone really using it to create real value? Most companies want to leverage AI. Few know 𝗵𝗼𝘄. ✅ What exactly should you ask to find real AI opportunities? ✅ Which AI techniques actually fit your business? ✅ Is your data even ready for AI? If you’re not sure, you’re not alone. This is a condensed version of the slides I presented at a Linkedin webinar for Tecnovy on 28.04.2025.

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including: -Artificial Intelligence Market Overview -Strategies for AI Adoption in 2025 -Anticipated drivers of AI adoption and transformative technologies -Benefits of AI and Big data for your business -Tips on how to prepare your business for innovation -AI and data privacy: Strategies for securing data privacy in AI models, etc. Download your free copy nowand implement the key findings to improve your business.

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, presentation slides, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

Mobile App Development Company in Saudi ArabiaSteve Jonas

EmizenTech is a globally recognized software development company, proudly serving businesses since 2013. With over 11+ years of industry experience and a team of 200+ skilled professionals, we have successfully delivered 1200+ projects across various sectors. As a leading Mobile App Development Company In Saudi Arabia we offer end-to-end solutions for iOS, Android, and cross-platform applications. Our apps are known for their user-friendly interfaces, scalability, high performance, and strong security features. We tailor each mobile application to meet the unique needs of different industries, ensuring a seamless user experience. EmizenTech is committed to turning your vision into a powerful digital product that drives growth, innovation, and long-term success in the competitive mobile landscape of Saudi Arabia.

AI and Data Privacy in 2025: Global TrendsInData Labs

TrsLabs - Fintech Product & Business ConsultingTrs Labs

Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

Build Your Own Copilot & Agents For DevsBrian McKeiver

Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul

Greenhouse_Monitoring_Presentation.pptx.hpbmnnxrvb

How Can I use the AI Hype in my Business Context?Daniel Lehner

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

Mobile App Development Company in Saudi ArabiaSteve Jonas

Lessons Learnt from Guanyu

1. Lessons learnt from Guanyu -- ECS, Autoscaling, and Architecture Cliff Chao-kuan Lu 呂昭寬 AWSUGTW <[email protected]> Image by NASA JPL via Space Images

2. Agenda • Cliff • Guanyu • Future

3. Cliff Chao-kuan Lu 呂昭寬 • Sr. Architect @ 104 Corp., #1 Job Bank in Taiwan • Organizer to AWS User Group Taiwan • AWS Community Hero • Certified ALL-5 + Big Data

4. Guanyu • Home-made security service on top of Sophos AV and AWS ECS • 6-9M scans per month at $100-200 • Developed June-August 2016

5. Architecture POST /scan/file ALB ECS Response Handler ParserSophos AV Cache DynamoDB

6. Architecture POST /scan/uri ALB ECS Response Fetch Cleanup DynamoDB Han dler Pa rs er Sop hos AV Cache

7. Architecture POST /scan/text ALB ECS Response DynamoDB Fet ch Clea nup H a n dl e r P a r s e r So ph os A V Cache ScanUri

8. Architecture, In Short • Node.js web project + Sophos-AV in 1 image •Monolithic

9. Container Footprint • At rest • CPU: Minimal • Memory: ~30mb • Scanning • CPU: ~50% (single core) • Memory: ~300mb • Default: 4 parallel scans • Cache Hit • CPU: Minimal • Memory: ~30mb

10. Auto Scaling, Ideally

11. Auto Scaling, NOT Ideal ?

12. Dilemma - Resource Availability • Starting EC2 instances takes time • Buffer with %Unreserved • Upper bound to %Reserved

13. Taking Spot Instance into Play • Takes longer to instantiate • Not always available • Lower price • Targets 50% reserved • Dual ASG (Spot + On- Demand)

14. Dilemma - Allocation / Utilization

15. Gotcha: Overshoot • Longer boot-up time means more buffer required • Metrics reflects PAST status • Grew to 17 when we needed 4 • Tuning complex scaling policies is an Art

16. Yeah, Art

17. Planned Scan Engines • Malware • Sophos AV • BinaryAlert https://www.binaryalert.io/ • Inappropriate Images • AWS Rekognition • OpenNSFW https://github.com/yahoo/open_nsfw

18. Proposed Architecture POST /scan/* ALB ECS Response Handler Cache DynamoDB SNSSQS ParserSophos AV ParserOpenNSFW Lambda

19. Advantages • Uniform workloads is easier to manage • Synchronous -> Asynchronous • Allows higher %Reserved • Do more, cost less

20. Better Late than Never

21. Take Home Message • Spot instance offers great performance per dollar • Mind the platform gap • Never too late to refactor • Keep an eye on Auto Scaling • Balance availability, cost, and performance

22. QUESTIONS

23. Thank You SEE YOU NEXT YEAR!

Editor's Notes

#5: Developed in ‘16 in response to security event that exploited us as vector
#15: Reserve according to the worst. Allocate less, and you’re at risk. Reservation targeted at 30-50%, utilization ~ 1-10%.

Lessons Learnt from Guanyu

Recommended

More Related Content

What's hot (14)

Similar to Lessons Learnt from Guanyu (20)

More from Cliff Chao-kuan Lu (13)

Recently uploaded (20)

Lessons Learnt from Guanyu

Editor's Notes