SlideShare a Scribd company logo
Autoscaling in Kubernetes (K8s)
Autoscaling – Challenges & Advantages
• Why?
• Traditional autoscaling in cloud
• Challenges with this approach
• Autoscaling in K8s
• Advantages of this approach -
• Auto-scales and provides results quicker
• Platform independent, HPA is a core component of any K8s distribution
and will work out of the box without any changes to code
Architecture
Architecture under idle load
Architecture under heavy load
For testing purposes, we set autoscaling to increase application pod replicas
when they cross over 50% of their allotted CPU usage. We have a minimum replica
count of 1, and a maximum of 3.
Scenario 1: Idle load
• Number of users: 100
• Requests per user: 10
• Ramp up time: 10s
A total of 1000 requests,
by 100 users, within 10 seconds
Test Scenarios
Scenario 2: Heavy load
• Number of users: 1000
• Requests per user: 10
• Ramp up time: 10s
A total of 10000 requests, by 100 users,
within 10 seconds
Demo
THANK YOU FOR ATTENDING THE WEBINAR

More Related Content

Similar to Autoscaling in Kubernetes (K8s) (20)

PDF
Configurable horizontal pod autoscaler
Paul Guth
 
PPTX
NDC London 2021 - Application Autoscaling Made Easy With Kubernetes Event-Dri...
Tom Kerkhove
 
PPTX
How we Auto Scale applications based on CPU with Kubernetes at M6Web?
Vincent Gallissot
 
PDF
AWS Summit Singapore 2019 | Autoscaling Your Kubernetes Workloads
AWS Summits
 
PDF
apidays LIVE New York 2021 - Service reliability through autoscaling workload...
apidays
 
PPTX
Application Autoscaling Made Easy with Kubernetes Event-Driven Autoscaling (K...
Codit
 
PDF
Kubernetes: Beyond Baby Steps
DigitalOcean
 
PDF
Driving Service Reliability Through Autoscaling Workloads on OpenShift
DevOps.com
 
PPTX
AZUG Lightning Talk - Application autoscaling on Kubernetes with Kubernetes E...
Tom Kerkhove
 
PPTX
Global Azure Virtual - Application Autoscaling with KEDA
Tom Kerkhove
 
PDF
Autoscaling Stateful Workloads in Kubernetes
DoKC
 
PDF
Kubernetes Autoscaling ​ & Cloud Native Solutions
KasunRathnayaka10
 
PPTX
Why and how to use Kubernetes for scaling of your multi-tier (n-tier) appli...
Ashnikbiz
 
PDF
Triple 20 IT – How to reduce costs on target while increasing speed and quality
StormForge .io
 
PDF
kubernetes_largescale_system_design_optimization
RaviShankar KS
 
PDF
Event-driven autoscaling through KEDA and Knative Integration | DevNation Tec...
Red Hat Developers
 
PPTX
KEDA Sacle to Zero - Serverless Meetup Nov 2024.pptx
ssuserd4e0d2
 
PPTX
Kubernetes Cairo Meetup_dec_2019
Ahmed Atef
 
PDF
Adaptive Scaling of Microgateways on Kubernetes
WSO2
 
PDF
Intelligent Auto-scaling of Kafka Consumers with Workload Prediction | Ming S...
HostedbyConfluent
 
Configurable horizontal pod autoscaler
Paul Guth
 
NDC London 2021 - Application Autoscaling Made Easy With Kubernetes Event-Dri...
Tom Kerkhove
 
How we Auto Scale applications based on CPU with Kubernetes at M6Web?
Vincent Gallissot
 
AWS Summit Singapore 2019 | Autoscaling Your Kubernetes Workloads
AWS Summits
 
apidays LIVE New York 2021 - Service reliability through autoscaling workload...
apidays
 
Application Autoscaling Made Easy with Kubernetes Event-Driven Autoscaling (K...
Codit
 
Kubernetes: Beyond Baby Steps
DigitalOcean
 
Driving Service Reliability Through Autoscaling Workloads on OpenShift
DevOps.com
 
AZUG Lightning Talk - Application autoscaling on Kubernetes with Kubernetes E...
Tom Kerkhove
 
Global Azure Virtual - Application Autoscaling with KEDA
Tom Kerkhove
 
Autoscaling Stateful Workloads in Kubernetes
DoKC
 
Kubernetes Autoscaling ​ & Cloud Native Solutions
KasunRathnayaka10
 
Why and how to use Kubernetes for scaling of your multi-tier (n-tier) appli...
Ashnikbiz
 
Triple 20 IT – How to reduce costs on target while increasing speed and quality
StormForge .io
 
kubernetes_largescale_system_design_optimization
RaviShankar KS
 
Event-driven autoscaling through KEDA and Knative Integration | DevNation Tec...
Red Hat Developers
 
KEDA Sacle to Zero - Serverless Meetup Nov 2024.pptx
ssuserd4e0d2
 
Kubernetes Cairo Meetup_dec_2019
Ahmed Atef
 
Adaptive Scaling of Microgateways on Kubernetes
WSO2
 
Intelligent Auto-scaling of Kafka Consumers with Workload Prediction | Ming S...
HostedbyConfluent
 

More from Ashnikbiz (20)

PPTX
CloudOps_tool.pptx
Ashnikbiz
 
PPTX
Webinar_CloudOps final.pptx
Ashnikbiz
 
PDF
Zero trust in a multi tenant environment
Ashnikbiz
 
PPTX
Deploy and automate ‘Secrets Management’ for a multi-cloud environment
Ashnikbiz
 
PPTX
Deploy, move and manage Postgres across cloud platforms
Ashnikbiz
 
PPTX
Deploy, move and manage Postgres across cloud platforms
Ashnikbiz
 
PPTX
The Best Approach For Multi-cloud Infrastructure Provisioning-2
Ashnikbiz
 
PPTX
The Best Approach For Multi-cloud Infrastructure Provisioning
Ashnikbiz
 
PPTX
Which PostgreSQL is right for your multi cloud strategy? P2
Ashnikbiz
 
PPTX
Which PostgreSQL is right for your multi cloud strategy? P1
Ashnikbiz
 
PPTX
Reduce the complexities of managing Kubernetes clusters anywhere 2
Ashnikbiz
 
PPTX
Reduce the complexities of managing Kubernetes clusters anywhere
Ashnikbiz
 
PPTX
Enhance your multi-cloud application performance using Redis Enterprise P2
Ashnikbiz
 
PPTX
Enhance your multi-cloud application performance using Redis Enterprise P1
Ashnikbiz
 
PPTX
Gain multi-cloud versatility with software load balancing designed for cloud-...
Ashnikbiz
 
PPTX
Gain multi-cloud versatility with software load balancing designed for cloud-...
Ashnikbiz
 
PPTX
Enterprise-class security with PostgreSQL - 1
Ashnikbiz
 
PPTX
Enterprise-class security with PostgreSQL - 2
Ashnikbiz
 
PPTX
Securing Your CI Pipeline with HashiCorp Vault - P2
Ashnikbiz
 
PDF
Build robust streaming data pipelines with MongoDB and Kafka P2
Ashnikbiz
 
CloudOps_tool.pptx
Ashnikbiz
 
Webinar_CloudOps final.pptx
Ashnikbiz
 
Zero trust in a multi tenant environment
Ashnikbiz
 
Deploy and automate ‘Secrets Management’ for a multi-cloud environment
Ashnikbiz
 
Deploy, move and manage Postgres across cloud platforms
Ashnikbiz
 
Deploy, move and manage Postgres across cloud platforms
Ashnikbiz
 
The Best Approach For Multi-cloud Infrastructure Provisioning-2
Ashnikbiz
 
The Best Approach For Multi-cloud Infrastructure Provisioning
Ashnikbiz
 
Which PostgreSQL is right for your multi cloud strategy? P2
Ashnikbiz
 
Which PostgreSQL is right for your multi cloud strategy? P1
Ashnikbiz
 
Reduce the complexities of managing Kubernetes clusters anywhere 2
Ashnikbiz
 
Reduce the complexities of managing Kubernetes clusters anywhere
Ashnikbiz
 
Enhance your multi-cloud application performance using Redis Enterprise P2
Ashnikbiz
 
Enhance your multi-cloud application performance using Redis Enterprise P1
Ashnikbiz
 
Gain multi-cloud versatility with software load balancing designed for cloud-...
Ashnikbiz
 
Gain multi-cloud versatility with software load balancing designed for cloud-...
Ashnikbiz
 
Enterprise-class security with PostgreSQL - 1
Ashnikbiz
 
Enterprise-class security with PostgreSQL - 2
Ashnikbiz
 
Securing Your CI Pipeline with HashiCorp Vault - P2
Ashnikbiz
 
Build robust streaming data pipelines with MongoDB and Kafka P2
Ashnikbiz
 
Ad

Recently uploaded (20)

PPTX
AI Penetration Testing Essentials: A Cybersecurity Guide for 2025
defencerabbit Team
 
PDF
CIFDAQ Market Wrap for the week of 4th July 2025
CIFDAQ
 
PDF
The Rise of AI and IoT in Mobile App Tech.pdf
IMG Global Infotech
 
PPTX
"Autonomy of LLM Agents: Current State and Future Prospects", Oles` Petriv
Fwdays
 
PDF
NewMind AI - Journal 100 Insights After The 100th Issue
NewMind AI
 
PPTX
Q2 FY26 Tableau User Group Leader Quarterly Call
lward7
 
PDF
"AI Transformation: Directions and Challenges", Pavlo Shaternik
Fwdays
 
PDF
Newgen 2022-Forrester Newgen TEI_13 05 2022-The-Total-Economic-Impact-Newgen-...
darshakparmar
 
PDF
[Newgen] NewgenONE Marvin Brochure 1.pdf
darshakparmar
 
PPTX
WooCommerce Workshop: Bring Your Laptop
Laura Hartwig
 
PDF
Newgen Beyond Frankenstein_Build vs Buy_Digital_version.pdf
darshakparmar
 
PDF
CIFDAQ Market Insights for July 7th 2025
CIFDAQ
 
PDF
Bitcoin for Millennials podcast with Bram, Power Laws of Bitcoin
Stephen Perrenod
 
PDF
Achieving Consistent and Reliable AI Code Generation - Medusa AI
medusaaico
 
PDF
New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
PDF
Transcript: New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
PDF
How Startups Are Growing Faster with App Developers in Australia.pdf
India App Developer
 
PDF
Chris Elwell Woburn, MA - Passionate About IT Innovation
Chris Elwell Woburn, MA
 
PDF
LLMs.txt: Easily Control How AI Crawls Your Site
Keploy
 
PDF
Empower Inclusion Through Accessible Java Applications
Ana-Maria Mihalceanu
 
AI Penetration Testing Essentials: A Cybersecurity Guide for 2025
defencerabbit Team
 
CIFDAQ Market Wrap for the week of 4th July 2025
CIFDAQ
 
The Rise of AI and IoT in Mobile App Tech.pdf
IMG Global Infotech
 
"Autonomy of LLM Agents: Current State and Future Prospects", Oles` Petriv
Fwdays
 
NewMind AI - Journal 100 Insights After The 100th Issue
NewMind AI
 
Q2 FY26 Tableau User Group Leader Quarterly Call
lward7
 
"AI Transformation: Directions and Challenges", Pavlo Shaternik
Fwdays
 
Newgen 2022-Forrester Newgen TEI_13 05 2022-The-Total-Economic-Impact-Newgen-...
darshakparmar
 
[Newgen] NewgenONE Marvin Brochure 1.pdf
darshakparmar
 
WooCommerce Workshop: Bring Your Laptop
Laura Hartwig
 
Newgen Beyond Frankenstein_Build vs Buy_Digital_version.pdf
darshakparmar
 
CIFDAQ Market Insights for July 7th 2025
CIFDAQ
 
Bitcoin for Millennials podcast with Bram, Power Laws of Bitcoin
Stephen Perrenod
 
Achieving Consistent and Reliable AI Code Generation - Medusa AI
medusaaico
 
New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
Transcript: New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
How Startups Are Growing Faster with App Developers in Australia.pdf
India App Developer
 
Chris Elwell Woburn, MA - Passionate About IT Innovation
Chris Elwell Woburn, MA
 
LLMs.txt: Easily Control How AI Crawls Your Site
Keploy
 
Empower Inclusion Through Accessible Java Applications
Ana-Maria Mihalceanu
 
Ad

Autoscaling in Kubernetes (K8s)

  • 2. Autoscaling – Challenges & Advantages • Why? • Traditional autoscaling in cloud • Challenges with this approach • Autoscaling in K8s • Advantages of this approach - • Auto-scales and provides results quicker • Platform independent, HPA is a core component of any K8s distribution and will work out of the box without any changes to code
  • 6. For testing purposes, we set autoscaling to increase application pod replicas when they cross over 50% of their allotted CPU usage. We have a minimum replica count of 1, and a maximum of 3. Scenario 1: Idle load • Number of users: 100 • Requests per user: 10 • Ramp up time: 10s A total of 1000 requests, by 100 users, within 10 seconds Test Scenarios Scenario 2: Heavy load • Number of users: 1000 • Requests per user: 10 • Ramp up time: 10s A total of 10000 requests, by 100 users, within 10 seconds
  • 8. THANK YOU FOR ATTENDING THE WEBINAR