Distributed Caching in Kubernetes with Hazelcast

@mesutcelik
Distributed Caching Patterns
in Kubernetes
Mesut Celik,Hazelcast

@mesutcelik
Mesut Celik
● Tech Lead @Hazelcast
● Java Developer
● lived in Turkey,Belgium,US
● Twitter: @mesutcelik

@mesutcelik
Agenda
● Hazelcast Introduction
● Caching Patterns
● Kubernetes Deployments
● Day 2 Operations

@mesutcelik
Hazelcast Products
● Hazelcast IMDG
● Hazelcast Jet
● Hazelcast Cloud
● Management Center
Hazelcast is an Open Source
Company
● Apache 2 License
● Remote friendly
● raised $21M series C
● Always hiring!!!!

@mesutcelik
Why Distributed Cache?
● Cache, Memory is faster than storage
● Distributed,Natural fit for Cloud-Native Deployments

@mesutcelik
Cache-aside
Application
DB
Cache
Application
DB
Cache
Read-through, Write-through, Write-behind
Caching Patterns
Cache-as-SoR

@mesutcelik
Read-Through Cache

@mesutcelik
Read-Through Cache 1,MinskPartition_34
1,MinskBackup_34

@mesutcelik
Hazelcast and Kubernetes
Caching Patterns

@mesutcelik
Distributed Caching Patterns in Kubernetes
● Embedded
● Sidecar
● Proxy Cache
● Client-Server

@mesutcelik
POD
Spring Boot Microservice
Hazelcast
Member
POD
Hazelcast ClusterKubernetesService
Http Request
Embedded
Hazelcast
Member
Kubernetes Cluster

@mesutcelik
Embedded
● Simple
● Java only
● Data co-located with Microservice JVM

@mesutcelik
Python
Microservice
POD
Hazelcast
Member
Python
Microservice
POD
Hazelcast
Member
Http Request
SideCar Kubernetes Cluster
hazelcast-client
hazelcast-client

@mesutcelik
Sidecar
● Simple
● Multiple Programming Languages
○ Java, Node.js, .NET, Python, Golang
● Data co-located with Microservice POD

hazelcast-proxy
sidecar
POD
Spring Boot
Application
POD
Spring Boot
Application
Http Request
Http reverse
proxy caching
Hazelcast
Member
hazelcast-proxy
sidecar
Hazelcast
Member
Kubernetes Cluster

Http reverse proxy caching
● Injecting Cache into every microservice
● No coupling with any Cache API
● Enabled w/o code change

@mesutcelik
POD
hazelcast-java-client
Http Request
Client Server
POD
Hazelcast
Member
POD
Hazelcast
Member
Kubernetes Cluster
POD
hazelcast-java-client
POD
ASP.NET Core
Microservice
hazelcast-dotnet-client
KubernetesService
Http Request

@mesutcelik
POD
KubernetesService
Http Request
Hazelcast Cloud
POD
cloud.hazelcast.com
Hazelcast Cluster
Kubernetes Cluster
Spring Boot
Application
hazelcast-client
Spring Boot
Application
hazelcast-client

@mesutcelik
Client Server
● CaaS - Cache as a Service
● Multiple Programming Languages
○ Java, nodejs, .NET, Python, Golang
● Separate Microservice and Hazelcast Layers

@mesutcelik
Spring Boot - Hazelcast Embedded Config
@Bean
public Config hazelcastConfig() {
Config config = new Config();
JoinConfig joinConfig = config.getNetworkConfig().getJoin();
joinConfig.getMulticastConfig().setEnabled(false);
joinConfig.getKubernetesConfig().setEnabled(true);
return config;
}

@mesutcelik
Spring Boot - Hazelcast Client Config
@Bean
public ClientConfig hazelcastConfig() {
ClientConfig config = new ClientConfig();
config.getNetworkConfig().getKubernetesConfig().setEnabled(true);
return config;
}

@mesutcelik
Hazelcast Cache Put and Get Operations
@Autowired
HazelcastInstance hazelcast;
Map<String, String> cities = hazelcast.getMap("cities");
cities.put("1","Minsk");
System.out.println("Best City in the world is " + cities.get("1"));

@mesutcelik
Kubernetes Deployment Options
For Hazelcast

@mesutcelik
Hazelcast Helm Chart
$ helm install stable/hazelcast

@mesutcelik
Hazelcast Kubernetes Operator
● OperatorHub.io
● Openshift 4 Operator Catalog
● IBM Cloud Private

@mesutcelik
Hazelcast Cloud
● Managed Service
● Pay as you go model
● https://cloud.hazelcast.com

@mesutcelik
Deployment Best Practices

@mesutcelik
Predictable Resource Allocation
● Calculate CPU/Memory Requirements
● Set Resource Request and Limits as the same value

@mesutcelik
Pod Anti-Affinity
● Hazelcast per K8S Node
● Large Kubernetes Clusters
● Safer in Node crushes

@mesutcelik
Multi-zone Deployment with ZONE_AWARE
hazelcast-member -1
hazelcast-member -2
hazelcast-member -3
Availability-Zone-A
hazelcast-member -4
hazelcast-member -5
hazelcast-member -6
Availability-Zone-B
Multi-zone Hazelcast Cluster
* Multi-zone if your architecture prefers availability over performance

@mesutcelik
Scaling Hazelcast Cluster
● Manual Scaling (kubectl scale or helm upgrade)
● Horizontal Pod Autoscaler (HPA)
● Vertical Pod Autoscaler
● Cluster Autoscaler

@mesutcelik
Rolling Upgrade - Why?
● Hazelcast Version Update
● Config Change
● Adding Jar to the classpath

@mesutcelik
Rolling Upgrade - How?
● helm upgrade (--set image.tag)
● kubectl set image
● StatefulSet
● Deployment with RollingUpdateStrategy
● Enable Graceful Shutdown
● Optimized Grace Period

@mesutcelik
Monitoring
● Hazelcast Management Center
● Metrics via Prometheus
● Alerting

@mesutcelik
Thank you!
● https://twitter.com/mesutcelik
● https://github.com/mesutcelik
● https://www.linkedin.com/in/mesutcelik/

Distributed Caching in Kubernetes with Hazelcast

Recommended

More Related Content

What's hot (20)

Similar to Distributed Caching in Kubernetes with Hazelcast (20)

Recently uploaded (20)

Distributed Caching in Kubernetes with Hazelcast