ORM and distributed caching

May 25, 20120 likes2,190 views

This document discusses ORM cache hierarchies and distributed caching. It describes two levels of caching - a session level cache and a query/entry cache level. It addresses consistency problems with caching and discusses solutions like using distributed locks or JTA transaction managers. It also proposes executing queries directly in the entity cache to avoid invalidation issues, and discusses writing data behind asynchronously to caches instead of synchronously to databases.

ORM and Distributed Caching

Alexey Ragozin
alexey.ragozin@gmail.com
May 2012

ORM cache hierarchy

Session
Level 1

Query cache Entry cache

Level 2

Database

ORM cache hierarchy

Session
POJO
Level 1

Query cache Entry cache
Sets of PK Entities
Level 2

Database

Second level cache

Query cache
 Query -> Result set (list of entry references)
Entity cache
 PK (entry reference) -> Entity data
Makes query cache useful
Helps with “N+1 select” problem
Actively used for lazy loading of entities

Consistency problem

Stale data in entity cache = big problem
Single process application
 Locking, to prevent concurrent updates
 Write through – modify DB and cache together
Distributed application
1. JTA transaction manager (add cache to Tx)
2. Use distributed locks for concurrency control

Solving Query Problem

Caching queries
 Exact query match may be infrequent
 Invalidation is messy

Why not execute quires in cache?
 Execute query in entity cache
 No invalidation problem
 Coherence, GemFire, Hazelcast has index support

Queries in Entity Cache

Pro
 DB is not involved in query processing
 Fallback to DB for complex quries
 Still using old good (or bad) JPQL

Cons
 ALL entities should be loaded in cache
 Only simple selects, no join queries are supported
 though link traversing works as usual

What is Next?

 Coherence cache is durable
 Why update DB synchronously?

Write behind for ORM
PRO

 reducing transaction execution time
 removing DB from critical path
CON

 Coherence does not honor transaction boundaries
 DB is out of sync, no way for execution complex JPQL

Few More Interesting Stuff

 Works with TopLink Grid
 Real transaction support
 Durability via distributed disk log
HIBERNATE OGM
 JPQL for NoSQL (data grid included)
 Lucene (Hibernate Search) support

Thank you
http://aragozin.blogspot.com

Alexey Ragozin
alexey.ragozin@gmail.com

This document summarizes a presentation about distributed caching technologies from key-value stores to in-memory data grids. It discusses the memory hierarchy and how software caches can improve performance by reducing data access latency and offloading storage. Different caching patterns like cache-aside, read-through, write-through and write-behind are explained. Popular caching products including Memcached, Redis, Cassandra and data grids are overviewed. Advanced concepts covered include data distribution, replication, consistency protocols and use cases.

Database backed coherence cachearagozin

The document discusses patterns and techniques for using Coherence cache with a database backend. It describes the benefits of using a read-write-backing map, which separates caching from database operations and allows write-behind for better performance. It also discusses challenges like slower database operations and ensuring data persistence. The document provides tips on using BinaryEntryStore as an alternative to CacheLoader/CacheStore, and when storeAll operations are called. It explains how to preload data and check for stored operations. Overall, it provides guidance on optimizing Coherence cache performance when backed by a database.

Distributed caching with java JCacheKasun Gajasinghe

MongoDB at eBayMongoDB

eBay has been using MongoDB to power several large scale applications due to its ability to scale horizontally and handle high volumes of data and queries. Some key applications summarized include search suggestions which handles high volume lookups, a cloud manager which tracks resource states, and a media metadata store which will store tens of terabytes of image data partitioned across multiple shards. MongoDB provides benefits like flexible schemas, automatic shard rebalancing, and proximity-aware replication which help eBay meet performance and scalability needs for these systems.

J2EE Performance And Scalability BpChris Adkin

Stability Patterns for Microservicespflueras

Distributed applications using HazelcastTaras Matyashovsky

Do you need to scale your application, share data across cluster, perform massive parallel processing on many JVMs or maybe consider alternative to your favorite NoSQL technology? Hazelcast to the rescue! With Hazelcast distributed development is much easier. This presentation will be useful to those who would like to get acquainted with Hazelcast top features and see some of them in action, e.g. how to cluster application, cache data in it, partition in-memory data, distribute workload onto many servers, take advantage of parallel processing, etc. Presented on JavaDay Kyiv 2014 conference.

Oracle rac cachefusion - High Availability Day 2015aioughydchapter

RAC Cache Fusion allows Oracle Real Application Clusters instances to share cached data in memory to avoid disk I/O and improve performance. Key aspects of Cache Fusion include global cache services coordinating cached data across instances, maintaining data consistency through modes and roles for cached blocks, and keeping past images of dirty blocks for recovery purposes. Cache blocks can be accessed locally or globally depending on their assigned role and mode.

Scalability, Availability & Stability PatternsJonas Bonér

This document provides an overview of patterns for scalability, availability, and stability in distributed systems. It discusses general recommendations like immutability and referential transparency. It covers scalability trade-offs around performance vs scalability, latency vs throughput, and availability vs consistency. It then describes various patterns for scalability including managing state through partitioning, caching, sharding databases, and using distributed caching. It also covers patterns for managing behavior through event-driven architecture, compute grids, load balancing, and parallel computing. Availability patterns like fail-over, replication, and fault tolerance are discussed. The document provides examples of popular technologies that implement many of these patterns.

1. beyond mission critical virtualizing big data and hadoopChiou-Nan Chen

Distributed Caching Essential Lessons (Ts 1402)Yury Kaliaha

Cameron Purdy, president of Tangosol, gave a presentation on distributed caching strategies. He discussed replicated, partitioned, and near caching topologies. Replicated caching provides extremely fast reads but limited scalability. Partitioned caching offers linear scalability as the cluster size increases but with a fixed read cost. Near caching combines local caching for fast access to hot data with a partitioned backend for full data scaling. Cache-through and cache-aside architectures were also covered.

Distributed Caching Using the JCACHE API and ehcache, Including a Case Study ...elliando dias

From cache to in-memory data grid. Introduction to Hazelcast.Taras Matyashovsky

MongoDB San Francisco 2013: Storing eBay's Media Metadata on MongoDB present...MongoDB

This session will be a case study of eBay’s experience running MongoDB for project Zoom, in which eBay stores all media metadata for the site. This includes references to pictures of every item for sale on eBay. This cluster is eBay's first MongoDB installation on the platform and is a mission critical application. Yuri Finkelstein, an Enterprise Architect on the team, will provide a technical overview of the project and its underlying architecture.

Scaling Out Tier Based ApplicationsYury Kaliaha

The document discusses scaling tier-based applications using Space Based Architecture (SBA). SBA uses a common data and processing grid to virtualize tiers, enabling applications to scale out processing across commodity hardware. This approach parallelizes transactions, reduces serialization overhead between tiers, and allows dynamic scalability through automated deployment of services on a grid. The session will provide examples of how financial and telecom applications achieve scalability using SBA.

An Elastic Metadata Store for eBay’s Media PlatformMongoDB

In order to build a robust, multi-tenant, highly available storage services that meet the business’ SLA your databases has to be sharded. But if your service has to scale continuously through the incremental additions of storage without service interruption or human intervention, basic static sharding is not enough. At eBay, we are building MStore to solve this problem, with MongoDB as the storage engine. In this presentation, we will dive into the key design concepts of this solution.

Thousands of Threads and Blocking I/OGeorge Cao

This document summarizes a talk about different server models using synchronous I/O (thread-per-connection) versus asynchronous I/O (NIO). The talk discusses the evolution of server designs from simple multithreaded models to NIO-based approaches. It presents arguments for both approaches but notes that benchmarks showed synchronous I/O to be faster than NIO in some cases, contradicting common beliefs. The talk aims to empirically compare the two approaches and debunk myths around multithreading and NIO performance.

New life inside monolithic applicationTaras Matyashovsky

This presentation will be useful to those who would like to get acquainted with lifetime history of successful monolithic Java application. It shows architectural and technical evolution of one Java web startup that is beyond daily coding routine and contains a lot of simplifications, Captain Obvious and internet memes. But this presentation is not intended for monolithic vs. micro services architectures comparison.

Web session replication with HazelcastEmrah Kocaman

The Google Chubby lock service for loosely-coupled distributed systemsRomain Jacotin

Architecture of a Next-Generation Parallel File System Great Wide Open

The document discusses the architecture of the next-generation parallel file system OrangeFS. OrangeFS distributes file data and metadata across multiple file servers and storage devices. It supports simultaneous access by multiple clients. Recent additions to OrangeFS include a scalable metadata operation protocol, support for SSD metadata storage, a Windows client, direct client access interface, client caching, WebDAV integration, and an S3 interface.

Architecture of the Upcoming OrangeFS v3 Distributed Parallel File SystemAll Things Open

OrangeFS is a parallel file system that provides distributed, shared-nothing metadata and data storage across multiple servers. It allows for high performance parallel I/O and a unified namespace. The document discusses OrangeFS's architecture, performance advantages, and areas for future improvement including enhanced availability, security, integrity checking, and administration. Upcoming versions will feature distributed primary object replication, geographic file replication, capability-based security, parallel background jobs for maintenance and verification, and improved metadata and scaling performance.

HTTP Session Replication with Oracle Coherence, GlassFish, WebLogicOracle

A Journey from Oracle to PostgreSQLEDB

The document describes a migration from an Oracle database topology to a PostgreSQL database topology at ACI. It discusses the starting Oracle topology with issues around operational complexity and non-ACID compliance. It then describes the target PostgreSQL topology with improved performance, availability and lower costs. The document outlines decisions around tools, extensions, code changes and testing approaches needed for the migration. It also discusses options for migrating the data and cutting over to the new PostgreSQL environment.

Geographically Distributed PostgreSQLmason_s

Infinispan @ Red Hat Forum 2013Jaehong Cheon

This document discusses Red Hat's distributed cache and data grid platform, Infinispan. It provides an overview of Infinispan, describing it as a distributed in-memory key/value data grid and cache that is highly available, elastic, and manageable. It outlines Infinispan's architecture as both a standalone library and clustered server, its clustering and persistence capabilities, support for transactions and querying, and use cases such as session clustering and big data processing.

인메모리 클러스터링 아키텍처Jaehong Cheon

This document discusses in-memory data grids and JBoss Infinispan. It begins with an overview of in-memory data grids, their uses for caching, performance boosting, scalability, and high availability. It then discusses Infinispan specifically, describing it as an open-source, distributed in-memory key-value data grid and cache. The document outlines Infinispan's architecture, features like persistence, transactions, querying, distributed execution, and map-reduce capabilities. It also provides a case study on using Infinispan for session clustering in a web application.

Caching technology comparisonRohit Kelapure

This document compares the caching technologies Memcached and DistributedMap, which is part of Dynacache. Memcached is an open-source key-value store, where each key is cached on one server and clients must transmit keys and values over TCP/IP. DistributedMap is a caching component of WebSphere Application Server that caches content in JVM memory, allowing cache operations through POJO calls. The document outlines advantages of each technology, such as Memcached's ability to be used across different platforms and DistributedMap's support within WebSphere and integration with other IBM products.

Repository performance tuningJukka Zitting

This document provides an overview of performance tuning for a content repository. It discusses identifying performance issues, investigating potential causes related to hardware, the repository, applications or clients. Possible solutions include changing content, configuration, code or upgrading hardware. The document also summarizes key aspects of the repository internals like the data store, persistence manager, query index and clustering. Specific tips are provided for basic content access, batch processing and query performance.

Performance and predictabilityRichardWarburton

These days fast code needs to operate in harmony with its environment. At the deepest level this means working well with hardware: RAM, disks and SSDs. A unifying theme is treating memory access patterns in a uniform and predictable that is sympathetic to the underlying hardware. For example writing to and reading from RAM and Hard Disks can be significantly sped up by operating sequentially on the device, rather than randomly accessing the data. In this talk we’ll cover why access patterns are important, what kind of speed gain you can get and how you can write simple high level code which works well with these kind of patterns.

More Related Content

What's hot (20)

Scalability, Availability & Stability PatternsJonas Bonér

1. beyond mission critical virtualizing big data and hadoopChiou-Nan Chen

Distributed Caching Essential Lessons (Ts 1402)Yury Kaliaha

Distributed Caching Using the JCACHE API and ehcache, Including a Case Study ...elliando dias

From cache to in-memory data grid. Introduction to Hazelcast.Taras Matyashovsky

MongoDB San Francisco 2013: Storing eBay's Media Metadata on MongoDB present...MongoDB

Scaling Out Tier Based ApplicationsYury Kaliaha

An Elastic Metadata Store for eBay’s Media PlatformMongoDB

Thousands of Threads and Blocking I/OGeorge Cao

New life inside monolithic applicationTaras Matyashovsky

Web session replication with HazelcastEmrah Kocaman

The Google Chubby lock service for loosely-coupled distributed systemsRomain Jacotin

Architecture of a Next-Generation Parallel File System Great Wide Open

Architecture of the Upcoming OrangeFS v3 Distributed Parallel File SystemAll Things Open

HTTP Session Replication with Oracle Coherence, GlassFish, WebLogicOracle

A Journey from Oracle to PostgreSQLEDB

Geographically Distributed PostgreSQLmason_s

Infinispan @ Red Hat Forum 2013Jaehong Cheon

인메모리 클러스터링 아키텍처Jaehong Cheon

Caching technology comparisonRohit Kelapure

Scalability, Availability & Stability PatternsJonas Bonér

1. beyond mission critical virtualizing big data and hadoopChiou-Nan Chen

Distributed Caching Essential Lessons (Ts 1402)Yury Kaliaha

Distributed Caching Using the JCACHE API and ehcache, Including a Case Study ...elliando dias

From cache to in-memory data grid. Introduction to Hazelcast.Taras Matyashovsky

MongoDB San Francisco 2013: Storing eBay's Media Metadata on MongoDB present...MongoDB

Scaling Out Tier Based ApplicationsYury Kaliaha

An Elastic Metadata Store for eBay’s Media PlatformMongoDB

Thousands of Threads and Blocking I/OGeorge Cao

New life inside monolithic applicationTaras Matyashovsky

Web session replication with HazelcastEmrah Kocaman

The Google Chubby lock service for loosely-coupled distributed systemsRomain Jacotin

Architecture of a Next-Generation Parallel File System Great Wide Open

Architecture of the Upcoming OrangeFS v3 Distributed Parallel File SystemAll Things Open

HTTP Session Replication with Oracle Coherence, GlassFish, WebLogicOracle

A Journey from Oracle to PostgreSQLEDB

Geographically Distributed PostgreSQLmason_s

Infinispan @ Red Hat Forum 2013Jaehong Cheon

인메모리 클러스터링 아키텍처Jaehong Cheon

Caching technology comparisonRohit Kelapure

Similar to ORM and distributed caching (20)

Repository performance tuningJukka Zitting

Performance and predictabilityRichardWarburton

Perfomance tuning on Go 2.0Yogi Kulkarni

This document discusses performance tuning of a continuous integration/delivery pipeline system built using Go and related tools. It describes problems the system was having with slow page loads, long job queues, rescheduling jobs, and timeouts. Profiling revealed thread blocking and database connection issues as culprits. Solutions introduced included caching, query tuning, locking optimizations, and JRuby/Rails configuration tweaks to reduce memory usage and lock contention. The results were a system with fast response times and high concurrency.

Java ThreadingGuillermo Schwarz

Threads allow concurrent execution of code by sharing memory within a process. Globals and static variables must be synchronized to be safely accessed by multiple threads, but local variables are private to each thread. The Java Virtual Machine originally used "green threads" but now uses native operating system threads, allowing parallel execution on multi-core systems. The J2EE standard recommends avoiding synchronization and instead storing data in databases protected by transactions. Synchronization, if used, should change minimal shared state to avoid problems like deadlocks.

Hibernate an introductionjoseluismms

This document provides an introduction to Hibernate, an object-relational mapping tool. It discusses the problems Hibernate solves like having SQL statements in code and the object-relational impedance mismatch. It outlines the advantages of Hibernate like database abstraction, automatic state changes, and configuration through XML files. It also provides a high-level overview of how Hibernate works by mapping objects to database tables, its configuration file, and object state changes with examples.

Lecture on Java Concurrency Day 2 on Feb 4, 2009.Kyung Koo Yoon

Why Wordnik went non-relationalTony Tam

Always on availability groups way too deepJoseph D'Antoni

This document discusses AlwaysOn availability groups in SQL Server 2012. It provides an overview and agenda which includes enabling AlwaysOn, building an availability group, adding data to a primary database, backing up the transaction log on the secondary, and querying the secondary database. It notes that extended events can provide insights into what happens with AlwaysOn operations and demonstrates some of these events.

MPTStore: A Fast, Scalable, and Stable Resource IndexChris Wilper

MPTStore is a resource index for Fedora that uses a relational database to store RDF triples in a fast, scalable, and stable way. It maps predicates to tables to improve performance of queries and updates. Tests showed MPTStore had significantly faster datastream modifications than the existing Kowari triplestore and comparable query speeds. Its use of a relational database provided benefits like transaction support and ease of administration compared to other triplestores.

Hibernate 3Rajiv Gupta

From I/O To RAMBaruch Sadogursky

Entity and NHibernate ORM Frameworks ComparedZoltan Iszlai

This document compares the Entity and NHibernate ORM frameworks. NHibernate was developed for Java in 2001 and ported to .NET frameworks, supporting all databases. It has a 2nd level cache, concurrency strategies, and rich mapping capabilities but can require more queries and be more difficult to optimize for database power. Entity was developed for C# and .NET in 2008 and has improved LINQ SQL generation, strong .NET and Microsoft integration, and easier optimization. However, it works in an attached mode to the database and is not recommended for real-time apps. Both frameworks have good community support but Entity's community is larger.

Jvm fundamentalsMiguel Pastor

This document provides an overview of several Java fundamentals topics including: - Java 7 features like improved exception handling, strings as switch selectors, and try-with-resources blocks - NIO.2 for easy file handling and asynchronous I/O using futures and callbacks - Dependency injection and modern concurrency concepts like safety, liveness, and performance - Building blocks for concurrency like atomic classes, locks, and thread pools

My Sql Performance In A CloudSky Jian

The document discusses deploying MySQL in cloud environments and focuses on improving InnoDB performance for workloads with high IO demands. It provides benchmarks comparing the performance of MySQL using direct attached storage versus network attached storage, as well as the impact of virtualization. Several techniques are suggested for tuning MySQL and InnoDB for IO-bound workloads, including various configuration options and patches that improve concurrency and throughput.

Column and hadoopAlex Jiang

rac_for_beginners_ppt.pdfHODCA1

This document provides an overview of Real Application Clusters (RAC) for beginners. It defines what RAC is, explains the key components and terminology of RAC including cache fusion, global locking, interconnects, and virtual IPs. It describes how data is stored and replicated across multiple database instances and nodes in a RAC configuration. The document also discusses important RAC concepts such as instance recovery, undo tablespaces, storage layout, TNS entries, and virtual IPs.

ZODB, the Zope Object Database (May 2003)Kiran Jonnalagadda

Rollin onj Rubyv3Oracle

Database architectureby howardoracle documents

oracle foreign key primary key constraints performance tuning MTS IOT 9i block size backup rman corrupted column drop rename recovery controlfile backup clone architecture database archives export dump dmp duplicate rows extents segments fragmentation hot cold blobs migration tablespace locally managed redo undo new features rollback ora-1555 shrink free space user password link TNS tnsnames.ora listener java shutdown sequence

Scalable Web Solutions - Use Case: Regulatory Reform In Vietnam On eZ Publish...Ivo Lukač

This document discusses the scalable web solution implemented for regulatory reform in Vietnam using an eZ Publish CMS. The solution included: - An infrastructure with 8 servers using iSCSI SAN storage to handle 125,000 dossiers and 300,000 objects with concurrent editing and 200GB of data. - An architecture with load-balanced varnish reverse proxies, eZ Publish web servers, MySQL database servers in master-slave replication, and a Solr search server. - Caching at multiple levels, minimizing database writes, and optimizing performance through solutions like OCFS2 file system and Solr search to handle the project needs of 88 million people and 21 million internet users in Vietnam.

Repository performance tuningJukka Zitting

Performance and predictabilityRichardWarburton

Perfomance tuning on Go 2.0Yogi Kulkarni

Java ThreadingGuillermo Schwarz

Hibernate an introductionjoseluismms

Lecture on Java Concurrency Day 2 on Feb 4, 2009.Kyung Koo Yoon

Why Wordnik went non-relationalTony Tam

Always on availability groups way too deepJoseph D'Antoni

MPTStore: A Fast, Scalable, and Stable Resource IndexChris Wilper

Hibernate 3Rajiv Gupta

From I/O To RAMBaruch Sadogursky

Entity and NHibernate ORM Frameworks ComparedZoltan Iszlai

Jvm fundamentalsMiguel Pastor

My Sql Performance In A CloudSky Jian

Column and hadoopAlex Jiang

rac_for_beginners_ppt.pdfHODCA1

ZODB, the Zope Object Database (May 2003)Kiran Jonnalagadda

Rollin onj Rubyv3Oracle

Database architectureby howardoracle documents

Scalable Web Solutions - Use Case: Regulatory Reform In Vietnam On eZ Publish...Ivo Lukač

More from aragozin (20)

Java on Linux for devs and opsaragozin

This document discusses Java memory usage on Linux systems and how to monitor and troubleshoot Java applications running on Linux. It covers Java memory structures like heap, non-heap memory and thread stacks. It also discusses Linux memory management and key metrics like resident size. The document provides tips on setting up the JVM, tuning network and OS settings. It recommends tools like jstack, jstat and jcmd for diagnosing issues like high CPU usage, leaks or out of memory errors.

I know why your Java is slowaragozin

The document discusses performance issues that can arise in Java applications and strategies for identifying bottlenecks. It provides an overview of potential causes of slowness at the server, browser, application, and database levels. It also describes various profiling tools like JVisualVM, JProfiler, and SJK ttop that can help analyze thread CPU usage, memory usage, and garbage collection to diagnose specific problems like CPU hogs, thread contention, and full GC pauses. The document provides examples of how to profile applications built with JEE technologies like JBoss, Seam and Hibernate. It also lists JVM options for tuning garbage collection, particularly for the Concurrent Mark Sweep (CMS) and Garbage First (G1

Java profiling Do It Yourself (jug.msk.ru 2016)aragozin

The document discusses various tools and techniques for Java profiling and diagnostics. It describes JVM diagnostic interfaces like JMX and JVMTI, the Attach Protocol, performance counters, and flight recording. It also summarizes tools like SJK and BTrace that provide command line interfaces for profiling, analyzing garbage collection, tracking CPU usage, working with heap dumps, and more. These tools exploit JVM interfaces and allow ad-hoc instrumentation to gather detailed insight into a running JVM.

Java black box profiling JUG.EKB 2016aragozin

The document discusses various techniques for profiling Java applications to identify performance bottlenecks, including stack trace sampling, bytecode instrumentation, Java Management Extensions (JMX), flight recording, and tools like SwissJavaKnife. It emphasizes starting with broad profiling before narrowing down on specific problem areas using more advanced tools. Some key points covered are understanding the target problem and performance indicators, avoiding getting sidetracked, and progressing profiling steps slowly and steadily.

Распределённое нагрузочное тестирование на Javaaragozin

What every Java developer should know about network?aragozin

This document summarizes key aspects of TCP networking that every Java developer should know. It covers TCP fundamentals like reliable in-order data transmission, connection establishment through binding and accepting sockets, graceful connection closure, and error handling. It also discusses tuning options like buffer sizes, Nagle's algorithm, and keepalive timeouts. The document explains TCP congestion control mechanisms like slow start and uses diagrams to illustrate concepts like the sliding window and congestion avoidance phases. It also cautions about network hazards that can be simulated for testing.

Java profiling Do It Yourselfaragozin

This document summarizes tools and techniques for Java profiling and diagnostics. It discusses using JMX, JVMTI, and the Attach API to gather information on threading, memory usage, garbage collection, and perform actions like heap dumps. It also introduces the SJK toolkit which provides commands for profiling tasks and the Sigar and BTrace tools. Real-world uses of profiling techniques are presented, like benchmarking and diagnosing production systems. Future ideas proposed include a visual thread analyzer and scripting-based heap dump exploration.

DIY Java Profileraragozin

This document discusses various tools for Java profiling and diagnostics including SJK, BTrace, JVM attach API, and perf counters. SJK is a command line tool that exploits JMX, attach API, and perf counters to provide commands for thread profiling, garbage collection analysis, heap dumps, and other diagnostic information. BTrace allows injecting code snippets to perform instrumentation profiling. The JVM attach API can be used to attach to running JVMs and perform operations like heap dumps and stack traces. Perf counters provide low-overhead access to JVM counters via shared memory. The document provides examples and links to documentation for these various Java profiling and diagnostic tools.

Java black box profilingaragozin

Блеск и нищета распределённых кэшейaragozin

JIT compilation in modern platforms – challenges and solutionsaragozin

This document discusses just-in-time (JIT) compilation techniques in modern runtimes. It outlines two main approaches to JIT - method-based compilation and tracing JIT. It then describes specific techniques used in the HotSpot JVM, including its fast interpreter, two-tiered JIT compilation, runtime profiling, devirtualization, incremental compilation, on-stack replacement, escape analysis and scalar replacement. It also discusses how the garbage collector interacts with compiled code.

Casual mass parallel computingaragozin

This document discusses strategies for casual mass parallel data processing using Java. It describes using a simple master-slave topology with a task queue and scheduler to distribute work. The data plane should avoid sending data over RMI and instead use local file systems or in-memory databases. NanoCloud is introduced as a way to drastically simplify coding for computing clusters by allowing remote code execution over SSH.

Nanocloud cloud scale jvmaragozin

NanoCloud provides a way to deploy Java applications across multiple servers and nodes in a cloud-like manner using only SSH and Java. It handles classpath replication, remote execution, and bidirectional communication between nodes in a transparent way without heavy infrastructure requirements. The document outlines NanoCloud's capabilities and goals to simplify distributed testing and deployment of Java applications at scale.

Java GC tuning and monitoring (by Alexander Ashitkin)aragozin

Garbage collection in JVMaragozin

This document discusses garbage collection in the Java Virtual Machine (JVM). It begins with common terms related to garbage collection like stop-the-world pauses and compacting algorithms. It then covers the diversity of garbage collection techniques for different heap sizes, including young generation collection and concurrent mark sweep. Potential dangers of different garbage collection approaches are listed. The document also summarizes the economy of different garbage collection algorithms and discusses the weak generational thesis.

Virtualizing Java in Java (jug.ru)aragozin

This document describes how to virtualize Java applications in Java by hosting multiple "pseudo JVMs" within a single JVM. This allows deploying distributed applications for testing purposes. Key points covered include: - Using custom classloaders and system properties to isolate "pseudo JVMs" and simulate distributed environments. - Frameworks like GridKit that enable starting whole application topologies within JUnit tests for behaviors testing. - Techniques for testing features like serialization, data routing, and cross-version compatibility. - Later extensions to deploy virtual nodes across real servers using SSH for performance and deployment testing of distributed systems.

Filtering 100M objects in Coherence cache. What can go wrong?aragozin

The document discusses filtering 100 million objects from a Coherence cache. It describes initial problems encountered including out of memory errors and high memory usage. Several strategies are proposed and tested to address these issues including using indexes more efficiently, incremental retrieval of results in batches to control traffic, and implementing basic multi-version concurrency control to provide snapshot consistency for queries.

Cборка мусора в Java без пауз (HighLoad++ 2013)aragozin

Доклад про паузы при сборке мусора уже был на одной из прошлых конференций HighLoad++. Паузы stop-the-world являются неотъемлемым атрибутом автоматического управления памятью. Или всё-таки их можно избежать? – Можно! Алгоритмы, не требующие пауз для управления памятью, существуют. Существуют и реальные JVM, которые их реализуют. Содержание доклада - Принципы автоматического управления памятью (сборки мусора). - "Метроном" - классический алгоритм сборки мусора без пауз. - С4 - алгоритм сборки мусора Zing JVM (Azul Systems). - Особенности эффективной реализации на x86-архитектуре. - Дополнительные источники проблем: слабые ссылки, фрагментация и прочее.

JIT-компиляция в виртуальной машине Java (HighLoad++ 2013)aragozin

Обеспечение достойной производительности высокоуровневого языка с динамической типизацией - непростая задача. Just-in-time (JIT) компиляция - динамическая генерация машинного кода с учетом информации, собранной во время выполнения приложения - ключевой элемент производительности виртуальной машины (будь то Java, .NET или даже JavaScript). JIT-компилятор, в свою очередь, должен иметь впечатляющий набор трюков и оптимизаций, что бы компенсировать "динамизм" языка. В докладе речь пойдет о достижениях современной JIT компиляции в целом и более подробно будут освещены особенности HotSpot JVM (бесплатной JVM от Oracle)

Performance Test Driven Development (CEE SERC 2013 Moscow)aragozin

Java on Linux for devs and opsaragozin

I know why your Java is slowaragozin

Java profiling Do It Yourself (jug.msk.ru 2016)aragozin

Java black box profiling JUG.EKB 2016aragozin

Распределённое нагрузочное тестирование на Javaaragozin

What every Java developer should know about network?aragozin

Java profiling Do It Yourselfaragozin

DIY Java Profileraragozin

Java black box profilingaragozin

Блеск и нищета распределённых кэшейaragozin

JIT compilation in modern platforms – challenges and solutionsaragozin

Casual mass parallel computingaragozin

Nanocloud cloud scale jvmaragozin

Java GC tuning and monitoring (by Alexander Ashitkin)aragozin

Garbage collection in JVMaragozin

Virtualizing Java in Java (jug.ru)aragozin

Filtering 100M objects in Coherence cache. What can go wrong?aragozin

Cборка мусора в Java без пауз (HighLoad++ 2013)aragozin

JIT-компиляция в виртуальной машине Java (HighLoad++ 2013)aragozin

Performance Test Driven Development (CEE SERC 2013 Moscow)aragozin

Recently uploaded (20)

How Can I use the AI Hype in my Business Context?Daniel Lehner

𝙄𝙨 𝘼𝙄 𝙟𝙪𝙨𝙩 𝙝𝙮𝙥𝙚? 𝙊𝙧 𝙞𝙨 𝙞𝙩 𝙩𝙝𝙚 𝙜𝙖𝙢𝙚 𝙘𝙝𝙖𝙣𝙜𝙚𝙧 𝙮𝙤𝙪𝙧 𝙗𝙪𝙨𝙞𝙣𝙚𝙨𝙨 𝙣𝙚𝙚𝙙𝙨? Everyone’s talking about AI but is anyone really using it to create real value? Most companies want to leverage AI. Few know 𝗵𝗼𝘄. ✅ What exactly should you ask to find real AI opportunities? ✅ Which AI techniques actually fit your business? ✅ Is your data even ready for AI? If you’re not sure, you’re not alone. This is a condensed version of the slides I presented at a Linkedin webinar for Tecnovy on 28.04.2025.

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots. 📕 Here's what you can expect: - Modeling: Build end-to-end processes using BPMN. - Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes. - Operating: Control process instances with rewind, replay, pause, and stop functions. - Monitoring: Use dashboards and embedded analytics for real-time insights into process instances. This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes. 👨‍🏫 Speaker: Andrei Vintila, Principal Product Manager @UiPath This session streamed live on April 29, 2025, 16:00 CET. Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

TrsLabs - Fintech Product & Business ConsultingTrs Labs

Hybrid Growth Mandate Model with TrsLabs Strategic Investments, Inorganic Growth, Business Model Pivoting are critical activities that business don't do/change everyday. In cases like this, it may benefit your business to choose a temporary external consultant. An unbiased plan driven by clearcut deliverables, market dynamics and without the influence of your internal office equations empower business leaders to make right choices. Getting things done within a budget within a timeframe is key to Growing Business - No matter whether you are a start-up or a big company Talk to us & Unlock the competitive advantage

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark? At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍 Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

Join this UiPath Community Berlin meetup to explore the Orchestrator API, Swagger interface, and the Test Manager API. Learn how to leverage these tools to streamline automation, enhance testing, and integrate more efficiently with UiPath. Perfect for developers, testers, and automation enthusiasts! 📕 Agenda Welcome & Introductions Orchestrator API Overview Exploring the Swagger Interface Test Manager API Highlights Streamlining Automation & Testing with APIs (Demo) Q&A and Open Discussion Perfect for developers, testers, and automation enthusiasts! 👉 Join our UiPath Community Berlin chapter: https://community.uipath.com/berlin/ This session streamed live on April 29, 2025, 18:00 CET. Check out all our upcoming UiPath Community sessions at https://community.uipath.com/events/.

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Talk at the final event of Data Fusion Dynamics: A Collaborative UK-Saudi Initiative in Cybersecurity and Artificial Intelligence funded by the British Council UK-Saudi Challenge Fund 2024, Cardiff Metropolitan University, 29th April 2025 https://alandix.com/academic/talks/CMet2025-AI-Changes-Everything/ Is AI just another technology, or does it fundamentally change the way we live and think? Every technology has a direct impact with micro-ethical consequences, some good, some bad. However more profound are the ways in which some technologies reshape the very fabric of society with macro-ethical impacts. The invention of the stirrup revolutionised mounted combat, but as a side effect gave rise to the feudal system, which still shapes politics today. The internal combustion engine offers personal freedom and creates pollution, but has also transformed the nature of urban planning and international trade. When we look at AI the micro-ethical issues, such as bias, are most obvious, but the macro-ethical challenges may be greater. At a micro-ethical level AI has the potential to deepen social, ethnic and gender bias, issues I have warned about since the early 1990s! It is also being used increasingly on the battlefield. However, it also offers amazing opportunities in health and educations, as the recent Nobel prizes for the developers of AlphaFold illustrate. More radically, the need to encode ethics acts as a mirror to surface essential ethical problems and conflicts. At the macro-ethical level, by the early 2000s digital technology had already begun to undermine sovereignty (e.g. gambling), market economics (through network effects and emergent monopolies), and the very meaning of money. Modern AI is the child of big data, big computation and ultimately big business, intensifying the inherent tendency of digital technology to concentrate power. AI is already unravelling the fundamentals of the social, political and economic world around us, but this is a world that needs radical reimagining to overcome the global environmental and human challenges that confront us. Our challenge is whether to let the threads fall as they may, or to use them to weave a better future.

Splunk Security Update | Public Sector Summit Germany 2025Splunk

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, transcript, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock

Building 10x Organizations with Modern Productivity Metrics 10x developers may be a myth, but 10x organizations are very real, as proven by the influential study performed in the 1980s, ‘The Coding War Games.’ Right now, here in early 2025, we seem to be experiencing YAPP (Yet Another Productivity Philosophy), and that philosophy is converging on developer experience. It seems that with every new method we invent for the delivery of products, whether physical or virtual, we reinvent productivity philosophies to go alongside them. But which of these approaches actually work? DORA? SPACE? DevEx? What should we invest in and create urgency behind today, so that we don’t find ourselves having the same discussion again in a decade?

What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat

The MCP (Model Context Protocol) is a framework designed to manage context and interaction within complex systems. This SlideShare presentation will provide a detailed overview of the MCP Model, its applications, and how it plays a crucial role in improving communication and decision-making in distributed systems. We will explore the key concepts behind the protocol, including the importance of context, data management, and how this model enhances system adaptability and responsiveness. Ideal for software developers, system architects, and IT professionals, this presentation will offer valuable insights into how the MCP Model can streamline workflows, improve efficiency, and create more intuitive systems for a wide range of use cases.

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.

How Can I use the AI Hype in my Business Context?Daniel Lehner

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfPrecisely

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

TrsLabs - Fintech Product & Business ConsultingTrs Labs

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

Special Meetup Edition - TDX Bengaluru Meetup #52.pptxshyamraj55

Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Splunk Security Update | Public Sector Summit Germany 2025Splunk

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada

DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock

What is Model Context Protocol(MCP) - The new technology for communication bw...Vishnu Singh Chundawat

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

ORM and distributed caching

1. ORM and Distributed Caching Alexey Ragozin [email protected] May 2012

2. ORM cache hierarchy Session Level 1 Query cache Entry cache Level 2 Database

3. ORM cache hierarchy Session POJO Level 1 Query cache Entry cache Sets of PK Entities Level 2 Database

4. Second level cache Query cache  Query -> Result set (list of entry references) Entity cache  PK (entry reference) -> Entity data Makes query cache useful Helps with “N+1 select” problem Actively used for lazy loading of entities

5. Consistency problem Stale data in entity cache = big problem Single process application  Locking, to prevent concurrent updates  Write through – modify DB and cache together Distributed application 1. JTA transaction manager (add cache to Tx) 2. Use distributed locks for concurrency control

6. Solving Query Problem Caching queries  Exact query match may be infrequent  Invalidation is messy Why not execute quires in cache?  Execute query in entity cache  No invalidation problem  Coherence, GemFire, Hazelcast has index support

7. Queries in Entity Cache Pro  DB is not involved in query processing  Fallback to DB for complex quries  Still using old good (or bad) JPQL Cons  ALL entities should be loaded in cache  Only simple selects, no join queries are supported  though link traversing works as usual

8. What is Next?  Coherence cache is durable  Why update DB synchronously? Write behind for ORM PRO  reducing transaction execution time  removing DB from critical path CON  Coherence does not honor transaction boundaries  DB is out of sync, no way for execution complex JPQL

9. Few More Interesting Stuff  Works with TopLink Grid  Real transaction support  Durability via distributed disk log HIBERNATE OGM  JPQL for NoSQL (data grid included)  Lucene (Hibernate Search) support

10. Thank you http://aragozin.blogspot.com Alexey Ragozin [email protected]

ORM and distributed caching

Recommended

More Related Content

What's hot (20)

Similar to ORM and distributed caching (20)

More from aragozin (20)

Recently uploaded (20)

ORM and distributed caching