Oracle GoldenGate Presentation from OTN Virtual Technology Summit - 7/9/14 (PDF)
7 likes2,870 views
This document provides an overview of Oracle GoldenGate and discusses performance tuning considerations. It begins with an introduction to GoldenGate's architecture and use cases. It then discusses the importance of baselining a GoldenGate implementation to understand existing performance. The document outlines how to gather baseline metrics on GoldenGate lag times, checkpoint information, and operating system CPU, memory, and disk I/O. It also provides GoldenGate tuning recommendations, such as using multiple process groups and parallel replication groups. The goal of performance tuning is to reduce lag times and optimize resource utilization.
![CPU
Ā InformaCon
Ā
ā¢āÆ Use
Ā mpstat
Ā
ā¢āÆ mpstat
Ā āP
Ā ALL
Ā [count
Ā [interval]]
Ā
ā¢āÆ sar
Ā can
Ā be
Ā used
Ā as
Ā well
Ā](https://image.slidesharecdn.com/oggarchitectureperformance-140709123545-phpapp02/85/Oracle-GoldenGate-Presentation-from-OTN-Virtual-Technology-Summit-7-9-14-PDF-17-320.jpg)
![Memory
Ā Performance
Ā
ā¢āÆ Use
Ā vmstat
Ā
ā¢āÆ Reports
Ā on
Ā virtual
Ā memory
Ā staCsCcs
Ā
ā¢āÆ vmstat
Ā āS
Ā M
Ā [count
Ā [interval]]
Ā](https://image.slidesharecdn.com/oggarchitectureperformance-140709123545-phpapp02/85/Oracle-GoldenGate-Presentation-from-OTN-Virtual-Technology-Summit-7-9-14-PDF-18-320.jpg)
![Disk
Ā I/O
Ā Tuning
Ā
ā¢āÆ Use
Ā iostat
Ā
ā¢āÆ Reports
Ā staCsCcs
Ā transfered
Ā between
Ā devices
Ā
ā¢āÆ iostat
Ā ām
Ā [count
Ā [interval]]
Ā](https://image.slidesharecdn.com/oggarchitectureperformance-140709123545-phpapp02/85/Oracle-GoldenGate-Presentation-from-OTN-Virtual-Technology-Summit-7-9-14-PDF-19-320.jpg)
![Tune
Ā GoldenGate
Ā (cachemgr
Ā conāt)
Ā
ā¢āÆ EsCmate
Ā swap
Ā space
Ā needed
Ā
ā¢āÆ Extract_Swap_Needed =(PROCESS_VM *
num_extracts) + (swap_other_processes)
ā¢āÆ Replicat_Swap_Needed =(PROCESS_VM *
num_replicats) + (swap_other_processes)
Ā
ā¢āÆ
Ā Review
Ā in
Ā report
Ā ļ¬le
Ā
ā¢āÆ send [extract/replicat] <group name>,
cachemanager
Ā
Ā](https://image.slidesharecdn.com/oggarchitectureperformance-140709123545-phpapp02/85/Oracle-GoldenGate-Presentation-from-OTN-Virtual-Technology-Summit-7-9-14-PDF-27-320.jpg)
Ad
More Related Content
What's hot (20)
Viewers also liked (14)
Ad
Similar to Oracle GoldenGate Presentation from OTN Virtual Technology Summit - 7/9/14 (PDF) (20)
Ad
More from Bobby Curtis (20)
Recently uploaded (20)
![Pixologic ZBrush Crack Plus Activation Key [Latest 2025] New Version](https://cdn.slidesharecdn.com/ss_thumbnails/fashionevolution2-250322112409-f76abaa7-250428124909-b51264ff-250504160528-fc2bb1c5-thumbnail.jpg?width=560&fit=bounds)
![Download Wondershare Filmora Crack [2025] With Latest](https://cdn.slidesharecdn.com/ss_thumbnails/neo4j-howkgsareshapingthefutureofgenerativeaiatawssummitlondonapril2024-240426125209-2d9db05d-250419-250428115407-a04afffa-thumbnail.jpg?width=560&fit=bounds)
Oracle GoldenGate Presentation from OTN Virtual Technology Summit - 7/9/14 (PDF)
- 1. Copyright Ā Ā© Ā 2014 Ā Oracle Ā and/or Ā its Ā aļ¬liates. Ā All Ā rights Ā reserved. Ā Ā | Ā Understanding Ā Oracle Ā GoldenGate Ā Architecture Ā Bobby Ā CurCs Ā Senior Ā Technical Ā Consultant Ā Accenture Ā Enkitec Ā Group Ā July Ā 9, Ā 2014 Ā Oracle Ā Conļ¬denCal Ā ā Ā Internal/Restricted/ Highly Ā Restricted Ā 1 Ā Performance Ā Tuning Ā to Ā the Ā OS Ā Level Ā
- 2. Speaker Ā Info Ā ā¢āÆ Douglasville, Ā Georgia Ā ā¢āÆ Senior Ā Technical Ā Consultant Ā ā¢āÆ Expert Ā OEM12c Ā (2013)/PracCcal Ā ODA Ā (2014) Ā ā¢āÆ TwiYer: Ā @dbasolved Ā ā¢āÆ Blog: Ā hYp://dbasolved.com Ā ā¢āÆ Email: Ā [email protected] Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [email protected] Ā
- 3. Accenture Ā Enkitec Ā Group Ā Enkitec Ā has Ā joined Ā Accentureās Ā Infrastructure Ā Services Ā as Ā Accenture Ā Enkitec Ā Group Ā ā¢āÆ 17,000 Ā Infrastructure Ā Services Ā professionals Ā ā¢āÆ 52,000 Ā Oracle Ā professionals Ā Focus Ā on Ā Oracle Ā Engineered Ā Systems Ā SoluCons Ā ā¢āÆ Database Ā MigraCons Ā & Ā TransformaCons Ā ā¢āÆ Database-Āāas-Āāa-ĀāService Ā ā¢āÆ Oracle Ā ApplicaCons Ā on Ā Engineered Ā Systems Ā ā¢āÆ Cloud-Āābased Ā soluCons Ā leveraging Ā Engineered Ā Systems Ā
- 4. Agenda Ā ā¢āÆ General Ā InformaCon Ā ā¢āÆ What Ā is Ā GoldenGate Ā ā¢āÆ Beneļ¬ts Ā ā¢āÆ Basic Ā Architecture Ā ā¢āÆ Use Ā Cases Ā ā¢āÆ Tuning Ā InformaCon Ā ā¢āÆ GoldenGate Ā Tuning Ā ā¢āÆ OperaCng Ā System Ā Tuning Ā ā¢āÆ Processes Ā ā¢āÆ Memory Ā ā¢āÆ Disk Ā
- 6. What Ā is Ā Oracle Ā GoldenGate Ā ā¢āÆ Comprehensive Ā soeware Ā for Ā real-ĀāCme Ā data Ā integraCon Ā in Ā heterogeneous Ā environments Ā ā¢āÆ Beneļ¬ts Ā ā¢āÆ High Ā Availability Ā SoluCons Ā ā¢āÆ Real-ĀāTime Ā Data Ā IntegraCon Ā ā¢āÆ TransformaCon Ā of Ā Data Ā ā¢āÆ TransacConal Ā Change Ā Data Ā Capture Ā ā¢āÆ Data Ā ReplicaCon Ā ā¢āÆ Veriļ¬caCon Ā of Ā Data Ā (Veridata) Ā ā¢āÆ Ā Primary Ā ReplicaCon Ā Tool Ā in Ā Oracle Ā Database Ā 12c Ā (12.1.0.1) Ā ā¢āÆ Oracle Ā Upgrade Ā Guide, Ā SecCons Ā 8.1.6 Ā & Ā 8.1.7 Ā ā¢āÆ MulCple Ā ways Ā to Ā successfully Ā monitor Ā Oracle Ā GoldenGate Ā
- 7. Beneļ¬ts Ā Ā ā¢āÆ Real-ĀāTime Ā Data Ā Capture Ā ā¢āÆ Near-ĀāZero Ā DownCme Ā migraCons Ā ā¢āÆ Quickly Ā upgrade Ā databases Ā ā¢āÆ Open Ā Architecture Ā (Heterogeneous) Ā ā¢āÆ Disaster Ā Recovery Ā ā¢āÆ Data Ā DistribuCon Ā ā¢āÆ Distributed Ā Oļ¬ces Ā ā¢āÆ Query Ā Oļ¬-Āāloading Ā ā¢āÆ ReporCng Ā Instances Ā
- 8. Basic Ā Architecture Ā Capture: Ā commiYed Ā transacCons Ā are Ā captured Ā (and Ā can Ā be Ā ļ¬ltered) Ā as Ā they Ā occur Ā by Ā reading Ā the Ā transacCon Ā logs. Ā Trail: Ā stages Ā and Ā queues Ā data Ā for Ā rouCng. Ā Pump: Ā distributes Ā data Ā for Ā rouCng Ā to Ā target(s). Ā Ā Route: Ā data Ā is Ā compressed, Ā encrypted Ā for Ā rouCng Ā to Ā target(s). Ā Delivery: Ā applies Ā data Ā with Ā transacCon Ā integrity, Ā transforming Ā the Ā data Ā as Ā required. Ā Source Oracle / Non-Oracle Database Target Oracle / Non-Oracle Database Capture Delivery Trail Files Pump Trail Files Pump Delivery Capture Bi-directional LAN / WAN / Internet Over TCP/IP Trail Files Trail Files Modular Ā Architecture Ā
- 9. Use Ā Cases Ā Ā Unidirec8onal Ā Query Ā Oļ¬oading Ā Zero-ĀāDownCme Ā MigraCon Ā Data Ā IntegraCon Ā Cloud Ā or Ā On-ĀāPremise Ā Ā Bi-ĀāDirec8onal Ā AcCve-ĀāAcCve Ā for Ā MulC-ĀāMaster/ HA Ā Cloud Ā or Ā On-ĀāPremises Ā Data Ā Distribu8on Ā via Ā Messaging Ā Cloud Ā Apps Ā Integra8on Ā Big Ā Data Ā Delivery Ā Real/Time Ā and Ā Batch Ā Delivery Ā Structured Ā Data Ā to Ā Data Ā Reservoir Ā
- 11. Performance Ā Tuning Ā Ā ā¢āÆ Per Ā Oracle Ā ā¢āÆ Baselining Ā ā¢āÆ GoldenGate Ā Tuning Ā ā¢āÆ Lag Ā Times Ā ā¢āÆ AWR/ASH Ā Reports Ā ā¢āÆ CPU Ā ā¢āÆ Memory Ā ā¢āÆ I/O Ā ā¢āÆ OperaCng Ā System Ā Tuning Ā
- 12. Per Ā Oracle Ā ā¢āÆ MulCple Ā Process Ā Groups Ā ā¢āÆ Data Ā Integrity Ā ā¢āÆ Number Ā of Ā Groups Ā ā¢āÆ Dependent Ā on Ā amount Ā of Ā memory Ā ā¢āÆ Use Ā Network Ā Eļ¬ciently Ā ā¢āÆ Benchmark Ā Extract/Replicat Ā (checkpoints) Ā ā¢āÆ Ā Eliminate Ā disk Ā I/O Ā ā¢āÆ Writes Ā data Ā sequenCally, Ā RAID Ā 0+1 Ā ā¢āÆ Ā Manage Ā VM Ā and Ā Paging Ā ā¢āÆ Cachemgr Ā
- 13. Baselining Ā ā¢āÆ Should Ā be Ā ļ¬rst Ā thing Ā you Ā gather Ā ā¢āÆ What Ā should Ā be Ā gathered? Ā ā¢āÆ GoldenGate Ā ā¢āÆ Lag Ā ā¢āÆ Checkpoint Ā Info Ā ā¢āÆ General Ā AWR Ā InformaCon Ā (DB) Ā ā¢āÆ OperaCng Ā System Ā ā¢āÆ CPU Ā performance Ā (mpstat) Ā ā¢āÆ Memory Ā performance Ā (vmstat) Ā ā¢āÆ I/O Ā performance Ā (iostat) Ā
- 14. GoldenGate Ā Lag Ā Info Ā ā¢āÆ ReporCng Ā Lag Ā ā¢āÆ Gives Ā an Ā idea Ā of Ā how Ā long Ā it Ā takes Ā data Ā to Ā transfer Ā on Ā network Ā ā¢āÆ GGSCI Ā commands Ā ā¢āÆ lag Ā extract Ā <group Ā name> Ā ā¢āÆ lag Ā replicat Ā <group Ā name> Ā
- 15. GoldenGate Ā Checkpoint Ā Info Ā ā¢āÆ Checkpoint Ā ā¢āÆ Helps Ā detect Ā network Ā boYlenecks Ā ā¢āÆ GGSCI Ā commands Ā ā¢āÆ info Ā extract Ā <group Ā name>, Ā showch Ā <number> Ā
- 16. Database Ā Tuning Ā ā¢āÆ AWR Ā Reports Ā ā¢āÆ Wait Ā Event: Ā Streams Ā Miscellaneous Ā Event Ā
- 17. CPU Ā InformaCon Ā ā¢āÆ Use Ā mpstat Ā ā¢āÆ mpstat Ā āP Ā ALL Ā [count Ā [interval]] Ā ā¢āÆ sar Ā can Ā be Ā used Ā as Ā well Ā
- 18. Memory Ā Performance Ā ā¢āÆ Use Ā vmstat Ā ā¢āÆ Reports Ā on Ā virtual Ā memory Ā staCsCcs Ā ā¢āÆ vmstat Ā āS Ā M Ā [count Ā [interval]] Ā
- 19. Disk Ā I/O Ā Tuning Ā ā¢āÆ Use Ā iostat Ā ā¢āÆ Reports Ā staCsCcs Ā transfered Ā between Ā devices Ā ā¢āÆ iostat Ā ām Ā [count Ā [interval]] Ā
- 20. Baseline Ā Completed Ā Metric Ā Baseline Ā Running Ā Lag Ā 5 Ā sec Ā (ext)/12 Ā sec Ā (rep) Ā 1 Ā sec Ā (ext)/4 Ā sec Ā (rep) Ā CPU Ā 4.64% Ā (iowait Ā (all)) Ā 7.73% Ā (iowait(all)) Ā Memory Ā 2214M Ā (free) Ā 2109M Ā (free) Ā Disk Ā IO Ā 29.16 Ā tps Ā 29.06 Ā tps Ā ā¢āÆ ObservaCon: Ā ā¢āÆ Serial Ā processing Ā (no Ā parallel) Ā ā¢āÆ Baseline Ā was Ā taken Ā with Ā higher Ā transacCon Ā count Ā ā¢āÆ Disk Ā I/O Ā was Ā slightly Ā lower Ā with Ā high Ā CPU Ā waits Ā ā¢āÆ More Ā memory Ā was Ā used Ā during Ā the Ā ārunningā Ā test Ā
- 22. Tune Ā GoldenGate Ā ā¢āÆ MulCple Ā Process Ā Groups Ā (Classic) Ā ā¢āÆ Parallel Ā Replicat Ā Groups Ā ā¢āÆ 3 Ā to Ā 1 Ā raCo Ā (replicat Ā to Ā trail Ā (classic)) Ā ā¢āÆ Reduced Ā with Ā Integrated Ā Replicat Ā ā¢āÆ DB Ā (11.2.0.4) Ā and Ā OGG Ā 12c Ā (12.1.2) Ā Source Ā Oracle Ā & Ā Non-ĀāOracle Ā Database(s) Ā Target Ā Oracle Ā & Ā Non-ĀāOracle Ā Database(s) Ā Capture Trail Files Pump DeliveryTrail Files Delivery Delivery LAN / WAN / Internet Over TCP/IP
- 23. Tune Ā GoldenGate Ā ā¢āÆ MulCple Ā Process Ā Groups Ā (Classic) Ā ā¢āÆ Parallel Ā Extract Ā Groups Ā ā¢āÆ 1 Ā to Ā 1 Ā raCo Ā (extract Ā to Ā trail Ā to Ā replicat) Ā ā¢āÆ Reduced Ā with Ā Integrated Ā processes Ā Source Ā Oracle Ā & Ā Non-ĀāOracle Ā Database(s) Ā Target Ā Oracle Ā & Ā Non-ĀāOracle Ā Database(s) Ā Trail Files Pump Trail Files Delivery Delivery Delivery LAN / WAN / Internet Over TCP/IP Capture Capture Capture
- 24. Tune Ā GoldenGate Ā ā¢āÆ Use Ā Network Ā Eļ¬ciently Ā ā¢āÆ Lag Ā Cmes Ā increase Ā ā¢āÆ Check Ā target Ā database Ā performance Ā ā¢āÆ Consult Ā Network Ā Team Ā for Ā any Ā performance Ā issue Ā ā¢āÆ Checkpoint Ā Extract/Replicat Ā ā¢āÆ send replicat rep, status ā¢āÆ Indicates Ā any Ā delay Ā with Ā replicat Ā
- 25. Tune Ā GoldenGate Ā ā¢āÆ Eliminate Ā disk Ā I/O Ā ā¢āÆ Try Ā to Ā eliminate Ā this Ā ļ¬rst Ā ā¢āÆ System Ā Conļ¬guraCons Ā ā¢āÆ Most Ā shops, Ā disk Ā are Ā controlled Ā by Ā SAN Ā Admin Ā or Ā internal Ā devices Ā ā¢āÆ Choose Ā RAID Ā 0+1 Ā over Ā RAID Ā 5 Ā ā¢āÆ GoldenGate Ā Conļ¬guraCon Ā ā¢āÆ Increase Ā values Ā of Ā parameters: Ā ā¢āÆ CHECKPOINTSECS ā¢āÆ GROUPTRANSOPS ā¢āÆ EOFDELAY or EOFDELAYSECS Ā
- 26. Tune Ā GoldenGate Ā ā¢āÆ Manage Ā VM Ā and Ā Paging Ā ā¢āÆ Default: Ā use Ā as Ā much Ā memory Ā allowed Ā ā¢āÆ Default: Ā ./dirtmp Ā and Ā as Ā much Ā space Ā as Ā allowed Ā ā¢āÆ Can Ā be Ā controlled Ā with Ā cachemgr parameter Ā ā¢āÆ Valid Ā for Ā Extract/Replicat Ā ā¢āÆ Current Ā seyngs Ā can Ā be Ā viewed Ā in Ā report Ā ļ¬le Ā
- 27. Tune Ā GoldenGate Ā (cachemgr Ā conāt) Ā ā¢āÆ EsCmate Ā swap Ā space Ā needed Ā ā¢āÆ Extract_Swap_Needed =(PROCESS_VM * num_extracts) + (swap_other_processes) ā¢āÆ Replicat_Swap_Needed =(PROCESS_VM * num_replicats) + (swap_other_processes) Ā ā¢āÆ Ā Review Ā in Ā report Ā ļ¬le Ā ā¢āÆ send [extract/replicat] <group name>, cachemanager Ā Ā
- 29. Proļ¬ling Ā the Ā GoldenGate Ā Processes Ā ā¢āÆ perf Ā Ā ā¢āÆ Used Ā to Ā proļ¬le Ā OS Ā processes Ā and Ā hardware Ā performance Ā ā¢āÆ strace Ā ā¢āÆ Used Ā to Ā see Ā what Ā processes Ā are Ā calling Ā ā¢āÆ backtrace Ā ļ¬le Ā
- 30. Proļ¬ling Ā the Ā GoldenGate Ā Extract Ā ā¢āÆ backtrace Ā ļ¬le Ā output Ā ā¢āÆ InteresCng Ā ļ¬nd Ā with Ā extract Ā process Ā Ā (6 Ā Threads Ā = Ā 1 Ā extract) Ā
- 31. Proļ¬ling Ā the Ā GoldenGate Ā Extract Ā ā¢āÆ Threads Ā IdenCļ¬ed Ā for Ā extract Ā ā¢āÆ Number Ā of Ā threads Ā increase/add Ā extracts Ā ā¢āÆ 1 Ā extract Ā = Ā 6 Ā threads Ā ā¢āÆ 2 Ā extracts Ā = Ā 12 Ā threads, Ā etc.. Ā ā¢āÆ Each Ā thread Ā takes/uses Ā memory Ā ā¢āÆ Average Ā Memory Ā 22-Āā50 Ā MB Ā ā¢āÆ 3.6-Āā8.3 Ā MB Ā per Ā thread Ā
- 32. Conclusion Ā ā¢āÆ Reviewed Ā Oracle Ā GoldenGate Ā Architecture Ā ā¢āÆ Discussed Ā tuning Ā aspects Ā of Ā Oracle Ā GoldenGate Ā for Ā applicaCon Ā and Ā operaCng Ā system Ā ā¢āÆ Quickly Ā looked Ā at Ā trace Ā of Ā an Ā extract Ā process Ā
- 34. Speaker Ā Info Ā ā¢āÆ Douglasville, Ā Georgia Ā ā¢āÆ Senior Ā Technical Ā Consultant Ā ā¢āÆ Expert Ā OEM12c Ā (2013)/PracCcal Ā ODA Ā (2014) Ā ā¢āÆ TwiYer: Ā @dbasolved Ā ā¢āÆ Blog: Ā hYp://dbasolved.com Ā ā¢āÆ Email: Ā [email protected] Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [email protected] Ā
- 35. Copyright Ā Ā© Ā 2014 Ā Oracle Ā and/or Ā its Ā aļ¬liates. Ā All Ā rights Ā reserved. Ā Ā | Ā Understanding Ā Oracle Ā GoldenGate Ā Architecture Ā Bobby Ā CurCs Ā Senior Ā Technical Ā Consultant Ā Accenture Ā Enkitec Ā Group Ā July Ā 9, Ā 2014 Ā Oracle Ā Conļ¬denCal Ā ā Ā Internal/Restricted/ Highly Ā Restricted Ā 35 Ā Performance Ā Tuning Ā to Ā the Ā OS Ā Level Ā