Implementing a Highly Available

Oracle EBS Architecture

**** ******
Oracle OpenWorld
September 2008
 Agenda

2
 Agenda
ƒ Oracle EBS Architecture

ƒ Single Points of Failure

ƒ High Availability Design

ƒ High Availability Architecture Project Considerations

ƒ Additional Sessions of Interest

ƒ Reference Notes and Web Sites

ƒ Q&A

3
 Oracle EBS Architecture

4
 Oracle EBS Architecture

3-Tier Logical Architecture

Client Tier Application Tier Database Tier

5
 Oracle EBS Architecture: Application Tier

ƒ Web Node
– Self Service Applications
– iStore, iSupplier,
iProcurement, SSHR Client Application Database
Tier Tier Tier

ƒ Forms Node
– Core Applications
– AP, Purchasing, HR, etc

ƒ Concurrent Node
– Oracle EBS Scheduling Utility
– Oracle Delivered/Custom

6
 Oracle EBS Architecture: Database Tier

ƒ Database Node
– Database Server
– Database Listener
Client Application Database
Tier Tier Tier
ƒ Concurrent Node
– Scheduler
– Oracle Delivered/Custom

7
 Single Points of Failure (SPOFs)

8
 Single Points of Failure (SPOFs)

ƒ Servers ƒ Network Attached Storage (NAS)

– Planar, Memory, Power & Storage Area Network (SAN)
Supply – Device Failure
– Internal Disk – Disk Failure
– Network Interface Card (NIC) – Data Access Paths
– Disk Controller – Data Controllers

ƒ Network ƒ Data Center

– Cables – Natural Disaster
– Switches – Catastrophic Event
– Routers
– Load Balancers

9
 Single Points of Failure (SPOFs)

ƒ Web Node ƒ Concurrent Node

– Service Unavailable – Service Unavailable
– Server Unavailable – Server Unavailable
– Network Unavailable – Network Unavailable
– Storage Unavailable – Storage Unavailable
– Data Center Unavailable – Data Center Unavailable

ƒ Forms Node ƒ Database Node

– Service Unavailable – Service Unavailable
– Server Unavailable – Server Unavailable
– Network Unavailable – Network Unavailable
– Storage Unavailable – Storage Unavailable
– Data Center Unavailable – Data Center Unavailable

10
 High Availability Design

11
 Oracle EBS Architecture (Review)

3-Tier Logical Architecture

Client Tier Application Tier Database Tier

12
 High Availability Design: Eliminating SPOFs

ƒ Servers ƒ Network Attached Storage (NAS)

¾ Multiple Servers & Storage Area Network (SAN)
¾ Redundant Array of Disks ¾ Clustering
(RAID) ¾ RAID
¾ Multiple NICs ¾ Replication
¾ Multiple Disk Controllers ¾ Multiple Access Paths
¾ Multiple Controllers

ƒ Network ƒ Data Center

¾ Redundant Cables ¾ Offsite Backup Storage
¾ Redundant Switches ¾ On Demand Data Center
¾ Redundant Routers ¾ Multiple Data Centers
¾ Clustered Load Balancer

13
 High Availability Design: Eliminating SPOFs

ƒ Web Node ƒ Concurrent Node

¾ Load Balance Web Nodes ¾ Parallel Concurrent
Processing

ƒ Forms Node ƒ Database Node

¾ Load Balance Forms Nodes ¾ Oracle DataGuard
• Forms Servlets (R11i & • Physical DataGuard Only
R12) (R11i and R12)
• Forms Metric Server ¾ Oracle Real Application
(R11i only) Clusters (RAC)

14
 High Availability Design
Load Balancing Web

15
 High Availability Design: Application Tier
Load Balancing Web Nodes
ƒ Determine and configure method of Load Balancing
– DNS
– Hardware/Software Load Balancing
– Session persistence
ƒ Define Web Entry Point
ƒ Implementation
– DNS/Network Configuration
– Update Context File Entries with OAM or Advanced
Configuration Wizard
– Run Autoconfig

217368.1 Advanced Configurations and Topologies for the Enterprise Deployments of E-Business Suite
380489.1 Using Load-Balancers with Oracle E-Business Suite Release 12

List of Tested Load Balancers, Firewalls, and Stand-Alone SSL Accelerators:

http://www.oracle.com/technology/products/ias/hi_av/tested_lbr_fw_sslaccel.html

16
 High Availability Design
Load Balancing Forms

17
 High Availability Design: Application Tier
Load Balancing Forms Nodes using Forms Servlets
ƒ Support
– Preferred method for Load Balancing Forms for R11i
– Only method for Load Balancing Forms for R12
ƒ Implementation
– Update context file entries with OAM or the Advanced
Configuration Wizard
– Run Autoconfig

217368.1 Advanced Configurations and Topologies for the Enterprise Deployments of E-Business Suite
380489.1 Using Load-Balancers with Oracle E-Business Suite Release 12

List of Tested Load Balancers, Firewalls, and Stand-Alone SSL Accelerators:

http://www.oracle.com/technology/products/ias/hi_av/tested_lbr_fw_sslaccel.html

18
 High Availability Design
Parallel Concurrent Processing

19
 High Availability Design: Application Tier

Parallel Concurrent Processing

ƒ Distribute Concurrent Managers across multiple nodes
– Distribute load
– Provide fault tolerance
ƒ Implementation: Concurrent Manager Definition
– Define primary and secondary nodes
– Specialization Rules: Include/Exclude Lists
– Workshifts

185489.1 Implement Parallel Concurrent Processing

Refer to chapter 'Defining Concurrent Managers' section 'Overview of Parallel Concurrent
Processing' in Refer to Oracle Applications System Administrator's Guide - Configuration
in the Oracle Applications Documentation Library for more details.

20
 High Availability Design: Application Tier

Implementing Parallel Concurrent Processing

21
 Adding EBS Nodes
Non-Shared Filesystem

22
 High Availability Design: Application Tier
Adding an EBS Node in a Non-Shared Filesystem environment
ƒ Follow Rapid Clone steps (R11i and R12)
– Includes a copy of the source to the target
ƒ Execute step to add the additional node:
cd <COMMON_TOP>/clone/bin
perl adaddnode.pl

230672.1 Cloning Oracle Applications Release 11i with Rapid Clone

406982.1 Cloning Oracle Applications Release 12 with Rapid Clone

23
 High Availability Design: Application Tier

APPL_TOP
APPL_TOP COMMON_TOP
COMMON_TOP 8.0.6
8.0.6 iAS
iAS
24
 High Availability Design: Application Tier

Specifying Node Type

ƒ XML Context File Entries
"s_isDB"
"s_isWeb"
"s_isWebDev"
"s_isAdmin"
"s_isForms"
"s_isFormsDev"
"s_isConc"
"s_isConcDev"

464018.1 How to Add a New Node to The Application Tier, and Make It a Web Server Node Only

25
 High Availability Design: Application Tier

Load
Balancer

`
`

Web/Forms Node Concurrent Node Database Node

Web/Forms Node
Concurrent Node

26
 Adding EBS Nodes
Shared Filesystem

27
 High Availability Design: Application Tier

Shared Application Tier Filesystem (R11i and R12)

– Expands the concept of a shared APPL_TOP (APPL_TOP
and COMMON_TOP)
– Includes Application Tier Technology Stack
– Requires the use of a shared disk resource mounted to
each node
• May implement utilizing Network Attached Storage
(NAS)
• May utilize features of the NAS device to assist with
maintenance tasks
*Refer to MetaLink Notes for commands for R11i and R12
233428.1 Sharing the Application Tier File System in Oracle Applications 11i
384248.1 Sharing The Application Tier File System in Oracle E-Business Suite Release 12
Guidelines about using NFS and NAS devices for Oracle software or database files:
http://download.oracle.com/docs/cd/B19306_01/install.102/b15660/app_nas.htm#sthref1131

28
 High Availability Design: Application Tier

Multi-Node Shared Application Tier Filesystem Benefits

ƒ Reduce maintenance requirements
ƒ Reduce disk requirements
ƒ Perform patching with Distributed AD
– Utilizes multiple application nodes
– Reduces application patching time
ƒ Reduces time to add additional nodes

29
 High Availability Design: Application Tier

Adding an EBS Node in a Shared Application Tier Filesystem

Environment (R11i & R12)
ƒ Prepare existing node by executing adpreclone
ƒ Mount the shared filesystem
ƒ Create new context file*
ƒ Run autoconfig*

*Refer to Metalink Notes for commands for R11i and R12

233428.1 Sharing the Application Tier File System in Oracle Applications 11i, Section 5: Adding a node
to a shared file system
384248.1 Sharing The Application Tier File System in Oracle E-Business Suite Release 12, Section 4:
Adding a Node to a Shared Application Tier File System

30
 High Availability Design: Application Tier

Tape

APPL_TOP
COMMON_TOP
8.0.6
iAS
31
 High Availability Design: Application Tier

Specifying Node Type

ƒ XML Context File Entries
"s_isDB"
"s_isWeb"
"s_isWebDev"
"s_isAdmin"
"s_isForms"
"s_isFormsDev"
"s_isConc"
"s_isConcDev"

464018.1 How to Add a New Node to The Application Tier, and Make It a Web Server Node Only

32
 High Availability Design: Application Tier

Load
Balancer

`
`

Web/Forms Node Concurrent Node Database Node

In
hp proliant DL380g3 E
t
La
xt

Tape
La
n1
SCSI UI
n2

Web/Forms Node
SCSI SCSI
Ultra 3 Ultra 3 Ultra 3 D
146GB 146GB 146GB
5 3 1
SCSI SCSI SCSI
Ultra 3 Ultra 3 Ultra 3
146GB 146GB 146GB
4 2 0

Concurrent Node
NAS
APPL_TOP
COMMON_TOP
8.0.6
iAS
33
 High Availability Design: Database Tier

Oracle DataGuard for EBS R11i and R12

ƒ Physical Standby
ƒ Force Logging
ƒ Archive redo log space
ƒ Document and test database patching procedures
ƒ Document and test failover procedures

216212.1 Business Continuity for Oracle Applications Release 11i, Database Releases 9i and 10g
452056.1 Business Continuity for Oracle Applications Release 12 on Database Release 10gR2

34
 High Availability Design: Database Tier

Load
Balancer

`
`

Application Node Database Node Database Node

Oracle DataGuard

Application Node

35
 High Availability Design: Database Tier

Oracle RAC for EBS R11i and R12

ƒ Clustered database tier
ƒ Increases availability
ƒ Increases scalability

362135.1 Configuring Oracle Applications Release 11i with Oracle10g Release 2

Real Application Clusters and Automatic Storage Management
388577.1 Using Oracle 10g Release 2 Real Application Clusters and Automatic
Storage Management with Oracle E-Business Suite Release 12

36
 High Availability Design: Database Tier

Load
Balancer

`
Oracle RAC
`

Application Node Database Node Database Node

Application Node

37
 High Availability Design

38
 HA Design: Spanning Data Centers

Tape

Tape

39
 HA Design: Spanning Data Centers

Concurrent Node Database Node Database Node Concurrent Node

hp proliant D L380g3 In
E
t
La
xt
Tape

La
n1 hp proliant DL380g3 In
SCSI SCSI SCSI UI
n2 E
t
Ultra 3 D La
xt

Tape
Ultra 3 Ultra 3
146GB 146GB La
n1
146GB SC SI SCSI SCSI UI
n2
5 3 1 Ultra 3 Ultra 3 Ultra 3 D
SCSI SCSI SCSI
Ultra 3
146GB 146GB 146GB
Ultra 3 Ultra 3
5 3 1
146GB 146GB 146GB SC SI SCSI SCSI
4 2 0 Ultra 3 Ultra 3 Ultra 3
146GB 146GB 146GB
4 2 0

Oracle DataGuard
NAS
NAS

Replication

Web/Forms Node Web/Forms Node

40
 HA Design: Spanning Data Centers

Tape

Tape

41
 HA Design: Spanning Data Centers

Oracle Oracle
RAC RAC

Concurrent Node Database Node Database Node Database Node Database Node Concurrent Node

In
hp proliant DL380g3 E
t
La
xt
T ape

La
n1 hp proliant DL380g3 In
SCSI SCSI SCSI UI
n2 E
t
Ultra 3 D La
xt

Tape
Ultra 3 Ultra 3
146GB 146GB 146GB La
n1
SCSI SCSI SCSI UI
n2
5 3 1 Ultra 3 Ultra 3 Ultra 3 D
SCSI SCSI SCSI
Ultra 3
146GB 146GB 146GB
Ultra 3 Ultra 3
5 3 1
146GB 146GB 146GB SCSI SCSI SCSI
4 2 0 Ultra 3 Ultra 3 Ultra 3
146GB 146GB 146GB
4 2 0

Oracle DataGuard
NAS
NAS

Replication

Web/Forms Node Web/Forms Node

42
 High Availability Design
Tips and Techniques
ƒ Consider the extent of HA required for development, test,
QA environments
ƒ Network Bandwidth
– Measure network latency between all nodes
– Measure network latency between data centers
ƒ Multi-node = multiple runs of autoconfig
ƒ Not all EBS configuration can be load balanced
– iPayment, Workflow Notification Mailer
ƒ Monitor proactively
ƒ Use OAM for context file change management
ƒ Use autoconfig templates for configuration customizations
ƒ Configure all node types for all servers; start only services
for specific node type

43
 High Availability Design

Tips and Techniques

ƒ Review, modify and document changes to cloning process
ƒ Review, modify and document changes to patching
process
ƒ Test, test, test…..
ƒ Document all processes and procedures
– Adding nodes, failover procedures, etc, etc…

44
 HA Architecture Project Considerations

45
 HA Architecture Project Considerations

SLA Recovery

Cost

46
 HA Architecture Project Considerations

ƒ Service Level Agreement

– Contract between customers
and providers

– Planned Downtime SLA Recovery

– Maintenance windows
– OS Upgrades, System
Upgrades, Database
maintenance, etc

– Unplanned Downtime Cost

– Hardware Failures
– Service Failures

47
 HA Architecture Project Considerations

ƒ Recovery Time
– Document points of failure

– Document and test recovery

procedures SLA Recovery
– Document recovery time lines

Cost

48
 HA Architecture Project Considerations

ƒ Estimate Cost to deliver SLA

ƒ Estimate Cost of Downtime
– Revenue
– Work hours
– Analyze impact of intangibles SLA Recovery

Cost

49
 Additional Sessions of Interest

50
 Additional Sessions of Interest

Thursday, September 25, 2008

13:30-14:30 PM, Moscone West 2002/04

Session S298389
Advanced Deployment Architectures for Oracle E-Business
Steven Chan, Ivo Dujmovic

15:00-16:00 PM, Moscone West 2007

Session S298391
Oracle Maximum Availability Architecture Best Practices:
Oracle E-Business Suite
Metin Yilmaz, Lyn Pratt

51
 Reference Notes and Web Sites

52
 Reference Notes and Web Sites

MetaLink Title
Note
217368.1 Advanced Configurations and Topologies for the Enterprise Deployments of E-
Business Suite
380489.1 Using Load-Balancers with Oracle E-Business Suite Release 12
201340.1 Using Forms Listener Servlet with Oracle Applications 11i
384241.1 Using Forms Socket Mode with Oracle E-Business Suite Release 12
185489.1 Implement Parallel Concurrent Processing
230672.1 Cloning Oracle Applications Release 11i with Rapid Clone
406982.1 Cloning Oracle Applications Release 12 with Rapid Clone
464018.1 How to Add a New Node to The Application Tier, and Make It a Web Server Node
Only
233428.1 Sharing the Application Tier File System in Oracle Applications 11i
384248.1 Sharing The Application Tier File System in Oracle E-Business Suite Release 12

236469.1 Using Distributed AD in Applications Release 11.5

53
 Reference Notes and Web Sites

MetaLink Title
Note
406652.1 Upgrading Oracle Applications 11i DB to DB 10gR2 with Physical Standby in Place

187242.1 Applying [DB] Patch Sets / Interim Patches with Physical Standby in Place

340859.1 Upgrading Oracle Applications 11i DB to Oracle Database 10g with Physical
Standby in Place
362135.1 Configuring Oracle Applications Release 11i with Oracle10g Release 2 Real
Application Clusters and Automatic Storage Management
388577.1 Using Oracle 10g Release 2 Real Application Clusters and Automatic Storage
Management with Oracle E-Business Suite Release 12
452056.1 Business Continuity for Oracle Applications Release 12 on Database Release 10gR2
216212.1 Business Continuity for Oracle Applications Release 11i, Database Releases 9i and
10g
403347.1 Maximum Availability Architecture and Oracle E-Business Suite Release 11i

54
 Reference Notes and Web Sites

ƒ List of Tested Load Balancers, Firewalls, and Stand-Alone

SSL Accelerators
– http://www.oracle.com/technology/products/ias/hi_av/te
sted_lbr_fw_sslaccel.html
ƒ Refer to this guide for guidelines about using NFS and NAS
devices for Oracle software or database files.
– http://download.oracle.com/docs/cd/B19306_01/install.1
02/b15660/app_nas.htm#sthref1131
ƒ Parallel Concurrent Processing (PCP)
– Refer to chapter 'Defining Concurrent Managers'
section 'Overview of Parallel Concurrent Processing' in
Refer to Oracle Applications System Administrator's
Guide - Configuration in the Oracle Applications
Documentation Library for more details.

55
 Reference Notes and Web Sites

ƒ Oracle Blogs and Forums

– http://blogs.oracle.com/stevenChan
– http://forums.oracle.com
– http://mix.oracle.com

ƒ OAUG SIGs
– OAUG E-Business Applications Technology SIG
http://atssig.oaug.org
– OAUG Database SIG
http://dbsig.oaug.org

56
57