EBS-endeca-technical-considerations

E-Business Suite Extensions
for Oracle Endeca: Technical
Considerations
Muhannad Obeidat
Anurag Malik
Matthew Halliday
Oracle

Safe Harbor Statement

The following is intended to outline our general product
direction. It is intended for information purposes only, and
may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality,
and should not be relied upon in making purchasing decision.
The development, release, and timing of any features or
functionality described for Oracle’s products remains at the
sole discretion of Oracle.

2

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

Insert Information Protection Policy Classification from Slide 12

Overview

3



HALF MY

MORNING
WASTED!
Again!
4



5



Need to Transform Business To …
REQUIREMENTS
RESOLVE

MEASURE

InformationDriven
Business
PRIORITIZE

6


IDENTIFY


Available Today

Order
Management

Warehouse
Management

Enterprise
Asset
Management

Outsourced
Manufacturing

7

Discrete
Manufacturing

Depot
Repair


Process
Manufacturing

iRecruitment

Learning
Management

iProcurement

Projects

Field
Service

Channel
Revenue
Management

Cost
Management

Install
Base

Receivables

Inventory


Enabling Information Driven Business
Accessing Data In Real Time

$

WO

PO
SO

$
PO

EBS DATABASE

8


EBS ENDECA


EBS APPLICATIONS

Integration with EBS

9



Oracle HW, Other HW, or Virtual Machines
EBS Endeca Applications
Results

Results

EBS Middle Tier
Server or VM

Transactions

EBS Database
Server or VM
10



EBS Endeca
Server or VM

(Incremental Refresh)

Oracle HW, Other HW, or Virtual Machines
EBS Endeca Applications
Results

 Same MT Server

EBS Endeca
EBS Middle Tier
Server or VM

Results

Transactions

Incremental Refresh

EBS Database
Server or VM
11



EBS VIEWS

12

INTEGRATOR


MDX SERVER


STUDIO SERVER

Oracle Endeca Information Discovery
Integration Suite
Studio

Integration Suite

Interactive Business Discovery
Create and Share Apps

 Lightweight ETL with native Endeca

Server connectivity

Endeca Server

 Java SDK for extensibility – easily

Hybrid Search/Analytical Database
Flexible Data Model

connect to additional data feeds and
APIs

Integration Suite

 Modules for unstructured data:

Data Integration and Enrichment
Structured and Unstructured


Sentiment Analysis

•


Text Enrichment

•

13

•

Content Management System Connectors

Oracle Endeca Information Discovery – Integrator Server
 Provides enterprise class platform for

executing ingest workflow at scale
 Runs on Weblogic
 Contains single tuned “Engine” for

executing all ingest streams (or graphs)
 Provides mechanism to schedule and

monitor ingest graphs
 Allows graphs to be started via HTTP
 Provides security and administration

features
 Offers a “sandbox” for each OEID project

(or EBS Endeca App)
 Typically one project per Data Domain

14



Endeca Server
Studio

Oracle Endeca Server


 Hybrid search/analytical database

 Search, navigation, and analytics on

Endeca Server

diverse, changing information

Flexible Data Model

 Designed for Discovery
•

15



Columnar storage

•


Flexible data model

•

Integration Suite

In-memory analytics

Oracle Endeca Information Discovery – Data Domain
Vendors
 Columnar Record Store
 Schema-less, self-describing

records
 Denormalized records

Contracts

 Collection of attributes, Key

Value Pairs
 Some attributes are navigable
 Some attributes are searchable

 Different entities introduced

through “record-types” concept
 EBS Endeca Apps has a

different Data Domain for each
app

16



Payments

Studio
Studio

Studio


 Interactive, visual discovery

environment

Endeca Server

 Drag-and-drop configuration

Flexible Data Model

 Full-featured component library
 Based on best practice UI design

Integration Suite

patterns


 Built on Java portal technology

standards

17



Endeca’s Unique User Experience
Interactive Data Exploration and Analysis

•
•
•
•

18

Advanced Search
Search across all data
Dynamic typeahead
Automatic spell correction
Unlocks unstructured data

+


Contextual Navigation
• Data-Driven. Freely browse data without
predefined paths or writing queries
• Interactive. Shows only valid next steps
• Easy to Use. Familiar online experience


+

Visual Analysis
• Charts, crosstabs, key metrics
• Geospatial visualization
• Tag clouds

UI and Security Integration

19



E-Business Suite
Security
Security
Navigation
E-BUSINESS SUITE EXTENSIONS FOR ENDECA

20



E-Business Suite with Embedded Endeca Content
 Authentication
 Fully Integrated with EBS Security
 No need for extra setup
 No SSO setup required

 Authorization
 UI is secured by FND function
security
 Flexibility in granting access to
Endeca content
 EBS data security is enforced

 UI Integration
 Out-of-the-box UI Integration
 Embedded experience

21



OA Integration
 Ability to drill down to an OA page in context

22



Forms Integration
 Ability to drill down to EBS forms in context

23



Data Integration

24



EBS Endeca Views

 Each Extension module delivers views installed on the EBS database
– Optimized to minimize impact on EBS during data load

 Each row represents a record to be loaded to a data domain
– “Last update date” attribute allows ETL to detect changes since prior load

– Security-related attributes ensure that data a user sees in Endeca UI

honors the same data security as EBS transaction screens
(e.g., responsibility, org id, inventory id)

25



Full Load
 Reset data domain
– Wipe out metadata
– Wipe out data

 Load attribute configuration and associated metadata
 Load application data from EBS views (with any app specific filters)
 Hint: Full load to an offline machine
– Avoid data domain being inaccessible for an extended period

26



Incremental Load
 Loads application data created/updated since previous load, filtering rows

where eid_last_update_date >= (last successful ETL DateTime) and
eid_last_update_date < (DateTime of Current Run)
 Does not affect metadata

Last successful
load

27


Load Failed


Current
load

Running ETL

28



Data Synchronization

 Tradeoffs in determining how often to run an Incremental Refresh
– More often means more impact on EBS production system
– Less often means a longer lag time before updates are reflected in Endeca

screens
– Example of where you might want a short refresh interval:
 Orders in Order Management Extension (transactional data)
– Example of where you might tolerate a longer refresh interval:
 Inventory items in Inventory Management Extension (reference data)

29



Running ETL

30



Personalization

31



Endeca UI Personalization

 Define FND function
 Grant access to FND function
 Personalize OA UI

32



Define FND Function

33



Grant FND Function

34



Personalize OA Page

35



Endeca UI Content Modification

Metrics

Tag Clouds

Display
Names
Charts
36



Start Integrator and click on File-NewCloverETL Server Project

40



Taking backup of the Sandbox

Clicking on this icon will download Sandbox zip
file. In this case all the ETL files for OM is zipped
into one zip file and downloaded

41



Installation

42



FAST Deployment

ONE
DAY
D

43

2013,


Prerequisites and BOM
Components and Versions

Linux 5/6 64 bit
EID Components: Server 7.5.1, Studio 3.0, Integrator 3.3.0.36
Weblogic Server 10.3, Oracle Express DB
EBS Product Family Patches
V4 is available for EBS 12.1.3 and 12.2.2

44



Sizing and Capacity Planning for Endeca Instance
 Sizing depends on multiple factors
– Total number of named and active users
– Number of extensions implemented
– Data set size across different data domains
– Frequency of incremental loads

 Endeca Load Types
– Load from full and incremental ETLs on EBS DB
– Online user activity on Endeca tier side both Sever and Studio
– Technology requires sufficient memory and CPU to function optimally

45



Setup Process
Endeca Tier

Step 1

Download
QuickInstall
Run QI Endeca
Phase

EBS Tier
Apply Patches
Configure Proxy

Validate Setup

Step 2
Integrate EID with
EBS (EBS Phase)

Validate Endeca
Content in EBS

Step 3

46


Setup RBAC


QuickInstall - Pre-Configured Template

HCM
Application

N Application

iProc Data
Source

Studio

iProc
Application

HCM Data
Source

N Data Source

Endeca
Server

Integrator
Server

47

Data
Domain
iProc.

iProc. Graph


Data
Domain
HCM

HCM Graph


Data
Domain
N

N Graph

WLS Directory Structure
FMW_HOME
user_projects
domains

endeca_domain - Admin Server - 7002

EndecaManagedServer - 7001

wlserver_10.3

StudioManagedServer - 7004
integrator_domain - Admin Server - 7005
CloverManagedServer - 7006
Sandboxes
portal-ext.properties
data/endeca-data-sources/*json Files

48



Setup Gotchas
EBS Integration
 Endeca tier should be on same

domain as EBS
 Need to enable proxy and rewrite

modules on EBS Apache
 Apps password is stored in WLS

datasource store. Need to be
updated if changed
 EBS cookie name for

EBS_APPSERVER_ID
–

49

FND_SESSION_MANAGEM
ENT.getsessioncookiename()


Endeca Data Sources
 Data source validation fails with

message definition
successful, unable to connect
– Ensure endeca-server and

data domain is up
– Check data domain log under

/u01/Oracle/Endeca/Server/7.5
.1/endeca-server/logs/<datadomain>.out
– If the error is Invalid Time

Zone, configure the system
timezone to use a location
based format instead of an
area/ocean format


Backing DB
 DB Issues:
– Ensure TWO_TASK variable

shouldn’t be set
– LD_BIND_NOW should be set

to 1
– DB owner should be part to

DBA group
– Ensure sufficient privileges on

/var/tmp/.oracle directory to
avoid listener startup issues

Lifecycle Management

50



Lifecycle Management Support - 12.1.3.4
Component
Installation

1562372.1

Globalization

1562374.1

Advanced Configurations (SSL, DMZ)

51

MOS Doc ID

1562608.1



Patching

52



QuickPatch - Applying Patches
APPL_TOP
CRM
PRC

adpatch

EBS/ENDECA
Artifacts

PRJ
SCM
HCM
FIN

EBS
12.1.3.4/12.2.2+
53



Creating Payload.zip
APPL_TOP
CRM
PRC
PRJ

CreatePayload.sh

SCM
HCM
FIN

EBS
54



Patch Endeca Artifacts

ETL Graphs
Studio Pages (LARs)
Data Source

Integrator Server

Security Jars
Auto Login Filter

PatchEID.sh*
Studio

FND EID Extensions

Endeca Information Discovery
(EID)

ICX EID Extensions
FND Common Extensions

Payload.zip
55


* EID patches are applied through EBS

Backup

56



Full Cycle- export, import and recover
Export Data Domain
Exported
Data Domain

Generate
Offline Directory

Import Data Domain
Endeca Server

Restore

Exported
Data Domain

Recover Data Domain
FND_EID_AUDIT_TRAIL

57



Configure
File

Stamp Restore Date

Backup and Restore of Data Domains

 Export utility as part of QuickInstall

 export.sh script
– Backups one domain or all domains
– Stores data domain backup in offline directory

– Creates a configuration file to capture details on backup
 restore_date

58




 Import utility as part of QuickInstall

 import.sh script
– Imports one domain or all domains
– Restores the domain from backup based on name

– Optionally, restoration of backup and audit table update through recover.sh
 restore_date

59




 recover.sh script
– Can be used manually
– Uses restore_date exported with data domain
– Takes care of updating audit tables

– Used for specific data domain or all data domains

60



Cloning

61



Cloning

 Build one master template, create multiple copies

 Can be used to clone production into development and testing
 Handles cloning all components
– All binaries including integrator, server, studio and backing DB

– Data domains

62



Cloning

 Master Environment
– Export all data domains
– Delete all data domains
– Shutdown all services including XE DB

– Package Endeca directories (app, diag, Oracle)

63



Cloning

 Target Environment
– Extract the package in destination target
– Start Endeca server and Endeca managed server
– Import data domains

– Start up XE database
– Start up Integrator and the Studio

64



Load Balancing and High
Availability

65



Reference Implementation
QI Leader

Studio

QI Follower

Studio

QI Follower

Studio

Balancer
Clover

Clover

Clover

Balancer

Shared
Sandboxes

Balancer

66



Endeca Server Cluster Topology
Server 1

Server 2

Server 3

Server X

eam

eam

Follower1

Follower2

FollowerX

icx-iproc
Leader

icx-iproc

icx-iproc

icx-iproc

Follower1

Follower2

FollowerX

wip-dwo
Leader

wip-dwo

wip-dwo

wip-dwo

Follower1

Follower2

FollowerX

+ CC

+ CC

+ CC

[ + CC ]

eam
Leader

eam

Cluster coordinator is optional after three but must be on an odd number of clusters.
67



Endeca Studio Cluster Topology

Load Balancer

Synchronized Caching

Studio

Studio

Sticky Session
Routing

Studio

Shared Database
Studio Database

68



Integrator Server Cluster Topology
Server 1

Server 2

Server N

CloverETL

CloverETL

CloverETL

Shared Sandboxes
Shared Sandboxes

69



Migrate Endeca Schemas to EBS DB

 Export schemas from XE DB for ebs_eid_integrator and

ebs_eid_studio
 Import into a RAC enabled DB, ideally your EBS DB
 Reduces maintenance activities as it eliminates need for Oracle
Express DB on Endeca tier

70



Monitoring and Diagnostics

71



Server & Application Logs
FMW_HOME (/u01/Oracle/Middleware)

-- Server Logs

user_projects

-- Application Logs

domains
endeca_domain
wlserver_10.3

bin

domain.log, endeca.log, studio.log
eid-studio.log

EndecaServer
logs

*.out

integrator_domain
bin

domain.log, clover.log

clover_temp_dir
cloverlogs
graph
72



*.log

Monitoring Data Domain

 URL to monitor data domain and expose statistics

 General URL pattern per data domain
– http://[host]:[port]/endeca-server/admin/[data_domain_name]?op=stats

 Covers multiple areas including
– Performance
– Caching
– Indexing

73



Monitoring Data Domain

74



Multi-Language Support

75



V4 Broader Language Support
Endeca Server 7.5.1
 Language sensitive search support for 22 languages:
• European:

English, Czech, Dutch, French, German, Greek, Hungarian, Itali
an, Polish, Portuguese, Romanian, Russian, Spanish, Swedish,
Thai, Turkish, Catalan
• BiDi: Hebrew
• Asian: Japanese, Korean, Simplified Chinese, Traditional
Chinese

76



V4 Multi Language Support

US

FR

GER

US

FR

GER

QI for French Language

QI for German Language

QI for English Language

One Data Domain, One Studio community per language

77


…….

E-Business Suite
Database


JA

JA

QI for Japanese Language

Additional Resources

78



Youtube Channel

http://www.youtube.com/user/OracleEBSdemos/featured
79



EBS-Endeca Linkedin Group

80



QuickInstall - Download
 Oracle E-Business Suite
Extensions for Oracle Endeca
Media Pack for Linux x86,
Release 12.1.3.4 (aru
16672160)
 Oracle E-Business Suite
Extensions for Oracle Endeca
Server Quick Install for Linux
x86-64

https://edelivery.oracle.com
81



Setup Documentation
 Setup & configuration steps,
reference information
•
•
•
•
•

Endeca UI
Access control
Profile options
Full & incremental loads
ETL Views

http://download.oracle.com/docs/cd/E18727_01/index.htm
82



Online Training
How to Implement and Use EBS Extensions for Oracle Endeca
My Oracle Support:
Transfer of Information (TOI) Online Training
Links* > Tools and Training > E-Business Suite > Release 12.1 Info Center
(Doc ID: 807319.1 )

83


* To access Links, on the Knowledge tab choose Customize Page and drag Links onto the page


Logging SRs
 Log SRs with your OPN
Membership CSI
• Install / Upgrade Issues:
10240
• Other Issues: Related
product id

 OPN Support Entitlements

84



Sales Collateral: Solution Brief

http://www.oracle.com/us/products/applications/ebusiness/ebiz-suite-endeca-solution-brief-1896945.pdf

85



86



EBS-endeca-technical-considerations

Recommended

More Related Content

What's hot (20)

Viewers also liked (20)

Similar to EBS-endeca-technical-considerations (20)

More from Berry Clemens (20)

Recently uploaded (20)

EBS-endeca-technical-considerations

Editor's Notes