Informatica PowerCenter 8.

6
Data Quality 8.6
Update Session
Identity Resolution
4 november 2008

Arjan Hijstek – Senior Sales Consultant

Alex Bruschke – Sales Consultant

1
• Informatica
- upgrades/updates vs. support
• PowerCenter 8.6
- new architecture

- new features
* CacheCalc
* Parameters
* GRID/High Availability
* Data Masking

- RTM – Reference Table Manager

- Mapping Analyst for Excel

2
• Informatica
- upgrades/updates vs. support
• PowerCenter 8.6
- new architecture

- new features
* CacheCalc
* Parameters
* GRID/High Availability
* Data Masking

- RTM – Reference Table Manager

- Mapping Analyst for Excel

3
PowerCenter 6 and 7 Architecture
Sources Targets
Client Tools
Designer Rep. Manager
Standards, Standards,
Messaging, Messaging,
Web Services WF Manager WF Monitor Web Services

Web Services Repository

Repository Database
Hub Server
Packaged Packaged
Applications Applications

Relational/Flat Relational/Flat
Files
Files
Data Servers (pmserver)
PowerCenter
Connects

Mainframe/
PowerExchange Mainframe/
Midrange Midrange

4
PowerCenter 8 Architecture

Client Tools
Repository Manager Workflow Manger

Designer Workflow Monitor

Administration Console

Application Services Repository

Database
Integration Service Repository Service

Web Services Hub * SAP BW Service

Core Services
PowerCenter
Connects Repository Service
Domain/Gateway Services Log Service
• Administration & Authorization
• Configuration
PowerExchange • Domain
• Licensing

Node & Domain

5
Domain Overview Dashboard

6
7
• Informatica
- upgrades/updates vs. support
• PowerCenter 8.6
- new architecture

- new features
* CacheCalc
* Parameters
* GRID/High Availability
* Data Masking

- RTM – Reference Table Manager

- Mapping Analyst for Excel

8
9
• Informatica
- upgrades/updates vs. support
• PowerCenter 8.6
- new architecture

- new features
* CacheCalc
* Parameters
* GRID/High Availability
* Data Masking

- RTM – Reference Table Manager

- Mapping Analyst for Excel

10
Additional levels of specification
(in parameter files)
high low
GLOBAL

PRECEDENCE
SERVICE
SCOPE

SERVICE PROCESS

WORKFLOW

SESSION
low high

11
 Example parameter file

Global level

Service level

Service process
level

Workflow level
takes precedence
over higher order levels
such as Global / Service
/ Service Process.

12
Expanded areas of parametrization
• Pre-defined server variables can be overridden in parameter file now
• Use of workflow variables in any task in the workflow as a parameter
• Owner name of relational source
• Table name prefix of relational target
• E-mail address in e-mail tasks and pre/post session e-mails
• File name parameterization
Workflow and session log file names
FTP remote file name
Persistent cache file name
• Use of workflow/session/mapping variables and parameters in
E-mail subject/ body
Pre/post SQL for source & target
Environment SQL
Transaction SQL
Pre/post session commands
Call text of stored procedures

13
• Informatica
- upgrades/updates vs. support
• PowerCenter 8.6
- new architecture

- new features
* CacheCalc
* Parameters
* GRID/High Availability
* Data Masking

- RTM – Reference Table Manager

- Mapping Analyst for Excel

14
PowerCenter 8 Architecture

Client Tools
Repository Manager Workflow Manger

Designer Workflow Monitor

Administration Console

Application Services Repository

Database
Integration Service Repository Service

Web Services Hub * SAP BW Service

Core Services
PowerCenter
Connects Repository Service
Domain/Gateway Services Log Service
• Administration & Authorization
• Configuration
PowerExchange • Domain
• Licensing

Node & Domain

15
Domain Overview Dashboard

16
High Availability in PowerCenter V8

• Failover
• Restart for data integration, repository and other services
• Primary and backup servers

• Recovery
• Workflow and sessions will be recovered on running servers on
the grid during server failure
• Checkpoint recovery
• Repository recovery

• Resilience
• PowerCenter jobs will sustain transient failure
• Network errors
• DB connection failures

17
 Simple High Availability/Failover Scenario

• Simple environment with 2

nodes for services and 1
server for repository.
A
B C
• Repository database is on C
Node A Node B

Integration
Service Primary Backup

Repository
Service Backup Primary

18
 Simple High/Failover Availability Scenario

• Node A goes down

• Integration Service fails over to
Node B A
B C

Node A Node B

Integration
Service Unavailable Backup

Repository
Service Unavailable Primary

19
• Informatica
- upgrades/updates vs. support
• PowerCenter 8.6
- new architecture

- new features
* CacheCalc
* Parameters
* GRID/High Availability
* Data Masking

- RTM – Reference Table Manager

- Mapping Analyst for Excel

20
 Protecting Sensitive Data
Restrict Access, Mask Private Data

• Development and Testing John Smith

654-65-8945
4563-3456-9876-6342

• Training 100 Cardinal way

Redwood city

• Support
Glen Carter

• Data Analysis 900-45-2643

4563-XXXX-XXXX-6342
342 54th Street
New York
• Outsourcing and Offshoring

21
What is Data Masking?

• Transformation of sensitive information into

de-identified, realistic-looking data
while retaining original data properties

• Data remains relevant and meaningful

• Preserves the shape and form of individual fields
• Preserves intra-record relationships
• Preserves join / foreign key relationships

John Smith Glen Carter

654-65-8945 900-45-2643
4739-1146-8075-5716 4739-1102-3517-8842
100 Cardinal way 342 54th Street
Redwood City New York

22
Masking Production Data for Test Environment

Production Environment Test Environment

Mainframe and Mainframe and

Mid-Range Mid-Range

Packaged Packaged
Applications Applications

PowerCenter +
Relational and Relational and
Flat Files Data Masking Option Flat Files

Standards and Standards and

Messaging Messaging

Remote Data Remote Data

23
 CUSTOMERS_PROD CUSTOMERS_TEST

PowerCenter +
Data Masking Option

CUSTOMER_ACCOUNTS CUSTOMER_ACCOUNTS
_PROD _TEST

24
25
• Informatica
- upgrades/updates vs. support
• PowerCenter 8.6
- new architecture

- new features
* CacheCalc
* Parameters
* GRID/High Availability
* Data Masking

- RTM – Reference Table Manager

- Mapping Analyst for Excel

26
Reference Table Manager (RTM) Overview

• An easy-to-use interface for business analysts/SMEs to:

• Create, edit and delete reference tables
• Manually edit reference data, such as valid values and cross-references,
individually or en masse
• Designate default values
• Import and export reference tables as .csv or .xls
• View an audit trail documenting the changes to the reference tables

27
Typical Use Cases

• Data Migrations
• Define default values for an application (e.g. the default value to
load into a field when there is no corresponding data from the
source system)
• Define valid values for an application (e.g. the list of acceptable
geography codes for an ERP application)
• Cross-reference data values from one application to another
(e.g. how the accounting codes from a legacy financial system
map to the codes in the new finance application)

• Data Warehousing/Other Data Integration

• Manage lookups for data warehousing operations

28
RTM empowers the business SME to create, edit and
manage reference tables directly

Benefit: Tighten business-IT collaboration;

accelerate project delivery

29
RTM maintains an audit trail on changes to the
reference data

Benefit: Ensure compliance

30
RTM is integrated with PowerCenter Admin Console

Benefit: Enterprise-grade security;

lower administrative overhead

31
32
• Informatica
- upgrades/updates vs. support
• PowerCenter 8.6
- new architecture

- new features
* CacheCalc
* Parameters
* GRID/High Availability
* Data Masking

- RTM – Reference Table Manager

- Mapping Analyst for Excel

33
 Mapping Analyst for Excel
Current Approach

Business Analyst Data Analyst Mapping

1. Gathers requirements from 1. Create source to target mapping Specification
the business specifications with transformation rules English/Pseudo Code
2. Documents business on a spreadsheet
information and business rules

DI Developer
1. Translate mapping specifications into
PowerCenter Mappings

34
Mapping Analyst for Excel
Mapping Specification: Issues with Current Practice
Each analyst has his
own Excel format

Rules are free-

form and
unstructured
Finding the right
sources for business
information takes a
long time

No easy way to collaborate.

Passing spreadsheets & documents back and forth.
Specification becomes out-dated quickly.

35
 Mapping Analyst for Excel
The Informatica Solution

Business Analyst Data Analyst

1. Gathers requirements from 1. Create source to target mapping
the business specifications with transformation rules
2. Documents business 2. Auto-generate PowerCenter Mapping Specification
information and business rules Mapping English/Pseudo Code on a
spreadsheet

DI Developer
1. Augment & Tune Generated
PowerCenter Mappings
2. Re-use mappings for other projects

36
 Mapping Analyst for Excel
Keep Specifications Updated
• Define business terms
• Specify associated sources, target • Jumpstart mappings from specification
• Define transformation rules • Modify and optimize mappings
Analyst • Standardize Excel format Developer • Synchronize mappings w/ spec.

Auto-generate PowerCenter mappings

Mapping Analyst for Excel PowerCenter

Auto-generate specification from modified mappings

Benefit: Improve documentation and
auditability

37
Mapping Specification Lifecycle

38
39