Informatica (Version 10.

0)

Application Service Guide

Informatica Application Service Guide

Version 10.0
November 2015
Copyright (c) 1993-2015 Informatica LLC. All rights reserved.
This software and documentation contain proprietary information of Informatica LLC and are provided under a license agreement containing restrictions on use and
disclosure and are also protected by copyright law. Reverse engineering of the software is prohibited. No part of this document may be reproduced or transmitted in any
form, by any means (electronic, photocopying, recording or otherwise) without prior consent of Informatica LLC. This Software may be protected by U.S. and/or
international Patents and other Patents Pending.
Use, duplication, or disclosure of the Software by the U.S. Government is subject to the restrictions set forth in the applicable software license agreement and as
provided in DFARS 227.7202-1(a) and 227.7702-3(a) (1995), DFARS 252.227-7013(1)(ii) (OCT 1988), FAR 12.212(a) (1995), FAR 52.227-19, or FAR 52.227-14
(ALT III), as applicable.
The information in this product or documentation is subject to change without notice. If you find any problems in this product or documentation, please report them to us
in writing.
Informatica, Informatica Platform, Informatica Data Services, PowerCenter, PowerCenterRT, PowerCenter Connect, PowerCenter Data Analyzer, PowerExchange,
PowerMart, Metadata Manager, Informatica Data Quality, Informatica Data Explorer, Informatica B2B Data Transformation, Informatica B2B Data Exchange Informatica
On Demand, Informatica Identity Resolution, Informatica Application Information Lifecycle Management, Informatica Complex Event Processing, Ultra Messaging and
Informatica Master Data Management are trademarks or registered trademarks of Informatica LLC in the United States and in jurisdictions throughout the world. All
other company and product names may be trade names or trademarks of their respective owners.
Portions of this software and/or documentation are subject to copyright held by third parties, including without limitation: Copyright DataDirect Technologies. All rights
reserved. Copyright Sun Microsystems. All rights reserved. Copyright RSA Security Inc. All Rights Reserved. Copyright Ordinal Technology Corp. All rights
reserved.Copyright Aandacht c.v. All rights reserved. Copyright Genivia, Inc. All rights reserved. Copyright Isomorphic Software. All rights reserved. Copyright Meta
Integration Technology, Inc. All rights reserved. Copyright Intalio. All rights reserved. Copyright Oracle. All rights reserved. Copyright Adobe Systems
Incorporated. All rights reserved. Copyright DataArt, Inc. All rights reserved. Copyright ComponentSource. All rights reserved. Copyright Microsoft Corporation. All
rights reserved. Copyright Rogue Wave Software, Inc. All rights reserved. Copyright Teradata Corporation. All rights reserved. Copyright Yahoo! Inc. All rights
reserved. Copyright Glyph & Cog, LLC. All rights reserved. Copyright Thinkmap, Inc. All rights reserved. Copyright Clearpace Software Limited. All rights
reserved. Copyright Information Builders, Inc. All rights reserved. Copyright OSS Nokalva, Inc. All rights reserved. Copyright Edifecs, Inc. All rights reserved.
Copyright Cleo Communications, Inc. All rights reserved. Copyright International Organization for Standardization 1986. All rights reserved. Copyright ejtechnologies GmbH. All rights reserved. Copyright Jaspersoft Corporation. All rights reserved. Copyright International Business Machines Corporation. All rights
reserved. Copyright yWorks GmbH. All rights reserved. Copyright Lucent Technologies. All rights reserved. Copyright (c) University of Toronto. All rights reserved.
Copyright Daniel Veillard. All rights reserved. Copyright Unicode, Inc. Copyright IBM Corp. All rights reserved. Copyright MicroQuill Software Publishing, Inc. All
rights reserved. Copyright PassMark Software Pty Ltd. All rights reserved. Copyright LogiXML, Inc. All rights reserved. Copyright 2003-2010 Lorenzi Davide, All
rights reserved. Copyright Red Hat, Inc. All rights reserved. Copyright The Board of Trustees of the Leland Stanford Junior University. All rights reserved. Copyright
EMC Corporation. All rights reserved. Copyright Flexera Software. All rights reserved. Copyright Jinfonet Software. All rights reserved. Copyright Apple Inc. All
rights reserved. Copyright Telerik Inc. All rights reserved. Copyright BEA Systems. All rights reserved. Copyright PDFlib GmbH. All rights reserved. Copyright
Orientation in Objects GmbH. All rights reserved. Copyright Tanuki Software, Ltd. All rights reserved. Copyright Ricebridge. All rights reserved. Copyright Sencha,
Inc. All rights reserved. Copyright Scalable Systems, Inc. All rights reserved. Copyright jQWidgets. All rights reserved. Copyright Tableau Software, Inc. All rights
reserved. Copyright MaxMind, Inc. All Rights Reserved. Copyright TMate Software s.r.o. All rights reserved. Copyright MapR Technologies Inc. All rights reserved.
Copyright Amazon Corporate LLC. All rights reserved. Copyright Highsoft. All rights reserved. Copyright Python Software Foundation. All rights reserved.
Copyright BeOpen.com. All rights reserved. Copyright CNRI. All rights reserved.
This product includes software developed by the Apache Software Foundation (http://www.apache.org/), and/or other software which is licensed under various versions
of the Apache License (the "License"). You may obtain a copy of these Licenses at http://www.apache.org/licenses/. Unless required by applicable law or agreed to in
writing, software distributed under these Licenses is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
implied. See the Licenses for the specific language governing permissions and limitations under the Licenses.
This product includes software which was developed by Mozilla (http://www.mozilla.org/), software copyright The JBoss Group, LLC, all rights reserved; software
copyright 1999-2006 by Bruno Lowagie and Paulo Soares and other software which is licensed under various versions of the GNU Lesser General Public License
Agreement, which may be found at http:// www.gnu.org/licenses/lgpl.html. The materials are provided free of charge by Informatica, "as-is", without warranty of any
kind, either express or implied, including but not limited to the implied warranties of merchantability and fitness for a particular purpose.
The product includes ACE(TM) and TAO(TM) software copyrighted by Douglas C. Schmidt and his research group at Washington University, University of California,
Irvine, and Vanderbilt University, Copyright () 1993-2006, all rights reserved.
This product includes software developed by the OpenSSL Project for use in the OpenSSL Toolkit (copyright The OpenSSL Project. All Rights Reserved) and
redistribution of this software is subject to terms available at http://www.openssl.org and http://www.openssl.org/source/license.html.
This product includes Curl software which is Copyright 1996-2013, Daniel Stenberg, <[email protected]>. All Rights Reserved. Permissions and limitations regarding this
software are subject to terms available at http://curl.haxx.se/docs/copyright.html. Permission to use, copy, modify, and distribute this software for any purpose with or
without fee is hereby granted, provided that the above copyright notice and this permission notice appear in all copies.
The product includes software copyright 2001-2005 () MetaStuff, Ltd. All Rights Reserved. Permissions and limitations regarding this software are subject to terms
available at http://www.dom4j.org/ license.html.
The product includes software copyright 2004-2007, The Dojo Foundation. All Rights Reserved. Permissions and limitations regarding this software are subject to
terms available at http://dojotoolkit.org/license.
This product includes ICU software which is copyright International Business Machines Corporation and others. All rights reserved. Permissions and limitations
regarding this software are subject to terms available at http://source.icu-project.org/repos/icu/icu/trunk/license.html.
This product includes software copyright 1996-2006 Per Bothner. All rights reserved. Your right to use such materials is set forth in the license which may be found at
http:// www.gnu.org/software/ kawa/Software-License.html.
This product includes OSSP UUID software which is Copyright 2002 Ralf S. Engelschall, Copyright 2002 The OSSP Project Copyright 2002 Cable & Wireless
Deutschland. Permissions and limitations regarding this software are subject to terms available at http://www.opensource.org/licenses/mit-license.php.
This product includes software developed by Boost (http://www.boost.org/) or under the Boost software license. Permissions and limitations regarding this software are
subject to terms available at http:/ /www.boost.org/LICENSE_1_0.txt.
This product includes software copyright 1997-2007 University of Cambridge. Permissions and limitations regarding this software are subject to terms available at
http:// www.pcre.org/license.txt.
This product includes software copyright 2007 The Eclipse Foundation. All Rights Reserved. Permissions and limitations regarding this software are subject to terms
available at http:// www.eclipse.org/org/documents/epl-v10.php and at http://www.eclipse.org/org/documents/edl-v10.php.

This product includes software licensed under the terms at http://www.tcl.tk/software/tcltk/license.html, http://www.bosrup.com/web/overlib/?License, http://
www.stlport.org/doc/ license.html, http://asm.ow2.org/license.html, http://www.cryptix.org/LICENSE.TXT, http://hsqldb.org/web/hsqlLicense.html, http://
httpunit.sourceforge.net/doc/ license.html, http://jung.sourceforge.net/license.txt , http://www.gzip.org/zlib/zlib_license.html, http://www.openldap.org/software/release/
license.html, http://www.libssh2.org, http://slf4j.org/license.html, http://www.sente.ch/software/OpenSourceLicense.html, http://fusesource.com/downloads/licenseagreements/fuse-message-broker-v-5-3- license-agreement; http://antlr.org/license.html; http://aopalliance.sourceforge.net/; http://www.bouncycastle.org/licence.html;
http://www.jgraph.com/jgraphdownload.html; http://www.jcraft.com/jsch/LICENSE.txt; http://jotm.objectweb.org/bsd_license.html; . http://www.w3.org/Consortium/Legal/
2002/copyright-software-20021231; http://www.slf4j.org/license.html; http://nanoxml.sourceforge.net/orig/copyright.html; http://www.json.org/license.html; http://
forge.ow2.org/projects/javaservice/, http://www.postgresql.org/about/licence.html, http://www.sqlite.org/copyright.html, http://www.tcl.tk/software/tcltk/license.html, http://
www.jaxen.org/faq.html, http://www.jdom.org/docs/faq.html, http://www.slf4j.org/license.html; http://www.iodbc.org/dataspace/iodbc/wiki/iODBC/License; http://
www.keplerproject.org/md5/license.html; http://www.toedter.com/en/jcalendar/license.html; http://www.edankert.com/bounce/index.html; http://www.net-snmp.org/about/
license.html; http://www.openmdx.org/#FAQ; http://www.php.net/license/3_01.txt; http://srp.stanford.edu/license.txt; http://www.schneier.com/blowfish.html; http://
www.jmock.org/license.html; http://xsom.java.net; http://benalman.com/about/license/; https://github.com/CreateJS/EaselJS/blob/master/src/easeljs/display/Bitmap.js;
http://www.h2database.com/html/license.html#summary; http://jsoncpp.sourceforge.net/LICENSE; http://jdbc.postgresql.org/license.html; http://
protobuf.googlecode.com/svn/trunk/src/google/protobuf/descriptor.proto; https://github.com/rantav/hector/blob/master/LICENSE; http://web.mit.edu/Kerberos/krb5current/doc/mitK5license.html; http://jibx.sourceforge.net/jibx-license.html; https://github.com/lyokato/libgeohash/blob/master/LICENSE; https://github.com/hjiang/jsonxx/
blob/master/LICENSE; https://code.google.com/p/lz4/; https://github.com/jedisct1/libsodium/blob/master/LICENSE; http://one-jar.sourceforge.net/index.php?
page=documents&file=license; https://github.com/EsotericSoftware/kryo/blob/master/license.txt; http://www.scala-lang.org/license.html; https://github.com/tinkerpop/
blueprints/blob/master/LICENSE.txt; http://gee.cs.oswego.edu/dl/classes/EDU/oswego/cs/dl/util/concurrent/intro.html; https://aws.amazon.com/asl/; https://github.com/
twbs/bootstrap/blob/master/LICENSE; https://sourceforge.net/p/xmlunit/code/HEAD/tree/trunk/LICENSE.txt; https://github.com/documentcloud/underscore-contrib/blob/
master/LICENSE, and https://github.com/apache/hbase/blob/master/LICENSE.txt.
This product includes software licensed under the Academic Free License (http://www.opensource.org/licenses/afl-3.0.php), the Common Development and Distribution
License (http://www.opensource.org/licenses/cddl1.php) the Common Public License (http://www.opensource.org/licenses/cpl1.0.php), the Sun Binary Code License
Agreement Supplemental License Terms, the BSD License (http:// www.opensource.org/licenses/bsd-license.php), the new BSD License (http://opensource.org/
licenses/BSD-3-Clause), the MIT License (http://www.opensource.org/licenses/mit-license.php), the Artistic License (http://www.opensource.org/licenses/artisticlicense-1.0) and the Initial Developers Public License Version 1.0 (http://www.firebirdsql.org/en/initial-developer-s-public-license-version-1-0/).
This product includes software copyright 2003-2006 Joe WaInes, 2006-2007 XStream Committers. All rights reserved. Permissions and limitations regarding this
software are subject to terms available at http://xstream.codehaus.org/license.html. This product includes software developed by the Indiana University Extreme! Lab.
For further information please visit http://www.extreme.indiana.edu/.
This product includes software Copyright (c) 2013 Frank Balluffi and Markus Moeller. All rights reserved. Permissions and limitations regarding this software are subject
to terms of the MIT license.
See patents at https://www.informatica.com/legal/patents.html.
DISCLAIMER: Informatica LLC provides this documentation "as is" without warranty of any kind, either express or implied, including, but not limited to, the implied
warranties of noninfringement, merchantability, or use for a particular purpose. Informatica LLC does not warrant that this software or documentation is error free. The
information provided in this software or documentation may include technical inaccuracies or typographical errors. The information in this software and documentation is
subject to change at any time without notice.
NOTICES
This Informatica product (the "Software") includes certain drivers (the "DataDirect Drivers") from DataDirect Technologies, an operating company of Progress Software
Corporation ("DataDirect") which are subject to the following terms and conditions:
1. THE DATADIRECT DRIVERS ARE PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING BUT NOT
LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NON-INFRINGEMENT.
2. IN NO EVENT WILL DATADIRECT OR ITS THIRD PARTY SUPPLIERS BE LIABLE TO THE END-USER CUSTOMER FOR ANY DIRECT, INDIRECT,
INCIDENTAL, SPECIAL, CONSEQUENTIAL OR OTHER DAMAGES ARISING OUT OF THE USE OF THE ODBC DRIVERS, WHETHER OR NOT
INFORMED OF THE POSSIBILITIES OF DAMAGES IN ADVANCE. THESE LIMITATIONS APPLY TO ALL CAUSES OF ACTION, INCLUDING, WITHOUT
LIMITATION, BREACH OF CONTRACT, BREACH OF WARRANTY, NEGLIGENCE, STRICT LIABILITY, MISREPRESENTATION AND OTHER TORTS.
Part Number: IN-SVG-10000-0001

Table of Contents
Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
Informatica Resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
Informatica My Support Portal. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
Informatica Documentation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
Informatica Product Availability Matrixes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
Informatica Web Site. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
Informatica How-To Library. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
Informatica Knowledge Base. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
Informatica Support YouTube Channel. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
Informatica Marketplace. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
Informatica Velocity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
Informatica Global Customer Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23

Chapter 1: Analyst Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25

Analyst Service Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
Analyst Service Architecture. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
Configuration Prerequisites. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
Services Associated with the Analyst Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
Flat File Cache Directory. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
Export File Directory. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
Attachments Directory. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
Keystore File. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
Recycle and Disable the Analyst Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
Properties for the Analyst Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
General Properties for the Analyst Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
Model Repository Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
Logging Options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
Human Task Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
Run-time Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
Metadata Manager Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Business Glossary Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Custom Properties for the Analyst Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Process Properties for the Analyst Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Node Properties for the Analyst Service Process. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Analyst Security Options for the Analyst Service Process. . . . . . . . . . . . . . . . . . . . . . . . . 32
Advanced Properties for the Analyst Service Process. . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Custom Properties for the Analyst Service Process. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Environment Variables for the Analyst Service Process. . . . . . . . . . . . . . . . . . . . . . . . . . 33
Creating and Configuring the Analyst Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Creating an Analyst Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

Table of Contents

Chapter 2: Content Management Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35

Content Management Service Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
Master Content Management Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
Content Management Service Architecture. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
Probabilistic Models and Classifier Models. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
Reference Data Warehouse. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Orphaned Reference Data. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Deleting Orphaned Tables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
Recycling and Disabling the Content Management Service. . . . . . . . . . . . . . . . . . . . . . . . . . . 39
Content Management Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
General Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
Multi-Service Options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Associated Services and Reference Data Location Properties. . . . . . . . . . . . . . . . . . . . . . 41
File Transfer Options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
Logging Options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
Custom Properties for the Content Management Service. . . . . . . . . . . . . . . . . . . . . . . . . 42
Content Management Service Process Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
Content Management Service Security Options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
Address Validation Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
Identity Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
Advanced Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
NLP Options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
Custom Properties for the Content Management Service Process. . . . . . . . . . . . . . . . . . . . 48
Creating a Content Management Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49

Chapter 3: Data Integration Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50

Data Integration Service Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50
Before You Create the Data Integration Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
Create Required Databases. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
Create Connections to the Databases. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
Create the Service Principal Name and Keytab File. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
Create Associated Services. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
Creating a Data Integration Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
Data Integration Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
General Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Model Repository Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Execution Options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
Logical Data Object/Virtual Table Cache Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
Logging Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
Pass-through Security Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
Modules. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
HTTP Proxy Server Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61

Table of Contents

HTTP Configuration Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62

Result Set Cache Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
Mapping Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
Profiling Warehouse Database Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
Advanced Profiling Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
SQL Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
Workflow Orchestration Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
Web Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
Custom Properties for the Data Integration Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
Data Integration Service Process Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Data Integration Service Security Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
HTTP Configuration Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
Result Set Cache Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
Advanced Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
Logging Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
SQL Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
Custom Properties for the Data Integration Service Process. . . . . . . . . . . . . . . . . . . . . . . 69
Environment Variables. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
Data Integration Service Compute Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
Execution Options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
Environment Variables. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
High Availability for the Data Integration Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
Data Integration Service Restart and Failover. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
Data Integration Service Recovery. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73

Chapter 4: Data Integration Service Architecture. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74

Data Integration Service Architecture Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
Data Integration Service Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75
Data Integration Service Components. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76
Service Components. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77
Mapping Service Module. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77
Profiling Service Module. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77
SQL Service Module. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78
Web Service Module. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78
Workflow Orchestration Service Module. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78
Data Object Cache Manager. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79
Result Set Cache Manager. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79
Deployment Manager. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79
Logical Data Transformation Manager. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79
Compute Component. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
Execution Data Transformation Manager. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
DTM Resource Allocation Policy. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81
Processing Threads. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81

Table of Contents

Output Files. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81
Process Where DTM Instances Run. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
In the Data Integration Service Process. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84
In Separate DTM Processes on the Local Node. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84
In Separate DTM Processes on Remote Nodes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 85
Single Node. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 85
Grid. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86
Logs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86

Chapter 5: Data Integration Service Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88

Data Integration Service Management Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88
Enable and Disable Data Integration Services and Processes. . . . . . . . . . . . . . . . . . . . . . . . . 89
Enable, Disable, or Recycle the Data Integration Service. . . . . . . . . . . . . . . . . . . . . . . . . 89
Enable or Disable a Data Integration Service Process. . . . . . . . . . . . . . . . . . . . . . . . . . . 91
Directories for Data Integration Service Files. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
Source and Output File Directories. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
Control File Directories. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
Log Directory. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
Output and Log File Permissions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
Run Jobs in Separate Processes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
DTM Process Pool Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95
Rules and Guidelines when Jobs Run in Separate Processes. . . . . . . . . . . . . . . . . . . . . . 96
Maintain Connection Pools. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96
Connection Pool Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96
Pooling Properties in Connection Objects. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
Example of a Connection Pool. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98
Optimize Connection Performance. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98
PowerExchange Connection Pools. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98
PowerExchange Connection Pool Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99
Connection Pooling for PowerExchange Netport Jobs. . . . . . . . . . . . . . . . . . . . . . . . . . . 99
PowerExchange Connection Pooling Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . 100
Maximize Parallelism for Mappings and Profiles. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102
One Thread for Each Pipeline Stage. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102
Multiple Threads for Each Pipeline Stage. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104
Maximum Parallelism Guidelines. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105
Enabling Partitioning for Mappings and Profiles. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106
Optimize Cache and Target Directories for Partitioning. . . . . . . . . . . . . . . . . . . . . . . . . . 106
Result Set Caching. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107
Data Object Caching. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107
Cache Tables. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108
Data Object Caching Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108
Data Object Cache Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110
Configure User-Managed Cache Tables. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111

Table of Contents

Persisting Virtual Data in Temporary Tables. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113

Temporary Table Implementation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113
Temporary Table Operations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114
Rules and Guidelines for Temporary Tables. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115
Content Management for the Profiling Warehouse. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116
Creating and Deleting Profiling Warehouse Content. . . . . . . . . . . . . . . . . . . . . . . . . . . . 116
Database Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116
Purge. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116
Tablespace Recovery. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119
Database Statistics. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120
Web Service Security Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120
HTTP Client Filter. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121
Pass-through Security. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121
Pass-Through Security with Data Object Caching. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122
Adding Pass-Through Security . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 123

Chapter 6: Data Integration Service Grid. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124

Data Integration Service Grid Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124
Grid Configuration by Job Type. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 125
Before You Configure a Data Integration Service Grid. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 126
Grid for SQL Data Services and Web Services. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 126
Example Grid that Runs Jobs in the Service Process. . . . . . . . . . . . . . . . . . . . . . . . . . . 127
Rules and Guidelines for Grids that Run Jobs in the Service Process. . . . . . . . . . . . . . . . 128
Configuring a Grid that Runs Jobs in the Service Process. . . . . . . . . . . . . . . . . . . . . . . . 128
Grid for Mappings, Profiles, and Workflows that Run in Local Mode. . . . . . . . . . . . . . . . . . . . . 132
Example Grid that Runs Jobs in Local Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133
Rules and Guidelines for Grids that Run Jobs in Local Mode. . . . . . . . . . . . . . . . . . . . . . 133
Configuring a Grid that Runs Jobs in Local Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 134
Grid for Mappings, Profiles, and Workflows that Run in Remote Mode. . . . . . . . . . . . . . . . . . . 137
Supported Node Roles. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 137
Job Types. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 138
Example Grid that Runs Jobs in Remote Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 140
Rules and Guidelines for Grids that Run Jobs in Remote Mode. . . . . . . . . . . . . . . . . . . . 140
Recycle the Service When Jobs Run in Remote Mode. . . . . . . . . . . . . . . . . . . . . . . . . . 141
Configuring a Grid that Runs Jobs in Remote Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . 141
Logs for Jobs that Run in Remote Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145
Override Compute Node Attributes to Increase Concurrent Jobs. . . . . . . . . . . . . . . . . . . . 146
Grid and Content Management Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 147
Maximum Number of Concurrent Jobs on a Grid. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 148
Editing a Grid. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149
Deleting a Grid. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149
Troubleshooting a Grid. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149

Table of Contents

Chapter 7: Data Integration Service Applications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 152

Data Integration Service Applications Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 152
Applications View. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
Applications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
Application State . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
Application Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
Deploying an Application. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 154
Enabling an Application . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155
Renaming an Application. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155
Starting an Application. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 156
Backing Up an Application. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 156
Restoring an Application. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 156
Refreshing the Applications View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 157
Logical Data Objects. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 157
Physical Data Objects. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 158
Mappings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 158
SQL Data Services. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160
SQL Data Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160
Enabling an SQL Data Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163
Renaming an SQL Data Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 164
Web Services. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 164
Web Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 164
Enabling a Web Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 166
Renaming a Web Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 166
Workflows. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 167
Workflow Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 167
Enabling a Workflow. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 167
Starting a Workflow. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 167

Chapter 8: Metadata Manager Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 169

Metadata Manager Service Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 169
Configuring a Metadata Manager Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 170
Creating a Metadata Manager Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 172
Metadata Manager Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 172
Database Connect Strings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 176
Overriding the Repository Database Code Page. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 176
Creating and Deleting Repository Content. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 176
Creating the Metadata Manager Repository. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 177
Restoring the PowerCenter Repository . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 177
Deleting the Metadata Manager Repository . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 177
Enabling and Disabling the Metadata Manager Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . 178
Metadata Manager Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 178

Table of Contents

General Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 179

Metadata Manager Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 180
Database Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 181
Configuration Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 183
Connection Pool Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 184
Advanced Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 185
Custom Properties for the Metadata Manager Service. . . . . . . . . . . . . . . . . . . . . . . . . . 186
Configuring the Associated PowerCenter Integration Service. . . . . . . . . . . . . . . . . . . . . . . . . 186
Privileges for the Associated PowerCenter Integration Service User. . . . . . . . . . . . . . . . . 187

Chapter 9: Model Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 189

Model Repository Service Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 189
Model Repository Architecture. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 190
Model Repository Objects. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 190
Model Repository Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 190
Model Repository Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 191
IBM DB2 Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 192
IBM DB2 Version 9.1. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 193
Microsoft SQL Server Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 193
Oracle Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 193
Enable and Disable Model Repository Services and Processes. . . . . . . . . . . . . . . . . . . . . . . 193
Enable, Disable, or Recycle the Model Repository Service. . . . . . . . . . . . . . . . . . . . . . . 194
Enable or Disable a Model Repository Service Process. . . . . . . . . . . . . . . . . . . . . . . . . 195
Properties for the Model Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 195
General Properties for the Model Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . . . 196
Repository Database Properties for the Model Repository Service. . . . . . . . . . . . . . . . . . 196
Search Properties for the Model Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . . . 198
Advanced Properties for the Model Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . . 199
Cache Properties for the Model Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . 199
Versioning Properties for the Model Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . 199
Custom Properties for the Model Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . . . 200
Properties for the Model Repository Service Process. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201
Node Properties for the Model Repository Service Process. . . . . . . . . . . . . . . . . . . . . . . 201
High Availability for the Model Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 203
Model Repository Service Restart and Failover. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 204
Model Repository Service Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 204
Content Management for the Model Repository Service . . . . . . . . . . . . . . . . . . . . . . . . . 204
Model Repository Backup and Restoration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 204
Security Management for the Model Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . 206
Search Management for the Model Repository Service . . . . . . . . . . . . . . . . . . . . . . . . . 207
Repository Log Management for the Model Repository Service. . . . . . . . . . . . . . . . . . . . 208
Audit Log Management for the Model Repository Service . . . . . . . . . . . . . . . . . . . . . . . . 209
Cache Management for the Model Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . . 209

10

Table of Contents

Version Control for the Model Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 210

How to Configure and Synchronize a Model Repository with a Version Control System. . . . . 211
Repository Object Administration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 214
Objects View. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 214
Locked Object Administration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 215
Versioned Object Administration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 215
Troubleshooting Team-based Development. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 216
Creating a Model Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 216

Chapter 10: PowerCenter Integration Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 217

PowerCenter Integration Service Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 217
Creating a PowerCenter Integration Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 218
Enabling and Disabling PowerCenter Integration Services and Processes. . . . . . . . . . . . . . . . 220
Enabling or Disabling a PowerCenter Integration Service Process. . . . . . . . . . . . . . . . . . 220
Enabling or Disabling the PowerCenter Integration Service. . . . . . . . . . . . . . . . . . . . . . . 220
Operating Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 221
Normal Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 222
Safe Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 222
Running the PowerCenter Integration Service in Safe Mode. . . . . . . . . . . . . . . . . . . . . . 222
Configuring the PowerCenter Integration Service Operating Mode. . . . . . . . . . . . . . . . . . 224
PowerCenter Integration Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225
General Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225
PowerCenter Integration Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 226
Advanced Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 228
Operating Mode Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 230
Compatibility and Database Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 230
Configuration Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 232
HTTP Proxy Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 234
Custom Properties for the PowerCenter Integration Service. . . . . . . . . . . . . . . . . . . . . . . 234
Operating System Profiles. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 235
Operating System Profile Components. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 235
Configuring Operating System Profiles. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 235
Troubleshooting Operating System Profiles. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 236
Associated Repository for the PowerCenter Integration Service. . . . . . . . . . . . . . . . . . . . . . . 236
PowerCenter Integration Service Processes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 237
Code Pages. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 237
Directories for PowerCenter Integration Service Files. . . . . . . . . . . . . . . . . . . . . . . . . . . 238
Directories for Java Components. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 239
General Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 239
Custom Properties for the PowerCenter Integration Service Process. . . . . . . . . . . . . . . . . 241
Environment Variables. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 241
Configuration for the PowerCenter Integration Service Grid. . . . . . . . . . . . . . . . . . . . . . . . . . 242
Creating a Grid. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 242

Table of Contents

11

Configuring the PowerCenter Integration Service to Run on a Grid. . . . . . . . . . . . . . . . . . 243

Configuring the PowerCenter Integration Service Processes. . . . . . . . . . . . . . . . . . . . . . 243
Resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 244
Editing and Deleting a Grid. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 246
Troubleshooting a Grid. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 247
Load Balancer for the PowerCenter Integration Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . 247
Configuring the Dispatch Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 248
Service Levels. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 249
Configuring Resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 250
Calculating the CPU Profile. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 251
Defining Resource Provision Thresholds. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 251

Chapter 11: PowerCenter Integration Service Architecture. . . . . . . . . . . . . . . . . . . . 253

PowerCenter Integration Service Architecture Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . 253
PowerCenter Integration Service Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 254
PowerCenter Integration Service Process. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 254
Load Balancer. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 256
Dispatch Process. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 257
Resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 257
Resource Provision Thresholds. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 258
Dispatch Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 258
Service Levels. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 259
Data Transformation Manager (DTM) Process. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 259
Processing Threads. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 260
Thread Types. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 261
Pipeline Partitioning. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 263
DTM Processing. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 263
Reading Source Data. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 263
Blocking Data. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 264
Block Processing. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 264
Grids. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 265
Workflow on a Grid. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 265
Session on a Grid. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 266
System Resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 267
CPU Usage. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 267
DTM Buffer Memory. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 267
Cache Memory. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 267
Code Pages and Data Movement Modes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 268
ASCII Data Movement Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 268
Unicode Data Movement Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 268
Output Files and Caches. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 269
Workflow Log. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 270
Session Log. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 270

12

Table of Contents

Session Details . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 270

Performance Detail File. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 270
Reject Files. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271
Row Error Logs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271
Recovery Tables Files. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271
Control File. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271
Email. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 272
Indicator File. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 272
Output File. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 272
Cache Files. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 272

Chapter 12: High Availability for the PowerCenter Integration Service. . . . . . . . . 274
High Availability for the PowerCenter Integration Service Overview. . . . . . . . . . . . . . . . . . . . . 274
Resilience. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 274
PowerCenter Integration Service Client Resilience. . . . . . . . . . . . . . . . . . . . . . . . . . . . 275
External Component Resilience. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 275
Restart and Failover. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276
Running on a Single Node. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276
Running on a Primary Node. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 277
Running on a Grid. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 278
Recovery. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 278
Stopped, Aborted, or Terminated Workflows. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 279
Running Workflows. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 279
Suspended Workflows. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 279
PowerCenter Integration Service Failover and Recovery Configuration. . . . . . . . . . . . . . . . . . 279

Chapter 13: PowerCenter Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 281

PowerCenter Repository Service Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 281
Creating a Database for the PowerCenter Repository. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 282
Creating the PowerCenter Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 282
Before You Begin. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 282
Creating a PowerCenter Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 282
Database Connect Strings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 284
PowerCenter Repository Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 285
Node Assignments. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 285
General Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 285
Repository Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 285
Database Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 286
Advanced Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 287
Metadata Manager Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 289
Custom Properties for the PowerCenter Repository Service. . . . . . . . . . . . . . . . . . . . . . . 290
PowerCenter Repository Service Process Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 290
Custom Properties for the PowerCenter Repository Service Process. . . . . . . . . . . . . . . . . 290

Table of Contents

13

Environment Variables. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 290

High Availability for the PowerCenter Repository Service. . . . . . . . . . . . . . . . . . . . . . . . . . . 291
Resilience. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 291
Restart and Failover. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 292
Recovery. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 292

Chapter 14: PowerCenter Repository Management. . . . . . . . . . . . . . . . . . . . . . . . . . . 293

PowerCenter Repository Management Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 293
PowerCenter Repository Service and Service Processes. . . . . . . . . . . . . . . . . . . . . . . . . . . 294
Enabling and Disabling a PowerCenter Repository Service. . . . . . . . . . . . . . . . . . . . . . . 294
Enabling and Disabling PowerCenter Repository Service Processes. . . . . . . . . . . . . . . . . 295
Operating Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 296
Running a PowerCenter Repository Service in Exclusive Mode. . . . . . . . . . . . . . . . . . . . 296
Running a PowerCenter Repository Service in Normal Mode. . . . . . . . . . . . . . . . . . . . . . 297
PowerCenter Repository Content. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 297
Creating PowerCenter Repository Content. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 297
Deleting PowerCenter Repository Content. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 298
Upgrading PowerCenter Repository Content. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 298
Enabling Version Control. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 299
Managing a Repository Domain. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 299
Prerequisites for a PowerCenter Repository Domain. . . . . . . . . . . . . . . . . . . . . . . . . . . 299
Building a PowerCenter Repository Domain. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 300
Promoting a Local Repository to a Global Repository. . . . . . . . . . . . . . . . . . . . . . . . . . . 300
Registering a Local Repository. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 301
Viewing Registered Local and Global Repositories. . . . . . . . . . . . . . . . . . . . . . . . . . . . 302
Moving Local and Global Repositories. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 303
Managing User Connections and Locks. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 303
Viewing Locks. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 303
Viewing User Connections. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 304
Closing User Connections and Releasing Locks. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 305
Sending Repository Notifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 306
Backing Up and Restoring the PowerCenter Repository. . . . . . . . . . . . . . . . . . . . . . . . . . . . 306
Backing Up a PowerCenter Repository. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 306
Viewing a List of Backup Files. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 307
Restoring a PowerCenter Repository. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 307
Copying Content from Another Repository. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 308
Repository Plug-in Registration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 309
Registering a Repository Plug-in. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 309
Unregistering a Repository Plug-in. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 309
Audit Trails. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 310
Repository Performance Tuning. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 310
Repository Statistics. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 310
Repository Copy, Back Up, and Restore Processes. . . . . . . . . . . . . . . . . . . . . . . . . . . . 311

14

Table of Contents

Chapter 15: PowerExchange Listener Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 312

PowerExchange Listener Service Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 312
DBMOVER Statements for the Listener Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 313
Creating a Listener Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 314
Listener Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 314
PowerExchange Listener Service General Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . 315
PowerExchange Listener Service Configuration Properties. . . . . . . . . . . . . . . . . . . . . . . 316
Environment Variables for the Listener Service Process. . . . . . . . . . . . . . . . . . . . . . . . . 316
Editing Listener Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 316
Editing Listener Service General Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 317
Editing Listener Service Configuration Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 317
Enabling, Disabling, and Restarting the Listener Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . 317
Enabling the Listener Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 317
Disabling the Listener Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 317
Restarting the Listener Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 318
Listener Service Logs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 318
Listener Service Restart and Failover. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 318

Chapter 16: PowerExchange Logger Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 319

PowerExchange Logger Service Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 319
Configuration Statements for the Logger Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 320
Creating a Logger Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 320
Properties of the PowerExchange Logger Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 321
PowerExchange Logger Service General Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . 321
PowerExchange Logger Service Configuration Properties. . . . . . . . . . . . . . . . . . . . . . . . 321
Logger Service Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 323
Configuring Logger Service General Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 323
Configuring Logger Service Configuration Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . 324
Configuring the Logger Service Process Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . 324
Enabling, Disabling, and Restarting the Logger Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . 324
Enabling the Logger Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 324
Disabling the Logger Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 324
Restarting the Logger Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 325
Logger Service Logs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 325
Logger Service Restart and Failover. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 325

Chapter 17: Reporting Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 326

Reporting Service Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 326
PowerCenter Repository Reports. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 327
Metadata Manager Repository Reports. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 327
Data Profiling Reports. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 327
Other Reporting Sources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 327

Table of Contents

15

Data Analyzer Repository. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 328

Creating the Reporting Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 328
Managing the Reporting Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 330
Configuring the Edit Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 331
Enabling and Disabling a Reporting Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 331
Creating Contents in the Data Analyzer Repository. . . . . . . . . . . . . . . . . . . . . . . . . . . . 332
Backing Up Contents of the Data Analyzer Repository. . . . . . . . . . . . . . . . . . . . . . . . . . 332
Restoring Contents to the Data Analyzer Repository. . . . . . . . . . . . . . . . . . . . . . . . . . . 333
Deleting Contents from the Data Analyzer Repository. . . . . . . . . . . . . . . . . . . . . . . . . . 333
Upgrading Contents of the Data Analyzer Repository. . . . . . . . . . . . . . . . . . . . . . . . . . . 333
Viewing Last Activity Logs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 334
Configuring the Reporting Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 334
General Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 334
Reporting Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 335
Data Source Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 335
Repository Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 336
Granting Users Access to Reports. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 337

Chapter 18: Reporting and Dashboards Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 338

Reporting and Dashboards Service Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 338
JasperReports Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 338
Users and Privileges. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 339
Configuration Prerequisites. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 339
Reporting and Dashboards Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 339
Reporting and Dashboards Service General Properties. . . . . . . . . . . . . . . . . . . . . . . . . 340
Reporting and Dashboards Service Security Properties. . . . . . . . . . . . . . . . . . . . . . . . . 340
Reporting and Dashboards Service Database Properties. . . . . . . . . . . . . . . . . . . . . . . . 341
Reporting and Dashboards Service Advanced Properties. . . . . . . . . . . . . . . . . . . . . . . . 342
Environment Variables for the Reporting and Dashboards Service. . . . . . . . . . . . . . . . . . 342
Creating a Reporting and Dashboards Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 342
Upgrading Jaspersoft Repository Contents from 9.1.0 HotFix 3 or Later. . . . . . . . . . . . . . . . . . 343
Reports. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 343
Reporting Source. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 343
Adding a Reporting Source. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 344
Running Reports. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 344
Exporting Jasper Resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 344
Importing Jasper Resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 344
Connection to the Jaspersoft Repository from Jaspersoft iReport Designer. . . . . . . . . . . . . 345
Enabling and Disabling the Reporting and Dashboards Service. . . . . . . . . . . . . . . . . . . . . . . 345
Editing a Reporting and Dashboards Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 345

Chapter 19: SAP BW Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 347

SAP BW Service Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 347

16

Table of Contents

Creating the SAP BW Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 348

Enabling and Disabling the SAP BW Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 350
Enabling the SAP BW Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 351
Disabling the SAP BW Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 351
Configuring the SAP BW Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 351
General Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 351
SAP BW Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 352
Configuring the Associated Integration Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 353
Configuring the SAP BW Service Processes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 353
Load Balancing for the SAP BW System and the SAP BW Service. . . . . . . . . . . . . . . . . . . . . 354
Viewing Log Events. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 354

Chapter 20: Search Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 355

Search Service Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 355
Search Service Architecture. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 356
Search Index. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 357
Extraction Interval . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 357
Search Request Process. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 358
Search Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 358
General Properties for the Search Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 358
Logging Options for the Search Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 359
Search Options for the Search Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 359
Custom Properties for the Search Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 360
Search Service Process Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 360
Advanced Properties of the Search Service Process. . . . . . . . . . . . . . . . . . . . . . . . . . . 360
Environment Variables for the Search Service Process. . . . . . . . . . . . . . . . . . . . . . . . . . 361
Custom Properties for the Search Service Process. . . . . . . . . . . . . . . . . . . . . . . . . . . . 361
Creating a Search Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 361
Enabling the Search Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 362
Recycling and Disabling the Search Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 362

Chapter 21: System Services. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 364

System Services Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 364
Email Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 365
Before You Enable the Email Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 365
Email Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 365
Email Service Process Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 367
Enabling, Disabling, and Recycling the Email Service. . . . . . . . . . . . . . . . . . . . . . . . . . 367
Resource Manager Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 368
Resource Manager Service Architecture. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 368
Before You Enable the Resource Manager Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . 369
Resource Manager Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 369
Resource Manager Service Process Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 370

Table of Contents

17

Enabling, Disabling, and Recycling the Resource Manager Service. . . . . . . . . . . . . . . . . . 370

Scheduler Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 371
Before You Enable the Scheduler Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 371
Scheduler Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 371
Scheduler Service Process Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 373
Enabling, Disabling, and Recycling the Scheduler Service. . . . . . . . . . . . . . . . . . . . . . . . 375

Chapter 22: Test Data Manager Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 377

Test Data Manager Service Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 377
Test Data Manager Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 377
General Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 378
Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 378
TDM Repository Configuration Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 379
TDM Server Configuration Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 380
Advanced Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 381
Database Connection Strings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 381
Configuring the Test Data Manager Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 381
Creating the Test Data Manager Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 382
Enabling and Disabling the Test Data Manager Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . 382
Editing the Test Data Manager Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 383
Create or Upgrade TDM Repository Content. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 383
Assigning the Test Data Manager Service to a Different Node. . . . . . . . . . . . . . . . . . . . . 383
Assigning a New License to the Test Data Manager Service. . . . . . . . . . . . . . . . . . . . . . 383
Deleting the Test Data Manager Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 384

Chapter 23: Web Services Hub. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 385

Web Services Hub Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 385
Creating a Web Services Hub. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 386
Enabling and Disabling the Web Services Hub. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 387
Web Services Hub Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 388
General Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 389
Service Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 389
Advanced Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 390
Custom Properties for the Web Services Hub. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 392
Configuring the Associated Repository. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 392
Adding an Associated Repository. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 392
Editing an Associated Repository. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 393

Chapter 24: Application Service Upgrade. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 394

Application Service Upgrade Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 394
Privileges to Upgrade Services. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 394
Service Upgrade from Previous Versions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 395
Running the Service Upgrade Wizard. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 395

18

Table of Contents

Verify the Model Repository Service Upgrade. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 396

Object Dependency Graph. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 396
Maximum Heap Size. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 397

Appendix A: Application Service Databases. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 398

Application Service Databases Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 398
Set Up Database User Accounts. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 399
Data Analyzer Repository Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 399
IBM DB2 Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 399
Microsoft SQL Server Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 400
Oracle Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 400
Sybase ASE Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 400
Data Object Cache Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 401
IBM DB2 Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 401
Microsoft SQL Server Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 401
Oracle Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 401
Jaspersoft Repository Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 402
IBM DB2 Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 402
Microsoft SQL Server Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 402
Oracle Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 402
Metadata Manager Repository Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . 402
IBM DB2 Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 403
Microsoft SQL Server Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 404
Oracle Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 405
Model Repository Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 406
IBM DB2 Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 406
Microsoft SQL Server Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 407
Oracle Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 407
PowerCenter Repository Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 407
IBM DB2 Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 408
Microsoft SQL Server Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 408
Oracle Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 408
Sybase ASE Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 408
Profiling Warehouse Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 409
IBM DB2 Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 409
Microsoft SQL Server Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 409
Oracle Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 410
Reference Data Warehouse Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 410
IBM DB2 Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 410
Microsoft SQL Server Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 410
Oracle Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 411
Workflow Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 411
IBM DB2 Database Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 411

Table of Contents

19

Microsoft SQL Server Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 412

Oracle Database Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 412
Configure Native Connectivity on Service Machines. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 413
Install Database Client Software. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 413
Configure Database Client Environment Variables on UNIX. . . . . . . . . . . . . . . . . . . . . . . 414

Appendix B: Connecting to Databases from Windows. . . . . . . . . . . . . . . . . . . . . . . . 415

Connecting to Databases from Windows Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 415
Connecting to an IBM DB2 Universal Database from Windows. . . . . . . . . . . . . . . . . . . . . . . . 416
Configuring Native Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 416
Connecting to an Informix Database from Windows. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 416
Configuring ODBC Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 417
Connecting to Microsoft Access and Microsoft Excel from Windows. . . . . . . . . . . . . . . . . . . . 417
Configuring ODBC Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 417
Connecting to a Microsoft SQL Server Database from Windows. . . . . . . . . . . . . . . . . . . . . . . 417
Configuring Native Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 417
Configuring Custom Properties for Microsoft SQL Server. . . . . . . . . . . . . . . . . . . . . . . . 418
Connecting to a Netezza Database from Windows. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 419
Configuring ODBC Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 419
Connecting to an Oracle Database from Windows. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 419
Configuring Native Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 420
Connecting to a Sybase ASE Database from Windows. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 421
Configuring Native Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 421
Connecting to a Teradata Database from Windows. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 422
Configuring ODBC Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 422

Appendix C: Connecting to Databases from UNIX. . . . . . . . . . . . . . . . . . . . . . . . . . . . 423

Connecting to Databases from UNIX Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 423
Connecting to an IBM DB2 Universal Database from UNIX. . . . . . . . . . . . . . . . . . . . . . . . . . 424
Configuring Native Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 424
Connecting to an Informix Database from UNIX. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 426
Configuring ODBC Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 426
Connecting to Microsoft SQL Server from UNIX. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 427
Configuring Native Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 427
Configuring SSL Authentication through ODBC. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 428
Configuring Custom Properties for Microsoft SQL Server. . . . . . . . . . . . . . . . . . . . . . . . 429
Connecting to a Netezza Database from UNIX. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 429
Configuring ODBC Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 429
Connecting to an Oracle Database from UNIX. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 431
Configuring Native Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 431
Connecting to a Sybase ASE Database from UNIX. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 433
Configuring Native Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 434
Connecting to a Teradata Database from UNIX. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 435

20

Table of Contents

Configuring ODBC Connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 436

Connecting to an ODBC Data Source. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 438
Sample odbc.ini File. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 440

Appendix D: Updating the DynamicSections Parameter of a DB2 Database. . . . 447

DynamicSections Parameter Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 447
Updating the DynamicSections Parameter. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 447
Downloading and Installing the DataDirect Connect for JDBC Utility. . . . . . . . . . . . . . . . . 447
Running the Test for JDBC Tool. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 448

Index. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 449

Table of Contents

21

Preface
The Informatica Application Service Guide is written for Informatica users who need to configure application
services. The Informatica Application Service Guide assumes you have basic working knowledge of
Informatica and details of the environment in which the application services run.

Informatica Resources
Informatica My Support Portal
As an Informatica customer, the first step in reaching out to Informatica is through the Informatica My Support
Portal at https://mysupport.informatica.com. The My Support Portal is the largest online data integration
collaboration platform with over 100,000 Informatica customers and partners worldwide.
As a member, you can:

Access all of your Informatica resources in one place.

Review your support cases.

Search the Knowledge Base, find product documentation, access how-to documents, and watch support
videos.

Find your local Informatica User Group Network and collaborate with your peers.

Informatica Documentation
The Informatica Documentation team makes every effort to create accurate, usable documentation. If you
have questions, comments, or ideas about this documentation, contact the Informatica Documentation team
through email at [email protected]. We will use your feedback to improve our
documentation. Let us know if we can contact you regarding your comments.
The Documentation team updates documentation as needed. To get the latest documentation for your
product, navigate to Product Documentation from https://mysupport.informatica.com.

Informatica Product Availability Matrixes

Product Availability Matrixes (PAMs) indicate the versions of operating systems, databases, and other types
of data sources and targets that a product release supports. You can access the PAMs on the Informatica My
Support Portal at https://mysupport.informatica.com.

22

Informatica Web Site

You can access the Informatica corporate web site at https://www.informatica.com. The site contains
information about Informatica, its background, upcoming events, and sales offices. You will also find product
and partner information. The services area of the site includes important information about technical support,
training and education, and implementation services.

Informatica How-To Library

As an Informatica customer, you can access the Informatica How-To Library at
https://mysupport.informatica.com. The How-To Library is a collection of resources to help you learn more
about Informatica products and features. It includes articles and interactive demonstrations that provide
solutions to common problems, compare features and behaviors, and guide you through performing specific
real-world tasks.

Informatica Knowledge Base

As an Informatica customer, you can access the Informatica Knowledge Base at
https://mysupport.informatica.com. Use the Knowledge Base to search for documented solutions to known
technical issues about Informatica products. You can also find answers to frequently asked questions,
technical white papers, and technical tips. If you have questions, comments, or ideas about the Knowledge
Base, contact the Informatica Knowledge Base team through email at [email protected].

Informatica Support YouTube Channel

You can access the Informatica Support YouTube channel at http://www.youtube.com/user/INFASupport. The
Informatica Support YouTube channel includes videos about solutions that guide you through performing
specific tasks. If you have questions, comments, or ideas about the Informatica Support YouTube channel,
contact the Support YouTube team through email at [email protected] or send a tweet to
@INFASupport.

Informatica Marketplace
The Informatica Marketplace is a forum where developers and partners can share solutions that augment,
extend, or enhance data integration implementations. By leveraging any of the hundreds of solutions
available on the Marketplace, you can improve your productivity and speed up time to implementation on
your projects. You can access Informatica Marketplace at http://www.informaticamarketplace.com.

Informatica Velocity
You can access Informatica Velocity at https://mysupport.informatica.com. Developed from the real-world
experience of hundreds of data management projects, Informatica Velocity represents the collective
knowledge of our consultants who have worked with organizations from around the world to plan, develop,
deploy, and maintain successful data management solutions. If you have questions, comments, or ideas
about Informatica Velocity, contact Informatica Professional Services at [email protected].

Informatica Global Customer Support

You can contact a Customer Support Center by telephone or through the Online Support.
Online Support requires a user name and password. You can request a user name and password at
http://mysupport.informatica.com.

Preface

23

The telephone numbers for Informatica Global Customer Support are available from the Informatica web site
at http://www.informatica.com/us/services-and-training/support-services/global-support-centers/.

24

Preface

CHAPTER 1

Analyst Service
This chapter includes the following topics:

Analyst Service Overview, 25

Analyst Service Architecture, 26

Configuration Prerequisites, 27

Recycle and Disable the Analyst Service, 28

Properties for the Analyst Service, 29

Process Properties for the Analyst Service, 31

Creating and Configuring the Analyst Service, 33

Creating an Analyst Service, 34

Analyst Service Overview

The Analyst Service is an application service that runs the Analyst tool in the Informatica domain. The
Analyst Service manages the connections between the service components and the users who log in to the
Analyst tool.
The Analyst Service connects to a Data Integration Service that runs profiles, scorecards, and mapping
specifications. The Analyst Service also connects to a Data Integration Service that runs workflows.
The Analyst Service connects to the Model Repository Service to identify a Model repository. The Analyst
Service connects to a Metadata Manager Service that enables data lineage analysis on scorecards in the
Analyst tool. The Analyst Service connects to a Search Service that enables and manages searches in the
Analyst tool.
Additionally, the Analyst Service connects to the Analyst tool, a flat file cache directory to store uploaded flat
files, and a business glossary export file directory.
You can use the Administrator tool to create and recycle an Analyst Service in the Informatica domain and to
access the Analyst tool. When you recycle the Analyst Service, the Service Manager restarts the Analyst
Service.
You can run more than one Analyst Service on the same node. You can associate a Model Repository
Service with one Analyst Service. You can associate one Data Integration Service with more than one
Analyst Service. The Analyst Service detects the associated Search Service based on the Model Repository
Service assigned to the Analyst Service.

25

Analyst Service Architecture

The Analyst Service connects to application services, databases, and directories.
The following figure shows the Analyst tool components that the Analyst Service connects to in the
Informatica domain:

The Analyst Service connects to the following components:

26

Data Integration Services. The Analyst Service manages the connection to a Data Integration Service that
runs profiles, scorecards, and mapping specifications in the Analyst tool. The Analyst Service also
manages the connection to a Data Integration Service that runs workflows.

Model Repository Service. The Analyst Service manages the connection to a Model Repository Service
for the Analyst tool. The Analyst tool connects to the Model repository database to create, update, and
delete projects and objects in the Analyst tool.

Search Service. The Analyst Service manages the connection to the Search Service that enables and
manages searches in the Analyst tool. The Analyst Service identifies the associated Search Service
based on the Model Repository Service associated with the Analyst Service.

Metadata Manager Service. The Analyst Service manages the connection to a Metadata Manager Service
that runs data lineage for scorecards in the Analyst tool.

Profiling warehouse database. The Analyst tool identifies the profiling warehouse database. The Data
Integration Service writes profile data and scorecard results to the database.

Flat file cache directory. The Analyst Service manages the connection to the directory that stores
uploaded flat files that you import for reference tables and flat file data sources in the Analyst tool.

Business Glossary export file directory. The Analyst Service manages the connection to the directory that
stores the business glossary as a file after you export it from the Analyst tool.

Business Glossary asset attachment directory. The Analyst Service identifies the directory that stores any
attachment that an Analyst tool user attaches to a Business Glossary asset.

Informatica Analyst. The Analyst Service defines the URL for the Analyst tool.

Chapter 1: Analyst Service

Configuration Prerequisites
Before you configure the Analyst Service, you can complete the prerequisite tasks for the service. You can
also choose to complete these tasks after you create an Analyst Service.
Perform the following tasks before you configure the Analyst Service:

Create and enable the associated Data Integration Services, Model Repository Service, and Metadata
Manager Service.

Identify a directory for the flat file cache to upload flat files.

Identify a directory to export a business glossary.

Identify a keystore file to configure the Transport Layer Security protocol for the Analyst Service.

Services Associated with the Analyst Service

The Analyst Service connects to associated services that you create and enable before you configure the
Analyst Service.
The Analyst Service connects to the following associated services:

Data Integration Services. You can associate up to two Data Integration Services with the Analyst Service.
Associate a Data Integration Service to run mapping specifications, profiles, and scorecards. Associate a
Data Integration Service to run workflows. You can associate the same Data Integration Service to run
mapping specifications, profiles, scorecards, and workflows.

Model Repository Service. When you create an Analyst Service, you assign a Model Repository Service to
the Analyst Service. You cannot assign the same Model Repository Service to another Analyst Service.

Metadata Manager Service. You can associate a Metadata Manager Service with the Analyst Service to
perform data lineage analysis on scorecards.

Search Service. The Analyst Service determines the associated Search Service based on the Model
Repository Service associated with the Analyst Service. If you modify the Analyst Service, you must
recycle the Search Service.

Flat File Cache Directory

Create a directory for the flat file cache where the Analyst tool stores uploaded flat files. The Data Integration
Service must also be able to access this directory.
If the Analyst Service and the Data Integration Service run on different nodes, configure the flat file directory
to use a shared directory. If the Data Integration Service runs on primary and back-up nodes or on a grid,
each Data Integration Service process must be able to access the files in the shared directory.
For example, you can create a directory named "flatfilecache" in the following mapped drive that all Analyst
Service and Data Integration Service processes can access:
F:\shared\<InformaticaInstallationDir>\server
When you import a reference table or flat file source, the Analyst tool uses the files from this directory to
create a reference table or flat file data object.

Configuration Prerequisites

27

Export File Directory

Create a directory to store the temporary business glossary files that the business glossary export process
creates.
For example, you can create a directory named "exportfiledirectory" in the following location:
<InformaticaInstallationDir>\server

Attachments Directory
Create a directory to store attachments that the Business Glossary data steward adds to Glossary assets.
For example, you can create a directory named "BGattachmentsdirectory" in the following location:
<InformaticaInstallationDir>\server

Keystore File
A keystore file contains the keys and certificates required if you enable secure communication and use the
HTTPS protocol for the Analyst Service.
You can create the keystore file when you install the Informatica services or you can create a keystore file
with keytool. keytool is a utility that generates and stores private or public key pairs and associated
certificates in a file called a keystore. When you generate a public or private key pair, keytool wraps the
public key into a self-signed certificate. You can use the self-signed certificate or use a certificate signed by a
certificate authority.
Note: You must use a certified keystore file. If you do not use a certified keystore file, security warnings and
error messages for the browser appear when you access the Analyst tool.

Recycle and Disable the Analyst Service

Disable an Analyst Service to perform maintenance or temporarily restrict users from accessing the Analyst
tool. Recycle an Analyst Service to make the Analyst tool available to users.
Use the Administrator tool to recycle and disable the Analyst Service. When you disable the Analyst Service,
you also stop the Analyst tool. When you recycle the Analyst Service, you stop and start the service to make
the Analyst tool available again.
In the Navigator, select the Analyst Service and click the Disable button to stop the service. Click the Recycle
button to start the service.
When you disable the Analyst Service, you must choose the mode to disable it in. You can choose one of the
following options:

Complete. Allows the jobs to run to completion before disabling the service.

Abort. Tries to stop all jobs before aborting them and disabling the service.

Stop. Stops all jobs and then disables the service.

Note: The Model Repository Service and the Data Integration Service must be running before you recycle the
Analyst Service.

28

Chapter 1: Analyst Service

Properties for the Analyst Service

After you create an Analyst Service, you can configure the Analyst Service properties. You can configure
Analyst Service properties on the Properties tab in the Administrator tool.
For each service properties section, click Edit to modify the service properties.
You can configure the following types of Analyst Service properties:

General Properties

Model Repository Service Properties

Logging Options

Human Task Properties

Run-Time Properties

Metadata Manager Properties

Business Glossary Export Properties

Custom Properties

If you update any of the properties, recycle the Analyst Service for the modifications to take effect.

General Properties for the Analyst Service

General properties for the Analyst Service include the name and description of the Analyst Service, and the
node in the Informatica domain that the Analyst Service runs on. You can configure these properties when
you create the Analyst Service.
You can configure the following general properties for the service:
Name
Name of the service. The name is not case sensitive and must be unique within the domain. It cannot
exceed 128 characters or begin with @. It also cannot contain spaces or the following special
characters:
`~%^*+={}\;:'"/?.,<>|!()][
You cannot change the name of the service after you create it.
Description
Description of the service. The description cannot exceed 765 characters.
Node
Node on which the service runs. If you change the node, you must recycle the Analyst Service.
License
License object that allows use of the service.

Model Repository Service Properties

Model Repository Service Properties include properties for the Model Repository Service that is associated
with the Analyst Service.
The Analyst Service has the following Model Repository Service properties:

Properties for the Analyst Service

29

Model Repository Service

Model Repository Service associated with the Analyst Service. The Analyst Service manages the
connections to the Model Repository Service for Informatica Analyst. You must recycle the Analyst
Service if you associate another Model Repository Service with the Analyst Service.
Username
User name of an administrator user in the Informatica domain. Not available for a domain with Kerberos
authentication.
Password
Password of the administrator user in the Informatica domain. Not available for a domain with Kerberos
authentication.
Security Domain
LDAP security domain for the user who manages the Model Repository Service. The security domain
field does not appear for users with Native or Kerberos authentication.

Logging Options
Logging options include properties for the severity level for Service logs. Configure the Log Level property to
set the logging level. The following values are valid:

Fatal. Writes FATAL messages to the log. FATAL messages include nonrecoverable system failures that
cause the service to shut down or become unavailable.

Error. Writes FATAL and ERROR code messages to the log. ERROR messages include connection
failures, failures to save or retrieve metadata, service errors.

Warning. Writes FATAL, WARNING, and ERROR messages to the log. WARNING errors include
recoverable system failures or warnings.

Info. Writes FATAL, INFO, WARNING, and ERROR messages to the log. INFO messages include system
and service change messages.

Trace. Write FATAL, TRACE, INFO, WARNING, and ERROR code messages to the log. TRACE
messages log user request failures.

Debug. Write FATAL, DEBUG, TRACE, INFO, WARNING, and ERROR messages to the log. DEBUG
messages are user request logs.

The default value is Info.

Human Task Properties

The Human task properties include the option to select a Data Integration Service that runs workflows. Select
a Data Integration Service to enable Analyst tool users to review and update the exception records that a
Human task identifies.
Select a Data Integration Service that you configure to run workflows. If the Data Integration Service that you
select is not configured to run workflows, select a different Data Integration Service.

Run-time Properties
Run-time properties include the Data Integration Service associated with the Analyst Service and the flat file
cache directory.
The Analyst Service has the following run-time properties:

30

Chapter 1: Analyst Service

Data Integration Service Name

Data Integration Service name associated with the Analyst Service. The Analyst Service manages the
connection to a Data Integration Service that enables users to perform data preview, mapping
specification, and profile tasks in the Analyst tool. You must recycle the Analyst Service if you associate
another Data Integration Service with the Analyst Service.
Flat File Cache Directory
Directory of the flat file cache where the Analyst tool stores uploaded flat files. The Analyst Service and
the Data Integration Service must be able to access this directory. If the Analyst Service and the Data
Integration Service run on different nodes, configure the flat file directory to use a shared directory. If the
Data Integration Service runs on primary and back-up nodes or on a grid, each Data Integration Service
process must be able to access the files in the shared directory.
When you import a reference table or flat file source, the Analyst tool uses the files from this directory to
create a reference table or flat file data object. Restart the Analyst Service if you change the flat file
location.

Metadata Manager Service Properties

The Metadata Manager Service Properties include the option to select a Metadata Manager Service by name.

Business Glossary Properties

You can configure the following Business Glossary properties:

Temporary directory to store the Microsoft Excel export file before the Analyst tool makes it available for
download via the browser.

Directory where attachments added to Glossary assets are stored.

Custom Properties for the Analyst Service

Configure custom properties that are unique to specific environments.
You might need to apply custom properties in special cases. When you define a custom property, enter the
property name and an initial value. Define custom properties only at the request of Informatica Global
Customer Support.

Process Properties for the Analyst Service

The Analyst Service runs the Analyst Service process on a node. When you select the Analyst Service in the
Administrator tool, you can view the service processes for the Analyst Service on the Processes tab. You
can view the node properties for the service process in the service panel. You can view the service process
properties in the Service Process Properties panel.
Note: You must select the node to view the service process properties in the Service Process Properties
panel.
You can configure the following types of Analyst Service process properties:

Analyst Security Options

Advanced Properties

Process Properties for the Analyst Service

31

Custom Properties

Environment Variables

If you update any of the process properties, restart the Analyst Service for the modifications to take effect.

Node Properties for the Analyst Service Process

The Analyst Service process has the following node properties:
Node
Node that the service process runs on.
Node Status
Status of the node. Status can be enabled or disabled.
Process Configuration
Status of the process configured to run on the node.
Process State
State of the service process running on the node. The state can be enabled or disabled.

Analyst Security Options for the Analyst Service Process

The Analyst Service Options include security properties for the Analyst Service process.
The Analyst Service process has the following security properties:
HTTP Port
HTTP port number on which the Analyst tool runs. Use a port number that is different from the HTTP port
number for the Data Integration Service. Default is 8085. You must recycle the service if you change the
HTTP port number.
Enable Secure Communication
Set up secure communication between the Analyst tool and the Analyst Service.
HTTPS Port
Port number to use for a secure connection to the Informatica Administrator service. Use a different port
number than the HTTP port number. You must recycle the service if you change the HTTPS port
number.
Keystore File
Path and file name of the keystore file to use for the HTTPS connection to the Informatica Administrator
service.
Keystore Password
Password for the keystore file.
SSL Protocol
Leave this field blank.

Advanced Properties for the Analyst Service Process

Advanced properties include properties for the maximum heap size and the Java Virtual Manager (JVM)
memory settings.

32

Chapter 1: Analyst Service

The Analyst Service process has the following advanced properties:

Maximum Heap Size
Amount of RAM allocated to the Java Virtual Machine (JVM) that runs the Analyst Service. Use this
property to increase the performance. Append one of the following letters to the value to specify the
units:

m for megabytes.

g for gigabytes.

Default is 768 megabytes. Specify 2 gigabytes if you run the Analyst Service on a 64-bit machine.
JVM Command Line Options
Java Virtual Machine (JVM) command line options to run Java-based programs. When you configure the
JVM options, you must set the Java SDK classpath, Java SDK minimum memory, and Java SDK
maximum memory properties.
To enable the Analyst Service to communicate with a Hadoop cluster on a particular Hadoop distribution,
add the following property to the JVM Command Line Options:
-DINFA_HADOOP_DIST_DIR=<Hadoop installation directory>\<HadoopDistributionName>
For example, to enable the Analyst Service to communicate with a Hadoop cluster on Cloudera CDH 5.2,
add the following property:
-DINFA_HADOOP_DIST_DIR=..\..\services\shared\hadoop\cloudera_cdh5u2

Custom Properties for the Analyst Service Process

Configure custom properties that are unique to specific environments.
You might need to apply custom properties in special cases. When you define a custom property, enter the
property name and an initial value. Define custom properties only at the request of Informatica Global
Customer Support.

Environment Variables for the Analyst Service Process

You can edit environment variables for the Analyst Service process.
The Analyst Service process has the following property for environment variables:
Environment Variables
Environment variables defined for the Analyst Service process.

Creating and Configuring the Analyst Service

Use the Administrator tool to create and configure the Analyst Service. After you create the Analyst Service,
you can configure the service properties and service process properties. You can enable the Analyst Service
to make the Analyst tool accessible to users.
1.

Complete the prerequisite tasks for configuring the Analyst Service.

2.

Create the Analyst Service.

3.

Configure the Analyst Service properties.

Creating and Configuring the Analyst Service

33

4.

Configure the Analyst Service process properties.

5.

Recycle the Analyst Service.

Creating an Analyst Service

Create an Analyst Service to manage the Informatica Analyst application and to grant users access to
Informatica Analyst.
Note: The Analyst service has the same privileges as the user account that creates it. Ensure that the user
account does not have privileges to read or modify sensitive files on the system.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

On the Domain Navigator Actions menu, click New > Analyst Service.
The New Analyst Service window appears.

3.

Enter the general properties for the service.

Optionally, click Browse in the Location field to enter the location for the domain and folder where you
want to create the service. Optionally, click Create Folder to create another folder.

4.

Enter the Analyst Security Options for the Analyst Service.

5.

Select Enable Service to enable the service after you create it.

6.

Click Next.

7.

Enter the Model Repository Service properties.

8.

Optionally, enter the Human task properties.

9.

Click Next.

10.

Enter the run-time properties.

11.

Optionally, enter the Metadata Manager properties.

12.

Optionally, enter the business glossary export property.

13.

Click Finish.

If you did not choose to enable the service earlier, you must recycle the service to start it.

34

Chapter 1: Analyst Service

CHAPTER 2

Content Management Service

This chapter includes the following topics:

Content Management Service Overview, 35

Master Content Management Service , 36

Content Management Service Architecture, 36

Probabilistic Models and Classifier Models, 37

Reference Data Warehouse, 38

Recycling and Disabling the Content Management Service, 39

Content Management Service Properties, 40

Content Management Service Process Properties, 43

Creating a Content Management Service, 49

Content Management Service Overview

The Content Management Service is an application service that manages reference data. It provides
reference data information to the Data Integration Service and to the Developer and Analyst tools. A master
Content Management Service maintains probabilistic model and classifier model data files across the
domain.
The Content Management Service manages the following types of reference data:
Address reference data
You use address reference data when you want to validate the postal accuracy of an address or fix
errors in an address. Use the Address Validator transformation to perform address validation.
Identity populations
You use identity population data when you want to perform duplicate analysis on identity data. An
identity is a set of values within a record that collectively identify a person or business. Use a Match
transformation or Comparison transformation to perform identity duplicate analysis.
Probabilistic models and classifier models
You use probabilistic or classifier model data when you want to identify the type of information that a
string contains. Use a probabilistic model in a Parser or Labeler transformation. Use a classifier model in
a Classifier transformation. Probabilistic models and classifier models use probabilistic logic to identify or
infer the type of information in the string. Use a Classifier transformation when each input string contains
a significant amount of data.

35

Reference tables
You use reference tables to verify the accuracy or structure of input data values in data quality
transformations.
The Content Management Service also compiles rule specifications into mapplets.
Use the Administrator tool to administer the Content Management Service. Recycle the Content Management
Service to start it.

Master Content Management Service

When you create multiple Content Management Services on a domain and associate the services with a
Model repository, one service operates as the master Content Management Service. The first Content
Management Service you create on a domain is the master Content Management Service.
Use the Master CMS property to identify the master Content Management Service. When you create the first
Content Management Service on a domain, the property is set to True. When you create additional Content
Management Services on a domain, the property is set to False.
You cannot edit the Master CMS property in the Administrator tool. Use the infacmd cms
UpdateServiceOptions command to change the master Content Management Service.

Content Management Service Architecture

The Developer tool and the Analyst tool interact with a Content Management Service to retrieve configuration
information for reference data and to compile rule specifications.
You associate a Content Management Service with a Data Integration Service and Model Repository Service
in a domain. If the Data Integration Service runs a mapping that reads reference data, you must create the
Data Integration Service and Content Management Service on the same node. You associate a Data
Integration Service with a single Content Management Service.
The Content Management Service must be available when you use the following resources:
Address reference data
The Content Management Service manages configuration information for address reference data. The
Data Integration Service maintains a copy of the configuration information. The Data Integration Service
applies the configuration information when it runs a mapping that reads the address reference data.
Identity population files
The Content Management Service manages the list of the population files on the node. When you
configure a Match transformation or a Comparison transformation, you select a population file from the
current list. The Data Integration Service applies the population configuration when it runs a mapping
that reads the population files.
Probabilistic model files and classifier model files
The Content Management Service stores the locations of any probabilistic model file and classifier model
file on the node. The Content Management Service also manages the compilation status of each model.

36

Chapter 2: Content Management Service

Update a probabilistic model or a classifier model on the master Content Management Service machine.
When you update a model, the master Content Management Service updates the corresponding model
file on any node that you associate with the Model repository.
Note: If you add a node to a domain and you create a Content Management Service on the node, run the
infacmd cms ResyncData command. The command updates the node with probabilistic model files or
classifier model files from the master Content Management Service machine.
Reference tables
The Content Management Service identifies the database that stores data values for the reference table
objects in the associated Model repository.
Rule specifications
The Content Management Service manages the compilation of rule specifications into mapplets. When
you compile a rule specification in the Analyst tool, the Analyst Service selects a Content Management
Service to generate the mapplet. The Analyst tool uses the Model Repository Service configuration to
select the Content Management Service.

Probabilistic Models and Classifier Models

The Model Repository Service reads probabilistic model and classifier model file data from the machine that
hosts the master Content Management Service in the domain. When you compile a probabilistic model or
classifier model in the Developer tool, you update the model files on the master Content Management
Service machine.
If a node in the domain runs a Content Management Service, the node stores local copies of the probabilistic
model and classifier model files. You specify the local path to the probabilistic and classifier model files in the
NLP Options property on the Content Management Service. The master Content Management Service
synchronizes the probabilistic model and classifier model files on the domain nodes with the master Content
Management Service files every 10 minutes.
To synchronize a Content Management Service machine with the current files from the master Content
Management Service machine, run the following command:
infacmd cms ResyncData
The command updates the machine that hosts the new service with the probabilistic model or classifier model
files from the master Content Management Service machine. When you add a Content Management Service
to a domain that includes a master Content Management Service, run the ResyncData command.
You specify a single type of model file when you run the command. To synchronize probabilistic model files
and classifier model files, run the command once for each type of model file.

Synchronization Operations
The master Content Management Service stores a list of the Content Management Services in the domain.
When the master Content Management Service synchronizes with the domain services, the master Content
Management Service copies the current model files sequentially to each domain node. If a node is
unavailable, the master Content Management Service moves the node to the end of the list and synchronizes
with the next node on the list. After the synchronization operation copies the files to all available Content
Management Service machines, the operation ends.
To verify that a synchronization operation succeeded on a node, browse the directory structure on the node
and find the probabilistic or classifier model files. Compare the files with the files on the master Content
Management Service machine.

Probabilistic Models and Classifier Models

37

Informatica uses the following directory paths as the default locations for the files:
[Informatica_install_directory]/tomcat/bin/ner
[Informatica_install_directory]/tomcat/bin/classifier
The file names have the following extensions:
Probabilistic model files: .ner
Classifier model files: .classifier
Note: The time required to synchronize the model files depends on the number of files on the master Content
Management Service machine. The ResyncData command copies model files in batches of 15 files at a time.

Reference Data Warehouse

The reference data warehouse stores data values for the reference table objects you define in a Model
repository.
When you add data to a reference table, the Content Management Service writes the data values to a table in
the reference data warehouse. For example, when you create a reference table from a flat file, the Content
Management Service uses the file structure to define the object metadata in the Model repository. The
Content Management Service writes the file data to a table in the reference data warehouse.
The Reference Data Location option on the Content Management identifies the reference data warehouse.
To update the data warehouse connection, configure this option.
When you specify a reference data warehouse, verify that the database you select stores data for the Model
repository only.

Orphaned Reference Data

When you delete a reference table object from the Model repository, the table data remains in the reference
data warehouse.
Use the Purge Orphaned Tables option on the Content Management Service to delete unused reference
tables. The option identifies the tables that store data for reference table objects in the Model repository and
deletes all other reference tables from the warehouse. The purge option removes obsolete reference tables
and creates additional space in the warehouse.
Before you purge the unused tables, verify the following prerequisites:

You have the Manage Service privilege on the domain.

The user name that the Content Management Service uses to communicate with the Model repository has
the Administrator role on the associated Model Repository Service.

All Data Integration Services associated with the Model repository are available.

There are no data operations in progress on the reference data warehouse.

The reference data warehouse stores data for the reference table objects in a single Model repository.

Note: The purge operation reads the Model repository that the current Content Management Service
identifies, and it deletes any reference table that the Model repository does not use. If the reference data
warehouse stores reference data for any other Model repository, the purge operation deletes all tables that
belong to the other repository. To prevent accidental data loss, the purge operation does not delete tables if
the Model repository does not contain a reference table object.

38

Chapter 2: Content Management Service

Deleting Orphaned Tables

To delete unused tables from the reference data warehouse, purge orphaned tables.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the master Content Management Service.

3.

Click Manage Actions > Purge Orphaned Tables.

The Content Management Service deletes all table data that does not belong to a reference table object
in the associated Model repository.

To prevent accidental data loss, the purge operation does not delete tables if the Model repository does not
contain a reference table object.
Note: To delete unused reference table at the command prompt, run the infacmd cms Purge command.

Recycling and Disabling the Content Management

Service
Recycle the Content Management Service to apply the latest service or service process options. Disable the
Content Management Service to restrict user access to information about reference data in the Developer
tool.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select Content Management Service > Disable to stop the service.
When you disable the Content Management Service, you must choose the mode to disable it in. You can
choose one of the following options:

3.

Complete. Allows the jobs to run to completion before disabling the service.

Abort. Tries to stop all jobs before aborting them and disabling the service.

Click the Recycle button to restart the service. The Data Integration Service must be running before you
recycle the Content Management Service.
You recycle the Content Management Service in the following cases:

Recycle the Content Management Service after you add or update address reference data files or
after you change the file location for probabilistic or classifier model data files.

Recycle the Content Management Service and the associated Data Integration Service after you
update the address validation properties, reference data location, identity cache directory, or identity
index directory on the Content Management Service.
When you update the reference data location on the Content Management Service, recycle the
Analyst Service associated with the Model Repository Service that the Content Management Service
uses. Open a Developer tool or Analyst tool application to refresh the reference data location stored
by the application.

Recycling and Disabling the Content Management Service

39

Content Management Service Properties

To view the Content Management Service properties, select the service in the Domain Navigator and click
the Properties view.
You can configure the following Content Management Service properties:

General properties

Multi-service options

Associated services and reference data location properties

File transfer options

Logging options

Custom properties

If you update a property, restart the Content Management Service to apply the update.

General Properties
General properties for the Content Management Service include the name and description of the Content
Management Service, and the node in the Informatica domain that the Content Management Service runs on.
You configure these properties when you create the Content Management Service.
The following table describes the general properties for the service:
Property

Description

Name

Name of the service. The name is not case sensitive and must be unique
within the domain. It cannot exceed 128 characters or begin with @. It also
cannot contain spaces or the following special characters:
`~%^*+={}\;:'"/?.,<>|!()][
You cannot change the name of the service after you create it.

40

Description

Description of the service. The description cannot exceed 765 characters.

Node

Node on which the service runs. If you change the node, you must recycle the
Content Management Service.

License

License object that allows use of the service.

Chapter 2: Content Management Service

Multi-Service Options
The Multi-service options indicate whether the current service is the master Content Management Service in
a domain.
The following table describes the single property under multi-service options:
Property

Description

Master CMS

Indicates the master status of the service.

The master Content Management Service is the first service you create on a
domain. The Master CMS property defaults to True when it is the first Content
Management Service on a domain. Otherwise, the Master CMS property defaults
to False.

Associated Services and Reference Data Location Properties

The Associated Services and Reference Data Location Properties identify the services associated with the
Content Management Service. It also identifies the database that stores reference data values for associated
reference data objects.
The following table describes the associated services and reference data location properties for the Content
Management Service:
Property

Description

Data Integration Service

Data Integration Service associated with the Content Management Service. The
Data Integration Service reads reference data configuration information from the
Content Management Service.
Recycle the Content Management Service if you associate another Data
Integration Service with the Content Management Service.

Model Repository Service

Model Repository Service associated with the Content Management Service.

Recycle the Content Management Service if you associate another Model
Repository Service with the Content Management Service.

Username

User name that the Content Management Service uses to connect to the Model
Repository Service.
To perform reference table management tasks in the Model repository, the user
that the property identifies must have the Model Repository Service
Administrator role. The reference table management tasks include purge
operations on orphaned reference tables.
Not available for a domain with Kerberos authentication.

Password

Password that the Content Management Service uses to connect to the Model
Repository Service.
Not available for a domain with Kerberos authentication.

Reference Data Location

Database connection name for the database that stores reference data values
for the reference data objects defined in the associated Model repository.
The database stores reference data object row values. The Model repository
stores metadata for reference data objects.

Content Management Service Properties

41

File Transfer Options

The File Transfer Options property identifies a directory on the Informatica services machine that the Content
Management Service can use to store data when a user imports data to a reference table.
When you import data to a reference table, the Content Management Service uses a local directory structure
as a staging area. The Content Management Service clears the directory when the reference table update is
complete.
The following table describes the File Transfer Options property:
Property

Description

Temporary File Location

Path to the directory that stores reference data during the import process.

Logging Options
Configure the Log Level property to set the logging level.
The following table describes the Log Level properties:
Property

Description

Log Level

Configure the Log Level property to set the logging level. The following values are
valid:
- Fatal. Writes FATAL messages to the log. FATAL messages include nonrecoverable
system failures that cause the service to shut down or become unavailable.
- Error. Writes FATAL and ERROR code messages to the log. ERROR messages
include connection failures, failures to save or retrieve metadata, service errors.
- Warning. Writes FATAL, WARNING, and ERROR messages to the log. WARNING
errors include recoverable system failures or warnings.
- Info. Writes FATAL, INFO, WARNING, and ERROR messages to the log. INFO
messages include system and service change messages.
- Trace. Write FATAL, TRACE, INFO, WARNING, and ERROR code messages to the
log. TRACE messages log user request failures.
- Debug. Write FATAL, DEBUG, TRACE, INFO, WARNING, and ERROR messages to
the log. DEBUG messages are user request logs.

Custom Properties for the Content Management Service

Configure custom properties that are unique to specific environments.
You might need to apply custom properties in special cases. When you define a custom property, enter the
property name and an initial value. Define custom properties only at the request of Informatica Global
Customer Support.

42

Chapter 2: Content Management Service

Content Management Service Process Properties

The Content Management Service runs the Content Management Service process on the same node as the
service. When you select the Content Management Service in the Administrator tool, you can view the
service process for the Content Management Service on the Processes tab.
You can view the node properties for the service process on the Processes tab. Select the node to view the
service process properties.
You can configure the following types of Content Management Service process properties:

Content Management Service security options

Address validation properties

Identity properties

Advanced properties

NLP option properties

Custom properties

If you update any of the Content Management Service process properties, restart the Content Management
Service for the modifications to take effect.
Note: The Content Management Service does not currently use the Content Management Service Security
Options properties.

Content Management Service Security Options

You can configure the Content Management Service to communicate with other components in the
Informatica domain in secure mode.
The following table describes the Content Management Service security options:
Property

Description

HTTP Port

Unique HTTP port number for the Reporting and Dashboards Service. Default is 8105.
Recycle the service if you change the HTTP port number.

HTTPS Port

HTTPS port number that the service runs on when you enable the Transport Layer Security
(TLS) protocol. Use a different port number than the HTTP port number.
Recycle the service if you change the HTTPS port number.

Keystore File

Path and file name of the keystore file that contains the private or public key pairs and
associated certificates. Required if you enable TLS and use HTTPS connections for the
service.

Keystore
Password

Plain-text password for the keystore file.

SSL Protocol

Leave this field blank.

Content Management Service Process Properties

43

Address Validation Properties

Configure address validation properties to determine how the Data Integration Service and the Developer tool
read address reference data files. After you update address validation properties, you must recycle the
Content Management Service and the Data Integration Service.
The following table describes the address validation properties for the Content Management Service process:
Property

Description

License

License key to activate validation reference data. You might have more than one key, for
example, if you use batch reference data and geocoding reference data. Enter keys as a
comma-delimited list. The property is empty by default.

Reference Data
Location

Location of the address reference data files. Enter the full path to the files. Install all address
reference data files to a single location. The property is empty by default.

Full Pre-Load
Countries

List of countries for which all batch, CAMEO, certified, interactive, or supplementary
reference data is loaded into memory before address validation begins. Enter the threecharacter ISO country codes in a comma-separated list. For example, enter DEU,FRA,USA.
Enter ALL to load all data sets. The property is empty by default.
Load the full reference database to increase performance. Some countries, such as the
United States, have large databases that require significant amounts of memory.

Partial Pre-Load
Countries

List of countries for which batch, CAMEO, certified, interactive, or supplementary reference
metadata and indexing structures are loaded into memory before address validation begins.
Enter the three-character ISO country codes in a comma-separated list. For example, enter
DEU,FRA,USA. Enter ALL to partially load all data sets. The property is empty by default.
Partial preloading increases performance when not enough memory is available to load the
complete databases into memory.

No Pre-Load
Countries

List of countries for which no batch, CAMEO, certified, interactive, or supplementary

reference data is loaded into memory before address validation begins. Enter the threecharacter ISO country codes in a comma-separated list. For example, enter DEU,FRA,USA.
Default is ALL.

Full Pre-Load
Geocoding
Countries

List of countries for which all geocoding reference data is loaded into memory before address
validation begins. Enter the three-character ISO country codes in a comma-separated list. For
example, enter DEU,FRA,USA. Enter ALL to load all data sets. The property is empty by
default.
Load all reference data for a country to increase performance when processing addresses
from that country. Some countries, such as the United States, have large data sets that
require significant amounts of memory.

Partial Pre-Load
Geocoding
Countries

List of countries for which geocoding reference metadata and indexing structures are loaded
into memory before address validation begins. Enter the three-character ISO country codes in
a comma-separated list. For example, enter DEU,FRA,USA. Enter ALL to partially load all
data sets. The property is empty by default.
Partial preloading increases performance when not enough memory is available to load the
complete databases into memory.

No Pre-Load
Geocoding
Countries

44

List of countries for which no geocoding reference data is loaded into memory before address
validation begins. Enter the three-character ISO country codes in a comma-separated list. For
example, enter DEU,FRA,USA. Default is ALL.

Chapter 2: Content Management Service

Property

Description

Full Pre-Load
Suggestion List
Countries

List of countries for which all suggestion list reference data is loaded into memory before
address validation begins. Enter the three-character ISO country codes in a commaseparated list. For example, enter DEU,FRA,USA. Enter ALL to load all data sets. The
property is empty by default.
Load the full reference database to increase performance. Some countries, such as the
United States, have large databases that require significant amounts of memory.

Partial Pre-Load
Suggestion List
Countries

List of countries for which the suggestion list reference metadata and indexing structures are
loaded into memory before address validation begins. Enter the three-character ISO country
codes in a comma-separated list. For example, enter DEU,FRA,USA. Enter ALL to partially
load all data sets. The property is empty by default.
Partial preloading increases performance when not enough memory is available to load the
complete databases into memory.

No Pre-Load
Suggestion List
Countries

List of countries for which no suggestion list reference data is loaded into memory before
address validation begins. Enter the three-character ISO country codes in a commaseparated list. For example, enter DEU,FRA,USA. Default is ALL.

Full Pre-Load
Address Code
Countries

List of countries for which all address code lookup reference data is loaded into memory
before address validation begins. Enter the three-character ISO country codes in a commaseparated list. For example, enter DEU,FRA,USA. Enter ALL to load all data sets. The
property is empty by default.
Load the full reference database to increase performance. Some countries, such as the
United States, have large databases that require significant amounts of memory.

Partial Pre-Load
Address Code
Countries

List of countries for which the address code lookup reference metadata and indexing
structures are loaded into memory before address validation begins. Enter the threecharacter ISO country codes in a comma-separated list. For example, enter DEU,FRA,USA.
Enter ALL to partially load all data sets. The property is empty by default.
Partial preloading increases performance when not enough memory is available to load the
complete databases into memory.

No Pre-Load
Address Code
Countries

List of countries for which no address code lookup reference data is loaded into memory
before address validation begins. Enter the three-character ISO country codes in a commaseparated list. For example, enter DEU,FRA,USA. Default is ALL.

Preloading
Method

Determines how the Data Integration Service preloads address reference data into memory.
The MAP method and the LOAD method both allocate a block of memory and then read
reference data into this block. However, the MAP method can share reference data between
multiple processes. Default is MAP.

Max Result
Count

Maximum number of addresses that address validation can return in suggestion list mode.
Set a maximum number in the range 1 through 100. Default is 20.

Memory Usage

Number of megabytes of memory that the address validation library files can allocate. Default
is 4096.

Max Address
Object Count

Maximum number of address validation instances to run at the same time. Default is 3. Set a
value that is greater than or equal to the Maximum Parallelism value on the Data Integration
Service.

Max Thread
Count

Maximum number of threads that address validation can use. Set to the total number of cores
or threads available on a machine. Default is 2.

Content Management Service Process Properties

45

Property

Description

Cache Size

Size of cache for databases that are not preloaded. Caching reserves memory to increase
lookup performance in reference data that has not been preloaded.
Set the cache size to LARGE unless all the reference data is preloaded or you need to reduce
the amount of memory usage.
Enter one of the following options for the cache size in uppercase letters:
- NONE. No cache. Enter NONE if all reference databases are preloaded.
- SMALL. Reduced cache size.
- LARGE. Standard cache size.

Default is LARGE.
SendRight
Report Location

Location to which an address validation mapping writes a SendRight report and any log file
that relates to the report. You generate a SendRight report to verify that a set of New Zealand
address records meets the certification standards of New Zealand Post. Enter a local path on
the machine that hosts the Data Integration Service that runs the mapping.
By default, address validation writes the report file to the bin directory of the Informatica
installation. If you enter a relative path, the Content Management Service appends the path to
the bin directory.

Rules and Guidelines for Address Reference Data Preload Options

If you run a mapping that reads address reference data, verify the policy that the Data Integration Service
uses to load the data into memory. To configure the policy, use the preload options on the address validation
process properties. The Data Integration Service reads the preload options from the Content Management
Service when an address validation mapping runs.
Consider the following rules and guidelines when you configure the preload options on the Content
Management Service:

By default, the Content Management Service applies the ALL value to the options that indicate no data
preload. If you accept the default options, the Data Integration Service reads the address reference data
from files in the directory structure when the mapping runs.

The address validation process properties must indicate a preload method for each type of address
reference data that a mapping specifies. If the Data Integration Service cannot determine a preload policy
for a type of reference data, it ignores the reference data when the mapping runs.

The Data Integration Service can use a different method to load data for each country. For example, you
can specify full preload for United States suggestion list data and partial preload for United Kingdom
suggestion list data.

The Data Integration Service can use a different preload method for each type of data. For example, you
can specify full preload for United States batch data and partial preload for United States address code
data.

Full preload settings supersede partial preload settings, and partial preload settings supersede settings
that indicate no data preload.
For example, you might configure the following options:
Full Pre-Load Geocoding Countries: DEU
No Pre-Load Geocoding Countries: ALL
The options specify that the Data Integration Service loads German geocoding data into memory and
does not load geocoding data for any other country.

46

The Data Integration Service loads the types of address reference data that you specify in the address
validation process properties. The Data Integration Service does not read the mapping metadata to
identify the address reference data that the mapping specifies.

Chapter 2: Content Management Service

Identity Properties
The identity properties specify the location of the identity population files and the default locations of the
temporary files that identity match analysis can generate. The locations on each property are local to the
Data Integration Service that runs the identity match mapping. The Data Integration Service must have write
access to each location.
The following table describes the identity properties:
Property

Description

Reference
Data
Location

Path to the directory that contains the identity population files.

Cache
Directory

The path identifies a parent directory. Install the population files to a directory with the name
default below the directory that the property specifies.
Path to the directory that contains the temporary data files that the Data Integration Service
generates during identity analysis. The Data Integration Service creates the directory at run time
if the Match transformation in the mapping does not specify the directory.
The property sets the following default path:
./identityCache
You can specify a relative path, or you can specify a fully qualified path to a directory that the
Data Integration Service can write to. The relative path is relative to the tomcat/bin directory
on the Data Integration Service machine.

Index
Directory

Path to the directory that contains the temporary index files that the Data Integration Service
generates during identity analysis. Identity match analysis uses the index to sort records into
groups before match analysis. The Data Integration Service creates the directory at run time if the
Match transformation in the mapping does not specify the directory.
The property sets the following default location:
./identityIndex
You can specify a relative path, or you can specify a fully qualified path to a directory that the
Data Integration Service can write to. The relative path is relative to the tomcat/bin directory
on the Data Integration Service machine.

Content Management Service Process Properties

47

Advanced Properties
The advanced properties define the maximum heap size and the Java Virtual Manager (JVM) memory
settings.
The following table describes the advanced properties for service process:
Property

Description

Maximum Heap Size

Amount of RAM allocated to the Java Virtual Machine (JVM) that runs the
service. Use this property to increase the memory available tp the service.
Append one of the following letters to the value to specify the units:
-

b for bytes
k for kilobytes
m for megabytes
g for gigabytes

Default is 512 megabytes.

JVM Command Line Options

Java Virtual Machine (JVM) command line options to run Java-based

programs. When you configure the JVM options, you must set the Java SDK
classpath, Java SDK minimum memory, and Java SDK maximum memory
properties.

Note: If you use Informatica Developer to compile probabilistic models, increase the default maximum heap
size value to 3 gigabytes.

NLP Options
The NLP Options property provides the location of probabilistic model and classifier model files on the
Informatica services machine. Probabilistic models and classifier models are types of reference data. Use the
models in transformations that perform Natural Language Processing (NLP) analysis.
The following table describes the NLP Options property:
Property

Description

NER File
Location

Path to the probabilistic model files. The property reads a relative path from the following
directory in the Informatica installation:
/tomcat/bin
The default value is ./ner, which indicates the following directory:
/tomcat/bin/ner

Classifier File
Location

Path to the classifier model files. The property reads a relative path from the following directory
in the Informatica installation:
/tomcat/bin
The default value is ./classifier, which indicates the following directory:
/tomcat/bin/classifier

Custom Properties for the Content Management Service Process

Configure custom properties that are unique to specific environments.
You might need to apply custom properties in special cases. When you define a custom property, enter the
property name and an initial value. Define custom properties only at the request of Informatica Global
Customer Support.

48

Chapter 2: Content Management Service

Creating a Content Management Service

Before you create a Content Management Service, verify that the domain contains a Data Integration Service
and Model Repository Service. You must also know the connection name of a database that the Content
Management Service can use to store reference data.
Create a Content Management Service to manage reference data properties and to provide the Developer
tool with information about installed reference data.
1.

On the Manage tab, select the Services and Nodes view.

2.

Select the domain name.

3.

Click Actions > New > Content Management Service.

The New Content Management Service window appears.

4.

Enter a name and optional description for the service.

5.

Set the location for the service. You can create the service in a folder on the domain. Click Browse to
create a folder.

6.

Select the node that you want the service to run on.

7.

Specify a Data Integration Service and Model Repository Service to associate with the Content
Management Service.

8.

Enter a username and password that the Content Management Service can use to connect to the Model
Repository Service.

9.

Select the database that the Content Management Service can use to store reference data.

10.

Click Next.

11.

Optionally, select Enable Service to enable the service after you create it.
Note: Do not configure the Transport Layer Security properties. The properties are reserved for future
use.

12.

Click Finish.

If you did not choose to enable the service, you must recycle the service to start it.

Creating a Content Management Service

49

CHAPTER 3

Data Integration Service

This chapter includes the following topics:

Data Integration Service Overview, 50

Before You Create the Data Integration Service, 51

Creating a Data Integration Service, 52

Data Integration Service Properties, 55

Data Integration Service Process Properties, 67

Data Integration Service Compute Properties, 70

High Availability for the Data Integration Service, 72

Data Integration Service Overview

The Data Integration Service is an application service in the Informatica domain that performs data
integration tasks for Informatica Analyst and Informatica Developer. It also performs data integration tasks for
external clients.
When you preview or run mappings, profiles, SQL data services, and web services in the Analyst tool or the
Developer tool, the application client sends requests to the Data Integration Service to perform the data
integration tasks. When you start a command from the command line or an external client to run mappings,
SQL data services, web services, and workflows in an application, the command sends the request to the
Data Integration Service.
The Data Integration Service performs the following tasks:

50

Runs mappings and generates mapping previews in the Developer tool.

Runs profiles and generates previews for profiles in the Analyst tool and the Developer tool.

Runs scorecards for the profiles in the Analyst tool and the Developer tool.

Runs SQL data services and web services in the Developer tool.

Runs mappings in a deployed application.

Runs workflows in a deployed application.

Caches data objects for mappings and SQL data services deployed in an application.

Runs SQL queries that end users run against an SQL data service through a third-party JDBC or ODBC
client tool.

Runs web service requests against a web service.

Create and configure a Data Integration Service in the Administrator tool. You can create one or more Data
Integration Services on a node. Based on your license, the Data Integration Service can be highly available.

Before You Create the Data Integration Service

Before you create the Data Integration Service, complete the prerequisite tasks for the service.
Perform the following tasks before you create the Data Integration Service:

Set up the databases that the Data Integration Service connects to.

Create connections to the databases.

If the domain uses Kerberos authentication and you set the service principal level at the process level,
create a keytab file for the Data Integration Service.

Create the associated Model Repository Service.

Create Required Databases

The Data Integration Service can connect to multiple relational databases. The databases that the service
can connect to depend on the license key generated for your organization. When you create the Data
Integration Service, you provide connection information to the databases.
Create the following databases before you create the Data Integration Service:
Data object cache database
Stores cached logical data objects and virtual tables. Data object caching enables the Data Integration
Service to access pre-built logical data objects and virtual tables. You need a data object cache
database to increase performance for mappings, SQL data service queries, and web service requests.
Profiling warehouse
Stores profiling information, such as profile results and scorecard results. You need a profiling
warehouse to perform profiling and data discovery.
Workflow database
Stores all run-time metadata for workflows, including Human task metadata.
For more information about the database requirements, see Appendix A, Application Service Databases on
page 398.
The Data Integration Service uses native database drivers to connect to the data object cache database, the
profiling warehouse, and source and target databases. To establish native connectivity between the service
and a database, install the database client software for the database that you want to access. For more
information, see Configure Native Connectivity on Service Machines on page 413.

Create Connections to the Databases

The Data Integration Service uses connections to access the databases. You specify the connection details
when you create the service.
When you create the database connection in the Administrator tool, specify the database connection
properties and test the connection.

Before You Create the Data Integration Service

51

The following table describes the database connections that you must create before you create the Data
Integration Service:
Database
Connection

Description

Data object cache

database

To access the data object cache, create the data object cache connection for the Data
Integration Service.

Workflow database

To store run-time metadata for workflows, create the workflow database connection for
the Data Integration Service.

Profiling warehouse
database

To create and run profiles and scorecards, create the profiling warehouse database
connection for the Data Integration Service.
To create and run profiles and scorecards, select this instance of the Data Integration
Service when you configure the run-time properties of the Analyst Service.

Create the Service Principal Name and Keytab File

If the Informatica domain uses Kerberos authentication and you set the service principal level for the domain
to process level, the domain requires an SPN and keytab file for each application service that you create in
the domain.
Before you enable a service, verify that an SPN and a keytab file are available for the service. Kerberos
cannot authenticate the application service if the service does not have a keytab file in the Informatica
directory.
For more information about creating the service principal names and keytab files, see the Informatica
Security Guide.

Create Associated Services

The Data Integration Service connects to the Model Repository Service to perform jobs such as running
mappings, workflows, and profiles.
Create the Model Repository Service before you create the Data Integration Service. When you create the
Data Integration Service, you provide the name of the Model Repository Service. You can associate the
same Model Repository Service to multiple Data Integration Services.

Creating a Data Integration Service

Use the service creation wizard in the Administrator tool to create the service.
1.

In the Administrator tool, click the Manage tab.

2.

Click the Services and Nodes view.

3.

In the Domain Navigator, select the domain.

4.

Click Actions > New > Data Integration Service.

The New Data Integration Service wizard appears.

52

Chapter 3: Data Integration Service

5.

On the New Data Integration Service - Step 1 of 14 page, enter the following properties:
Property

Description

Name

Name of the service. The name is not case sensitive and must be unique within the
domain. It cannot exceed 128 characters or begin with @. It also cannot contain spaces
or the following special characters:
`~%^*+={}\;:'"/?.,<>|!()][

6.

Description

Description of the service. The description cannot exceed 765 characters.

Location

Domain and folder where the service is created. Click Browse to choose a different
folder. You can move the service after you create it.

License

License object that allows use of the service.

Assign

Select Node to configure the service to run on a node. If your license includes grid, you
can create a grid and assign the service to run on the grid after you create the service.

Node

Node on which the service runs.

Backup Nodes

If your license includes high availability, nodes on which the service can run if the
primary node is unavailable.

Model
Repository
Service

Model Repository Service to associate with the service.

Username

User name that the service uses to access the Model Repository Service. Enter the
Model repository user that you created. Not available for a domain with Kerberos
authentication.

Password

Password for the Model repository user. Not available for a domain with Kerberos
authentication.

Security
Domain

LDAP security domain for the Model repository user. The field appears when the
Informatica domain contains an LDAP security domain. Not available for a domain with
Kerberos authentication.

Click Next.
The New Data Integration Service - Step 2 of 14 page appears.

7.

Enter the HTTP port number to use for the Data Integration Service.

8.

Accept the default values for the remaining security properties. You can configure the security properties
after you create the Data Integration Service.

9.

Select Enable Service.

The Model Repository Service must be running to enable the Data Integration Service.

10.

Verify that the Move to plugin configuration page is not selected.

11.

Click Next.
The New Data Integration Service - Step 3 of 14 page appears.

12.

Set the Launch Job Options property to one of the following values:

Creating a Data Integration Service

53

In the service process. Configure when you run SQL data service and web service jobs. SQL data
service and web service jobs typically achieve better performance when the Data Integration Service
runs jobs in the service process.

In separate local processes. Configure when you run mapping, profile, and workflow jobs. When the
Data Integration Service runs jobs in separate local processes, stability increases because an
unexpected interruption to one job does not affect all other jobs.

If you configure the Data Integration Service to run on a grid after you create the service, you can
configure the service to run jobs in separate remote processes.
13.

Accept the default values for the remaining execution options and click Next.
The New Data Integration Service - Step 4 of 14 page appears.

14.

If you created the data object cache database for the Data Integration Service, click Select to select the
cache connection. Select the data object cache connection that you created for the service to access the
database.

15.

Accept the default values for the remaining properties on this page and click Next.
The New Data Integration Service - Step 5 of 14 page appears.

16.

For optimal performance, enable the Data Integration Service modules that you plan to use.
The following table lists the Data Integration Service modules that you can enable:

17.

Module

Description

Web Service Module

Runs web service operation mappings.

Mapping Service Module

Runs mappings and previews.

Profiling Service Module

Runs profiles and scorecards.

SQL Service Module

Runs SQL queries from a third-party client tool to an SQL data

service.

Workflow Orchestration Service Module

Runs workflows.

Click Next.
The New Data Integration Service - Step 6 of 14 page appears.
You can configure the HTTP proxy server properties to redirect HTTP requests to the Data Integration
Service. You can configure the HTTP configuration properties to filter the web services client machines
that can send requests to the Data Integration Service. You can configure these properties after you
create the service.

18.

Accept the default values for the HTTP proxy server and HTTP configuration properties and click Next.
The New Data Integration Service - Step 7 of 14 page appears.
The Data Integration Service uses the result set cache properties to use cached results for SQL data
service queries and web service requests. You can configure the properties after you create the service.

19.

Accept the default values for the result set cache properties and click Next.
The New Data Integration Service - Step 8 of 14 page appears.

54

20.

If you created the profiling warehouse database for the Data Integration Service, select the Profiling
Service module.

21.

If you created the workflow database for the Data Integration Service, select the Workflow Orchestration
Service module.

Chapter 3: Data Integration Service

22.

Verify that the remaining modules are not selected.

You can configure properties for the remaining modules after you create the service.

23.

Click Next.
The New Data Integration Service - Step 11 of 14 page appears.

24.

If you created the profiling warehouse database for the Data Integration Service, click Select to select
the database connection. Select the profiling warehouse connection that you created for the service to
access the database.

25.

Select whether or not content exists in the profiling warehouse database.

If you created a new profiling warehouse database, select No content exists under specified
connection string.

26.

Click Next.
The New Data Integration Service - Step 12 of 14 page appears.

27.

Accept the default values for the advanced profiling properties and click Next.
The New Data Integration Service - Step 14 of 14 page appears.

28.

If you created the workflow database for the Data Integration Service, click Select to select the database
connection. Select the workflow database connection that you created for the service to access the
database.

29.

Click Finish.
The domain creates and enables the Data Integration Service.

After you create the service through the wizard, you can edit the properties or configure other properties.

Data Integration Service Properties

To view the Data Integration Service properties, select the service in the Domain Navigator and click the
Properties view. You can change the properties while the service is running, but you must restart the service
for the properties to take effect.

General Properties
The general properties of a Data Integration Service includes name, license, and node assignment.
The following table describes the general properties for the service:
General Property

Description

Name

Name of the service. The name is not case sensitive and must be unique within
the domain. It cannot exceed 128 characters or begin with @. It also cannot
contain spaces or the following special characters:
`~%^*+={}\;:'"/?.,<>|!()][
You cannot change the name of the service after you create it.

Description

Description of the service. The description cannot exceed 765 characters.

License

License object that allows use of the service.

Data Integration Service Properties

55

General Property

Description

Assign

Node or grid on which the Data Integration Service runs.

Node

Node on which the service runs.

Grid

Name of the grid on which the Data Integration Service runs if the service runs on
a grid. Click the grid name to view the grid configuration.

Backup Nodes

If your license includes high availability, nodes on which the service can run if the
primary node is unavailable.

Model Repository Properties

The following table describes the Model repository properties for the Data Integration Service:
Property

Description

Model Repository Service

Service that stores run-time metadata required to run mappings and SQL data
services.

User Name

User name to access the Model repository. The user must have the Create Project
privilege for the Model Repository Service.
Not available for a domain with Kerberos authentication.

Password

User password to access the Model repository.

Not available for a domain with Kerberos authentication.

56

Chapter 3: Data Integration Service

Execution Options
The following table describes the execution options for the Data Integration Service:
Property

Description

Launch Job Options

Runs jobs in the Data Integration Service process, in separate DTM processes on
the local node, or in separate DTM processes on remote nodes. Configure the
property based on whether the Data Integration Service runs on a single node or a
grid and based on the types of jobs that the service runs.
Choose one of the following options:
- In the service process. Configure when you run SQL data service and web service
jobs on a single node or on a grid where each node has both the service and
compute roles.
- In separate local processes. Configure when you run mapping, profile, and workflow
jobs on a single node or on a grid where each node has both the service and
compute roles.
- In separate remote processes. Configure when you run mapping, profile, and
workflow jobs on a grid where nodes have a different combination of roles. If you
choose this option when the Data Integration Service runs on a single node, then the
service runs jobs in separate local processes.

Default is in separate local processes.

Note: If the Data Integration Service runs on UNIX and is configured to run jobs in
separate local or remote processes, verify that the host file on each node with the
compute role contains a localhost entry. Otherwise, jobs that run in separate
processes fail.
Maximum Execution Pool
Size

Maximum number of jobs that each Data Integration Service process can run
concurrently. Jobs include data previews, mappings, profiling jobs, SQL queries,
and web service requests. For example, a Data Integration Service grid includes
three running service processes. If you set the value to 10, each Data Integration
Service process can run up to 10 jobs concurrently. A total of 30 jobs can run
concurrently on the grid. Default is 10.

Maximum Memory Size

Maximum amount of memory, in bytes, that the Data Integration Service can
allocate for running all requests concurrently when the service runs jobs in the
Data Integration Service process. When the Data Integration Service runs jobs in
separate local or remote processes, the service ignores this value. If you do not
want to limit the amount of memory the Data Integration Service can allocate, set
this property to 0.
If the value is greater than 0, the Data Integration Service uses the property to
calculate the maximum total memory allowed for running all requests concurrently.
The Data Integration Service calculates the maximum total memory as follows:
Maximum Memory Size + Maximum Heap Size + memory required for loading
program components
Default is 0.
Note: If you run profiles or data quality mappings, set this property to 0.

Data Integration Service Properties

57

Property

Description

Maximum Parallelism

Maximum number of parallel threads that process a single mapping pipeline stage.
When you set the value greater than 1, the Data Integration Service enables
partitioning for mappings, column profiling, and data domain discovery. The
service dynamically scales the number of partitions for a mapping pipeline at run
time. Increase the value based on the number of CPUs available on the nodes
where jobs run.
In the Developer tool, developers can change the maximum parallelism value for
each mapping. When maximum parallelism is set for both the Data Integration
Service and the mapping, the Data Integration Service uses the minimum value
when it runs the mapping.
Default is 1. Maximum is 64.
Note: Developers cannot change the maximum parallelism value for each profile.
When the Data Integration Service converts a profile job into one or more
mappings, the mappings always use Auto for the mapping maximum parallelism.

Hadoop Kerberos Service

Principal Name

Service Principal Name (SPN) of the Data Integration Service to connect to a

Hadoop cluster that uses Kerberos authentication.

Hadoop Kerberos Keytab

The file path to the Kerberos keytab file on the machine on which the Data
Integration Service runs.

Temporary Directories

Directory for temporary files created when jobs are run. Default is <home
directory>/disTemp.
Enter a list of directories separated by semicolons to optimize performance during
profile operations and during cache partitioning for Sorter transformations.
You cannot use the following characters in the directory path:
* ? < > " | , [ ]

Home Directory

Root directory accessible by the node. This is the root directory for other service
directories. Default is <Informatica installation directory>/
tomcat/bin. If you change the default value, verify that the directory exists.
You cannot use the following characters in the directory path:
* ? < > " | , [ ]

Cache Directory

Directory for index and data cache files for transformations. Default is <home
directory>/cache.
Enter a list of directories separated by semicolons to increase performance during
cache partitioning for Aggregator, Joiner, or Rank transformations.
You cannot use the following characters in the directory path:
* ? < > " | , [ ]

Source Directory

Directory for source flat files used in a mapping. Default is <home directory>/
source.
If the Data Integration Service runs on a grid, you can use a shared directory to
create one directory for source files. If you configure a different directory for each
node with the compute role, ensure that the source files are consistent among all
source directories.
You cannot use the following characters in the directory path:
* ? < > " | , [ ]

58

Chapter 3: Data Integration Service

Property

Description

Target Directory

Default directory for target flat files used in a mapping. Default is <home
directory>/target.
Enter a list of directories separated by semicolons to increase performance when
multiple partitions write to the flat file target.
You cannot use the following characters in the directory path:
* ? < > " | , [ ]

Rejected Files Directory

Directory for reject files. Reject files contain rows that were rejected when running
a mapping. Default is <home directory>/reject.
You cannot use the following characters in the directory path:
* ? < > " | , [ ]

Informatica Home Directory

on Hadoop

The PowerCenter Big Data Edition home directory on every data node created by
the Hadoop RPM install. Type /
<PowerCenterBigDataEditionInstallationDirectory>/
Informatica.

Hadoop Distribution
Directory

The directory containing a collection of Hive and Hadoop JARS on the cluster from
the RPM Install locations. The directory contains the minimum set of JARS
required to process Informatica mappings in a Hadoop environment. Type /
<PowerCenterBigDataEditionInstallationDirectory>/
Informatica/services/shared/hadoop/
[Hadoop_distribution_name].

Data Integration Service

Hadoop Distribution
Directory

The Hadoop distribution directory on the Data Integration Service node. The
contents of the Data Integration Service Hadoop distribution directory must be
identical to Hadoop distribution directory on the data nodes. Type
<Informatica Installation directory/Informatica/services/
shared/hadoop/[Hadoop_distribution_name].

Logical Data Object/Virtual Table Cache Properties

The following table describes the data object and virtual table cache properties:
Property

Description

Cache Removal Time

The number of milliseconds that the Data Integration Service waits before cleaning
up cache storage after a refresh. Default is 3,600,000.

Cache Connection

The database connection name for the database that stores the data object cache.
Select a valid connection object name.

Data Integration Service Properties

59

Property

Description

Maximum Concurrent
Refresh Requests

Maximum number of cache refreshes that can occur at the same time. Limit the
concurrent cache refreshes to maintain system resources.

Enable Nested LDO Cache

Indicates that the Data Integration Service can use cache data for a logical data
object used as a source or a lookup in another logical data object during a cache
refresh. If false, the Data Integration Service accesses the source resources even
if you enabled caching for the logical data object used as a source or a lookup.
For example, logical data object LDO3 joins data from logical data objects LDO1
and LDO2. A developer creates a mapping that uses LDO3 as the input and
includes the mapping in an application. You enable caching for LDO1, LDO2, and
LDO3. If you enable nested logical data object caching, the Data Integration
Service uses cache data for LDO1 and LDO2 when it refreshes the cache table for
LDO3. If you do not enable nested logical data object caching, the Data Integration
Service accesses the source resources for LDO1 and LDO2 when it refreshes the
cache table for LDO3.
Default is False.

Logging Properties
The following table describes the log level properties:
Property

Description

Log Level

Configure the Log Level property to set the logging level. The following values are
valid:
- Fatal. Writes FATAL messages to the log. FATAL messages include nonrecoverable
system failures that cause the service to shut down or become unavailable.
- Error. Writes FATAL and ERROR code messages to the log. ERROR messages
include connection failures, failures to save or retrieve metadata, service errors.
- Warning. Writes FATAL, WARNING, and ERROR messages to the log. WARNING
errors include recoverable system failures or warnings.
- Info. Writes FATAL, INFO, WARNING, and ERROR messages to the log. INFO
messages include system and service change messages.
- Trace. Write FATAL, TRACE, INFO, WARNING, and ERROR code messages to the
log. TRACE messages log user request failures.
- Debug. Write FATAL, DEBUG, TRACE, INFO, WARNING, and ERROR messages to
the log. DEBUG messages are user request logs.

Deployment Options
The following table describes the deployment options for the Data Integration Service:
Property

Description

Default Deployment Mode

Determines whether to enable and start each application after you deploy it to a
Data Integration Service. Default Deployment mode affects applications that you
deploy from the Developer tool, command line, and Administrator tool.
Choose one of the following options:
- Enable and Start. Enable the application and start the application.
- Enable Only. Enable the application but do not start the application.
- Disable. Do not enable the application.

60

Chapter 3: Data Integration Service

Pass-through Security Properties

The following table describes the pass-through security properties:
Property

Description

Allow Caching

Allows data object caching for all pass-through connections in the Data Integration
Service. Populates data object cache using the credentials from the connection
object.
Note: When you enable data object caching with pass-through security, you might
allow users access to data in the cache database that they might not have in an
uncached environment.

Modules
By default, all Data Integration Service modules are enabled. You can disable some of the modules.
You might want to disable a module if you are testing and you have limited resources on the computer. You
can save memory by limiting the Data Integration Service functionality. Before you disable a module, you
must disable the Data Integration Service.
The following table describes the Data Integration Service modules:
Module

Description

Web Service Module

Runs web service operation mappings.

Mapping Service Module

Runs mappings and previews.

Profiling Service Module

Runs profiles and generate scorecards.

SQL Service Module

Runs SQL queries from a third-party client tool to an SQL data service.

Workflow Orchestration Service Module

Runs workflows.

HTTP Proxy Server Properties

The following table describes the HTTP proxy server properties:
Property

Description

HTTP Proxy Server Host

Name of the HTTP proxy server.

HTTP Proxy Server Port

Port number of the HTTP proxy server.

Default is 8080.

HTTP Proxy Server User

Authenticated user name for the HTTP proxy server. This is required if the
proxy server requires authentication.

HTTP Proxy Server Password

Password for the authenticated user. The Service Manager encrypts the
password. This is required if the proxy server requires authentication.

HTTP Proxy Server Domain

Domain for authentication.

Data Integration Service Properties

61

HTTP Configuration Properties

The following table describes the HTTP Configuration Properties:
Property

Description

Allowed IP Addresses

List of constants or Java regular expression patterns compared to the IP

address of the requesting machine. Use a space to separate multiple
constants or expressions.
If you configure this property, the Data Integration Service accepts requests
from IP addresses that match the allowed address pattern. If you do not
configure this property, the Data Integration Service uses the Denied IP
Addresses property to determine which clients can send requests.

Allowed Host Names

List of constants or Java regular expression patterns compared to the host

name of the requesting machine. The host names are case sensitive. Use a
space to separate multiple constants or expressions.
If you configure this property, the Data Integration Service accepts requests
from host names that match the allowed host name pattern. If you do not
configure this property, the Data Integration Service uses the Denied Host
Names property to determine which clients can send requests.

Denied IP Addresses

List of constants or Java regular expression patterns compared to the IP

address of the requesting machine. Use a space to separate multiple
constants or expressions.
If you configure this property, the Data Integration Service accepts requests
from IP addresses that do not match the denied IP address pattern. If you do
not configure this property, the Data Integration Service uses the Allowed IP
Addresses property to determine which clients can send requests.

Denied Host Names

List of constants or Java regular expression patterns compared to the host

name of the requesting machine. The host names are case sensitive. Use a
space to separate multiple constants or expressions.
If you configure this property, the Data Integration Service accepts requests
from host names that do not match the denied host name pattern. If you do
not configure this property, the Data Integration Service uses the Allowed
Host Names property to determine which clients can send requests.

HTTP Protocol Type

Security protocol that the Data Integration Service uses. Select one of the
following values:
- HTTP. Requests to the service must use an HTTP URL.
- HTTPS. Requests to the service must use an HTTPS URL.
- HTTP&HTTPS. Requests to the service can use either an HTTP or an HTTPS
URL.

When you set the HTTP protocol type to HTTPS or HTTP&HTTPS, you
enable Transport Layer Security (TLS) for the service.
You can also enable TLS for each web service deployed to an application.
When you enable HTTPS for the Data Integration Service and enable TLS
for the web service, the web service uses an HTTPS URL. When you enable
HTTPS for the Data Integration Service and do not enable TLS for the web
service, the web service can use an HTTP URL or an HTTPS URL. If you
enable TLS for a web service and do not enable HTTPS for the Data
Integration Service, the web service does not start.
Default is HTTP.

62

Chapter 3: Data Integration Service

Result Set Cache Properties

The following table describes the result set cache properties:
Property

Description

File Name Prefix

The prefix for the names of all result set cache files stored on disk. Default is
RSCACHE.

Enable Encryption

Indicates whether result set cache files are encrypted using 128-bit AES
encryption. Valid values are true or false. Default is true.

Mapping Service Properties

The following table describes Mapping Service Module properties for the Data Integration Service:
Property

Description

Maximum
Notification
Thread Pool
Size

Maximum number of concurrent job completion notifications that the Mapping Service Module
sends to external clients after the Data Integration Service completes jobs. The Mapping
Service Module is a component in the Data Integration Service that manages requests sent to
run mappings. Default is 5.

Maximum
Memory Per
Request

The behavior of Maximum Memory Per Request depends on the following Data Integration
Service configurations:
- The service runs jobs in separate local or remote processes, or the service property Maximum
Memory Size is 0 (default).
Maximum Memory Per Request is the maximum amount of memory, in bytes, that the Data
Integration Service can allocate to all transformations that use auto cache mode in a single
request. The service allocates memory separately to transformations that have a specific cache
size. The total memory used by the request can exceed the value of Maximum Memory Per
Request.
- The service runs jobs in the Data Integration Service process, and the service property Maximum
Memory Size is greater than 0.
Maximum Memory Per Request is the maximum amount of memory, in bytes, that the Data
Integration Service can allocate to a single request. The total memory used by the request cannot
exceed the value of Maximum Memory Per Request.

Default is 536,870,912.
Requests include mappings and mappings run from Mapping tasks within a workflow.

Profiling Warehouse Database Properties

The following table describes the profiling warehouse database properties:
Property

Description

Profiling Warehouse
Database

The connection to the profiling warehouse.

Maximum Ranks

Number of minimum and maximum values to display for a profile. Default is 5.

Maximum Patterns

Maximum number of patterns to display for a profile. Default is 10.

Select the connection object name.

Data Integration Service Properties

63

Property

Description

Maximum Profile
Execution Pool Size

Maximum number of threads to run profiling. Default is 10.

Maximum DB Connections

Maximum number of database connections for each profiling job. Default is 5.

Profile Results Export

Path

Location where the Data Integration Service exports profile results file.

Maximum Memory Per

Request

Maximum amount of memory, in bytes, that the Data Integration Service can
allocate for each mapping run for a single profile request.

If the Data Integration Service and Analyst Service run on different nodes, both
services must be able to access this location. Otherwise, the export fails.

Default is 536,870,912.

Advanced Profiling Properties

The following table describes the advanced profiling properties:

64

Property

Description

Pattern Threshold
Percentage

Maximum number of values required to derive a pattern. Default is 5.

Maximum # Value
Frequency Pairs

Maximum number of value-frequency pairs to store in the profiling warehouse.

Default is 16,000.

Maximum String Length

Maximum length of a string that the Profiling Service can process. Default is 255.

Maximum Numeric
Precision

Maximum number of digits for a numeric value. Default is 38.

Maximum Concurrent
Profile Jobs

The maximum number of concurrent profile threads used to run a profile on flat
files and relational sources. If left blank, the Profiling Service plug-in determines
the best number based on the set of running jobs and other environment factors.

Maximum Concurrent
Columns

Maximum number of columns that you can combine for profiling flat files in a single
execution pool thread. Default is 5.

Maximum Concurrent
Profile Threads

The maximum number of concurrent execution pool threads used to run a profile
on flat files. Default is 1.

Maximum Column Heap

Size

Amount of memory to allow each column for column profiling. Default is 64

megabytes.

Reserved Profile Threads

Number of threads of the Maximum Execution Pool Size that are for priority
requests. Default is 1.

Chapter 3: Data Integration Service

SQL Properties
The following table describes the SQL properties:
Property

Description

DTM Keep Alive

Time

Number of milliseconds that the DTM instance stays open after it completes the last request.
Identical SQL queries can reuse the open instance. Use the keep alive time to increase
performance when the time required to process the SQL query is small compared to the
initialization time for the DTM instance. If the query fails, the DTM instance terminates.
Must be greater than or equal to 0. 0 means that the Data Integration Service does not keep
the DTM instance in memory. Default is 0.
You can also set this property for each SQL data service that is deployed to the Data
Integration Service. If you set this property for a deployed SQL data service, the value for the
deployed SQL data service overrides the value you set for the Data Integration Service.

Table Storage
Connection

Relational database connection that stores temporary tables for SQL data services. By default,
no connection is selected.

Maximum
Memory Per
Request

The behavior of Maximum Memory Per Request depends on the following Data Integration
Service configurations:
- The service runs jobs in separate local or remote processes, or the service property Maximum
Memory Size is 0 (default).
Maximum Memory Per Request is the maximum amount of memory, in bytes, that the Data
Integration Service can allocate to all transformations that use auto cache mode in a single
request. The service allocates memory separately to transformations that have a specific cache
size. The total memory used by the request can exceed the value of Maximum Memory Per
Request.
- The service runs jobs in the Data Integration Service process, and the service property Maximum
Memory Size is greater than 0.
Maximum Memory Per Request is the maximum amount of memory, in bytes, that the Data
Integration Service can allocate to a single request. The total memory used by the request cannot
exceed the value of Maximum Memory Per Request.

Default is 50,000,000.
Skip Log Files

Prevents the Data Integration Service from generating log files when the SQL data service
request completes successfully and the tracing level is set to INFO or higher. Default is false.

Workflow Orchestration Service Properties

The following table describes the Workflow Orchestration Service properties for the Data Integration Service:

Property

Description

Workflow Connection

The connection name of the database that stores the run-time configuration data
for the workflows that the Data Integration Service runs. Select a database on the
Connections view.
Create the workflow database contents before you run a workflow. To create the
contents, use the Actions menu options for the Data Integration Service in the
Administrator tool.
Note: After you create the Data Integration Service, recycle the service before you
create the workflow database contents.

Data Integration Service Properties

65

Web Service Properties

The following table describes the web service properties:
Property

Description

DTM Keep
Alive Time

Number of milliseconds that the DTM instance stays open after it completes the last request.
Web service requests that are issued against the same operation can reuse the open instance.
Use the keep alive time to increase performance when the time required to process the request
is small compared to the initialization time for the DTM instance. If the request fails, the DTM
instance terminates.
Must be greater than or equal to 0. 0 means that the Data Integration Service does not keep the
DTM instance in memory. Default is 5000.
You can also set this property for each web service that is deployed to the Data Integration
Service. If you set this property for a deployed web service, the value for the deployed web
service overrides the value you set for the Data Integration Service.

Logical URL

Prefix for the WSDL URL if you use an external HTTP load balancer. For example,
http://loadbalancer:8080
The Data Integration Service requires an external HTTP load balancer to run a web service on a
grid. If you run the Data Integration Service on a single node, you do not need to specify the
logical URL.

Maximum
Memory Per
Request

The behavior of Maximum Memory Per Request depends on the following Data Integration
Service configurations:
- The service runs jobs in separate local or remote processes, or the service property Maximum
Memory Size is 0 (default).
Maximum Memory Per Request is the maximum amount of memory, in bytes, that the Data
Integration Service can allocate to all transformations that use auto cache mode in a single request.
The service allocates memory separately to transformations that have a specific cache size. The
total memory used by the request can exceed the value of Maximum Memory Per Request.
- The service runs jobs in the Data Integration Service process, and the service property Maximum
Memory Size is greater than 0.
Maximum Memory Per Request is the maximum amount of memory, in bytes, that the Data
Integration Service can allocate to a single request. The total memory used by the request cannot
exceed the value of Maximum Memory Per Request.

Default is 50,000,000.
Skip Log
Files

Prevents the Data Integration Service from generating log files when the web service request
completes successfully and the tracing level is set to INFO or higher. Default is false.

Custom Properties for the Data Integration Service

Configure custom properties that are unique to specific environments.
You might need to apply custom properties in special cases. When you define a custom property, enter the
property name and an initial value. Define custom properties only at the request of Informatica Global
Customer Support.

66

Chapter 3: Data Integration Service

Data Integration Service Process Properties

A service process is the physical representation of a service running on a node. When the Data Integration
Service runs on multiple nodes, a Data Integration Service process can run on each node with the service
role. You can configure the service process properties differently for each node.
To configure properties for the Data Integration Service processes, click the Processes view. Select a node
to configure properties specific to that node.
The number of running service processes depends on the following ways that you can configure the Data
Integration Service:
Single node
A single service process runs on the node.
Primary and back-up nodes
A service process is enabled on each node. However, only a single process runs at any given time, and
the other processes maintain standby status.
Grid
A service process runs on each node in the grid that has the service role.
You can edit service process properties such as the HTTP port, result set cache, custom properties, and
environment variables. You can change the properties while the Data Integration Service process is running,
but you must restart the process for the changed properties to take effect.

Data Integration Service Security Properties

When you set the HTTP protocol type for the Data Integration Service to HTTPS or both, you enable the
Transport Layer Security (TLS) protocol for the service. Depending on the HTTP protocol type of the service,
you define the HTTP port, the HTTPS port, or both ports for the service process.
The following table describes the Data Integration Service Security properties:
Property

Description

HTTP Port

Unique HTTP port number for the Data Integration Service process when the
service uses the HTTP protocol.
Default is 8095.

HTTPS Port

Unique HTTPS port number for the Data Integration Service process when the
service uses the HTTPS protocol.
When you set an HTTPS port number, you must also define the keystore file
that contains the required keys and certificates.

Data Integration Service Process Properties

67

HTTP Configuration Properties

The HTTP configuration properties for a Data Integration Service process specify the maximum number of
HTTP or HTTPS connections that can be made to the process. The properties also specify the keystore and
truststore file to use when the Data Integration Service uses the HTTPS protocol.
The following table describes the HTTP configuration properties for a Data Integration Service process:
Property

Description

Maximum Concurrent
Requests

Maximum number of HTTP or HTTPS connections that can be made to this

Data Integration Service process. Default is 200.

Maximum Backlog Requests

Maximum number of HTTP or HTTPS connections that can wait in a queue for
this Data Integration Service process. Default is 100.

Keystore File

Path and file name of the keystore file that contains the keys and certificates
required if you use HTTPS connections for the Data Integration Service. You
can create a keystore file with a keytool. keytool is a utility that generates and
stores private or public key pairs and associated certificates in a keystore file.
You can use the self-signed certificate or use a certificate signed by a certificate
authority.
If you run the Data Integration Service on a grid, the keystore file on each node
in the grid must contain the same keys.

Keystore Password

Password for the keystore file.

Truststore File

Path and file name of the truststore file that contains authentication certificates
trusted by the Data Integration Service.
If you run the Data Integration Service on a grid, the truststore file on each node
in the grid must contain the same keys.

Truststore Password

Password for the truststore file.

SSL Protocol

Secure Sockets Layer protocol to use. Default is TLS.

Result Set Cache Properties

The following table describes the result set cache properties:

68

Property

Description

Maximum Total Disk Size

Maximum number of bytes allowed for the total result set cache file storage.
Default is 0.

Maximum Per Cache Memory

Size

Maximum number of bytes allocated for a single result set cache instance in
memory. Default is 0.

Maximum Total Memory Size

Maximum number of bytes allocated for the total result set cache storage in
memory. Default is 0.

Maximum Number of Caches

Maximum number of result set cache instances allowed for this Data
Integration Service process. Default is 0.

Chapter 3: Data Integration Service

Advanced Properties
The following table describes the Advanced properties:
Property

Description

Maximum Heap Size

Amount of RAM allocated to the Java Virtual Machine (JVM) that runs the Data
Integration Service. Use this property to increase the performance. Append one of
the following letters to the value to specify the units:
-

b for bytes.
k for kilobytes.
m for megabytes.
g for gigabytes.

Default is 512 megabytes.

Note: Consider increasing the heap size when the Data Integration Service needs
to process large amounts of data.
JVM Command Line
Options

Java Virtual Machine (JVM) command line options to run Java-based programs.
When you configure the JVM options, you must set the Java SDK classpath, Java
SDK minimum memory, and Java SDK maximum memory properties.

Logging Options
The following table describes the logging options for the Data Integration Service process:
Property

Description

Log Directory

Directory for Data Integration Service node process logs. Default is

<Informatica installation directory>/logs/node_name>/
services/DataIntegrationService/.
If the Data Integration Service runs on a grid, use a shared directory to create one
directory for log files. Use a shared directory to ensure that if the master service
process fails over to another node, the new master service process can access
previous log files.

SQL Properties
The following table describes the SQL properties:
Property

Description

Maximum # of Concurrent
Connections

Limits the number of database connections that the Data Integration Service
can make for SQL data services. Default is 100.

Custom Properties for the Data Integration Service Process

Configure custom properties that are unique to specific environments.
You might need to apply custom properties in special cases. When you define a custom property, enter the
property name and an initial value. Define custom properties only at the request of Informatica Global
Customer Support.

Data Integration Service Process Properties

69

Environment Variables
You can configure environment variables for the Data Integration Service process.
The following table describes the environment variables:
Property

Description

Environment Variable

Enter a name and a value for the environment variable.

Data Integration Service Compute Properties

You can configure the compute properties that the execution Data Transformation Manager (DTM) uses when
it runs jobs.
When the Data Integration Service runs on primary and back-up nodes, you can configure the compute
properties differently for each node. When the Data Integration Service runs on a grid, DTM instances run
jobs on each node with the compute role. You can configure the compute properties differently for each node
with the compute role.
To configure compute properties for the DTM, click the Compute view. Select a node with the compute role
to configure properties specific to DTM instances that run on the node.
You can change the compute properties while the Data Integration Service is running, but you must restart
the service for the properties to take effect.

Execution Options
The default value for each execution option on the Compute view is defined by the same execution option on
the Properties view. When the Data Integration Service runs on multiple nodes, you can override the
execution options to define different values for each node with the compute role. The DTM instances that run
on the node use the overridden values.
You can override the following execution options on the Compute view:

Home Directory

Temporary Directories

Cache Directory

Source Directory

Target Directory

Rejected Files Directory

When you override an execution option for a specific node, the Administrator tool displays a green checkmark
next to the overridden property. The Edit Execution Options dialog box displays a reset option next to each
overridden property. Select Reset to remove the overridden value and use the value defined for the Data
Integration Service on the Properties view.

70

Chapter 3: Data Integration Service

The following image shows that the Temporary Directories property has an overridden value in the Edit
Execution Options dialog box:

Related Topics:

Execution Options on page 57

Directories for Data Integration Service Files on page 91

Environment Variables
When a Data Integration Service grid runs jobs in separate remote processes, you can configure environment
variables for DTM processes that run on nodes with the compute role.
Note: If the Data Integration Service runs on a single node or on a grid that runs jobs in the service process
or in separate local processes, any environment variables that you define on the Compute view are ignored.
When a node in the grid has the compute role only, configure environment variables for DTM processes on
the Compute view.
When a node in the grid has both the service and compute roles, you configure environment variables for the
Data Integration Service process that runs on the node on the Processes view. You configure environment
variables for DTM processes that run on the node on the Compute view. DTM processes inherit the
environment variables defined for the Data Integration Service process. You can override an environment
variable value for DTM processes. Or, you can define specific environment variables for DTM processes.
Consider the following examples:

You define EnvironmentVar1=A on the Processes view and define EnvironmentVar1=B on the Compute
view. The Data Integration Service process that runs on the node uses the value A for the environment
variable. The DTM processes that run on the node use the value B.

You define EnvironmentVar1 on the Processes view and define EnvironmentVar2 on the Compute view.
The Data Integration Service process that runs on the node uses EnvironmentVar1. The DTM processes
that run on the node use both EnvironmentVar1 and EnvironmentVar2.

Data Integration Service Compute Properties

71

The following table describes the environment variables:

Property

Description

Environment Variable

Enter a name and a value for the environment variable.

High Availability for the Data Integration Service

High availability for the Data Integration Service minimizes interruptions to data integration tasks. High
availability enables the Service Manager and the Data Integration Service to react to network failures and
failures of the Data Integration Service.
The Data Integration Service has the following high availability features that are available based on your
license:
Restart and Failover
When a Data Integration Service process becomes unavailable, the Service Manager tries to restart the
process or fails the process over to another node based on the service configuration.
Recovery
When a Data Integration Service process shuts down unexpectedly, the Data Integration Service can
automatically recover canceled workflow instances.
For information about configuring a highly available domain, see the Informatica Administrator Guide.

Data Integration Service Restart and Failover

When a Data Integration Service process becomes unavailable, the Service Manager restarts the Data
Integration Service process on the same node or on a backup node.
The restart and failover behavior depends on the following ways that you can configure the Data Integration
Service:
Single node
When the Data Integration Service runs on a single node and the service process shuts down
unexpectedly, the Service Manager tries to restart the service process. If the Service Manager cannot
restart the process, the process stops or fails.
Primary and backup nodes
When the Data Integration Service runs on primary and backup nodes and the service process shuts
down unexpectedly, the Service Manager tries to restart the service process. If the Service Manager
cannot restart the process, the Service Manager fails the service process over to a backup node.
A Data Integration Service process fails over to a backup node in the following situations:

The Data Integration Service process fails and the primary node is not available.

The Data Integration Service process is running on a node that fails.

Grid
When the Data Integration Service runs on a grid, the restart and failover behavior depends on whether
the master or worker service process becomes unavailable.

72

Chapter 3: Data Integration Service

If the master service process shuts down unexpectedly, the Service Manager tries to restart the process.
If the Service Manager cannot restart the process, the Service Manager elects another node to run the
master service process. The remaining worker service processes register themselves with the new
master. The master service process then reconfigures the grid to run on one less node.
If a worker service process shuts down unexpectedly, the Service Manager tries to restart the process. If
the Service Manager cannot restart the process, the master service process reconfigures the grid to run
on one less node.
The Service Manager restarts the Data Integration Service process based on domain property values set for
the amount of time spent trying to restart the service and the maximum number of attempts to try within the
restart period.
The Data Integration Service clients are resilient to temporary connection failures during restart and failover
of the service.

Data Integration Service Failover Configuration

When you configure the Data Integration Service to run on multiple nodes, verify that each node has access
to the source and output files that the Data Integration Service requires to process data integration tasks
such as workflows and mappings. For example, a workflow might require parameter files, input files, or output
files.
To access logs for completed data integration tasks after a failover occurs, configure a shared directory for
the Data Integration Service process Logging Directory property.

Data Integration Service Recovery

The Data Integration Service can recover some workflows that are enabled for recovery. Workflow recovery
is the completion of a workflow instance from the point of interruption.
A running workflow instance can be interrupted when an error occurs, when you cancel the workflow
instance, when you restart a Data Integration Service, or when a Data Integration Service process shuts
down unexpectedly. If you abort the workflow instance, the instance is not recoverable.
The Data Integration Service performs workflow recovery based on the state of the workflow tasks, the values
of the workflow variables and parameters during the interrupted workflow instance, and whether the recovery
is manual or automatic.
Based on your license, you can configure automatic recovery of workflow instances. If you enable a workflow
for automatic recovery, the Data Integration Service automatically recovers the workflow when the Data
Integration Service restarts.
If the Data Integration Service runs on a grid and the master service process fails over, all nodes retrieve
object state information from the Model repository. The new master automatically recovers workflow
instances that were running during the failover and that are configured for automatic recovery.
The Data Integration Service does not automatically recover workflows that are not configured for automatic
recovery. You can manually recover these workflows if they are enabled for recovery.
Any SQL data service, web service, mapping, profile, and preview jobs that were running during the failover
are not recovered. You must manually restart these jobs.

High Availability for the Data Integration Service

73

CHAPTER 4

Data Integration Service

Architecture
This chapter includes the following topics:

Data Integration Service Architecture Overview, 74

Data Integration Service Connectivity, 75

Data Integration Service Components, 76

Service Components, 77

Compute Component, 80

Process Where DTM Instances Run, 83

Single Node, 85

Grid, 86

Logs, 86

Data Integration Service Architecture Overview

The Data Integration Service receives requests to run data transformation jobs from client tools. Data
transformation jobs include mappings, previews, profiles, SQL queries to an SQL data service, web service
operation mappings, and workflows. The Data Integration Service connects to other application services,
databases, and third-party applications to access and transform the data.
To perform data transformation jobs, the Data Integration Service starts the following components:
Data Integration Service process
The Data Integration Service starts one or more Data Integration Service processes to manage requests
to run jobs, application deployment, job optimizations, and data caches. Multiple service components run
within a Data Integration Service process. Each service component performs a specific function to
complete a data transformation job.
DTM instance
The Data Integration Service starts a DTM instance to run each job. A DTM instance is a specific, logical
representation of the execution Data Transformation Manager (DTM). The DTM is the compute
component of the Data Integration Service that runs jobs.

74

The Data Integration Service can run on a single node or on a grid. A grid is an alias assigned to a group of
nodes that run jobs. When you run a job on a grid, you improve scalability and performance by distributing
jobs to processes running on multiple nodes in the grid.

Data Integration Service Connectivity

The Data Integration Service uses multiple types of connectivity to communicate with client tools, other
application services, databases, and applications.
The following image shows an overview of the types of connectivity that the Data Integration Service uses:

The Data Integration Service uses the following types of connectivity:

TCP/IP
The Data Integration Service uses TCP/IP network protocol to communicate with Informatica Analyst (the
Analyst tool), Informatica Developer (the Developer tool), and external clients that send SQL queries.
The Data Integration Service also uses TCIP/IP to communicate with the Model Repository Service.
HTTP or HTTPS
The Data Integration Service uses HTTP or HTTPS to communicate with external clients that send web
service requests.
Native drivers
The Data Integration Service uses native drivers to connect to the data object cache database. The Data
Integration Service can also use native drivers to connect to the profiling warehouse or to a source or
target database or application.
JDBC
The Data Integration Service uses JDBC to connect to the workflow database. The Data Integration
Service can also use native JDBC drivers to connect to the profiling warehouse or to a source or target
database or application.
ODBC
The Data Integration Service can use ODBC drivers to connect to a source or target database or
application.

Data Integration Service Connectivity

75

Data Integration Service Components

The Data Integration Service includes multiple components that complete data transformation jobs.
The Data Integration Service includes the following components:
Service components
Multiple service components run within the Data Integration Service process. The service components
manage job requests, application deployment, job optimizations, and data caches. Service components
include modules and managers.
Modules manage the requests from client tools to run data transformation jobs. When a service module
receives a request to run a job, the service module sends the job to the logical Data Transformation
Manager (LDTM). The LDTM optimizes and compiles the job, and then sends the job to the execution
Data Transformation Manager (DTM).
Managers manage application deployment, data caching, and temporary result set caches.
Compute component
The compute component is the execution Data Transformation Manager (DTM) that runs jobs. The DTM
extracts, transforms, and loads data to complete a data transformation job such as a preview or
mapping.
The following image shows how the Data Integration Service components complete job requests:

76

1.

A Data Integration Service client sends a request to a service module to run a job.

2.

The service module sends the job to the LDTM.

3.

The LDTM optimizes and compiles the job.

Chapter 4: Data Integration Service Architecture

4.

The LDTM sends the compiled job to the DTM.

5.

The DTM runs the job.

Service Components
The service components of the Data Integration Service include modules that manage requests from client
tools. They also include managers that manage application deployment, caches, and job optimizations.
The service components run within the Data Integration Service process. The Data Integration Service
process must run on a node with the service role. A node with the service role can run application services.

Mapping Service Module

The Mapping Service Module manages requests to preview data and run mappings.
The following table lists the requests that the Mapping Service Module manages from the different client
tools:
Request

Client Tools

Preview source or transformation data based on mapping logic.

Developer tool
Analyst tool

Run a mapping.

Developer tool

Run a mapping in a deployed application.

Command line

Preview an SQL data service.

Developer tool

Preview a web service operation mapping.

Developer tool

Sample third-party client tools include SQL SQuirreL Client, DBClient, and MySQL ODBC Client.
When you preview or run a mapping, the client tool sends the request and the mapping to the Data
Integration Service. The Mapping Service Module sends the mapping to the LDTM for optimization and
compilation. The LDTM passes the compiled mapping to a DTM instance, which generates the preview data
or runs the mapping.
When you preview data contained in an SQL data service in the Developer tool, the Developer tool sends the
request to the Data Integration Service. The Mapping Service Module sends the SQL statement to the LDTM
for optimization and compilation. The LDTM passes the compiled SQL statement to a DTM instance, which
runs the SQL statement and generates the preview data.
When you preview a web service operation mapping in the Developer tool, the Developer tool sends the
request to the Data Integration Service. The Mapping Service Module sends the operation mapping to the
LDTM for optimization and compilation. The LDTM passes the compiled operation mapping to a DTM
instance, which runs the operation mapping and generates the preview data.

Profiling Service Module

The Profiling Service Module manages requests to run profiles and generate scorecards.

Service Components

77

When you run a profile in the Analyst tool or the Developer tool, the application sends the request to the Data
Integration Service. The Profiling Service Module converts the profile into one or more mappings. The
Profiling Service Module sends the mappings to the LDTM for optimization and compilation. The LDTM
passes the compiled mappings to DTM instances that get the profiling rules and run the profile.
When you run a scorecard in the Analyst tool or the Developer tool, the application sends the request to the
Data Integration Service. The Profiling Service Module converts the scorecard into one or more mappings.
The Profiling Service Module sends the mappings to the LDTM for optimization and compilation. The LDTM
passes the compiled mappings to DTM instances that generate a scorecard for the profile.
To create and run profiles and scorecards, you must associate the Data Integration Service with a profiling
warehouse. The Profiling Service Module stores profiling data and metadata in the profiling warehouse.

SQL Service Module

The SQL Service Module manages SQL queries sent to an SQL data service from a third-party client tool.
When the Data Integration Service receives an SQL query from a third-party client tool, the SQL Service
Module sends the SQL statement to the LDTM for optimization and compilation. The LDTM passes the
compiled SQL statement to a DTM instance to run the SQL query against the virtual tables in the SQL data
service.
If you do not cache the data when you deploy an SQL data service, a DTM instance is started to run the SQL
data service. Every time the third-party client tool sends an SQL query to the virtual database, the DTM
instance reads data from the source tables instead of cache tables.

Web Service Module

The Web Service Module manages web service operation requests sent to a web service from a web service
client.
When the Data Integration Service receives requests from a web service client, the Web Service Module
sends the web service operation mapping to the LDTM for optimization and compilation. The LDTM passes
the compiled mapping to a DTM instance that runs the operation mapping. The Web Service Module sends
the operation mapping response to the web service client.

Workflow Orchestration Service Module

The Workflow Orchestration Service Module manages requests to run workflows.
When you start a workflow instance in a deployed application, the Data Integration Service receives the
request. The Workflow Orchestration Service Module runs and manages the workflow instance. The Workflow
Orchestration Service Module runs workflow objects in the order that the objects are connected. The
Workflow Orchestration Service Module evaluates expressions in conditional sequence flows to determine
whether to run the next task. If the expression evaluates to true or if the sequence flow does not include a
condition, the Workflow Orchestration Service Module starts and passes input data to the connected task.
The task uses the input data to complete a single unit of work.
When a Mapping task runs a mapping, it sends the mapping to the LDTM for optimization and compilation.
The LDTM passes the compiled mapping to a DTM instance to run the mapping.
When a task finishes processing a unit of work, the task passes output data back to the Workflow
Orchestration Service Module. The Workflow Orchestration Service Module uses this data to evaluate
expressions in conditional sequence flows or uses this data as input for the remaining tasks in the workflow.

78

Chapter 4: Data Integration Service Architecture

Data Object Cache Manager

The Data Object Cache Manager caches data in an application.
When you enable data object caching, the Data Object Cache Manager can cache logical data objects and
virtual tables in a database. The Data Object Cache Manager initially caches the data when you enable the
application. Optimal performance for the cache depends on the speed and performance of the database.
By default, the Data Object Cache Manager manages the data object cache in the data object cache
database. The Data Object Cache Manager creates the cache tables and refreshes the cache. It creates one
table for each cached logical data object or virtual table in an application. Objects within an application share
cache tables, but objects in different applications do not. If one data object is used in multiple applications,
the Data Object Cache Manager creates a separate cache table for each instance of the data object.

Result Set Cache Manager

The Result Set Cache Manager manages cached results for SQL data service queries and web service
requests. A result set cache is the result of a DTM instance that runs an SQL query against an SQL data
service or a web service request against a web service operation.
When you enable result set caching, the Result Set Cache Manager creates in-memory caches to temporarily
store the results of a DTM instance. If the Result Set Cache Manager requires more space than allocated, it
stores the data in cache files. The Result Set Cache Manager caches the results for a specified time period.
When an external client makes the same request before the cache expires, the Result Set Cache Manager
returns the cached results. If a cache does not exist or has expired, the Data Integration Service starts a
DTM instance to process the request and then it stores the cached the results.
When the Result Set Cache Manager stores the results by user, the Data Integration Service only returns
cached results to the user that ran the SQL query or sent the web service request. The Result Set Cache
Manager stores the result set cache for SQL data services by user. The Result Set Cache Manager stores
the result set cache for web services by user when the web service uses WS-Security. The Result Set Cache
Manager stores the cache by the user name that is provided in the username token of the web service
request.

Deployment Manager
The Deployment Manager is the component in Data Integration Service that manages applications. When you
deploy an application, the Deployment Manager manages the interaction between the Data Integration
Service and the Model Repository Service.
The Deployment Manager starts and stops an application. The Deployment Manager validates the mappings,
workflows, web services, and SQL data services in the application and their dependent objects when you
deploy the application.
After validation, the Deployment Manager stores application run-time metadata in the Model repository. Runtime metadata includes information to run the mappings, workflows, web services, and SQL data services in
the application.
The Deployment Manager creates a separate set of run-time metadata in the Model repository for each
application. When the Data Integration Service runs application objects, the Deployment Manager retrieves
the run-time metadata and makes it available to the DTM.

Logical Data Transformation Manager

The logical Data Transformation Manager (LDTM) optimizes and compiles jobs.
The LDTM can perform the following optimizations:

Service Components

79

Filter data to reduce the number of rows to be processed.

The LDTM applies optimization methods to filter data and reduce the number of rows to be processed.
For example, the LDTM can use early selection optimization to move a filter closer to the source. It can
use pushdown optimization to push transformation logic to a database. It can use the cost-based
optimization method to change the join processing order. When you develop a mapping, you can choose
an optimizer level that determines which optimization methods the LDTM can apply to the mapping.
Determine the partitioning strategy to maximize parallel processing.
If you have the partitioning option, the Data Integration Service can maximize parallelism for mappings
and profiles. The LDTM dynamically determines the optimal number of partitions for each pipeline stage
and the best way to redistribute data across each partition point.
Determine the data movement mode to optimize processing of ASCII characters.
The LDTM determines whether to use the ASCII or Unicode data movement mode for mappings that
read from a flat file or relational source. The LDTM determines the data movement mode based on the
character sets that the mapping processes. When a mapping processes all ASCII data, the LDTM
selects the ASCII mode. In ASCII mode, the Data Integration Service uses use one byte to store each
character, which can optimize mapping performance. In Unicode mode, the service uses two bytes for
each character.
After optimizing a mapping, the LDTM compiles the optimized mapping and makes it available to the
execution Data Transformation Manager (DTM) to run.

Compute Component
The compute component of the Data Integration Service is the execution Data Transformation Manager
(DTM). The DTM extracts, transforms, and loads data to complete a data transformation job.
The DTM must run on a node with the compute role. A node with the compute role can perform computations
requested by application services.

Execution Data Transformation Manager

The execution Data Transformation Manager (DTM) extracts, transforms, and loads data to run a data
transformation job such as a preview or mapping.
When a service module in the Data Integration Service receives a request to run a job, the service module
sends the request to the LDTM. The LDTM optimizes and compiles the job, and then sends the compiled job
to the DTM. A DTM instance is started to run the job and complete the request.
A DTM instance is a specific, logical representation of the DTM. The Data Integration Service runs multiple
instances of the DTM to complete multiple requests. For example, the Data Integration Service runs a
separate instance of the DTM each time it receives a request from the Developer tool to preview a mapping.
The DTM completes the following types of jobs:

80

Run or preview mappings.

Run mappings in workflows.

Preview transformations.

Run or query SQL data services.

Run web service operations.

Chapter 4: Data Integration Service Architecture

Run or preview data profiles.

Generate scorecards.

DTM Resource Allocation Policy

The Data Transformation Manager resource allocation policy determines how to allocate the CPU resources
for tasks. The DTM uses an on-demand resource allocation policy to allocate CPU resources.
When the DTM runs a mapping, it converts the mapping into a set of tasks such as:

Initializing and deinitializing pipelines

Reading data from source

Transforming data

Writing data to target

The DTM allocates CPU resources only when a DTM task needs a thread. When a task completes or if a task
is idle, the task returns the thread to a thread pool. The DTM reuses the threads in the thread pool for other
DTM tasks.

Processing Threads
When the DTM runs mappings, it uses reader, transformation, and writer pipelines that run in parallel to
extract, transform, and load data.
The DTM separates a mapping into pipeline stages and uses one reader thread, one transformation stage,
and one writer thread to process each stage. Each pipeline stage runs in one of the following threads:

Reader thread that controls how the DTM extracts data from the source.

Transformation thread that controls how the DTM processes data in the pipeline.

Writer thread that controls how the DTM loads data to the target.

Because the pipeline contains three stages, the DTM can process three sets of rows concurrently and
optimize mapping performance. For example, while the reader thread processes the third row set, the
transformation thread processes the second row set, and the writer thread processes the first row set.
If you have the partitioning option, the Data Integration Service can maximize parallelism for mappings and
profiles. When you maximize parallelism, the DTM separates a mapping into pipeline stages and uses
multiple threads to process each stage.

Output Files
The DTM generates output files when it runs mappings, mappings included in a workflow, profiles, SQL
queries to an SQL data service, or web service operation requests. Based on transformation cache settings
and target types, the DTM can create cache, reject, target, and temporary files.
By default, the DTM stores output files in the directories defined by execution options for the Data Integration
Service.
Data objects and transformations in the Developer tool use system parameters to access the values of these
Data Integration Service directories. By default, the system parameters are assigned to flat file directory,
cache file directory, and temporary file directory fields.
For example, when a developer creates an Aggregator transformation in the Developer tool, the CacheDir
system parameter is the default value assigned to the cache directory field. The value of the CacheDir
system parameter is defined in the Cache Directory property for the Data Integration Service. Developers

Compute Component

81

can remove the default system parameter and enter a different value for the cache directory. However, jobs
fail to run if the Data Integration Service cannot access the directory.
In the Developer tool, developers can change the default system parameters to define different directories for
each transformation or data object.

Cache Files
The DTM creates at least one cache file for each Aggregator, Joiner, Lookup, Rank, and Sorter
transformation included in a mapping, profile, SQL data service, or web service operation mapping.
If the DTM cannot process a transformation in memory, it writes the overflow values to cache files. When the
job completes, the DTM releases cache memory and usually deletes the cache files.
By default, the DTM stores cache files for Aggregator, Joiner, Lookup, and Rank transformations in the list of
directories defined by the Cache Directory property for the Data Integration Service. The DTM creates index
and data cache files. It names the index file PM*.idx, and the data file PM*.dat.
The DTM stores the cache files for Sorter transformations in the list of directories defined by the Temporary
Directories property for the Data Integration Service. The DTM creates one sorter cache file.

Reject Files
The DTM creates a reject file for each target instance in a mapping or web service operation mapping. If the
DTM cannot write a row to the target, the DTM writes the rejected row to the reject file. If the reject file does
not contain any rejected rows, the DTM deletes the reject file when the job completes.
By default, the DTM stores reject files in the directory defined by the Rejected Files Directory property for the
Data Integration Service. The DTM names reject files based on the name of the target data object. The
default name for reject files is <file_name>.bad.

Target Files
If a mapping or web service operation mapping writes to a flat file target, the DTM creates the target file
based on the configuration of the flat file data object.
By default, the DTM stores target files in the list of directories defined by the Target Directory property for the
Data Integration Service. The DTM names target files based on the name of the target data object. The
default name for target files is <file_name>.out.

Temporary Files
The DTM can create temporary files when it runs mappings, profiles, SQL queries, or web service operation
mappings. When the jobs complete, the temporary files are usually deleted.
By default, the DTM stores temporary files in the list of directories defined by the Temporary Directories
property for the Data Integration Service. The DTM also stores the cache files for Sorter transformations in
the list of directories defined by the Temporary Directories property.

82

Chapter 4: Data Integration Service Architecture

Process Where DTM Instances Run

Based on how you configure the Data Integration Service, DTM instances can run in the Data Integration
Service process, in a separate DTM process on the local node, or in a separate DTM process on a remote
node.
A DTM process is an operating system process that the Data Integration Service starts to run DTM instances.
Multiple DTM instances can run within the Data Integration Service process or within the same DTM process.
The Launch Job Options property on the Data Integration Service determines where the service starts DTM
instances. Configure the property based on whether the Data Integration Service runs on a single node or a
grid and based on the types of jobs that the service runs.
The following table lists each process where DTM instances can run:
Process Where
DTM Instances
Run

Data Integration
Service
Configuration

Types of Jobs

In the Data
Integration
Service process

Single node or grid

SQL data service and web service jobs on a single node or on a grid
where each node has both the service and compute roles.
Advantages:
SQL data service and web service jobs typically achieve better
performance when the Data Integration Service runs jobs in the
service process.

In separate DTM
processes on the
local node

Single node or grid

Mapping, profile, and workflow jobs on a single node or on a grid

where each node has both the service and compute roles.
Advantages:
When the Data Integration Service runs jobs in separate local
processes, stability increases because an unexpected interruption to
one job does not affect all other jobs.

In separate DTM
processes on
remote nodes

Grid

Mapping, profile, and workflow jobs on a grid where nodes have a

different combination of roles.
Advantages:
When the Data Integration Service runs jobs in separate remote
processes, stability increases because an unexpected interruption to
one job does not affect all other jobs. In addition, you can better use
the resources available on each node in the grid. When a node has
the compute role only, the node does not have to run the service
process. The machine uses all available processing power to run
mappings.

Note: Ad hoc jobs, with the exception of profiles, can run in the Data Integration Service process or in
separate DTM processes on the local node. Ad hoc jobs include mappings run from the Developer tool or
previews, scorecards, or drill downs on profile results run from the Developer tool or Analyst tool. If you
configure a Data Integration Service grid to run jobs in separate remote processes, the service runs ad hoc
jobs in separate local processes.

Process Where DTM Instances Run

83

In the Data Integration Service Process

To run DTM instances in the Data Integration Service process, configure the Data Integration Service to
launch jobs in the service process. Configure DTM instances to run in the Data Integration Service process
when the service runs SQL data service and web service jobs on a single node or on a grid.
SQL data service and web service jobs typically achieve better performance when the Data Integration
Service runs jobs in the service process.
The following image shows a Data Integration Service that runs DTM instances in the Data Integration
Service process:

In Separate DTM Processes on the Local Node

To run DTM instances in separate DTM processes on the local node, configure the Data Integration Service
to launch jobs in separate local processes. Configure DTM instances to run in separate DTM processes on
the local node when the Data Integration Service runs mapping, profile, and workflow jobs on a single node
or on a grid where each node has both the service and compute roles.
When the Data Integration Service runs jobs in separate local processes, stability increases because an
unexpected interruption to one job does not affect all other jobs.
The following image shows a Data Integration Service that runs DTM instances in separate DTM processes
on the local node:

84

Chapter 4: Data Integration Service Architecture

In Separate DTM Processes on Remote Nodes

To run DTM instances in separate DTM processes on remote nodes, configure the Data Integration Service
to launch jobs in separate remote processes. Configure DTM instances to run in separate DTM processes on
remote nodes when the Data Integration Service runs mapping, profile, and workflow jobs on a grid where
nodes can have a different combination of roles.
When the Data Integration Service runs jobs in separate remote processes, stability increases because an
unexpected interruption to one job does not affect all other jobs. In addition, you can better use the resources
available on each node in the grid. When a node has the compute role only, the node does not have to run
the service process. The machine uses all available processing power to run mappings.
The following image shows two of many nodes in a Data Integration Service grid. Node1 has the service role,
and Node2 has the compute role. The Data Integration Service process on Node1 manages application
deployments, logging, job requests, and job optimizations. The Service Manager on Node2 runs DTM
instances in separate DTM processes started within containers.

Single Node
When the Data Integration Service runs on a single node, the service and compute components of the Data
Integration Service run on the same node. The node must have both the service and compute roles.
A Data Integration Service that runs on a single node can run DTM instances in the Data Integration Service
process or in separate DTM processes. Configure the service based on the types of jobs that the service
runs.
If you run the Data Integration Service on a single node and you have the high availability option, you can
configure back-up nodes in case the primary node becomes unavailable. High availability enables the Service
Manager and the Data Integration Service to react to network failures and failures of the Data Integration
Service. If a Data Integration Service becomes unavailable, the Service Manager can restart the service on
the same node or on a back-up node.

Single Node

85

Grid
If your license includes grid, you can configure the Data Integration Service to run on a grid. A grid is an alias
assigned to a group of nodes that run jobs.
When the Data Integration Service runs on a grid, you improve scalability and performance by distributing
jobs to processes running on multiple nodes in the grid. The Data Integration Service is also more resilient
when it runs on a grid. If a service process shuts down unexpectedly, the Data Integration Service remains
available as long as another service process runs on another node.
When the Data Integration Service runs on a grid, the service and compute components of the Data
Integration Service can run on the same node or on different nodes, based on how you configure the grid and
the node roles. Nodes in a Data Integration Service grid can have a combination of the service only role, the
compute only role, and both the service and compute roles.
A Data Integration Service that runs on a grid can run DTM instances in the Data Integration Service process,
in separate DTM processes on the same node, or in separate DTM processes on remote nodes. Configure
the service based on the types of jobs that the service runs.

Logs
The Data Integration Service generates log events about service configuration and processing and about the
jobs that the DTM runs.
The Data Integration Service generates the following types of log events:
Service log events
The Data Integration Service process generates log events about service configuration, processing, and
failures. These log events are collected by the Log Manager in the domain. You can view the logs for the
Data Integration Service on the Logs tab of the Administrator tool.
Job log events
The DTM generates log events about the jobs that it runs. The DTM generates log events for the
following jobs:

Previews, profiles, scorecards, or mappings run from the Analyst tool or the Developer tool

Deployed mappings

Logical data objects

SQL data service queries

Web service operation mappings

Workflows

You can view the logs for these jobs on the Monitor tab of the Administrator tool.
When the DTM runs, it generates log events for the job that it is running. The DTM bypasses the Log
Manager and sends the log events to log files. The DTM stores the log files in the Log Directory property
specified for the Data Integration Service process. Log files have a .log file name extension.
If you created a custom location for logs before upgrading to the current version of Informatica, the Data
Integration Service continues to write logs to that location after you upgrade. When you create a new
Data Integration Service, the Data Integration Service writes logs to the default location unless you
specify a different location.

86

Chapter 4: Data Integration Service Architecture

When the Workflow Service Module runs a workflow, it generates log events for the workflow. The
Workflow Service Module bypasses the Log Manager and sends the log events to log files. The Workflow
Service Module stores the log files in a folder named workflow in the log directory that you specify for
the Data Integration Service process.
When a Mapping task in a workflow starts a DTM instance to run a mapping, the DTM generates log
events for the mapping. The DTM stores the log files in a folder named mappingtask in the log directory
that you specify for the Data Integration Service process.

Logs

87

CHAPTER 5

Data Integration Service

Management
This chapter includes the following topics:

Data Integration Service Management Overview, 88

Enable and Disable Data Integration Services and Processes, 89

Directories for Data Integration Service Files, 91

Run Jobs in Separate Processes, 94

Maintain Connection Pools, 96

PowerExchange Connection Pools, 98

Maximize Parallelism for Mappings and Profiles, 102

Result Set Caching, 107

Data Object Caching, 107

Persisting Virtual Data in Temporary Tables, 113

Content Management for the Profiling Warehouse, 116

Web Service Security Management, 120

Pass-through Security, 121

Data Integration Service Management Overview

After you create the Data Integration Service, use the Administrator tool to manage the service. When you
change a service property, you must recycle the service or disable and then enable the service for the
changes to take affect.
You can configure directories for the source, output, and log files that the Data Integration Service accesses
when it runs jobs. When a Data Integration Service runs on multiple nodes, you might need to configure
some of the directory properties to use a single shared directory.
You can optimize Data Integration Service performance by configuring the following features:
Run jobs in separate processes
You can configure the Data Integration Service to run jobs in separate DTM processes or in the Data
Integration Service process. Running jobs in separate processes optimizes stability because an
unexpected interruption to one job does not affect all other jobs.

88

Maintain connection pools

You can configure whether the Data Integration Service maintains connection pools for database
connections when the service processes jobs. When you configure connection pooling, the Data
Integration Service maintains and reuses a pool of database connections. Reusing connections
optimizes performance because it minimizes the amount of time and resources used to open and close
multiple database connections.
Maximize parallelism
If your license includes partitioning, you can enable the Data Integration Service to maximize parallelism
when it runs mappings and profiles. When you maximize parallelism, the Data Integration Service
dynamically divides the underlying data into partitions and processes all of the partitions concurrently.
When the Data Integration Service adds partitions, it increases the number of processing threads, which
can optimize mapping and profiling performance.
Cache result sets and data objects
You can configure the Data Integration Service to cache results for SQL data service queries and web
service requests. You can also configure the service to use data object caching to access pre-built
logical data objects and virtual tables. When the Data Integration Service caches result sets and data
objects, subsequent jobs can take less time to run.
Persist virtual data in temporary tables
You can configure the Data Integration Service to persist virtual data in temporary tables. When
business intelligence tools can retrieve data from the temporary table instead of the SQL data service,
you can optimize SQL data service performance.
You can also manage content for the databases that the service accesses and configure security for SQL
data service and web service requests to the Data Integration Service.

Enable and Disable Data Integration Services and

Processes
You can enable and disable the entire Data Integration Service or a single Data Integration Service process
on a particular node.
If you run the Data Integration Service on a grid or with the high availability option, you have one Data
Integration Service process configured for each node. For a grid, the Data Integration Service runs all
enabled Data Integration Service processes. For high availability, the Data Integration Service runs the Data
Integration Service process on the primary node.

Enable, Disable, or Recycle the Data Integration Service

You can enable, disable, or recycle the Data Integration Service. You might disable the Data Integration
Service if you need to perform maintenance or you need to temporarily restrict users from using the service.
You might recycle the service if you changed a service property or if you updated the role for a node
assigned to the service or to the grid on which the service runs.
The number of service processes that start when you enable the Data Integration Service depends on the
following components which the service can run on:

Enable and Disable Data Integration Services and Processes

89

Single node
When you enable a Data Integration Service that runs on a single node, a service process starts on the
node.
Grid
When you enable a Data Integration Service that runs on a grid, a service process starts on each node
in the grid that has the service role.
Primary and back-up nodes
When you enable a Data Integration Service configured to run on primary and back-up nodes, a service
process is available to run on each node, but only the service process on the primary node starts. For
example, you have the high availability option and you configure a Data Integration Service to run on a
primary node and two back-up nodes. You enable the Data Integration Service, which enables a service
process on each of the three nodes. A single process runs on the primary node, and the other processes
on the back-up nodes maintain standby status.
Note: The associated Model Repository Service must be started before you can enable the Data Integration
Service.
When you disable the Data Integration Service, you shut down the Data Integration Service and disable all
service processes. If you are running the Data Integration Service on a grid, you disable all service processes
on the grid.
When you disable the Data Integration Service, you must choose the mode to disable it in. You can choose
one of the following options:

Complete. Stops all applications and cancels all jobs within each application. Waits for all jobs to cancel
before disabling the service.

Abort. Stops all applications and tries to cancel all jobs before aborting them and disabling the service.

When you recycle the Data Integration Service, the Service Manager restarts the service. When the Service
Manager restarts the Data Integration Service, it also restores the state of each application associated with
the Data Integration Service.

Enabling, Disabling, or Recycling the Service

You can enable, disable, or recycle the service from the Administrator tool.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the service.

3.

On the Manage tab Actions menu, click one of the following options:

Enable Service to enable the service.

Disable Service to disable the service.

Choose the mode to disable the service in. Optionally, you can choose to specify whether the action
was planned or unplanned, and enter comments about the action. If you complete these options, the
information appears in the Events and Command History panels in the Domain view on the
Manage tab.

90

Recycle Service to recycle the service.

Chapter 5: Data Integration Service Management

Enable or Disable a Data Integration Service Process

You can enable or disable a Data Integration Service process on a particular node.
The impact on the Data Integration Service after you disable a service process depends on the following
components which the service can run on:
Single node
When the Data Integration Service runs on a single node, disabling the service process disables the
service.
Grid
When the Data Integration Service runs on a grid, disabling a service process does not disable the
service. The service continues to run on other nodes that are designated to run the service, as long as
the nodes are available.
Primary and back-up nodes
When you have the high availability option and you configure the Data Integration Service to run on
primary and back-up nodes, disabling a service process does not disable the service. Disabling a service
process that is running causes the service to fail over to another node.

Enabling or Disabling a Service Process

You can enable or disable a service process from the Administrator tool.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the service.

3.

In the contents panel, click the Processes view.

4.

On the Manage tab Actions menu, click one of the following options:

Enable Process to enable the service process.

Disable Process to disable the service process. Choose the mode to disable the service process in.

Directories for Data Integration Service Files

The Data Integration Service accesses file directories when it reads source files, reads control files, writes
output files, and writes log files. When the Data Integration Service runs on multiple nodes, you might need to
configure some of the directory properties to use a single shared directory to ensure that the processes
running on each node can access all files.

Source and Output File Directories

Configure the directories for source and output files in the Execution Options on the Properties view for the
Data Integration Service.
The Data Integration Service accesses source files when it runs a mapping or web service operation mapping
that reads from a flat file source. The service generates output files when it runs mappings, mappings
included in a workflow, profiles, SQL queries to an SQL data service, or web service operation requests.
Based on transformation cache settings and target types, the Data Integration Service can generate cache,
reject, target, and temporary files.

Directories for Data Integration Service Files

91

When you configure directories for the source and output files, you configure the paths for the home directory
and its subdirectories. The default value of the Home Directory property is <Informatica installation
directory>/tomcat/bin. If you change the default value, verify that the directory exists.
By default, the following directories have values relative to the home directory:

Temporary directories

Cache directory

Source directory

Target directory

Rejected files directory

You can define a different directory relative to the home directory. Or, you can define an absolute directory
outside the home directory.
If you define a different absolute directory, use the correct syntax for the operating system:

On Windows, enter an absolute path beginning with a drive letter, colon, and backslash. For example:
C:\<Informatica installation directory>\tomcat\bin\MyHomeDir

On UNIX, enter an absolute path beginning with a slash. For example:

/<Informatica installation directory>/tomcat/bin/MyHomeDir

Data objects and transformations in the Developer tool use system parameters to access the values of these
Data Integration Service directories. By default, the system parameters are assigned to flat file directory,
cache file directory, and temporary file directory fields.
For example, when a developer creates an Aggregator transformation in the Developer tool, the CacheDir
system parameter is the default value assigned to the cache directory field. The value of the CacheDir
system parameter is defined in the Cache Directory property for the Data Integration Service. Developers
can remove the default system parameter and enter a different value for the cache directory. However, jobs
fail to run if the Data Integration Service cannot access the directory.

Configure Source and Output File Directories for Multiple Nodes

When the Data Integration Service runs on primary and back-up nodes or on a grid, DTM instances can run
jobs on each node with the compute role. Each DTM instance must be able to access the source and output
file directories. To run mappings that manage metadata changes in flat file sources, each Data Integration
Service process must be able to access the source file directories.
When you configure the source and output file directories for a Data Integration Service that runs on multiple
nodes, consider the following guidelines:

You can configure the Source Directory property to use a shared directory to create one directory for
source files.
If you run mappings that manage metadata changes in flat file sources and if the Data Integration Service
grid is configured to run jobs in separate remote processes, you must configure the Source Directory
property to use a shared directory.
If you run other types of mappings or if you run mappings that manage metadata changes in flat file
sources on any other Data Integration Service grid configuration, you can configure different source
directories for each node with the compute role. Replicate all source files in all of the source directories.

92

If you run mappings that use a persistent lookup cache, you must configure the Cache Directory property
to use a shared directory. If no mappings use a persistent lookup cache, you can configure the cache
directory to have a different directory for each node with the compute role.

You can configure the Target Directory, Temporary Directories, and Reject File Directory properties to
have different directories for each node with the compute role.

Chapter 5: Data Integration Service Management

To configure a shared directory, configure the directory in the Execution Options on the Properties view. You
can configure a shared directory for the home directory so that all source and output file directories use the
same shared home directory. Or, you can configure a shared directory for a specific source or output file
directory. Remove any overridden values for the same execution option on the Compute view.
To configure different directories for each node with the compute role, configure the directory in the
Execution Options on the Compute view.

Control File Directories

The Data Integration Service accesses control files when it runs mappings that generate columns for flat file
sources based on control files. When the Data Integration Service runs the mapping, it fetches metadata from
the control file of the flat file source.
Use the Developer tool to configure the control file directory for each flat file data object that is configured to
generate run-time column names from a control file. You cannot use the Administrator tool to configure a
single control file directory used by the Data Integration Service.

Configure Control File Directories for Multiple Nodes

When the Data Integration Service runs on primary and back-up nodes or on a grid, Data Integration Service
processes can run on each node with the service role. Each Data Integration Service process must be able to
access the control file directories.
Use the Developer tool to configure the Control File Directory property for each flat file data object that is
configured to generate run-time column names from a control file. Configure the Control File Directory
property in the Advanced properties for the flat file data object. Find the property in the Runtime: Read
section.
When the Data Integration Service runs on multiple nodes, use one of the following methods to ensure that
each Data Integration Service process can access the directories:

Configure the Control File Directory property for each flat file data object to use a shared directory to
create one directory for control files.

Configure the Control File Directory property for each flat file data object to use an identical directory
path that is local to each node with the service role. Replicate all control files in the identical directory on
each node with the service role.

Log Directory
Configure the directory for log files on the Processes view for the Data Integration Service. Data Integration
Service log files include files that contain service log events and files that contain job log events.
By default, the log directory for each Data Integration Service process is within the Informatica installation
directory on the node.

Configure the Log Directory for Multiple Nodes

When the Data Integration Service runs on primary and back-up nodes or on a grid, a Data Integration
Service process can run on each node with the service role. Configure each service process to use the same
shared directory for log files.
When you configure a shared log directory, you ensure that if the master service process fails over to another
node, the new master service process can access previous log files.

Directories for Data Integration Service Files

93

Configure each service process with identical absolute paths to the shared directories. If you use a mapped
or mounted drive, the absolute path to the shared location must also be identical.
For example, a newly elected master service process cannot access previous log files when nodes use the
following drives for the log directory:

Mapped drive on node1: F:\shared\<Informatica installation directory>\logs\<node_name>

\services\DataIntegrationService\disLogs

Mapped drive on node2: G:\shared\<Informatica installation directory>\logs\<node_name>

\services\DataIntegrationService\disLogs

A newly elected master service process also cannot access previous log files when nodes use the following
drives for the log directory:

Mounted drive on node1: /mnt/shared/<Informatica installation directory>/logs/<node_name>/

services/DataIntegrationService/disLogs

Mounted drive on node2: /mnt/shared_filesystem/<Informatica installation directory>/logs/

<node_name>/services/DataIntegrationService/disLogs

Output and Log File Permissions

When a Data Integration Service process generates output or log files, it sets file permissions based on the
operating system.
When a Data Integration Service process on UNIX generates an output or log file, it sets the file permissions
according to the umask of the shell that starts the Data Integration Service process. For example, when the
umask of the shell that starts the Data Integration Service process is 022, the Data Integration Service
process creates files with rw-r--r-- permissions. To change the file permissions, you must change the umask
of the shell that starts the Data Integration Service process and then restart it.
A Data Integration Service process on Windows generates output and log files with read and write
permissions.

Run Jobs in Separate Processes

The Data Integration Service can run jobs in the Data Integration Service process or in separate DTM
processes on local or remote nodes. You optimize service performance when you configure the
recommended option based on the job types that the service runs.
When the Data Integration Service receives a request to run a job, the service creates a DTM instance to run
the job. A DTM instance is a specific, logical representation of the execution Data Transformation Manager.
You can configure the Data Integration Service to run DTM instances in the Data Integration Service process,
in a separate DTM process on the local node, or in a separate DTM process on a remote node.
A DTM process is an operating system process started to run DTM instances. Multiple DTM instances can
run within the Data Integration Service process or within the same DTM process.
The Launch Job Options property on the Data Integration Service determines where the service starts DTM
instances. Configure the property based on whether the Data Integration Service runs on a single node or a
grid and based on the types of jobs that the service runs.
Choose one of the following options for the Launch Job Options property:

94

Chapter 5: Data Integration Service Management

In the service process

Configure when you run SQL data service and web service jobs on a single node or on a grid where
each node has both the service and compute roles.
SQL data service and web service jobs typically achieve better performance when the Data Integration
Service runs jobs in the service process.
In separate local processes
Configure when you run mapping, profile, and workflow jobs on a single node or on a grid where each
node has both the service and compute roles.
When the Data Integration Service runs jobs in separate local processes, stability increases because an
unexpected interruption to one job does not affect all other jobs.
In separate remote processes
Configure when you run mapping, profile, and workflow jobs on a grid where nodes have a different
combination of roles. If you choose this option when the Data Integration Service runs on a single node,
then the service runs jobs in separate local processes.
When the Data Integration Service runs jobs in separate remote processes, stability increases because
an unexpected interruption to one job does not affect all other jobs. In addition, you can better use the
resources available on each node in the grid. When a node has the compute role only, the node does not
have to run the service process. The machine uses all available processing power to run mappings.
Note: If you run multiple job types, create multiple Data Integration Services. Configure one Data Integration
Service to run SQL data service and web service jobs in the Data Integration Service process. Configure the
other Data Integration Service to run mappings, profiles, and workflows in separate local processes or in
separate remote processes.

Related Topics:

Process Where DTM Instances Run on page 83

DTM Process Pool Management

When the Data Integration Service runs jobs in separate local or remote processes, the Data Integration
Service maintains a pool of reusable DTM processes.
The DTM process pool includes DTM processes that are running jobs and DTM processes that are idle. Each
running DTM process in the pool is reserved for use by one of the following groups of related jobs:

Jobs from the same deployed application

Preview jobs

Profiling jobs

Mapping jobs run from the Developer tool

For example, if you run two jobs from the same deployed application, two DTM instances are created in the
same DTM process. If you run a preview job, the DTM instance is created in a different DTM process.
When a DTM process finishes running a job, the process closes the DTM instance. When the DTM process
finishes running all jobs, the DTM process is released to the pool as an idle DTM process. An idle DTM
process is available to run any type of job.

Run Jobs in Separate Processes

95

Rules and Guidelines when Jobs Run in Separate Processes

Consider the following rules and guidelines when you configure the Data Integration Service to run jobs in
separate local or remote processes:

You cannot use the Maximum Memory Size property for the Data Integration Service to limit the amount
of memory that the service allocates to run jobs. If you set the maximum memory size, the Data
Integration Service ignores it.

If the Data Integration Service runs on UNIX, the host file on each node with the compute role and on
each node with both the service and compute roles must contain a localhost entry. If the host file does not
contain a localhost entry, jobs that run in separate processes fail. Windows does not require a localhost
entry in the host file.

If you configure connection pooling, each DTM process maintains its own connection pool library. All DTM
instances running in the DTM process can use the connection pool library. The number of connection pool
libraries depends on the number of running DTM processes.

Maintain Connection Pools

Connection pooling is a framework to cache database connection information that is used by the Data
Integration Service. Connection pools increase performance through the reuse of cached connection
information.
A connection pool is a group of connection instances for one connection object. A connection instance is a
representation of a physical connection to a data source. A connection pool library can contain multiple
connection pools. The number of connection pools depends on the number of unique connections that the
DTM instances use while running jobs.
You configure the Data Integration Service to run DTM instances in the Data Integration Service process or in
separate DTM processes that run on local or remote nodes. Each Data Integration Service process or DTM
process maintains its own connection pool library that all DTM instances running in the process can use. The
number of connection pool libraries depends on the number of running Data Integration Service processes or
DTM processes.
A connection instance can be active or idle. An active connection instance is a connection instance that a
DTM instance is using to connect to a database. A DTM process or the Data Integration Service process can
create an unlimited number of active connection instances.
An idle connection instance is a connection instance in a connection pool that is not in use. A connection pool
retains idle connection instances based on the pooling properties that you configure for a database
connection. You configure the minimum connections, the maximum connections, and the maximum idle
connection time.

Connection Pool Management

When a DTM process or the Data Integration Service process runs a job, it requests a connection instance
from the pool. If an idle connection instance exists, the connection pool releases it to the DTM process or the
Data Integration Service process. If the connection pool does not have an idle connection instance, the DTM
process or the Data Integration Service process creates an active connection instance.
When the DTM process or the Data Integration Service process completes the job, it releases the active
connection instance to the pool as an idle connection instance. If the connection pool contains the maximum

96

Chapter 5: Data Integration Service Management

number of idle connection instances, the process drops the active connection instance instead of releasing it
to the pool.
The DTM process or the Data Integration Service process drops an idle connection instance from the pool
when the following conditions are true:

A connection instance reaches the maximum idle time.

The connection pool exceeds the minimum number of idle connections.

When you update the user name, password, or connection string for a database connection that has
connection pooling enabled, the updates take effect immediately. Subsequent connection requests use the
updated information. Also, the connection pool library drops all idle connections and restarts the connection
pool. It does not return any connection instances that are active at the time of the restart to the connection
pool when complete.
If you update any other database connection property, you must restart the Data Integration Service to apply
the updates.

Pooling Properties in Connection Objects

You can edit connection pooling properties in the Pooling view for a database connection.
The number of connection pool libraries depends on the number of running Data Integration Service
processes or DTM processes. Each Data Integration Service process or DTM process maintains its own
connection pool library. The values of the pooling properties are for each connection pool library.
For example, if you set maximum connections to 15, then each connection pool library can have a maximum
of 15 idle connections in the pool. If the Data Integration Service runs jobs in separate local processes and
three DTM processes are running, then you can have a maximum of 45 idle connection instances.
To decrease the total number of idle connection instances, set the minimum number of connections to 0 and
decrease the maximum idle time for each database connection.
The following list describes database connection pooling properties that you can edit in the Pooling view for
a database connection:
Enable Connection Pooling
Enables connection pooling. When you enable connection pooling, each connection pool retains idle
connection instances in memory. To delete the pools of idle connections, you must restart the Data
Integration Service.
If connection pooling is disabled, the DTM process or the Data Integration Service process stops all
pooling activity. The DTM process or the Data Integration Service process creates a connection instance
each time it processes a job. It drops the instance when it finishes processing the job.
Default is enabled for DB2 for i5/OS, DB2 for z/OS, IBM DB2, Microsoft SQL Server, Oracle, and ODBC
connections. Default is disabled for Adabas, IMS, Sequential, and VSAM connections.
Minimum # of Connections
The minimum number of idle connection instances that a pool maintains for a database connection after
the maximum idle time is met. Set this value to be equal to or less than the maximum number of idle
connection instances. Default is 0.
Maximum # of Connections
The maximum number of idle connection instances that a pool maintains for a database connection
before the maximum idle time is met. Set this value to be more than the minimum number of idle
connection instances. Default is 15.

Maintain Connection Pools

97

Maximum Idle Time

The number of seconds that a connection instance that exceeds the minimum number of connection
instances can remain idle before the connection pool drops it. The connection pool ignores the idle time
when the connection instance does not exceed the minimum number of idle connection instances.
Default is 120.

Example of a Connection Pool

You want to use connection pools to optimize connection performance. You have configured the Data
Integration Service to run jobs in separate local processes.
You configure the following pooling properties for a connection:

Connection Pooling: Enabled

Minimum Connections: 2

Maximum Connections: 4

Maximum Idle Time: 120 seconds

When a DTM process runs five jobs, it uses the following process to maintain the connection pool:
1.

The DTM process receives a request to process five jobs at 11:00 a.m., and it creates five connection
instances.

2.

The DTM process completes processing at 11:30 a.m., and it releases four connections to the
connection pool as idle connections.

3.

It drops one connection because it exceeds the connection pool size.

4.

At 11:32 a.m., the maximum idle time is met for the idle connections, and the DTM process drops two
idle connections.

5.

The DTM process maintains two idle connections because the minimum connection pool size is two.

Optimize Connection Performance

To optimize connection performance, configure connection pooling for the database connections. Each DTM
process or the Data Integration Service process caches database connections for jobs and maintains a pool
of connections that it can reuse.
The DTM process or the Data Integration Service process caches and releases the connections based on
how you configure connection pooling properties for the connection. Reusing connections optimizes
performance. It minimizes the amount of time and resources that the DTM process or the Data Integration
Service process uses when it opens and closes multiple database connections.
To optimize connection performance, enable the Connection Pooling property in the database connection
properties. Optionally, configure additional connection pooling properties.

PowerExchange Connection Pools

A PowerExchange connection pool is a set of network connections to a PowerExchange Listener. The Data
Integration Service connects to a PowerExchange data source through the PowerExchange Listener.
PowerExchange uses connection pools for the following types of database connection objects:

98

Adabas

Chapter 5: Data Integration Service Management

DB2 for i5/OS

DB2 for z/OS

IMS

Sequential

VSAM

To define a connection to a PowerExchange Listener, include a NODE statement in the DBMOVER file on the
Data Integration Service machine. Then define a database connection and associate the connection with the
Listener. The Location property specifies the Listener node name. Define database connection pooling
properties in the Pooling view for a database connection.

PowerExchange Connection Pool Management

The Data Integration Service connects to a PowerExchange data source through the PowerExchange
Listener. A PowerExchange connection pool is a set of connections to a PowerExchange Listener.
When a DTM process or the Data Integration Service process runs a data transformation job, it requests a
connection instance from a connection pool. If the DTM process or the Data Integration Service process
requires a PowerExchange connection instance, it requests the connection instance from PowerExchange.
When PowerExchange receives a request for a connection to a Listener, it uses a connection in the pool that
has matching characteristics, including user ID and password. If the pool does not contain a connection with
matching characteristics, PowerExchange modifies and reuses a pooled connection to the Listener, if
possible. For example, if PowerExchange receives a request for a connection for USER1 on NODE1 and
finds only a pooled connection for USER2 on NODE1, PowerExchange reuses the connection, signs off
USER2, and signs on USER1.
When PowerExchange returns a Listener connection to the pool, it closes any files or databases that the
Listener had opened.
If you associate multiple database connection objects with the same Listener node name, PowerExchange
combines the connections into a single pool. For example, if you associate multiple database connections to
NODE1, a connection pool is used for all PowerExchange connections to NODE1. To determine the
maximum size of the connection pool for the Listener, PowerExchange adds the Maximum # of
Connections values that you specify for each database connection that uses the Listener.
If you want each database connection object to use a separate connection pool, define multiple NODE
statements for the same PowerExchange Listener and associate each database connection object with a
different Listener node name.
Note: PowerExchange connection pooling does not reuse netport connections unless the user name and
password match.

Connection Pooling for PowerExchange Netport Jobs

Netport jobs that use connection pooling might result in constraint issues.
Depending on the data source, the netport JCL might reference a data set or other resource exclusively.
Because a pooled netport connection can persist for some time after the data processing has finished, you
might encounter concurrency issues. If you cannot change the netport JCL to reference resources
nonexclusively, consider disabling connection pooling.

PowerExchange Connection Pools

99

In particular, IMS netport jobs that use connection pooling might result in constraint issues. Because the
program specification block (PSB) is scheduled for a longer period of time when netport connections are
pooled, resource constraints can occur in the following cases:

A netport job on another port might try to read a separate database in the same PSB, but the scheduling
limit is reached.

The netport runs as a DL/1 job, and you attempt to restart the database within the IMS/DC environment
after the mapping finishes running. The database restart fails, because the database is still allocated to
the netport DL/1 region.

Processing in a second mapping or a z/OS job flow relies on the database being available when the first
mapping has finished running. If pooling is enabled, there is no guarantee that the database is available.

You might need to build a PSB that includes multiple IMS databases that the Data Integration Service
accesses. In this case, resource constraint issues are more severe as netport jobs are pooled that tie up
multiple IMS databases for long periods.
This requirement might apply because you can include up to ten NETPORT statements in a DBMOVER
file. Also, PowerExchange data maps cannot include program communication block (PCB) and PSB
values that PowerExchange can use dynamically.

PowerExchange Connection Pooling Configuration

To configure PowerExchange connection pooling, include statements in the DBMOVER configuration files on
each machine that hosts the PowerExchange Listener or the Data Integration Service. Also, define
connection pooling properties in the Pooling view of the connection.

DBMOVER Configuration Statements for PowerExchange Connection Pooling

To configure PowerExchange connection pooling, define DBMOVER configuration statements on each
machine that hosts the PowerExchange Listener or the Data Integration Service.
Define the following statements:
LISTENER
Defines the TCP/IP port on which a named PowerExchange Listener process listens for work requests.
Include the LISTENER statement in the DBMOVER configuration file on the PowerExchange Listener
machine.
MAXTASKS
Defines the maximum number of tasks that can run concurrently in a PowerExchange Listener. Include
the MAXTASKS statement in the DBMOVER configuration file on the PowerExchange Listener machine.
Ensure that MAXTASKS is large enough to accommodate twice the maximum size of the connection
pool for the Listener. The maximum size of the connection pool is equal to the sum of the values that you
enter for the Maximum # of Connections pooling property for each database connection that is
associated with the Listener.
Default is 30.
NODE
Defines the TCP/IP host name and port that PowerExchange uses to contact a PowerExchange Listener.
Include the NODE statement in the DBMOVER file on the Data Integration Service machine.

100

Chapter 5: Data Integration Service Management

TCPIP_SHOW_POOLING
Writes diagnostic information to the PowerExchange log file. Include the TCPIP_SHOW_POOLING
statement in the DBMOVER file on the Data Integration Service machine.
If TCPIP_SHOW_POOLING=Y, PowerExchange writes message PWX-33805 to the PowerExchange log
file each time a connection is returned to a PowerExchange connection pool.
Message PWX-33805 provides the following information:

Size. Total size of PowerExchange connection pools.

Hits. Number of times that PowerExchange found a connection in a PowerExchange connection pool
that it could reuse.

Partial hits. Number of times that PowerExchange found a connection in a PowerExchange

connection pool that it could modify and reuse.

Misses. Number of times that PowerExchange could not find a connection in a PowerExchange
connection pool that it could reuse.

Expired. Number of connections that were discarded from a PowerExchange connection pool
because the maximum idle time was exceeded.

Discarded pool full. Number of connections that were discarded from a PowerExchange connection
pool because the pool was full.

Discarded error. Number of connections that were discarded from a PowerExchange connection pool
due to an error condition.

Pooling Properties in PowerExchange Connection Objects

Configure connection pooling properties in the Pooling view for a PowerExchange database connection.
Enable Connection Pooling
Enables connection pooling. When you enable connection pooling, each connection pool retains idle
PowerExchange Listener connection instances in memory. When you disable connection pooling, the
DTM process or the Data Integration Service process stops all pooling activity. To delete the pool of idle
connections, you must restart the Data Integration Service.
Default is enabled for DB2 for i5/OS and DB2 for z/OS connections. Default is disabled for Adabas, IMS,
Sequential, and VSAM connections.
Minimum # of Connections
The minimum number of idle connection instances that a pool maintains for a database connection after
the maximum idle time is met. If multiple database connections are associated with a PowerExchange
Listener, PowerExchange determines the minimum number of connections to the PowerExchange
Listener by adding the values for each database connection.
Maximum # of Connections
The maximum number of idle connection instances that a pool maintains for a database connection
before the maximum idle time is met. If multiple database connections are associated with a
PowerExchange Listener, PowerExchange determines the maximum number of connections to the
PowerExchange Listener node by adding the values for each database connection.
Verify that the value of MAXTASKS in the DBMOVER configuration file is large enough to accommodate
twice the maximum number of connections to the PowerExchange Listener node.
Enter 0 to specify an unlimited connection pool size.
Default is 15.

PowerExchange Connection Pools

101

Maximum Idle Time

The number of seconds that a connection instance that exceeds the minimum number of connection
instances can remain idle before the connection pool drops it. The connection pool ignores the idle time
when the connection instance does not exceed the minimum number of idle connection instances.
If multiple database connections are associated with a PowerExchange Listener, PowerExchange
calculates the arithmetic mean of the non-zero values for each database connection to determine the
maximum idle time for connections to the same Listener.
Default is 120.
Tip: Assign the same maximum idle time to each database connection.

Maximize Parallelism for Mappings and Profiles

If you have the partitioning option, you can enable the Data Integration Service to maximize parallelism when
it runs mappings, runs column profiles, or performs data domain discovery. When you maximize parallelism,
the Data Integration Service dynamically divides the underlying data into partitions and processes all of the
partitions concurrently.
Note: When you run a profile job, the Data Integration Service converts the profile job into one or more
mappings, and then can run those mappings in multiple partitions.
If mappings process large data sets or contain transformations that perform complicated calculations, the
mappings can take a long time to process and can cause low data throughput. When you enable partitioning
for these mappings, the Data Integration Service uses additional threads to process the mapping. Increasing
the number of processing threads increases the load on the node where the mapping runs. If the node
contains sufficient CPU bandwidth, concurrently processing rows of data in a mapping can optimize mapping
performance.
By default, the Maximum Parallelism property is set to 1 for the Data Integration Service. When the Data
Integration Service runs a mapping, it separates the mapping into pipeline stages and uses one thread to
process each stage. These threads are allocated to reading, transforming, and writing tasks, and they run in
parallel.
When you increase the maximum parallelism value, you enable partitioning. The Data Integration Service
uses multiple threads to process each pipeline stage.
The Data Integration Service can create partitions for mappings that have physical data as input and output.
The Data Integration Service can use multiple partitions to complete the following actions during a mapping
run:

Read from flat file, IBM DB2 for LUW, or Oracle sources.

Run transformations.

Write to flat file, IBM DB2 for LUW, or Oracle targets.

One Thread for Each Pipeline Stage

When maximum parallelism is set to 1, partitioning is disabled. The Data Integration Service separates a
mapping into pipeline stages and uses one reader thread, one transformation thread, and one writer thread to
process each stage.

102

Chapter 5: Data Integration Service Management

Each mapping contains one or more pipelines. A pipeline consists of a Read transformation and all the
transformations that receive data from that Read transformation. The Data Integration Service separates a
mapping pipeline into pipeline stages and then performs the extract, transformation, and load for each
pipeline stage in parallel.
Partition points mark the boundaries in a pipeline and divide the pipeline into stages. For every mapping
pipeline, the Data Integration Service adds a partition point after the Read transformation and before the
Write transformation to create multiple pipeline stages.
Each pipeline stage runs in one of the following threads:

Reader thread that controls how the Data Integration Service extracts data from the source.

Transformation thread that controls how the Data Integration Service processes data in the pipeline.

Writer thread that controls how the Data Integration Service loads data to the target.

The following figure shows a mapping separated into a reader pipeline stage, a transformation pipeline stage,
and a writer pipeline stage:

Because the pipeline contains three stages, the Data Integration Service can process three sets of rows
concurrently and optimize mapping performance. For example, while the reader thread processes the third
row set, the transformation thread processes the second row set, and the writer thread processes the first
row set.
The following table shows how multiple threads can concurrently process three sets of rows:
Reader Thread

Transformation Thread

Writer Thread

Row Set 1

Row Set 2

Row Set 1

Row Set 3

Row Set 2

Row Set 1

Row Set 4

Row Set 3

Row Set 2

Row Set n

Row Set (n-1)

Row Set (n-2)

If the mapping pipeline contains transformations that perform complicated calculations, processing the
transformation pipeline stage can take a long time. To optimize performance, the Data Integration Service
adds partition points before some transformations to create an additional transformation pipeline stage.

Maximize Parallelism for Mappings and Profiles

103

Multiple Threads for Each Pipeline Stage

When maximum parallelism is set to a value greater than 1, partitioning is enabled. The Data Integration
Service separates a mapping into pipeline stages and uses multiple threads to process each stage.
When you maximize parallelism, the Data Integration Service dynamically performs the following tasks at run
time:
Divides the data into partitions.
The Data Integration Service dynamically divides the underlying data into partitions and runs the
partitions concurrently. The Data Integration Service determines the optimal number of threads for each
pipeline stage. The number of threads used for a single pipeline stage cannot exceed the maximum
parallelism value. The Data Integration Service can use a different number of threads for each pipeline
stage.
Redistributes data across partition points.
The Data Integration Service dynamically determines the best way to redistribute data across a partition
point based on the transformation requirements.
The following image shows an example mapping that distributes data across multiple partitions for each
pipeline stage:

In the preceding image, maximum parallelism for the Data Integration Service is three. Maximum parallelism
for the mapping is Auto. The Data Integration Service separates the mapping into four pipeline stages and

104

Chapter 5: Data Integration Service Management

uses a total of 12 threads to run the mapping. The Data Integration Service performs the following tasks at
each of the pipeline stages:

At the reader pipeline stage, the Data Integration Service queries the Oracle database system to discover
that both source tables, source A and source B, have two database partitions. The Data Integration
Service uses one reader thread for each database partition.

At the first transformation pipeline stage, the Data Integration Service redistributes the data to group rows
for the join condition across two threads.

At the second transformation pipeline stage, the Data Integration Service determines that three threads
are optimal for the Aggregator transformation. The service redistributes the data to group rows for the
aggregate expression across three threads.

At the writer pipeline stage, the Data Integration Service does not need to redistribute the rows across the
target partition point. All rows in a single partition stay in that partition after crossing the target partition
point.

Maximum Parallelism Guidelines

Maximum parallelism determines the maximum number of parallel threads that can process a single pipeline
stage. Configure the Maximum Parallelism property for the Data Integration Service based on the available
hardware resources. When you increase the maximum parallelism value, you might decrease the amount of
processing time.
Consider the following guidelines when you configure maximum parallelism:
Increase the value based on the number of available CPUs.
Increase the maximum parallelism value based on the number of CPUs available on the nodes where
mappings run. When you increase the maximum parallelism value, the Data Integration Service uses
more threads to run the mapping and leverages more CPUs. A simple mapping runs faster in two
partitions, but typically requires twice the amount of CPU than when the mapping runs in a single
partition.
Consider the total number of processing threads.
Consider the total number of processing threads when setting the maximum parallelism value. If a
complex mapping results in multiple additional partition points, the Data Integration Service might use
more processing threads than the CPU can handle.
The total number of processing threads is equal to the maximum parallelism value.
Consider the other jobs that the Data Integration Service must run.
If you configure maximum parallelism such that each mapping uses a large number of threads, fewer
threads are available for the Data Integration Service to run additional jobs.
Optionally change the value for a mapping.
By default, the maximum parallelism for each mapping is set to Auto. Each mapping uses the maximum
parallelism value defined for the Data Integration Service.
In the Developer tool, developers can change the maximum parallelism value in the mapping run-time
properties to define a maximum value for a particular mapping. When maximum parallelism is set to
different integer values for the Data Integration Service and the mapping, the Data Integration Service
uses the minimum value of the two.
Note: You cannot use the Developer tool to change the maximum parallelism value for profiles. When the
Data Integration Service converts a profile job into one or more mappings, the mappings always use Auto for
the mapping maximum parallelism value.

Maximize Parallelism for Mappings and Profiles

105

Enabling Partitioning for Mappings and Profiles

To enable partitioning for mappings, column profiles, and data domain discovery, set maximum parallelism
for the Data Integration Service to a value greater than 1.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the Data Integration Service.

3.

In the contents panel, click the Properties view.

4.

In the Execution Options section, click Edit.

5.

Enter a value greater than 1 for the Maximum Parallelism property.

6.

Click OK.

7.

Recycle the Data Integration Service to apply the changes.

Optimize Cache and Target Directories for Partitioning

For optimal performance during cache partitioning for Aggregator, Joiner, Rank, and Sorter transformations,
configure multiple cache directories for the Data Integration Service. For optimal performance when multiple
threads write to a file target, configure multiple target directories for the Data Integration Service.
When multiple threads write to a single directory, the mapping might encounter a bottleneck due to input/
output (I/O) contention. An I/O contention can occur when threads write data to the file system at the same
time.
When you configure multiple directories, the Data Integration Service determines the output directory for
each thread in a round-robin fashion. For example, you configure a flat file data object to use directoryA and
directoryB as target directories. If the Data Integration Service uses four threads to write to the file target, the
first and third writer threads write target files to directoryA. The second and fourth writer threads write target
files to directoryB.
If the Data Integration Service does not use cache partitioning for transformations or does not use multiple
threads to write to the target, the service writes the files to the first listed directory.
In the Administrator tool, you configure multiple cache and target directories by entering multiple directories
separated by semicolons for the Data Integration Service execution properties. Configure the directories in
the following execution properties:
Cache Directory
Defines the cache directories for Aggregator, Joiner, and Rank transformations. By default, the
transformations use the CacheDir system parameter to access the cache directory value defined for the
Data Integration Service.
Temporary Directories
Defines the cache directories for Sorter transformations. By default, the Sorter transformation uses the
TempDir system parameter to access the temporary directory value defined for the Data Integration
Service.
Target Directory
Defines the target directories for flat file targets. By default, flat file targets use the TargetDir system
parameter to access the target directory value defined for the Data Integration Service.
Instead of using the default system parameters, developers can configure multiple directories specific to the
transformation or flat file data object in the Developer tool.
Note: A Lookup transformation can only use a single cache directory.

106

Chapter 5: Data Integration Service Management

Result Set Caching

Result set caching enables the Data Integration Service to use cached results for SQL data service queries
and web service requests. Users that run identical queries in a short period of time may want to use result set
caching to decrease the runtime of identical queries.
When you configure result set caching, the Data Integration Service caches the results of the DTM process
associated with each SQL data service query and web service request. The Data Integration Service caches
the results for the expiration period that you configure. When an external client makes the same query or
request before the cache expires, the Data Integration Service returns the cached results.
The Result Set Cache Manager creates in-memory caches to temporarily store the results of the DTM
process. If the Result Set Cache Manager requires more space than allocated in the result set cache
properties, it stores the data in encrypted cache files. The files are saved at <Domain_install_dir>/
tomcat/bin/disTemp/<Service_Name>/<Node_Name>/. Do not rename or move the cache files.
Complete the following steps to configure result set caching for SQL data services and web service
operations:
1.

Configure the result set cache properties in the Data Integration Service process properties.

2.

Configure the cache expiration period in the SQL data service properties.

3.

Configure the cache expiration period in the web service operation properties. If you want the Data
Integration Service to cache the results by user, enable WS-Security in the web service properties.

The Data Integration Service purges result set caches in the following situations:

When the result set cache expires, the Data Integration Service purges the cache.

When you restart an application or run the infacmd dis purgeResultSetCache command, the Data
Integration Service purges the result set cache for objects in the application.

When you restart a Data Integration Service, the Data Integration Service purges the result set cache for
objects in applications that run on the Data Integration Service.

When you change the permissions for a user, the Data Integration Service purges the result set cache
associated with that user.

Data Object Caching

The Data Integration Service uses data object caching to access pre-built logical data objects and virtual
tables. Enable data object caching to increase performance for mappings, SQL data service queries, and
web service requests that include logical data objects and virtual tables.
By default, the Data Integration Service extracts source data and builds required data objects when it runs a
mapping, SQL data service query, or a web service request. When you enable data object caching, the Data
Integration Service can use cached logical data objects and virtual tables.
Perform the following steps to configure data object caching for logical data objects and virtual tables in an
application:
1.

Configure the data object cache database connection in the cache properties for the Data Integration
Service.

2.

Enable caching in the properties of logical data objects or virtual tables in an application.

By default, the Data Object Cache Manager component of the Data Integration Service manages the cache
tables for logical data objects and virtual tables in the data object cache database. When the Data Object

Result Set Caching

107

Cache Manager manages the cache, it inserts all data into the cache tables with each refresh. If you want to
incrementally update the cache tables, you can choose to manage the cache tables yourself using a
database client or other external tool. After enabling data object caching, you can configure a logical data
object or virtual table to use a user-managed cache table.

Cache Tables
The Data Object Cache Manager is the component of the Data Integration Service that creates and manages
cache tables in a relational database.
You can use the following database types to store data object cache tables:

IBM DB2

Microsoft SQL Server

Oracle

After the database administrator sets up the data object cache database, use the Administrator tool to create
a connection to the database. Then, you configure the Data Integration Service to use the cache database
connection.
When data object caching is enabled, the Data Object Cache Manager creates a cache table when you start
the application that contains the logical data object or virtual table. It creates one table in the cache database
for each cached logical data object or virtual table in an application. The Data Object Cache Manager uses a
prefix of CACHE to name each table.
Objects within an application share cache tables, but objects in different applications do not. If one logical
data object or virtual table is used in multiple applications, the Data Object Cache Manager creates a
separate cache table for each instance of the object.

Data Object Caching Configuration

To configure data object caching, configure the cache database connection for the Data Integration Service.
Then, enable caching for each logical data object or virtual table that end users access frequently.
Perform the following steps to configure data object caching:
1.

Configure the cache database connection in the cache properties for the Data Integration Service.
The Data Object Cache Manager creates the cache tables in this database.

2.

Enable caching in the properties of logical data objects or virtual tables in an application.
When you enable caching, you can also configure the Data Integration Service to generate indexes on
the cache tables based on a column. Indexes can increase the performance of queries on the cache
database.

Step 1. Configure the Cache Database Connection

The Data Integration Service stores cached logical data objects and virtual tables in the data object cache
database. You configure the connection that the Data Integration Service uses to access the database.
Verify that the database administrator has set up the data object cache database and that you have created
the connection to the database.
To configure the connection for the Data Integration Service, click the Properties view for the service in the
Administrator tool. Click Edit in the Logical Data Object/Virtual Table Cache area, and then select the
database connection name for the Cache Connection property. Restart the service for the property to take
effect.

108

Chapter 5: Data Integration Service Management

Step 2. Enable Data Object Caching for an Object

To enable caching for an object, stop the application that contains the logical data object or virtual table, edit
the object properties, and restart the application.
1.

In the Administrator tool, select the Data Integration Service.

2.

Click the Applications view.

3.

Select the application that contains the logical data object or virtual table for which you want to enable
caching.

4.

Stop the application.

5.

Expand the application, and select the logical data object or virtual table.

6.

In the Logical Data Object Properties or Virtual Table Properties area, click Edit.
The Edit Properties dialog box appears.

7.

Select Enable Caching.

8.

In the Cache Refresh Period property, enter the amount of time in minutes that the Data Object Cache
Manager waits before refreshing the cache.
For example, if you enter 720, the Data Object Cache Manager refreshes the cache every 12 hours. If
you leave the default value of zero, the Data Object Cache Manager does not refresh the cache
according to a schedule. You must manually refresh the cache using the infacmd dis
RefreshDataObjectCache command.

9.

Leave the Cache Table Name property blank.

When you enter a table name, the Data Object Cache Manager does not manage the cache for the
object. Enter a table name only when you want to use a user-managed cache table. A user-managed
cache table is a table in the data object cache database that you create, populate, and manually refresh
when needed.

10.

Click OK.

Data Object Caching

109

11.

To generate indexes on the cache table based on a column, expand the logical data object or virtual
table.
a.

Select a column, and then click Edit in the Logical Data Object Column Properties or Virtual
Table Column Properties area.
The Edit Column Properties dialog box appears.

b.
12.

Select Create Index and then click OK.

Restart the application.

The Data Object Cache Manager creates and populates the cache table.

Data Object Cache Management

By default, the Data Object Cache Manager manages the cache tables in the data object cache database.
You can use the Administrator tool or infacmd to configure when and how the Data Object Cache Manager
refreshes the cache. Or, you can choose to manage the cache tables yourself using a database client or
other external tool.
When the Data Object Cache Manager manages the cache, it inserts all data into the cache table with each
refresh. You can choose to manage the cache tables yourself so that you can incrementally update the
cache.

Cache Tables Managed by the Data Object Cache Manager

By default, the Data Object Cache Manager manages the cache tables in the data object cache database.
When the Data Object Cache Manager manages the cache tables, you can perform the following operations
on the data object cache:
Refresh the cache
You can refresh the cache for a logical data object or virtual table according to a schedule or manually.
To refresh data according to a schedule, set the cache refresh period for the logical data object or virtual
table in the Administrator tool.
To refresh the cache manually, use the infacmd dis RefreshDataObjectCache command. When the Data
Object Cache Manager refreshes the cache, it creates a new cache. If an end user runs a mapping or

110

Chapter 5: Data Integration Service Management

queries an SQL data service during a cache refresh, the Data Integration Service returns information
from the existing cache.
Abort a refresh
To abort a cache refresh, use the infacmd dis CancelDataObjectCacheRefresh command. If you abort a
cache refresh, the Data Object Cache Manager restores the existing cache.
Purge the cache
To purge the cache, use the infacmd dis PurgeDataObjectCache command. You must disable the
application before you purge the cache.

User-Managed Cache Tables

A user-managed cache table is a table in the data object cache database that you create, populate, and
manually refresh when needed.
Configure a logical data object or virtual table to use a user-managed cache table when you want to
incrementally update the cache. When the Data Object Cache Manager manages the cache, it inserts all data
into the cache table with each refresh. If the source contains a large data set, the refresh can take a long
time to process. Instead, you can configure the object to use a user-managed cache table and then use an
external tool to insert only the changed data into the cache table. For example, you can use a PowerCenter
CDC mapping to extract changed data for the objects and incrementally update the cache.
When you configure an object to use a user-managed cache table, you must use a database client or other
tool to create, populate, purge, and refresh the cache table. You create the user-managed cache table in the
data object cache database that the Data Integration Service accesses with the cache database connection.
You cannot use the Administrator tool or command line tools to manage a user-managed cache table. The
Data Integration Service uses the cache stored in the user-managed cache table when it runs a mapping, an
SQL data service query, or a web service request that includes the object. However, the Data Object Cache
Manager does not manage the cache table. When you use the Monitor tab to monitor an object that uses a
user-managed cache table, the object has a cache state of Skipped.
Note: If the user-managed cache table is stored in a Microsoft SQL Server database and the database user
name is not the same as the schema name, you must specify a schema name in the database connection
object. Otherwise, mappings, SQL data service queries, and web service requests that access the cache fail.

Configure User-Managed Cache Tables

To configure a logical data object or virtual table to use a user-managed cache table, you must create a table
in the data object cache database. Populate the table with the initial cache, and then enter the table name in
the data object properties.
Note: Before you configure an object to use a user-managed cache table, you must configure the cache
database connection for the Data Integration Service. You also must enable data object caching for the
object so that the Data Object Cache Manager creates the default cache table.

Step 1. Find the Name of the Default Cache Table

On the Monitor tab of the Administrator tool, find the name of the default cache table that the Data Object
Cache Manager created after you enabled data object caching for the object.
1.

In the Administrator tool, click the Monitor tab.

2.

Click the Execution Statistics view.

3.

In the Navigator, expand a Data Integration Service.

Data Object Caching

111

4.

In the Navigator, expand an application and select Logical Data Objects or SQL Data Services.

5.

In the contents panel, perform one of the following steps:

Select a logical data object.

Select an SQL data service, click the Virtual Tables view, and then select a table row.

Details about the selected object appear in the details panel.

6.

In the details panel, select the Cache Refresh Runs view.

The Storage Name column lists the name of the default cache table that the Data Object Cache Manager
created.
For example, the following image displays a cache table named CACHE5841939198782829781:

Step 2. Create the User-Managed Cache Table

Ask the database administrator to create a table in the data object cache database using the same table
structure as the default cache table.
Use a database client to find the default cache table in the data object cache database. Use the SQL DDL
from the default cache table to create the user-managed cache table with a different name. The name of the
user-managed cache table cannot have the prefix CACHE. The prefix CACHE is reserved for names of cache
tables that are managed by the Data Object Cache Manager.
After creating the user-managed cache table, populate the table by copying the initial cache data from the
default cache table.

Step 3. Configure the Object to Use the User-Managed Cache Table

To configure a logical data object or virtual table to use a user-managed cache table, stop the application that
contains the object, edit the object properties, and restart the application.
1.

In the Administrator tool, select the Data Integration Service.

2.

Click the Applications view.

3.

Select the application that contains the logical data object or virtual table for which you want to use a
user-managed cache table.

4.

Stop the application.

5.

Expand the application, and select the logical data object or virtual table.

6.

In the Logical Data Object Properties or Virtual Table Properties area, click Edit.
The Edit Properties dialog box appears.

7.

Enter the name of the user-managed cache table that you created in the data object cache database.
When you enter a cache table name, the Data Object Cache Manager does not generate the cache for
the object and ignores the cache refresh period.

112

Chapter 5: Data Integration Service Management

The following figure shows a logical data object configured to use a user-managed cache table:

8.

Click OK.

9.

Restart the application.

Persisting Virtual Data in Temporary Tables

A temporary table is a table in a relational database that stores intermediate, temporary data. Complex
queries commonly require storage for large amounts of intermediate data, such as information from joins.
When you implement temporary tables, business intelligence tools can retrieve this data from the temporary
table instead of the SQL data service. This results in an increase in performance.
Temporary tables also provide increased security in two ways. First, only the user of the active session can
access the tables. Also, the tables persist while a session is active, and the database drops the tables when
the connection closes.
You must configure the Table Storage Connection property of the Data Integration Service before the
database administrator creates a temporary table.
Temporary tables for all SQL data services in a Data Integration Service use the same relational database
connection. When the connection to the SQL data service is active, you can connect to the SQL data service
through a JDBC or ODBC client. The relational database drops temporary tables when the session ends. If
the Data Integration Service unexpectedly shuts down, the relational database drops temporary tables on the
next Data Integration Service startup.

Temporary Table Implementation

You can store intermediate query result set data in temporary tables when complex queries produce large
amounts of intermediate data. For example, temporary tables can store frequently used join results. Business

Persisting Virtual Data in Temporary Tables

113

intelligence tools can query the temporary table instead of the SQL data service, resulting in increased
performance.
To implement temporary tables, the Informatica administrator and the business intelligence tool user perform
the following separate tasks:
Step 1. The Informatica administrator creates a connection for the data integration service.
In the Administrator tool, create a connection to the SQL data service. Edit the SQL Properties of the
Data Integration Service and select a relational database connection for the Table Storage Connection
property. Recycle the Data Information Service.
Step 2. The business intelligence tool user creates a connection for the SQL data service.
In a business intelligence tool, create a connection to the SQL data service. The connection uses the
Informatica ODBC or JDBC driver.
Step 3. Queries from the business intelligence tool create and use temporary tables.
While the connection is active, the business intelligence tool issues queries to the SQL data service.
These queries create and use temporary tables to store large amounts of data that the complex query
produces. When the connection ends, the database drops the temporary table.

Temporary Table Operations

After you create the SQL data service connection, you can use SQL operations to create, populate, select
from, or drop a temporary table. You can issue these commands in a regular or stored SQL statement.
You can perform the following operations:
Create a temporary table.
To create a temporary table on the relational database, use the following syntax:
CREATE TABLE emp (empID INTEGER PRIMARY KEY,eName char(50) NOT NULL,)
You can specify the table name in the SQL data service.
Note: Use CREATE TABLE, not CREATE TEMPORARY TABLE. The use of CREATE TEMPORARY TABLE is not
supported.
Create a temporary table from a source table.
You can create a temporary table with or without data from a source table.
The following syntax is supported in Informatica Data Services version 9.5.1:
CREATE TABLE emp.backup as select * from emp
Where emp is an existing schema in the SQL data service that you connected to.
The following syntax is supported in Informatica Data Services version 9.6.0 and 9.6.1:
CREATE TABLE emp.backup as select * from emp [ [LIMIT n] ]
Where emp is an existing schema in the SQL data service that you connected to.
When you create a temporary table with data, the Data Integration Service populates the table with the
data. The CREATE AS operator copies columns from a database table into the temporary table.
You cannot maintain foreign key or primary key constraints when you use CREATE AS.
You can cancel a request before the Data Integration Service copies all the data.
Note: The Informatica administrator must create a connection, and then configure it in SQL Properties
as the Table Storage Connection, before you create the temporary table.

114

Chapter 5: Data Integration Service Management

Insert data into a temporary table.

To insert data into a temporary table, use the INSERT INTO <temp_table> statement. You can insert
literal data and query data into a temporary table.
The following table shows examples of SQL statements that you can use to insert literal data and query
data into a temporary table:
Type

Description

Literal
data

Literals describe a user or system-supplied string or value that is not an identifier or keyword.
Use strings, numbers, dates, or boolean values when you insert literal data into a temporary
table. Use the following statement format to insert literal data into a temporary table:
INSERT INTO <TABLENAME> <OPTIONAL COLUMN LIST> VALUES (<VALUE
LIST>), (<VALUE LIST>)
For example, INSERT INTO temp_dept (dept_id, dept_name, location)
VALUES (2, 'Marketing', 'Los Angeles').

Query
data

You can query an SQL data service and insert data from the query into a temporary table. Use
the following statement format to insert query data into a temporary table:
INSERT INTO <TABLENAME> <OPTIONAL COLUMN LIST> <SELECT QUERY>
For example, INSERT INTO temp_dept(dept_id, dept_name, location) SELECT
dept_id, dept_name, location from dept where dept_id = 99.
You can use a set operator, such as UNION, in the SQL statement when you insert query data
into a temporary table. Use the following statement format when you use a set operator:
INSERT INTO <TABLENAME> <OPTIONAL COLUMN LIST> (<SELECT QUERY>
<SET OPERATOR> <SELECT QUERY>)
For example, INSERT INTO temp_dept select * from north_america_dept
UNION select * from asia_dept.

Select from a temporary table.

You can query the temporary table with the SELECT ... from <table> statement.
Drop a temporary table.
To drop a temporary table from the relational database, use the following syntax:
DROP TABLE <tableName>
If the table is not dropped on the physical database, the SQL data service drops the table the next time
the Data Integration Service starts, if the table still exists.

Rules and Guidelines for Temporary Tables

Consider the following rules and guidelines for creation and use of temporary tables:

You can specify schema and default schema for a temporary table.

You can place the primary key, NULL, NOT NULL, and DEFAULT constraints on a temporary table.

You cannot place a foreign key or CHECK and UNIQUE constraints on a temporary table.

You cannot issue a query that contains a common table expression or a correlated subquery against a
temporary table.

CREATE AS statements cannot contain a correlated subquery.

Persisting Virtual Data in Temporary Tables

115

Content Management for the Profiling Warehouse

To create and run profiles and scorecards, you must associate the Data Integration Service with a profiling
warehouse. You can specify the profiling warehouse when you create the Data Integration Service or when
you edit the Data Integration Service properties.
The profiling warehouse stores profiling data and metadata. If you specify a new profiling warehouse
database, you must create the profiling content. If you specify an existing profiling warehouse, you can use
the existing content or delete and create new content.
You can create or delete content for a profiling warehouse at any time. You may choose to delete the content
of a profiling warehouse to delete corrupted data or to increase disk or database space.

Creating and Deleting Profiling Warehouse Content

The Data Integration Service must be running when you create or delete profiling warehouse content.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select a Data Integration Service that has an associated profiling warehouse.

3.

To create profiling warehouse content, click the Actions menu on the Manage tab and select Profiling
Warehouse Database Contents > Create.

4.

To delete profiling warehouse content, click the Actions menu on the Manage tab and select Profiling
Warehouse Database Contents > Delete.

Database Management
You need to periodically review and manage the profiling warehouse database growth. You can remove
profile information that you no longer need and monitor or maintain the profiling warehouse tables.
The need for maintenance depends on different scenarios, such as short-term projects or when you no longer
need the profile results. You can remove unused profile results and recover disk space used by the results so
that you can reuse the database space for other purposes.

Purge
Purges profile and scorecard results from the profiling warehouse.
The infacmd ps Purge command uses the following syntax:
Purge
<-DomainName|-dn> domain_name
[<-Gateway|-hp> gateway_name]
[<-NodeName|-nn>] node_name
<-UserName|-un> user_name
<-Password|-pd> Password
[<-SecurityDomain|-sdn> security_domain]
<-MrsServiceName|-msn> MRS_name
<-DsServiceName|-dsn> data_integration_service_name
<-ObjectType|-ot> object_type

116

Chapter 5: Data Integration Service Management

<-ObjectPathAndName|-opn> MRS_object_path
[<-RetainDays|-rd> results_retain_days]
[<-ProjectFolderPath|-pf> project_folder_path]
[<-ProfileTaskName|-pt> profile_task_name]
[<-Recursive|-r> recursive]
[<-PurgeAllResults|-pa> purge_all_results]
The following table describes infacmd ps Purge options and arguments:
Option

Argument

Description

-DomainName

domain_name

Required. The name of the Informatica domain.

-dn

-Gateway
-hp

You can set the domain name with the -dn option or the
environment variable INFA_DEFAULT_DOMAIN. If you set a
domain name with both methods, the -dn option takes
precedence.
gateway_nam
e

Optional if you run the command from the Informatica

installation \bin directory. Required if you run the command
from another location.
The gateway node name.
Use the following syntax:
[Domain_Host]:[HTTP_Port]

-NodeName

node_name

Required. The name of the node where the Data Integration

Service runs.

user_name

Required if the domain uses Native or LDAP authentication.

User name to connect to the domain. You can set the user
name with the -un option or the environment variable
INFA_DEFAULT_DOMAIN_USER. If you set a user name
with both methods, the -un option takes precedence.

-nn
-UserName
-un

Optional if the domain uses Kerberos authentication. To run

the command with single sign-on, do not set the user name.
If you set the user name, the command runs without single
sign-on.
-Password
-pd

Password

Required if you specify the user name. Password for the user
name. The password is case sensitive. You can set a
password with the -pd option or the environment variable
INFA_DEFAULT_DOMAIN_PASSWORD. If you set a
password with both methods, the password set with the -pd
option takes precedence.

Content Management for the Profiling Warehouse

117

Option

Argument

Description

-SecurityDomain

security_doma
in

Required if the domain uses LDAP authentication. Optional if

the domain uses native authentication or Kerberos
authentication. Name of the security domain to which the
domain user belongs. You can set a security domain with the
-sdn option or the environment variable
INFA_DEFAULT_SECURITY_DOMAIN. If you set a security
domain name with both methods, the -sdn option takes
precedence. The security domain name is case sensitive.

-sdn

If the domain uses native or LDAP authentication, the default

is Native. If the domain uses Kerberos authentication, the
default is the LDAP security domain created during
installation. The name of the security domain is the same as
the user realm specified during installation.
-MrsServiceName

MRS_name

Required. The Model Repository Service name.

data_integrati
on_service_na
me

Required. The Data Integration Service name

-dsn
-ObjectType

Required. Enter profile or scorecard.

MRS_object_p
ath

Optional. Do not use with ProjectFolderPath or Recursive.

The path to the profile or scorecard in the Model repository.

-msn
-DsServiceName

-ot
-ObjectPathAndName
-opn *

Use the following syntax:

ProjectName/FolderName/.../{SubFolder_Name/
ObjectName|ProjectName/ObjectName}
-RetainDays
-rd
-ProjectFolderPath
-pf *

results_retain
_days

Optional. The number of days that the profiling warehouse

stores profile or scorecard results before it purges the
results.

project_folder
_path

Optional. Do not use with ObjectPathAndName or

ProfileTaskName.
The names of the project and folder where the profile or
scorecard is stored.
Use the following syntax:
ProjectName/FolderName

-ProfileTaskName
-pt *

profile_task_n
ame

Optional. The name of the profile task that you want to

purge. If you specified the ProjectFolderPath, you do not
need to specify this option because the ProjectFolderPath
includes the name of the enterprise discovery profile that
contains the profile task.

-Recursive

recursive

Optional. Do not use with ObjectPathAndName.

-r

118

Chapter 5: Data Integration Service Management

Applies the command to objects in the folder that you specify

and its subfolders.

Option

Argument

Description

-PurgeAllResults

purge_all_res
ults

Optional. Set this option to purge all results for the profile or
scorecard object.

-pa

Use with the -recursive option to apply the command to

profile and scorecard results in the folder that you specify
and its subfolders.
* To run the command, you need to specify ObjectPathAndName or ProjectFolderPath or ProfileTaskName.

Tablespace Recovery
As part of the regular profile operations, the Data Integration Service writes profile results to the profiling
warehouse and deletes results from the profiling warehouse. The indexes and base tables can become
fragmented over a period of time. You need to reclaim the unused disk space, especially for Index Organized
Tables in Oracle database.
Most of the profiling warehouse tables contain relatively small amount of data and you do not need to recover
the tablespace and index space.
The following tables store large amounts of profile data and deleting the tables can leave the tables
fragmented:
Name

Description

IDP_FIELD_VERBOSE_SMRY_DATA

Stores the value frequencies

IDP_VERBOSE_FIELD_DTL_RES

Stores the staged data

When you perform the tablespace recovery, ensure that no user runs a profile task. After you recover the
data, update the database statistics to reflect the changed structure.

IBM DB2
The recommendation is to shut down the Data Integration Service when you reorganize the tables and
indexes.
To recover the database for a table, run the following command:
REORG TABLE <TABLE NAME>
REORG INDEXES ALL FOR TABLE <TABLE NAME> ALLOW WRITE ACCESS CLEANUP ONLY ALL

Oracle
You can rebuild Index Organized Tables in Oracle. This action reclaims unused fragments inside the index
and applies to the IDP_FIELD_VERBOSE_SMRY_DATA and IDP_FIELD_VERBOSE_SMRY_DATA profiling
warehouse tables.
To recover the database for a table, run the following command:
ALTER TABLE <Table Name> MOVE ONLINE

Content Management for the Profiling Warehouse

119

Microsoft SQL Server

Microsoft SQL Server reclaims unused space back into the tablespace and compacts indexes when rows are
deleted. You do not need to maintain the database.

Database Statistics
Update the database statistics to allow the database to quickly run the queries on the profiling warehouse.

Database Statistics on IBM DB2

IBM DB2 recommends that you run the RUNSTATS command to update the statistics after a lot of updates
have been made to a table or after a reorganization of the table.
To update the statistics, run the following command:
RUNSTATS ON TABLE <TABLE NAME> WITH DISTRIBUTION AND DETAILED INDEXES ALL

Database Statistics on Oracle

By default, Oracle gathers database statistics and therefore, you do not need to perform any action. For more
information, refer the documentation on Oracle DBMS_STATS command.

Database Statistics on Microsoft SQL Server

By default, Microsoft SQL Server gathers statistics and therefore, no action is required. To update the
statistics more frequently than the default recommended option, refer the documentation on SQL Server
UPDATE STATISTICS command.

Web Service Security Management

An HTTP client filter, transport layer security, and message layer security can provide secure data transfer
and authorized data access for a web service. When you configure message layer security, the Data
Integration Service can pass credentials to connections.
You can configure the following security options for a web service:
HTTP Client Filter
If you want the Data Integration Service to accept requests based on the host name or IP address of the
web service client, use the Administrator tool to configure an HTTP client filter. By default, a web service
client running on any machine can send requests.
Message Layer Security
If you want the Data Integration Service to authenticate user credentials in SOAP requests, use the
Administrator tool to enable WS-Security and configure web service permissions. The Data Integration
Service can validate user credentials that are provided as a user name token in the SOAP request. If the
user name token is not valid, the Data Integration Service rejects the request and sends a systemdefined fault to the web service client. If a user does not have permission to execute the web service
operation, the Data Integration Service rejects the request and sends a system-defined fault to the web
service client.

120

Chapter 5: Data Integration Service Management

Transport Layer Security (TLS)

If you want the web service and web service client to communicate using an HTTPS URL, use the
Administrator tool to enable transport layer security (TLS) for a web service. The Data Integration
Service that the web service runs on must also use the HTTPS protocol. An HTTPS URL uses SSL to
provide a secure connection for data transfer between a web service and a web service client.
Pass-Through Security
If an operation mapping requires connection credentials, the Data Integration Service can pass
credentials from the user name token in the SOAP request to the connection. To configure the Data
Integration Service to pass credentials to a connection, use the Administrator tool to configure the Data
Integration Service to use pass-through security for the connection and enable WS-Security for the web
service.
Note: You cannot use pass-through security when the user name token includes a hashed or digested
password.

HTTP Client Filter

An HTTP client filter specifies web services client machine that can send requests to the Data Integration
Service. By default, a web service client running on any machine can send requests.
To specify machines that can send web service request to a Data Integration Service, configure the HTTP
client filter properties in the Data Integration Service properties. When you configure these properties, the
Data Integration Service compares the IP address or host name of machines that submit web service
requests against these properties. The Data Integration Service either allows the request to continue or
refuses to process the request.
You can use constants or Java regular expressions as values for these properties. You can include a period
(.) as a wildcard character in a value.
Note: You can allow or deny requests from a web service client that runs on the same machine as the Data
Integration Service. Enter the host name of the Data Integration Service machine in the allowed or denied
host names property.

Example
The Finance department wants to configure a web service to accept web service requests from a range of IP
addresses. To configure the Data Integration Service to accept web service requests from machines in a
local network, enter the following expression as an allowed IP Address:
192\.168\.1\.[0-9]*
The Data Integration Service accepts requests from machines with IP addresses that match this pattern. The
Data Integration Service refuses to process requests from machines with IP addresses that do not match this
pattern.

Pass-through Security
Pass-through security is the capability to connect to an SQL data service or an external source with the client
user credentials instead of the credentials from a connection object.
Users might have access to different sets of data based on the job in the organization. Client systems restrict
access to databases by the user name and the password. When you create an SQL data service, you might
combine data from different systems to create one view of the data. However, when you define the
connection to the SQL data service, the connection has one user name and password.

Pass-through Security

121

If you configure pass-through security, you can restrict users from some of the data in an SQL data service
based on their user name. When a user connects to the SQL data service, the Data Integration Service
ignores the user name and the password in the connection object. The user connects with the client user
name or the LDAP user name.
A web service operation mapping might need to use a connection object to access data. If you configure
pass-through security and the web service uses WS-Security, the web service operation mapping connects to
a source using the user name and password provided in the web service SOAP request.
Configure pass-through security for a connection in the connection properties of the Administrator tool or with
infacmd dis UpdateServiceOptions. You can set pass-through security for connections to deployed
applications. You cannot set pass-through security in the Developer tool. Only SQL data services and web
services recognize the pass-through security configuration.
For more information about configuring security for SQL data services, see the Informatica How-To Library
article "How to Configure Security for SQL Data Services":
http://communities.informatica.com/docs/DOC-4507.

Example
An organization combines employee data from multiple databases to present a single view of employee data
in an SQL data service. The SQL data service contains data from the Employee and Compensation
databases. The Employee database contains name, address, and department information. The
Compensation database contains salary and stock option information.
A user might have access to the Employee database but not the Compensation database. When the user
runs a query against the SQL data service, the Data Integration Service replaces the credentials in each
database connection with the user name and the user password. The query fails if the user includes salary
information from the Compensation database.

Pass-Through Security with Data Object Caching

To use data object caching with pass-through security, you must enable caching in the pass-through security
properties for the Data Integration Service.
When you deploy an SQL data service or a web service, you can choose to cache the logical data objects in
a database. You must specify the database in which to store the data object cache. The Data Integration
Service validates the user credentials for access to the cache database. If a user can connect to the cache
database, the user has access to all tables in the cache. The Data Integration Service does not validate user
credentials against the source databases when caching is enabled.
For example, you configure caching for the EmployeeSQLDS SQL data service and enable pass-through
security for connections. The Data Integration Service caches tables from the Compensation and the
Employee databases. A user might not have access to the Compensation database. However, if the user has
access to the cache database, the user can select compensation data in an SQL query.
When you configure pass-through security, the default is to disallow data object caching for data objects that
depend on pass-through connections. When you enable data object caching with pass-through security,
verify that you do not allow unauthorized users access to some of the data in the cache. When you enable
caching for pass-through security connections, you enable data object caching for all pass-through security
connections.

122

Chapter 5: Data Integration Service Management

Adding Pass-Through Security

Enable pass-through security for a connection in the connection properties. Enable data object caching for
pass-through security connections in the pass-through security properties of the Data Integration Service.
1.

Select a connection.

2.

Click the Properties view.

3.

Edit the connection properties.

The Edit Connection Properties dialog box appears.

4.

To choose pass-through security for the connection, select the Pass-through Security Enabled option.

5.

Optionally, select the Data Integration Service for which you want to enable object caching for passthrough security.

6.

Click the Properties view.

7.

Edit the pass-through security options.

The Edit Pass-through Security Properties dialog box appears.

8.

Select Allow Caching to allow data object caching for the SQL data service or web service. This applies
to all connections.

9.

Click OK.

You must recycle the Data Integration Service to enable caching for the connections.

Pass-through Security

123

CHAPTER 6

Data Integration Service Grid

This chapter includes the following topics:

Data Integration Service Grid Overview, 124

Before You Configure a Data Integration Service Grid, 126

Grid for SQL Data Services and Web Services, 126

Grid for Mappings, Profiles, and Workflows that Run in Local Mode, 132

Grid for Mappings, Profiles, and Workflows that Run in Remote Mode, 137

Grid and Content Management Service, 147

Maximum Number of Concurrent Jobs on a Grid, 148

Editing a Grid, 149

Deleting a Grid, 149

Troubleshooting a Grid, 149

Data Integration Service Grid Overview

If your license includes grid, you can configure the Data Integration Service to run on a grid. A grid is an alias
assigned to a group of nodes. When you run jobs on a Data Integration Service grid, you improve scalability
and performance by distributing jobs to processes running on multiple nodes in the grid.
To configure a Data Integration Service to run on a grid, you create a grid object and assign nodes to the
grid. Then, you assign the Data Integration Service to run on the grid.
When you enable a Data Integration Service assigned to a grid, a Data Integration Service process runs on
each node in the grid that has the service role. If a service process shuts down unexpectedly, the Data
Integration Service remains available as long as another service process runs on another node. Jobs can run
on each node in the grid that has the compute role. The Data Integration Service balances the workload
among the nodes based on the type of job and based on how the grid is configured.
When the Data Integration Service runs on a grid, the service and compute components of the Data
Integration Service can run on the same node or on different nodes, based on how you configure the grid and
the node roles. Nodes in a Data Integration Service grid can have a combination of the service only role, the
compute only role, and both the service and compute roles.

124

Grid Configuration by Job Type

A Data Integration Service that runs on a grid can run DTM instances in the Data Integration Service process,
in separate DTM processes on the local node, or in separate DTM processes on remote nodes. Configure the
service based on the types of jobs that the service runs.
Configure a Data Integration Service grid based on the following types of jobs that the service runs:
SQL data services and web services
When a Data Integration Service grid runs SQL queries and web service requests, configure the service
to run jobs in the Data Integration Service process. All nodes in the grid must have both the service and
compute roles. The Data Integration Service dispatches jobs to available nodes in a round-robin fashion.
SQL data service and web service jobs typically achieve better performance when the Data Integration
Service runs jobs in the service process.
Mappings, profiles, and workflows that run in local mode
When a Data Integration Service grid runs mappings, profiles, and workflows, you can configure the
service to run jobs in separate DTM processes on the local node. All nodes in the grid must have both
the service and compute roles. The Data Integration Service dispatches jobs to available nodes in a
round-robin fashion.
When the Data Integration Service runs jobs in separate local processes, stability increases because an
unexpected interruption to one job does not affect all other jobs.
Mappings, profiles, and workflows that run in remote mode
When a Data Integration Service grid runs mappings, profiles, and workflows, you can configure the
service to run jobs in separate DTM processes on remote nodes. The nodes in the grid can have a
different combination of roles. The Data Integration Service designates one node with the compute role
as the master compute node. The Service Manager on the master compute node communicates with the
Resource Manager Service to dispatch jobs to an available worker compute node. The Resource
Manager Service matches job requirements with resource availability to identify the best compute node
to run the job.
When the Data Integration Service runs jobs in separate remote processes, stability increases because
an unexpected interruption to one job does not affect all other jobs. In addition, you can better use the
resources available on each node in the grid. When a node has the compute role only, the node does not
have to run the service process. The machine uses all available processing power to run mappings.
Note: Ad hoc jobs, with the exception of profiles, can run in the Data Integration Service process or in
separate DTM processes on the local node. Ad hoc jobs include mappings run from the Developer tool or
previews, scorecards, or drill downs on profile results run from the Developer tool or Analyst tool. If you
configure a Data Integration Service grid to run jobs in separate remote processes, the service runs ad hoc
jobs in separate local processes.
By default, each Data Integration Service is configured to run jobs in separate local processes, and each
node has both the service and compute roles.
If you run SQL queries or web service requests, and you run other job types in which stability and scalability
is important, create multiple Data Integration Services. Configure one Data Integration Service grid to run
SQL queries and web service requests in the Data Integration Service process. Configure the other Data
Integration Service grid to run mappings, profiles, and workflows in separate local processes or in separate
remote processes.

Data Integration Service Grid Overview

125

Before You Configure a Data Integration Service Grid

Before you configure a Data Integration Service to run on a grid, complete the prerequisite tasks for a grid.

Define and Add Multiple Nodes to the Domain

Run the Informatica installer on each machine that you want to define as a node in the Data Integration
Service grid. The installer adds the node to the domain with both the service and compute roles enabled.
When you log in to the Administrator tool, the node appears in the Navigator.

Verify that All Grid Nodes are Homogeneous

All machines represented by nodes in a Data Integration Service grid must have homogeneous
environments. Verify that each machine meets the following requirements:

All machines must use the same operating system.

All machines must use the same locale settings.

All machines that represent nodes with the compute role or nodes with both the service and compute roles
must have installations of the native database client software associated with the databases that the Data
Integration Service accesses. For example, you run mappings that read from and write to an Oracle
database. You must install and configure the same version of the Oracle client on all nodes in the grid that
have the compute role and all nodes in the grid that have both the service and compute roles.
For more information about establishing native connectivity between the Data Integration Service and a
database, see Configure Native Connectivity on Service Machines on page 413.

Obtain an External HTTP Load Balancer for Web Service Requests

To run web service requests on a Data Integration Service grid, you must obtain and use an external HTTP
load balancer. If you do not use an external HTTP load balancer, web service requests are not distributed
across the nodes in the grid. Each web service request runs on the node that receives the request from the
web service client.

Grid for SQL Data Services and Web Services

When a Data Integration Service grid runs SQL queries and web service requests, configure the service to
run jobs in the Data Integration Service process. All nodes in the grid must have both the service and
compute roles.
When you enable a Data Integration Service that runs on a grid, one service process starts on each node
with the service role in the grid. The Data Integration Service designates one service process as the master
service process, and designates the remaining service processes as worker service processes. When a
worker service process starts, it registers itself with the master service process so that the master is aware of
the worker.
The master service process manages application deployments and logging. The worker service processes
run the SQL data service, web service, and preview jobs. The master service process also acts as a worker
service process and completes jobs.
The Data Integration Service balances the workload across the nodes in the grid based on the following job
types:

126

Chapter 6: Data Integration Service Grid

SQL data services

When you connect to an SQL data service from a third-party client tool to run queries against the
service, the Data Integration Service dispatches the connection directly to a worker service process. To
ensure faster throughput, the Data Integration Service bypasses the master service process. When you
establish multiple connections to SQL data services, the Data Integration Service uses round robin to
dispatch each connection to a worker service process. When you run multiple queries against the SQL
data service using the same connection, each query runs on the same worker service process.
Web services
When you submit a web service request, the Data Integration Service uses an external HTTP load
balancer to distribute the request to a worker service process. When you submit multiple requests
against web services, the Data Integration Service uses round robin to dispatch each query to a worker
service process.
To run web service requests on a grid, you must configure the external HTTP load balancer. Specify the
logical URL for the load balancer in the web service properties of the Data Integration Service. When you
configure the external load balancer, enter the URLs for all nodes in the grid that have both the service
and compute roles. If you do not configure an external HTTP load balancer, web service requests are
not distributed across the nodes in the grid. Each web service request runs on the node that receives the
request from the web service client.
Previews
When you preview a stored procedure output or virtual table data, the Data Integration Service uses
round robin to dispatch the first preview query directly to a worker service process. To ensure faster
throughput, the Data Integration Service bypasses the master service process. When you preview
additional objects from the same login, the Data Integration Service dispatches the preview queries to
the same worker service process.
Note: You can run mappings, profiles, and workflows on a Data Integration Service grid that is configured to
run jobs in the Data Integration Service process. However, you optimize stability for these job types when the
Data Integration Service grid is configured to run jobs in separate DTM processes.

Example Grid that Runs Jobs in the Service Process

In this example, the grid contains three nodes. All nodes have both the service and compute roles. The Data
Integration Service is configured to run jobs in the service process.
The following image shows an example Data Integration Service grid configured to run SQL data service,
web service, and preview jobs in the Data Integration Service process:

Grid for SQL Data Services and Web Services

127

The Data Integration Service manages requests and runs jobs on the following nodes in the grid:

On Node1, the master service process manages application deployment and logging. The master service
process also acts as a worker service process and completes jobs. The Data Integration Service
dispatches a preview request directly to the service process on Node1. The service process creates a
DTM instance to run the preview job. SQL data service and web service jobs can also run on Node1.

On Node2, the Data Integration Service dispatches SQL queries and web service requests directly to the
worker service process. The worker service process creates a separate DTM instance to run each job and
complete the request. Preview jobs can also run on Node2.

On Node3, the Data Integration Service dispatches two preview requests from a different user login than
the preview1 request directly to the worker service process. The worker service process creates a
separate DTM instance to run each preview job. SQL data service and web service jobs can also run on
Node3.

Rules and Guidelines for Grids that Run Jobs in the Service
Process
Consider the following rules and guidelines when you configure a Data Integration Service grid to run SQL
data service, web service, and preview jobs in the Data Integration Service process:

If the grid contains nodes with the compute role only, the Data Integration Service cannot start.

If the grid contains nodes with the service role only, jobs that are dispatched to the service process on the
node fail to run.

Configure environment variables for the Data Integration Service processes on the Processes view for
the service. The Data Integration Service ignores any environment variables configured on the Compute
view.

Configuring a Grid that Runs Jobs in the Service Process

When a Data Integration Service grid runs SQL queries against an SQL data service or runs web service
requests, configure the Data Integration Service to run jobs in the service process.
To configure a Data Integration Service grid to run SQL queries and web service requests, perform the
following tasks:

128

1.

Create a grid for SQL data service and web service jobs.

2.

Assign the Data Integration Service to the grid.

3.

Configure the Data Integration Service to run jobs in the service process.

4.

Configure load balancing for web services.

5.

Configure a shared log directory.

6.

Optionally, configure properties for each Data Integration Service process that runs on a node in the
grid.

7.

Optionally, configure compute properties for each DTM instance that can run on a node in the grid.

8.

Recycle the Data Integration Service.

Chapter 6: Data Integration Service Grid

Step 1. Create a Grid

To create a grid, create the grid object and assign nodes to the grid. You can assign a node to more than one
grid when the Data Integration Service is configured to run jobs in the service process or in separate local
processes.
When a Data Integration Service grid runs SQL queries or web service requests, all nodes in the grid must
have both the service and compute roles. When you assign nodes to the grid, select nodes that have both
roles.
1.

In the Administrator tool, click the Manage tab.

2.

Click the Services and Nodes view.

3.

In the Domain Navigator, select the domain.

4.

On the Navigator Actions menu, click New > Grid.

The Create Grid dialog box appears.

5.

Enter the following properties:

Property

Description

Name

Name of the grid. The name is not case sensitive and must be unique within the domain. It
cannot exceed 128 characters or begin with @. It also cannot contain spaces or the following
special characters:
`~%^*+={}\;:'"/?.,<>|!()][

Description

Description of the grid. The description cannot exceed 765 characters.

Nodes

Select nodes to assign to the grid.

Path

Location in the Navigator, such as:

DomainName/ProductionGrids

6.

Click OK.

Step 2. Assign the Data Integration Service to the Grid

Assign the Data Integration Service to run on the grid.
1.

On the Services and Nodes view, select the Data Integration Service in the Domain Navigator.

2.

Select the Properties tab.

Grid for SQL Data Services and Web Services

129

3.

In the General Properties section, click Edit.

The Edit General Properties dialog box appears.

4.

Next to Assign, select Grid.

5.

Select the grid to assign to the Data Integration Service.

6.

Click OK.

Step 3. Run Jobs in the Service Process

Configure the Data Integration Service to run jobs in the service process.
1.

On the Services and Nodes view, select the Data Integration Service in the Domain Navigator.

2.

Select the Properties tab.

3.

In the Execution Options section, click Edit.

The Edit Execution Options dialog box appears.

4.

For the Launch Job Options property, select In the service process.

5.

Click OK.

Step 4. Configure Load Balancing for Web Services

To run web service requests on a grid, you must configure an external HTTP load balancer. If you do not
configure an external HTTP load balancer, the Data Integration Service runs the web service on the node that
receives the request.
To configure load balancing, specify the logical URL for the load balancer in the Data Integration Service
properties. Then, configure the external load balancer to distribute web service requests to all nodes in the
grid that have both the service and compute roles.
1.

Complete the following steps in the Administrator tool to configure the Data Integration Service to
communicate with the external HTTP load balancer:
a.

On the Services and Nodes view, select the Data Integration Service in the Domain Navigator.

b.

Select the Properties tab.

c.

In the Web Service Properties section, click Edit.

The Edit Web Service Properties window appears.

d.
2.

Enter the logical URL for the external HTTP load balancer, and then click OK.

Configure the external load balancer to distribute requests to all nodes in the grid that have both the
service and compute roles.

Step 5. Configure a Shared Log Directory

When the Data Integration Service runs on a grid, a Data Integration Service process can run on each node
with the service role. Configure each service process to use the same shared directory for log files. When
you configure a shared log directory, you ensure that if the master service process fails over to another node,
the new master service process can access previous log files.

130

1.

On the Services and Nodes view, select the Data Integration Service in the Domain Navigator.

2.

Select the Processes tab.

3.

Select a node to configure the shared log directory for that node.

4.

In the Logging Options section, click Edit.

Chapter 6: Data Integration Service Grid

The Edit Logging Options dialog box appears.

5.

Enter the location to the shared log directory.

6.

Click OK.

7.

Repeat the steps for each node listed in the Processes tab to configure each service process with
identical absolute paths to the shared directories.

Related Topics:

Log Directory on page 93

Step 6. Optionally Configure Process Properties

Optionally, configure the Data Integration Service process properties for each node with the service role in
the grid. You can configure the service process properties differently for each node.
To configure properties for the Data Integration Service processes, click the Processes view. Select a node
with the service role to configure properties specific to that node.

Related Topics:

Data Integration Service Process Properties on page 67

Step 7. Optionally Configure Compute Properties

You can configure the compute properties that the execution Data Transformation Manager (DTM) uses when
it runs jobs. When the Data Integration Service runs on a grid, DTM processes run jobs on each node with
the compute role. You can configure the compute properties differently for each node.
To configure compute properties for the DTM, click the Compute view. Select a node with the compute role
to configure properties specific to DTM instances that run on the node. For example, you can configure a
different temporary directory for each node.
When a Data Integration Service grid runs jobs in the Data Integration Service process, you can configure the
execution options on the Compute view. If you configure environment variables on the Compute view, they
are ignored.

Related Topics:

Data Integration Service Compute Properties on page 70

Step 8. Recycle the Data Integration Service

After you change Data Integration Service properties, you must recycle the service for the changed
properties to take effect.
To recycle the service, select the service in the Domain Navigator and click Recycle the Service.

Grid for SQL Data Services and Web Services

131

Grid for Mappings, Profiles, and Workflows that Run

in Local Mode
When a Data Integration Service grid runs mappings, profiles, and workflows, you can configure the service
to run jobs in separate DTM processes on the local node. All nodes in the grid must have both the service
and compute roles.
When you enable a Data Integration Service that runs on a grid, one service process starts on each node
with the service role in the grid. The Data Integration Service designates one service process as the master
service process, and designates the remaining service processes as worker service processes. When a
worker service process starts, it registers itself with the master service process so that the master is aware of
the worker.
The master service process manages application deployments, logging, job requests, and the dispatch of
mappings to worker service processes. The worker service processes optimize and compile mapping and
preview jobs. The worker service processes create separate DTM processes to run jobs. The master service
process also acts as a worker service process and runs jobs.
The Data Integration Service balances the workload across the nodes in the grid based on the following job
types:
Workflows
When you run a workflow instance, the master service process runs the workflow instance and nonmapping tasks. The master service process uses round robin to dispatch each mapping within a Mapping
task to a worker service process. The worker service process optimizes and compiles the mapping. The
worker service process then creates a DTM instance within a separate DTM process to run the mapping.
Deployed mappings
When you run a deployed mapping, the master service process uses round robin to dispatch each
mapping to a worker service process. The worker service process optimizes and compiles the mapping.
The worker service process then creates a DTM instance within a separate DTM process to run the
mapping.
Profiles
When you run a profile, the master service process converts the profiling job into multiple mapping jobs
based on the advanced profiling properties of the Data Integration Service. The master service process
then uses round robin to dispatch the mappings across the worker service processes. The worker
service process optimizes and compiles the mapping. The worker service process then creates a DTM
instance within a separate DTM process to run the mapping.
Ad hoc jobs, with the exception of profiles
When you run ad hoc jobs, with the exception of profiles, the Data Integration Service uses round robin
to dispatch the first request directly to a worker service process. Ad hoc jobs include mappings run from
the Developer tool or previews, scorecards, or drill downs on profile results run from the Developer tool
or Analyst tool. To ensure faster throughput, the Data Integration Service bypasses the master service
process. The worker service process creates a DTM instance within a separate DTM process to run the
job. When you run additional ad hoc jobs from the same login, the Data Integration Service dispatches
the requests to the same worker service process.
Note: Informatica does not recommend running SQL queries or web service requests on a Data Integration
Service grid that is configured to run jobs in separate local processes. SQL data service and web service jobs
typically achieve better performance when the Data Integration Service runs jobs in the service process. For
web service requests, you must configure the external HTTP load balancer to distribute requests to nodes
that have both the service and compute roles.

132

Chapter 6: Data Integration Service Grid

Example Grid that Runs Jobs in Local Mode

In this example, the grid contains three nodes. All nodes have both the service and compute roles. The Data
Integration Service is configured to run jobs in separate local processes.
The following image shows an example Data Integration Service grid configured to run mapping, profile,
workflow, and ad hoc jobs in separate local processes:

The Data Integration Service manages requests and runs jobs on the following nodes in the grid:

On Node1, the master service process runs the workflow instance and non-mapping tasks. The master
service process dispatches mappings included in Mapping tasks from workflow1 to the worker service
processes on Node2 and Node3. The master service process also acts as a worker service process and
completes jobs. The Data Integration Service dispatches a preview request directly to the service process
on Node1. The service process creates a DTM instance within a separate DTM process to run the preview
job. Mapping and profile jobs can also run on Node1.

On Node2, the worker service process creates a DTM instance within a separate DTM process to run
mapping1 from workflow1. Ad hoc jobs can also run on Node2.

On Node3, the worker service process creates a DTM instance within a separate DTM process to run
mapping2 from workflow1. Ad hoc jobs can also run on Node3.

Rules and Guidelines for Grids that Run Jobs in Local Mode
Consider the following rules and guidelines when you configure a Data Integration Service grid to run jobs in
separate local processes:

If the grid contains nodes with the compute role only, the Data Integration Service cannot start.

If the grid contains nodes with the service role only, jobs that are dispatched to the service process on the
node fail to run.

Configure environment variables for the Data Integration Service processes on the Processes view for
the service. The Data Integration Service ignores any environment variables configured on the Compute
view.

Grid for Mappings, Profiles, and Workflows that Run in Local Mode

133

Configuring a Grid that Runs Jobs in Local Mode

When a Data Integration Service grid runs mappings, profiles, and workflows, you can configure the Data
Integration Service to run jobs in separate DTM processes on local nodes.
To configure a Data Integration Service grid to run mappings, profiles, and workflows in separate local
processes, perform the following tasks:
1.

Create a grid for mappings, profiles, and workflows that run in separate local processes.

2.

Assign the Data Integration Service to the grid.

3.

Configure the Data Integration Service to run jobs in separate local processes.

4.

Configure a shared log directory.

5.

Optionally, configure properties for each Data Integration Service process that runs on a node in the
grid.

6.

Optionally, configure compute properties for each DTM instance that can run on a node in the grid.

7.

Recycle the Data Integration Service.

Step 1. Create a Grid

To create a grid, create the grid object and assign nodes to the grid. You can assign a node to more than one
grid when the Data Integration Service is configured to run jobs in the service process or in separate local
processes.
When a Data Integration Service grid runs mappings, profiles, and workflows in separate local processes, all
nodes in the grid must have both the service and compute roles. When you assign nodes to the grid, select
nodes that have both roles.
1.

In the Administrator tool, click the Manage tab.

2.

Click the Services and Nodes view.

3.

In the Domain Navigator, select the domain.

4.

On the Navigator Actions menu, click New > Grid.

The Create Grid dialog box appears.

134

Chapter 6: Data Integration Service Grid

5.

Enter the following properties:

Property

Description

Name

Name of the grid. The name is not case sensitive and must be unique within the domain. It
cannot exceed 128 characters or begin with @. It also cannot contain spaces or the following
special characters:
`~%^*+={}\;:'"/?.,<>|!()][

Description

Description of the grid. The description cannot exceed 765 characters.

Nodes

Select nodes to assign to the grid.

Path

Location in the Navigator, such as:

DomainName/ProductionGrids

6.

Click OK.

Step 2. Assign the Data Integration Service to the Grid

Assign the Data Integration Service to run on the grid.
1.

On the Services and Nodes view, select the Data Integration Service in the Domain Navigator.

2.

Select the Properties tab.

3.

In the General Properties section, click Edit.

The Edit General Properties dialog box appears.

4.

Next to Assign, select Grid.

5.

Select the grid to assign to the Data Integration Service.

6.

Click OK.

Step 3. Run Jobs in Separate Local Processes

Configure the Data Integration Service to run jobs in separate local processes.
1.

On the Services and Nodes view, select the Data Integration Service in the Domain Navigator.

2.

Select the Properties tab.

3.

In the Execution Options section, click Edit.

The Edit Execution Options dialog box appears.

4.

For the Launch Job Options property, select In separate local processes.

5.

Click OK.

Step 4. Configure a Shared Log Directory

When the Data Integration Service runs on a grid, a Data Integration Service process can run on each node
with the service role. Configure each service process to use the same shared directory for log files. When
you configure a shared log directory, you ensure that if the master service process fails over to another node,
the new master service process can access previous log files.
1.

On the Services and Nodes view, select the Data Integration Service in the Domain Navigator.

Grid for Mappings, Profiles, and Workflows that Run in Local Mode

135

2.

Select the Processes tab.

3.

Select a node to configure the shared log directory for that node.

4.

In the Logging Options section, click Edit.

The Edit Logging Options dialog box appears.

5.

Enter the location to the shared log directory.

6.

Click OK.

7.

Repeat the steps for each node listed in the Processes tab to configure each service process with
identical absolute paths to the shared directories.

Related Topics:

Log Directory on page 93

Step 5. Optionally Configure Process Properties

Optionally, configure the Data Integration Service process properties for each node with the service role in
the grid. You can configure the service process properties differently for each node.
To configure properties for the Data Integration Service processes, click the Processes view. Select a node
with the service role to configure properties specific to that node.

Related Topics:

Data Integration Service Process Properties on page 67

Step 6. Optionally Configure Compute Properties

You can configure the compute properties that the execution Data Transformation Manager (DTM) uses when
it runs jobs. When the Data Integration Service runs on a grid, DTM processes run jobs on each node with
the compute role. You can configure the compute properties differently for each node.
To configure compute properties for the DTM, click the Compute view. Select a node with the compute role
to configure properties specific to DTM instances that run on the node. For example, you can configure a
different temporary directory for each node.
When a Data Integration Service grid runs jobs in separate local processes, you can configure the execution
options on the Compute view. If you configure environment variables on the Compute view, they are
ignored.

Related Topics:

Data Integration Service Compute Properties on page 70

Step 7. Recycle the Data Integration Service

After you change Data Integration Service properties, you must recycle the service for the changed
properties to take effect.
To recycle the service, select the service in the Domain Navigator and click Recycle the Service.

136

Chapter 6: Data Integration Service Grid

Grid for Mappings, Profiles, and Workflows that Run

in Remote Mode
When a Data Integration Service grid runs mappings, profiles, and workflows, you can configure the service
to run jobs in separate DTM processes on remote nodes. The nodes in the grid can have a different
combination of roles.
A Data Integration Service grid uses the following components to run jobs in separate remote processes:
Master service process
When you enable a Data Integration Service that runs on a grid, one service process starts on each
node with the service role in the grid. The Data Integration Service designates one service process as
the master service process. The master service process manages application deployments, logging, job
requests, and the dispatch of mappings to worker service processes for optimization and compilation.
The master service process also acts as a worker service process and can optimize and compile
mappings.
Worker service processes
The Data Integration Service designates the remaining service processes as worker service processes.
When a worker service process starts, it registers itself with the master service process so that the
master is aware of the worker. A worker service process optimizes and compiles mappings, and then
generates a grid task. A grid task is a job request sent by the worker service process to the Service
Manager on the master compute node.
Service Manager on the master compute node
When you enable a Data Integration Service that runs on a grid, the Data Integration Service designates
one node with the compute role as the master compute node.
The Service Manager on the master compute node performs the following functions to determine the
optimal worker compute node to run the mapping:

Communicates with the Resource Manager Service to manage the grid of available compute nodes.
When the Service Manager on a node with the compute role starts, the Service Manager registers the
node with the Resource Manager Service.

Orchestrates worker service process requests and dispatches mappings to worker compute nodes.

The master compute node also acts as a worker compute node and can run mappings.
DTM processes on worker compute nodes
The Data Integration Service designates the remaining nodes with the compute role as worker compute
nodes. The Service Manager on a worker compute node runs mappings in separate DTM processes
started within containers.

Supported Node Roles

When a Data Integration Service grid runs jobs in separate remote processes, the nodes in the grid can
contain the service role only, the compute role only, or both the service and compute roles.
A Data Integration Service grid that runs jobs in separate remote processes can contain nodes with the
following roles:

Grid for Mappings, Profiles, and Workflows that Run in Remote Mode

137

Service role
A Data Integration Service process runs on each node with the service role. Service components within
the Data Integration Service process run workflows and profiles, and perform mapping optimization and
compilation.
Compute role
DTM processes run on each node with the compute role. The DTM processes run deployed mappings,
mappings run by Mapping tasks within a workflow, and mappings converted from a profile.
Both service and compute roles
A Data Integration Service process and DTM processes run on each node with both the service and
compute roles. At least one node with both service and compute roles is required to run ad hoc jobs, with
the exception of profiles. Ad hoc jobs include mappings run from the Developer tool or previews,
scorecards, or drill downs on profile results run from the Developer tool or Analyst tool. The Data
Integration Service runs these job types in separate DTM processes on the local node.
In addition, nodes with both roles can complete all of the tasks that a node with the service role only or a
node with the compute role only can complete. For example, a workflow can run on a node with the
service role only or on a node with both the service and compute roles. A deployed mapping can run on
a node with the compute role only or on a node with both the service and compute roles.
The following table lists the job types that run on nodes based on the node role:
Job Type

Service Role

Compute Role

Service and
Compute Roles

Perform mapping optimization and compilation.

Yes

Yes

Run deployed mappings.

Yes

Yes

Run workflows.

Yes

Yes

Run mappings included in workflow Mapping tasks.

Yes

Yes

Run profiles.

Yes

Yes

Run mappings converted from profiles.

Yes

Yes

Run ad hoc jobs, with the exception of profiles, from

the Analyst tool or the Developer tool.

Yes

Note: If you associate a Content Management Service with the Data Integration Service to run mappings that
read reference data, each node in the grid must have both the service and compute roles.

Job Types
When a Data Integration Service grid runs jobs in separate remote processes, how the Data Integration
Service runs each job depends on the job type.
The Data Integration Service balances the workload across the nodes in the grid based on the following job
types:
Workflows
When you run a workflow instance, the master service process runs the workflow instance and nonmapping tasks. The master service process uses round robin to dispatch each mapping within a Mapping

138

Chapter 6: Data Integration Service Grid

task to a worker service process. The LDTM component of the worker service process optimizes and
compiles the mapping. The worker service process then communicates with the master compute node to
dispatch the compiled mapping to a separate DTM process running on a worker compute node.
Deployed mappings
When you run a deployed mapping, the master service process uses round robin to dispatch each
mapping to a worker service process. The LDTM component of the worker service process optimizes
and compiles the mapping. The worker service process then communicates with the master compute
node to dispatch the compiled mapping to a separate DTM process running on a worker compute node.
Profiles
When you run a profile, the master service process converts the profiling job into multiple mapping jobs
based on the advanced profiling properties of the Data Integration Service. The master service process
then distributes the mappings across the worker service processes. The LDTM component of the worker
service process optimizes and compiles the mapping. The worker service process then communicates
with the master compute node to dispatch the compiled mapping to a separate DTM process running on
a worker compute node.
Ad hoc jobs, with the exception of profiles
When you run an ad hoc job, with the exception of profiles, the Data Integration Service uses round robin
to dispatch the first request directly to a worker service process that runs on a node with both the service
and compute roles. The worker service process runs the job in a separate DTM process on the local
node. To ensure faster throughput, the Data Integration Service bypasses the master service process.
When you run additional ad hoc jobs from the same login, the Data Integration Service dispatches the
requests to the same worker service process.
Note: Informatica does not recommend running SQL queries or web service requests on a Data Integration
Service grid that is configured to run jobs in separate remote processes. SQL data service and web service
jobs typically achieve better performance when the Data Integration Service runs jobs in the service process.
If you do run SQL queries and web service requests on a Data Integration Service grid configured to run jobs
in separate remote processes, these job types run on the nodes in the grid with both the service and compute
roles. The Data Integration Service runs these job types in separate DTM processes on the local node. For
web service requests, you must configure the external HTTP load balancer to distribute requests to nodes
that have both the service and compute roles.

Grid for Mappings, Profiles, and Workflows that Run in Remote Mode

139

Example Grid that Runs Jobs in Remote Mode

In this example, the grid contains three nodes. Node1 has the service role only. Node2 has both the service
and compute roles. Node3 has the compute role only. The Data Integration Service is configured to run jobs
in separate remote processes.
The following image shows an example Data Integration Service grid configured to run mapping, profile,
workflow, and ad hoc jobs in separate remote processes:

The Data Integration Service manages requests and runs jobs on the following nodes in the grid:

On Node1, the master service process runs the workflow instance and non-mapping tasks. The master
service process dispatches a mapping included in a Mapping task from workflow1 to the worker service
process on Node2. The master service process also acts as a worker service process and can optimize
and compile mappings. Profile jobs can also run on Node1.

On Node2, the worker service process optimizes and compiles the mapping. The worker service process
then communicates with the master compute node on Node3 to dispatch the compiled mapping to a
worker compute node. The Data Integration Service dispatches a preview request directly to the worker
service process on Node2. The service process creates a DTM instance within a separate DTM process
on Node2 to run the preview job. Node2 also serves as a worker compute node and can run compiled
mappings.

On Node3, the Service Manager on the master compute node orchestrates requests to run mappings. The
master compute node also acts as a worker compute node and runs the mapping from workflow1 in a
separate DTM process started within a container.

Rules and Guidelines for Grids that Run Jobs in Remote Mode
Consider the following rules and guidelines when you configure a Data Integration Service grid to run jobs in
separate remote processes:

140

The grid must contain at least one node with both the service and compute roles to run an ad hoc job, with
the exception of profiles. The Data Integration Service runs these job types in a separate DTM process on
the local node. Add additional nodes with both the service and compute roles so that these job types can
be distributed to service processes running on other nodes in the grid.

To support failover for the Data Integration Service, the grid must contain at least two nodes that have the
service role.

If you associate a Content Management Service with the Data Integration Service to run mappings that
read reference data, each node in the grid must have both the service and compute roles.

The grid cannot include two nodes that are defined on the same host machine.

Chapter 6: Data Integration Service Grid

Informatica does not recommend assigning multiple Data Integration Services to the same grid nor
assigning one node to multiple Data Integration Service grids.
If a worker compute node is shared across multiple grids, mappings dispatched to the node might fail due
to an over allocation of the node's resources. If a master compute node is shared across multiple grids,
the log events for the master compute node are also shared and might become difficult to troubleshoot.

Recycle the Service When Jobs Run in Remote Mode

You must recycle the Data Integration Service if you change a service property or if you update the role for a
node assigned to the service or to the grid on which the service runs. You must recycle the service for
additional reasons when the service is on a grid and is configured to run jobs in separate remote processes.
When a Data Integration Service grid runs jobs in separate remote processes, recycle the Data Integration
Service after you complete the following actions:

Override compute node attributes for a node assigned to the grid.

Add or remove a node from the grid.

Shut down or restart a node assigned to the grid.

To recycle the Data Integration Service, select the service in the Domain Navigator and click Recycle the
Service.

Configuring a Grid that Runs Jobs in Remote Mode

When a Data Integration Service grid runs mappings, profiles, and workflows, you can configure the Data
Integration Service to run jobs in separate DTM processes on remote nodes.
To configure a Data Integration Service grid to run mappings, profiles, and workflows in separate remote
processes, perform the following tasks:
1.

Update the roles for the nodes in the grid.

2.

Create a grid for mappings, profiles, and workflows that run in separate remote processes.

3.

Assign the Data Integration Service to the grid.

4.

Configure the Data Integration Service to run jobs in separate remote processes.

5.

Enable the Resource Manager Service.

6.

Configure a shared log directory.

7.

Optionally, configure properties for each Data Integration Service process that runs on a node with the
service role.

8.

Optionally, configure compute properties for each DTM instance that can run on a node with the compute
role.

9.

Recycle the Data Integration Service.

Step 1. Update Node Roles

By default, each node has both the service and compute roles. You can update the roles of each node that
you plan to add to the grid. Enable only the service role to dedicate a node to running the Data Integration
Service process. Enable only the compute role to dedicate a node to running mappings.
At least one node in the grid must have both the service and compute roles to run ad hoc jobs, with the
exception of profiles.

Grid for Mappings, Profiles, and Workflows that Run in Remote Mode

141

Note: Before you can disable the service role on a node, you must shut down all application service
processes running on the node and remove the node as a primary or back-up node for any application
service. You cannot disable the service role on a gateway node.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select a node that you plan to add to the grid.

3.

In the Properties view, click Edit for the general properties.

The Edit General Properties dialog box appears.

4.

Select or clear the service and compute roles to update the node role.

5.

Click OK.

6.

If you disabled the compute role, the Disable Compute Role dialog box appears. Perform the following
steps:
a.

b.
7.

Select one of the following modes to disable the compute role:

Complete. Allows jobs to run to completion before disabling the role.

Stop. Stops all jobs and then disables the role.

Abort. Tries to stop all jobs before aborting them and disabling the role.

Click OK.

Repeat the steps to update the node role for each node that you plan to add to the grid.

Step 2. Create a Grid

To create a grid, create the grid object and assign nodes to the grid. You can assign a node to one grid when
the Data Integration Service is configured to run jobs in separate remote processes.
When a Data Integration Service grid runs mappings, profiles, and workflows in separate remote processes,
the grid can include the following nodes:

Any number of nodes with the service role only.

Any number of nodes with the compute role only.

At least one node with both the service and compute roles to run previews and to run ad hoc jobs, with the
exception of profiles.

If you associate a Content Management Service with the Data Integration Service to run mappings that read
reference data, each node in the grid must have both the service and compute roles.

142

1.

In the Administrator tool, click the Manage tab.

2.

Click the Services and Nodes view.

3.

In the Domain Navigator, select the domain.

Chapter 6: Data Integration Service Grid

4.

On the Navigator Actions menu, click New > Grid.

The Create Grid dialog box appears.

5.

Enter the following properties:

Property

Description

Name

Name of the grid. The name is not case sensitive and must be unique within the domain. It
cannot exceed 128 characters or begin with @. It also cannot contain spaces or the following
special characters:
`~%^*+={}\;:'"/?.,<>|!()][

Description

Description of the grid. The description cannot exceed 765 characters.

Nodes

Select nodes to assign to the grid.

Path

Location in the Navigator, such as:

DomainName/ProductionGrids

6.

Click OK.

Step 3. Assign the Data Integration Service to the Grid

Assign the Data Integration Service to run on the grid.
1.

On the Services and Nodes view, select the Data Integration Service in the Domain Navigator.

2.

Select the Properties tab.

3.

In the General Properties section, click Edit.

The Edit General Properties dialog box appears.

4.

Next to Assign, select Grid.

5.

Select the grid to assign to the Data Integration Service.

6.

Click OK.

Step 4. Run Jobs in Separate Remote Processes

Configure the Data Integration Service to run jobs in separate remote processes.
1.

On the Services and Nodes view, select the Data Integration Service in the Domain Navigator.

2.

Select the Properties tab.

3.

In the Execution Options section, click Edit.

The Edit Execution Options dialog box appears.

4.

For the Launch Job Options property, select In separate remote processes.

5.

Click OK.

Step 5. Enable the Resource Manager Service

By default, the Resource Manager Service is disabled. You must enable the Resource Manager Service so
that the Data Integration Service grid can run jobs in separate remote processes.
1.

On the Services and Nodes view, expand the System_Services folder.

Grid for Mappings, Profiles, and Workflows that Run in Remote Mode

143

2.

Select the Resource Manager Service in the Domain Navigator, and click Recycle the Service.

Step 6. Configure a Shared Log Directory

When the Data Integration Service runs on a grid, a Data Integration Service process can run on each node
with the service role. Configure each service process to use the same shared directory for log files. When
you configure a shared log directory, you ensure that if the master service process fails over to another node,
the new master service process can access previous log files.
1.

On the Services and Nodes view, select the Data Integration Service in the Domain Navigator.

2.

Select the Processes tab.

3.

Select a node to configure the shared log directory for that node.

4.

In the Logging Options section, click Edit.

The Edit Logging Options dialog box appears.

5.

Enter the location to the shared log directory.

6.

Click OK.

7.

Repeat the steps for each node listed in the Processes tab to configure each service process with
identical absolute paths to the shared directories.

Related Topics:

Log Directory on page 93

Step 7. Optionally Configure Process Properties

Optionally, configure the Data Integration Service process properties for each node with the service role in
the grid. You can configure the service process properties differently for each node.
To configure properties for the Data Integration Service processes, click the Processes view. Select a node
with the service role to configure properties specific to that node.

Related Topics:

Data Integration Service Process Properties on page 67

Step 8. Optionally Configure Compute Properties

You can configure the compute properties that the execution Data Transformation Manager (DTM) uses when
it runs jobs. When the Data Integration Service runs on a grid, DTM processes run jobs on each node with
the compute role. You can configure the compute properties differently for each node.
To configure compute properties for the DTM, click the Compute view. Select a node with the compute role
to configure properties specific to DTM processes that run on the node. For example, you can configure a
different temporary directory or different environment variable values for each node.

144

Chapter 6: Data Integration Service Grid

Related Topics:

Data Integration Service Compute Properties on page 70

Step 9. Recycle the Data Integration Service

After you change Data Integration Service properties, you must recycle the service for the changed
properties to take effect.
To recycle the service, select the service in the Domain Navigator and click Recycle the Service.

Logs for Jobs that Run in Remote Mode

When a Data Integration Service grid runs a mapping in a separate remote process, the worker service
process that optimizes and compiles the mapping writes log events to one log file. The DTM process that
runs the mapping writes log events to another log file. When you access the mapping log, the Data
Integration Service consolidates the two files into a single log file.
The worker service process writes to a log file in the shared log directory configured for each Data Integration
Service process. The DTM process writes to a temporary log file in the log directory configured for the worker
compute node. When the DTM process finishes running the mapping, it sends the log file to the master Data
Integration Service process. The master service process writes the DTM log file to the shared log directory
configured for the Data Integration Service processes. The DTM process then removes the temporary DTM
log file from the worker compute node.
When you access the mapping log using the Administrator tool or the infacmd ms getRequestLog command,
the Data Integration Service consolidates the two files into a single log file.
The consolidated log file contains the following types of messages:
LDTM messages written by the worker service process on the service node
The first section of the mapping log contains LDTM messages about mapping optimization and
compilation and about generating the grid task written by the worker service process on the service
node.
The grid task messages include the following message that indicates the location of the log file written by
the DTM process on the worker compute node:
INFO: [GCL_5] The grid task [gtid-1443479776986-1-79777626-99] cluster logs can be
found at [./1443479776986/taskletlogs/gtid-1443479776986-1-79777626-99].
The listed directory is a subdirectory of the following default log directory configured for the worker
compute node:
<Informatica installation directory>/logs/<node name>/dtmLogs/
DTM messages written by the DTM process on the compute node
The second section of the mapping log contains messages about mapping execution written by the DTM
process on the worker compute node.
The DTM section of the log begins with the following lines which indicate the name of the worker
compute node that ran the mapping:
###
### <MyWorkerComputeNodeName>
###
### Start Grid Task [gtid-1443479776986-1-79777626-99] Segment [s0] Tasklet [t-0]
Attempt [1]

Grid for Mappings, Profiles, and Workflows that Run in Remote Mode

145

The DTM section of the log concludes with the following line:
### End Grid Task [gtid-1443479776986-1-79777626-99] Segment [s0] Tasklet [t-0]
Attempt [1]

Override Compute Node Attributes to Increase Concurrent Jobs

You can override compute node attributes to increase the number of concurrent jobs that run on the node.
You can override the maximum number of cores and the maximum amount of memory that the Resource
Manager Service can allocate for jobs that run on the compute node. The default values are the actual
number of cores and memory available on the machine.
When the Data Integration Service runs jobs in separate remote processes, by default a machine that
represents a compute node requires at least five cores and 2.5 GB of memory to initialize a container to start
a DTM process. If any compute node assigned to the grid has fewer than five cores, then that number is used
as the minimum number of cores required to initialize a container. For example, if a compute node assigned
to the grid has three cores, then each compute node in that grid requires at least three cores and 2.5 GB of
memory to initialize a container.
You might want to override compute node attributes to increase the number of concurrent jobs when the
following conditions are true:

You run long-running jobs on the grid.

The Data Integration Service cannot reuse DTM processes because you run jobs from different deployed
applications.

Job concurrency is more important than the job execution time.

For example, you have configured a Data Integration Service grid that contains a single compute node. You
want to concurrently run two mappings from different applications. Because the mappings are in different
applications, the Data Integration Service runs the mappings in separate DTM processes, which requires two
containers. The machine that represents the compute node has four cores. Only one container can be
initialized, and so the two mappings cannot run concurrently. You can override the compute node attributes
to specify that the Resource Manager Service can allocate eight cores for jobs that run on the compute node.
Then, two DTM processes can run at the same time and the two mappings can run concurrently.
Use caution when you override compute node attributes. Specify values that are close to the actual resources
available on the machine so that you do not overload the machine. Configure the values such that the
memory requirements for the total number of concurrent mappings do not exceed the actual resources. A
mapping that runs in one thread requires one core. A mapping can use the amount of memory configured in
the Maximum Memory Per Request property for the Data Integration Service modules.
To override compute node attributes, run the infacmd rms SetComputeNodeAttributes command for a
specified node.

146

Chapter 6: Data Integration Service Grid

You can override the following options:

Option

Argument

Description

-MaxCores

max_number_of_cores_to_allocate

Optional. Maximum number of cores that the Resource

Manager Service can allocate for jobs that run on the
compute node. A compute node requires at least five
available cores to initialize a container to start a DTM
process. If any compute node assigned to the grid has fewer
than five cores, then that number is used as the minimum
number of cores required to initialize a container.

-mc

By default, the maximum number of cores is the actual

number of cores available on the machine.
-MaxMem
-mm

max_memory_in_mb_to_allocate

Optional. Maximum amount of memory in megabytes that the

Resource Manager Service can allocate for jobs that run on
the compute node. A compute node requires at least 2.5 GB
of memory to initialize a container to start a DTM process.
By default, the maximum memory is the actual memory
available on the machine.

After you override compute node attributes, you must recycle the Data Integration Service for the changes to
take effect. To reset an option to its default value, specify -1 as the value.

Grid and Content Management Service

You must associate a Content Management Service with a Data Integration Service to run mappings that
read reference data. To associate a Content Management Service with a Data Integration Service that runs
on a grid, you must create and configure multiple Content Management Services and multiple Data
Integration Services.
To associate a Content Management Service with a Data Integration Service that runs on a grid, perform the
following tasks:
1.

Create a grid where each node in the grid includes both the service and compute roles.

2.

Create a Data Integration Service and assign the service to run on the grid. Configure the Data
Integration Service to run jobs in separate local or remote processes.

3.

Create a Content Management Service and a new Data Integration Service to run on each node in the
grid.

4.

Associate each Content Management Service with the Data Integration Service that runs on the same
node.

5.

Associate each Content Management Service and Data Integration Service with the same Model
Repository Service that the Data Integration Service on grid is associated with.
The Content Management Service provides reference data information to all Data Integration Service
processes that run on the same node and that are associated with the same Model Repository Service.

Grid and Content Management Service

147

The following image shows an example domain that contains three nodes. A total of three Data Integration
Services, two Content Management Services, and one Model Repository Service exist in the domain:

The following services run in the domain:

A Data Integration Service named DIS_grid. DIS_grid is assigned to run on the grid. A DIS_grid process
runs on each node in the grid. When you run a job on the grid, the DIS_grid processes run the job.

A Data Integration Service named DIS1 and a Content Management Service named CMS1 assigned to
run on Node1. CMS1 is associated with DIS1.

A Data Integration Service named DIS2 and a Content Management Service named CMS2 assigned to
run on Node2. CMS2 is associated with DIS2.

A Model Repository Service named MRS1 assigned to run on Node3. Each Data Integration Service and
Content Management Service in the domain is associated with MRS1. In this example, the Model
Repository Service runs on a node outside of the Data Integration Service grid. However, the Model
Repository Service can run on any node in the domain.

Maximum Number of Concurrent Jobs on a Grid

You can increase the maximum number of concurrent jobs that a Data Integration Service grid can run.
The Maximum Execution Pool Size property on the Data Integration Service determines the maximum
number of jobs that each Data Integration Service process can run concurrently. Jobs include data previews,
mappings, profiling jobs, SQL queries, and web service requests. The default value is 10.
When the Data Integration Service runs on a grid, the maximum number of jobs that can run concurrently
across the grid is calculated as follows:
Maximum Execution Pool Size * Number of running service processes
For example, a Data Integration Service grid includes three running service processes. If you set the value to
10, each Data Integration Service process can run up to 10 jobs concurrently. A total of 30 jobs can run
concurrently on the grid.

148

Chapter 6: Data Integration Service Grid

When you increase the pool size value, the Data Integration Service uses more hardware resources such as
CPU, memory, and system I/O. Set this value based on the resources available on the nodes in the grid. For
example, consider the number of CPUs on the machines where Data Integration Service processes run and
the amount of memory that is available to the Data Integration Service.
Note: If the Data Integration Service grid runs jobs in separate remote processes, additional concurrent jobs
might not run on compute nodes after you increase the value of this property. You might need to override
compute node attributes to increase the number of concurrent jobs on each compute node. For more
information, see Override Compute Node Attributes to Increase Concurrent Jobs on page 146.

Editing a Grid
You can edit a grid to change the description, add nodes to the grid, or remove nodes from the grid.
Before you remove a node from the grid, disable the Data Integration Service process running on the node.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

Select the grid in the Domain Navigator.

3.

To edit the grid, click Edit in the Grid Details section.

You can change the grid description, add nodes to the grid, or remove nodes from the grid.

4.

Click OK.

5.

If you added or removed a node from a Data Integration Service grid configured to run jobs in separate
remote processes, recycle the Data Integration Service for the changes to take effect.

Deleting a Grid
You can delete a grid from the domain if the grid is no longer required.
Before you delete a grid, disable the Data Integration Service running on the grid.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

Select the grid in the Domain Navigator.

3.

Select Actions > Delete.

Troubleshooting a Grid
I enabled a Data Integration Service that runs on a grid, but one of the service processes failed to start.
When you enable a Data Integration Service that runs on a grid, a service process starts on each node in the
grid that has the service role. A service process might fail to start for the following reasons:

The node does not have the service role.

Enable the service role on the node, and then enable the service process running on that node.

Editing a Grid

149

Another process running on the machine is using the HTTP port number assigned to the service process.
On the Processes view for the Data Integration Service, enter a unique HTTP port number for the service
process. Then, enable the service process running on that node.

A job failed to run on a Data Integration Service grid. Which logs do I review?
If the Data Integration Service grid is configured to run jobs in the service process or in separate local
processes, review the following logs in this order:
1.

Job log accessible from the Monitor tab.

Includes log events about how the DTM instance runs the job.

2.

Data Integration Service log accessible from the Service view of the Logs tab.
Includes log events about service configuration, processing, and failures.

If the Data Integration Service grid is configured to run jobs in separate remote processes, additional
components write log files. Review the following logs in this order:
1.

Job log accessible from the Monitor tab.

Includes log events about how the DTM instance runs the job.

2.

Data Integration Service log accessible from the Service view of the Logs tab.
Includes log events about service configuration, processing, and failures. The Data Integration Service
log includes the following message which indicates the host name and port number of the master
compute node:
INFO: [GRIDCAL_0204] The Integration Service [<MyDISName>] elected a new master
compute node [<HostName>:<PortNumber>].

3.

Master compute node log accessible in the cadi_services_0.log file located in the log directory
configured for the master compute node.
Includes log events written by the Service Manager on the master compute node about managing the
grid of compute nodes and orchestrating worker service process requests. The master compute node
logs are not accessible from the Administrator tool.

4.

Resource Manager Service log accessible from the Service view of the Logs tab.
Includes log events about service configuration and processing and about nodes with the compute role
that register with the service.

5.

Container management log accessible from the Domain view of the Logs tab. Select Container
Management for the category.
Includes log events about how the Service Manager manages containers on nodes with the compute
role.

A mapping that ran in a separate remote process has an incomplete log file.
When a mapping runs on a Data Integration Service grid configured to run jobs in separate remote
processes, the Data Integration Service writes two files for the mapping log. The worker service process that
optimizes and compiles the mapping on the service node writes log events to one log file. The DTM process
that runs the mapping on the compute node writes log events to another log file. When you access the
mapping log, the Data Integration Service consolidates the two files into a single log file.

150

Chapter 6: Data Integration Service Grid

A mapping log might be incomplete for the following reasons:

The mapping is still running.

When a DTM process finishes running a mapping, it sends the log file to the master Data Integration
Service process. No DTM messages appear in the mapping log until the entire mapping is complete. To
resolve the issue, you can wait until the mapping completes before accessing the log. Or, you can find the
log file that the DTM process temporarily writes on the worker compute node.

The mapping has completed, but the DTM process failed to send the complete log file to the master Data
Integration Service process.
The DTM process might fail to send the complete DTM log because of a network error or because the
worker compute node unexpectedly shut down. The DTM process sends the log file to the Data
Integration Service process in multiple sections. The DTM section of the log begins and ends with the
following lines:
###
### <MyWorkerComputeNodeName>
###
### Start Grid Task [gtid-1443479776986-1-79777626-99] Segment [s0] Tasklet [t-0]
Attempt [1]
....
### End Grid Task [gtid-1443479776986-1-79777626-99] Segment [s0] Tasklet [t-0]
Attempt [1]
If these lines are not included in the mapping log or if the beginning line is included but not the ending
line, then the DTM process failed to send the complete log file. To resolve the issue, you can find the DTM
log files written to the following directory on the node where the master Data Integration Service process
runs:
<Informatica installation directory>/logs/<node name>/services/DataIntegrationService/
disLogs/logConsolidation/<mappingName>_<jobID>_<timestamp>
If the job ID folder is empty, find the log file that the DTM process temporarily writes on the worker
compute node.

To find the temporary DTM log file on the worker compute node, find the following message in the first
section of the mapping log:
INFO: [GCL_5] The grid task [gtid-1443479776986-1-79777626-99] cluster logs can be
found at [./1443479776986/taskletlogs/gtid-1443479776986-1-79777626-99].
The listed directory is a subdirectory of the following default log directory configured for the worker compute
node:
<Informatica installation directory>/logs/<node name>/dtmLogs/

Troubleshooting a Grid

151

CHAPTER 7

Data Integration Service

Applications
This chapter includes the following topics:

Data Integration Service Applications Overview, 152

Applications, 153

Logical Data Objects, 157

Physical Data Objects, 158

Mappings, 158

SQL Data Services, 160

Web Services, 164

Workflows, 167

Data Integration Service Applications Overview

A developer can create a logical data object, physical data object, mapping, SQL data service, web service,
or workflow and add it to an application in the Developer tool. To run the application, the developer must
deploy it. A developer can deploy an application to an application archive file or deploy the application
directly to the Data Integration Service.
As an administrator, you can deploy an application archive file to a Data Integration Service. You can enable
the application to run and start the application.
When you deploy an application archive file to a Data Integration Service, the Deployment Manager validates
the logical data objects, physical data objects, mappings, SQL data services, web services, and workflows in
the application. The deployment fails if errors occur. The connections that are defined in the application must
be valid in the domain that you deploy the application to.
The Data Integration Service stores the application in the Model repository associated with the Data
Integration Service.
You can configure the default deployment mode for a Data Integration Service. The default deployment mode
determines the state of each application after deployment. An application is disabled, stopped, or running
after deployment.

152

Applications View
To manage deployed applications, select a Data Integration Service in the Navigator and then click the
Applications view.
The Applications view displays the applications that have been deployed to a Data Integration Service. You
can view the objects in the application and the properties. You can start and stop an application, an SQL data
service, and a web service in the application. You can also back up and restore an application.
The Applications view shows the applications in alphabetic order. The Applications view does not show
empty folders. Expand the application name in the top panel to view the objects in the application.
When you select an application or object in the top panel of the Applications view, the bottom panel displays
read-only general properties and configurable properties for the selected object. The properties change
based on the type of object you select.
When you select physical data objects, you can click a column heading in the lower panel to sort the list of
objects. You can use the filter bar to filter the list of objects.
Refresh the Applications view to see the latest applications and their states.

Applications
The Applications view displays the applications that users deployed to a Data Integration Service. You can
view the objects in the application and application properties. You can deploy, enable, rename, start, back
up, and restore an application.

Application State
The Applications view shows the state for each application deployed to the Data Integration Service.
An application can have one of the following states:

Running. The application is running.

Stopped. The application is enabled to run but it is not running.

Disabled. The application is disabled from running. If you recycle the Data Integration Service, the
application will not start.

Failed. The administrator started the application, but it failed to start.

Application Properties
Application properties include read-only general properties and a property to configure whether the
application starts when the Data Integration Service starts.
The following table describes the read-only general properties for applications:
Property

Description

Name

Name of the application.

Description

Short description of the application.

Applications

153

Property

Description

Type

Type of the object. Valid value is application.

Location

The location of the application. This includes the domain and Data Integration Service
name.

Last Modification Date

Date that the application was last modified.

Deployment Date

Date that the application was deployed.

Created By

User who created the application.

Unique Identifier

ID that identifies the application in the Model repository.

Creation Project Path

Path in the project that contains the application.

Creation Date

Date that the application was created.

Last Modified By

User who modified the application last.

Creation Domain

Domain in which the application was created.

Deployed By

User who deployed the application.

The following table describes the configurable application property:

Property

Description

Startup Type

Determines whether an application starts when the Data Integration Service starts. When you
enable the application, the application starts by default when you start or recycle the Data
Integration Service.
Choose Disabled to prevent the application from starting. You cannot manually start an
application if it is disabled.

Deploying an Application
Deploy an object to an application archive file if you want to check the application into version control or if
your organization requires that administrators deploy objects to Data Integration Services.
1.

Click the Domain tab.

2.

Select a Data Integration Service, and then click the Applications view.

3.

In Domain Actions, click Deploy Full Application.

The Deploy Application dialog box appears.

4.

Click Upload Files.

The Add Files dialog box appears.

5.

Click Browse to search for an application archive file.

Application archive files have a file extension of .iar.

6.

Click Add More Files if you want to deploy multiple application files.
You can add up to 10 files.

154

Chapter 7: Data Integration Service Applications

7.

Click Deploy to finish the selection.

The application file names appear in the Uploaded Applications Archive Files panel. The destination
Data Integration Service appears as selected in the Data Integration Services panel.

8.

To select additional Data Integration Services, select them in the Data Integration Services panel. To
choose all Data Integration Services, select the box at the top of the list.

9.

Click OK to start the deployment.

If no errors are reported, the deployment succeeds and the application starts.

10.

To continue working while deployment is in progress, you can click Deploy in Background.
The deployment process continues in the background.

11.

If a name conflict occurs, choose one of the following options to resolve the conflict:

Keep the existing application and discard the new application.

Replace the existing application with the new application.

Update the existing application with the new application.

Rename the new application. Enter the new application name if you select this option.

If you replace or update the existing application and the existing application is running, select the Force
Stop the Existing Application if it is Running option to stop the existing application. You cannot
update or replace an existing application that is running. When you stop an application, all running
objects in the application are aborted.
After you select an option, click OK.
12.

Click Close.

You can also deploy an application file using the infacmd dis deployApplication program.

Enabling an Application
An application must be enabled to run before you can start it. When you enable a Data Integration Service,
the enabled applications start automatically.
You can configure a default deployment mode for a Data Integration Service. When you deploy an application
to a Data Integration Service, the property determines the application state after deployment. An application
might be enabled or disabled. If an application is disabled, you can enable it manually. If the application is
enabled after deployment, the SQL data services, web services, and workflows are also enabled.
1.

Select the Data Integration Service in the Navigator.

2.

In the Applications view, select the application that you want to enable.

3.

In Application Properties area, click Edit.

The Edit Application Properties dialog box appears.

4.

In the Startup Type field, select Enabled and click OK.

The application is enabled to run.
You must enable each SQL data service or web service that you want to run.

Renaming an Application
Rename an application to change the name. You can rename an application when the application is not
running.
1.

Select the Data Integration Service in the Navigator.

Applications

155

2.

In the Application view, select the application that you want to rename.

3.

Click Actions > Rename Application.

4.

Enter the name and click OK.

Starting an Application
You can start an application from the Administrator tool.
An application must be running before you can start or access an object in the application. You can start the
application from the Applications Actions menu if the application is enabled to run.
1.

Select the Data Integration Service in the Navigator.

2.

In the Applications view, select the application that you want to start.

3.

Click Actions > Start Application.

Backing Up an Application
You can back up an application to an XML file. The backup file contains all the property settings for the
application. You can restore the application to another Data Integration Service.
You must stop the application before you back it up.
1.

In the Applications view, select the application to back up.

2.

Click Actions > Backup Application.

The Administrator tool prompts you to open the XML file or save the XML file.

3.

Click Open to view the XML file in a browser.

4.

Click Save to save the XML file.

5.

If you click Save, enter an XML file name and choose the location to back up the application.
The Administrator tool backs up the application to an XML file in the location you choose.

Restoring an Application
You can restore an application from an XML backup file. The application must be an XML backup file that you
create with the Backup option.
1.

In the Domain Navigator, select a Data Integration Service that you want to restore the application to.

2.

Click the Applications view.

3.

Click Actions > Restore Application from File.

The Administrator tool prompts you for the file to restore.

4.

Browse for and select the XML file.

5.

Click OK to start the restore.

The Administrator tool checks for a duplicate application.

6.

156

If a conflict occurs, choose one of the following options:

Keep the existing application and discard the new application. The Administrator tool does not restore
the file.

Replace the existing application with the new application. The Administrator tool restores the backup
application to the Data Integration Service.

Chapter 7: Data Integration Service Applications

7.

Rename the new application. Choose a different name for the application you are restoring.

Click OK to restore the application.

The application starts if the default deployment option is set to Enable and Start for the Data Integration
Service.

Refreshing the Applications View

Refresh the Applications view to view newly deployed and restored applications, remove applications that
were recently undeployed, and update the state of each application.
1.

Select the Data Integration Service in the Navigator.

2.

Click the Applications view.

3.

Select the application in the Content panel.

4.

Click Refresh Application View in the application Actions menu.

The Application view refreshes.

Logical Data Objects

The Applications view displays logical data objects included in applications that have been deployed to the
Data Integration Service.
Logical data object properties include read-only general properties and properties to configure caching for
logical data objects.
The following table describes the read-only general properties for logical data objects:
Property

Description

Name

Name of the logical data object.

Description

Short description of the logical data object.

Type

Type of the object. Valid value is logical data object.

Location

The location of the logical data object. This includes the domain and Data Integration Service
name.

Logical Data Objects

157

The following table describes the configurable logical data object properties:
Property

Description

Enable Caching

Cache the logical data object in the data object cache database.

Cache Refresh
Period

Number of minutes between cache refreshes.

Cache Table
Name

The name of the user-managed table from which the Data Integration Service accesses the
logical data object cache. A user-managed cache table is a table in the data object cache
database that you create, populate, and manually refresh when needed.
If you specify a cache table name, the Data Object Cache Manager does not manage the
cache for the object and ignores the cache refresh period.
If you do not specify a cache table name, the Data Object Cache Manager manages the
cache for the object.

The following table describes the configurable logical data object column properties:
Property

Description

Create Index

Enables the Data Integration Service to generate indexes for the cache table based on this
column. Default is false.

Physical Data Objects

The Applications view displays physical data objects included in applications that are deployed on the Data
Integration Service.
The following table describes the read-only general properties for physical data objects:
Property

Description

Name

Name of the physical data object.

Type

Type of the object.

Mappings
The Applications view displays mappings included in applications that have been deployed to the Data
Integration Service.
Mapping properties include read-only general properties and properties to configure the settings the Data
Integration Services uses when it runs the mappings in the application.

158

Chapter 7: Data Integration Service Applications

The following table describes the read-only general properties for mappings:
Property

Description

Name

Name of the mapping.

Description

Short description of the mapping.

Type

Type of the object. Valid value is mapping.

Location

The location of the mapping. This includes the domain and Data Integration
Service name.

The following table describes the configurable mapping properties:

Property

Description

Date format

Date/time format the Data Integration Services uses when the mapping converts
strings to dates.
Default is MM/DD/YYYY HH24:MI:SS.

Enable high precision

Runs the mapping with high precision.

High precision data values have greater accuracy. Enable high precision if the
mapping produces large numeric values, for example, values with precision of
more than 15 digits, and you require accurate values. Enabling high precision
prevents precision loss in large numeric values.
Default is enabled.

Tracing level

Overrides the tracing level for each transformation in the mapping. The tracing
level determines the amount of information the Data Integration Service sends to
the mapping log files.
Choose one of the following tracing levels:
- None. The Data Integration Service uses the tracing levels set in the mapping.
- Terse. The Data Integration Service logs initialization information, error messages,
and notification of rejected data.
- Normal. The Data Integration Service logs initialization and status information, errors
encountered, and skipped rows due to transformation row errors. It summarizes
mapping results, but not at the level of individual rows.
- Verbose Initialization. In addition to normal tracing, the Data Integration Service logs
additional initialization details, names of index and data files used, and detailed
transformation statistics.
- Verbose Data. In addition to verbose initialization tracing, the Data Integration
Service logs each row that passes into the mapping. The Data Integration Service
also notes where it truncates string data to fit the precision of a column and provides
detailed transformation statistics. The Data Integration Service writes row data for all
rows in a block when it processes a transformation.

Default is None.

Mappings

159

Property

Description

Optimization level

Controls the optimization methods that the Data Integration Service applies to a
mapping as follows:
- None. The Data Integration Service does not optimize the mapping.
- Minimal. The Data Integration Service applies the early projection optimization
method to the mapping.
- Normal. The Data Integration Service applies the early projection, early selection,
and predicate optimization methods to the mapping.
- Full. The Data Integration Service applies the early projection, early selection,
predicate optimization, and semi-join optimization methods to the mapping.

Default is Normal.
Sort order

Order in which the Data Integration Service sorts character data in the mapping.
Default is Binary.

SQL Data Services

The Applications view displays SQL data services included in applications that have been deployed to a Data
Integration Service. You can view objects in the SQL data service and configure properties that the Data
Integration Service uses to run the SQL data service. You can enable and rename an SQL data service.

SQL Data Service Properties

SQL data service properties include read-only general properties and properties to configure the settings the
Data Integration Service uses when it runs the SQL data service.
When you expand an SQL data service in the top panel of the Applications view, you can access the
following objects contained in an SQL data service:

Virtual tables

Virtual columns

Virtual stored procedures

The Applications view displays read-only general properties for SQL data services and the objects contained
in the SQL data services. Properties that appear in the view depend on the object type.
The following table describes the read-only general properties for SQL data services, virtual tables, virtual
columns, and virtual stored procedures:

160

Property

Description

Name

Name of the selected object. Appears for all object types.

Description

Short description of the selected object. Appears for all object types.

Type

Type of the selected object. Appears for all object types.

Location

The location of the selected object. This includes the domain and Data Integration Service name.
Appears for all object types.

Chapter 7: Data Integration Service Applications

Property

Description

JDBC URL

JDBC connection string used to access the SQL data service. The SQL data service contains
virtual tables that you can query. It also contains virtual stored procedures that you can run.
Appears for SQL data services.

Column Type

Datatype of the virtual column. Appears for virtual columns.

The following table describes the configurable SQL data service properties:
Property

Description

Startup Type

Determines whether the SQL data service is enabled to run when the application starts or
when you start the SQL data service. Enter ENABLED to allow the SQL data service to run.
Enter DISABLED to prevent the SQL data service from running.

Trace Level

Level of error written to the log files. Choose one of the following message levels:
-

OFF
SEVERE
WARNING
INFO
FINE
FINEST
ALL

Default is INFO.
Connection
Timeout

Maximum number of milliseconds to wait for a connection to the SQL data service. Default is
3,600,000.

Request Timeout

Maximum number of milliseconds for an SQL request to wait for an SQL data service
response. Default is 3,600,000.

Sort Order

Sort order that the Data Integration Service uses for sorting and comparing data when
running in Unicode mode. You can choose the sort order based on your code page. When the
Data Integration runs in ASCII mode, it ignores the sort order value and uses a binary sort
order. Default is binary.

Maximum Active
Connections

Maximum number of active connections to the SQL data service.

Result Set
Cache Expiration
Period

The number of milliseconds that the result set cache is available for use. If set to -1, the
cache never expires. If set to 0, result set caching is disabled. Changes to the expiration
period do not apply to existing caches. If you want all caches to use the same expiration
period, purge the result set cache after you change the expiration period. Default is 0.

SQL Data Services

161

Property

Description

DTM Keep Alive

Time

Number of milliseconds that the DTM instance stays open after it completes the last request.
Identical SQL queries can reuse the open instance. Use the keep alive time to increase
performance when the time required to process the SQL query is small compared to the
initialization time for the DTM instance. If the query fails, the DTM instance terminates.
Must be an integer. A negative integer value means that the DTM Keep Alive Time for the
Data Integration Service is used. 0 means that the Data Integration Service does not keep
the DTM instance in memory. Default is -1.

Optimization
Level

The optimizer level that the Data Integration Service applies to the object. Enter the numeric
value that is associated with the optimizer level that you want to configure. You can enter one
of the following numeric values:
- 0. The Data Integration Service does not apply optimization.
- 1. The Data Integration Service applies the early projection optimization method.
- 2. The Data Integration Service applies the early projection, early selection, push-into, and
predicate optimization methods.
- 3. The Data Integration Service applies the cost-based, early projection, early selection, pushinto, predicate, and semi-join optimization methods.

Virtual Table Properties

Configure whether to cache virtual tables for an SQL data service and configure how often to refresh the
cache. You must disable the SQL data service before configuring virtual table properties.
The following table describes the configurable virtual table properties:
Property

Description

Enable Caching

Cache the virtual table in the data object cache database.

Cache Refresh
Period

Number of minutes between cache refreshes.

Cache Table
Name

The name of the user-managed table from which the Data Integration Service accesses the
virtual table cache. A user-managed cache table is a table in the data object cache database
that you create, populate, and manually refresh when needed.
If you specify a cache table name, the Data Object Cache Manager does not manage the
cache for the object and ignores the cache refresh period.
If you do not specify a cache table name, the Data Object Cache Manager manages the
cache for the object.

162

Chapter 7: Data Integration Service Applications

Virtual Column Properties

Configure the properties for the virtual columns included in an SQL data service.
The following table describes the configurable virtual column properties:
Property

Description

Create Index

Enables the Data Integration Service to generate indexes for the cache table based on this
column. Default is false.

Deny With

When you use column level security, this property determines whether to substitute the restricted
column value or to fail the query. If you substitute the column value, you can choose to substitute
the value with NULL or with a constant value.
Select one of the following options:
- ERROR. Fails the query and returns an error when an SQL query selects a restricted column.
- NULL. Returns a null value for a restricted column in each row.
- VALUE. Returns a constant value for a restricted column in each row.

Insufficient
Permission
Value

The constant that the Data Integration Service returns for a restricted column.

Virtual Stored Procedure Properties

Configure the property for the virtual stored procedures included in an SQL data service.
The following table describes the configurable virtual stored procedure property:
Property

Description

Result Set Cache Expiration Period

The number of milliseconds that the result set cache is available for
use. If set to -1, the cache never expires. If set to 0, result set caching
is disabled. Changes to the expiration period do not apply to existing
caches. If you want all caches to use the same expiration period, purge
the result set cache after you change the expiration period. Default is
0.

Enabling an SQL Data Service

Before you can start an SQL data service, the Data Integration Service must be running and the SQL data
service must be enabled.
When a deployed application is enabled by default, the SQL data services in the application are also
enabled.
When a deployed application is disabled by default, the SQL data services are also disabled. When you
enable the application manually, you must also enable each SQL data service in the application.
1.

Select the Data Integration Service in the Navigator.

2.

In the Applications view, select the SQL data service that you want to enable.

3.

In SQL Data Service Properties area, click Edit.

The Edit Properties dialog box appears.

4.

In the Startup Type field, select Enabled and click OK.

SQL Data Services

163

Renaming an SQL Data Service

Rename an SQL data service to change the name of the SQL data service. You can rename an SQL data
service when the SQL data service is not running.
1.

Select the Data Integration Service in the Navigator.

2.

In the Application view, select the SQL data service that you want to rename.

3.

Click Actions > Rename SQL Data Service.

4.

Enter the name and click OK.

Web Services
The Applications view displays web services included in applications that have been deployed to a Data
Integration Service. You can view the operations in the web service and configure properties that the Data
Integration Service uses to run a web service. You can enable and rename a web service.

Web Service Properties

Web service properties include read-only general properties and properties to configure the settings that the
Data Integration Service uses when it runs a web service.
When you expand a web service in the top panel of the Applications view, you can access web service
operations contained in the web service.
The Applications view displays read-only general properties for web services and web service operations.
Properties that appear in the view depend on the object type.
The following table describes the read-only general properties for web services and web service operations:

164

Property

Description

Name

Name of the selected object. Appears for all objects.

Description

Short description of the selected object. Appears for all objects.

Type

Type of the selected object. Appears for all object types.

Location

The location of the selected object. This includes the domain and Data Integration Service name.
Appears for all objects.

WSDL URL

WSDL URL used to connect to the web service. Appears for web services.

Chapter 7: Data Integration Service Applications

The following table describes the configurable web service properties:

Property

Description

Startup Type

Determines whether the web service is enabled to run when the application starts or when
you start the web service.

Trace Level

Level of error messages written to the run-time web service log. Choose one of the following
message levels:
- OFF. The DTM process does not write messages to the web service run-time logs.
- SEVERE. SEVERE messages include errors that might cause the web service to stop running.
- WARNING. WARNING messages include recoverable failures or warnings. The DTM process
writes WARNING and SEVERE messages to the web service run-time log.
- INFO. INFO messages include web service status messages. The DTM process writes INFO,
WARNING and SEVERE messages to the web service run-time log.
- FINE. FINE messages include data processing errors for the web service request. The DTM
process writes FINE, INFO, WARNING and SEVERE messages to the web service run-time log.
- FINEST. FINEST message are used for debugging. The DTM process writes FINEST, FINE,
INFO, WARNING and SEVERE messages to the web service run-time log.
- ALL. The DTM process writes FINEST, FINE, INFO, WARNING and SEVERE messages to the
web service run-time log.

Default is INFO.
Request Timeout

Maximum number of milliseconds that the Data Integration Service runs an operation
mapping before the web service request times out. Default is 3,600,000.

Maximum
Concurrent
Requests

Maximum number of requests that a web service can process at one time. Default is 10.

Sort Order

Sort order that the Data Integration Service to sort and compare data when running in
Unicode mode.

Enable Transport
Layer Security

Indicates that the web service must use HTTPS. If the Data Integration Service is not
configured to use HTTPS, the web service will not start.

Enable WSSecurity

Enables the Data Integration Service to validate the user credentials and verify that the user
has permission to run each web service operation.

Optimization
Level

The optimizer level that the Data Integration Service applies to the object. Enter the numeric
value that is associated with the optimizer level that you want to configure. You can enter
one of the following numeric values:
- 0. The Data Integration Service does not apply optimization.
- 1. The Data Integration Service applies the early projection optimization method.
- 2. The Data Integration Service applies the early projection, early selection, push-into, and
predicate optimization methods.
- 3. The Data Integration Service applies the cost-based, early projection, early selection, pushinto, predicate, and semi-join optimization methods.

DTM Keep Alive

Time

Number of milliseconds that the DTM instance stays open after it completes the last request.
Web service requests that are issued against the same operation can reuse the open
instance. Use the keep alive time to increase performance when the time required to process
the request is small compared to the initialization time for the DTM instance. If the request
fails, the DTM instance terminates.
Must be an integer. A negative integer value means that the DTM Keep Alive Time for the
Data Integration Service is used. 0 means that the Data Integration Service does not keep
the DTM instance in memory. Default is -1.

Web Services

165

Property

Description

SOAP Output
Precision

Maximum number of characters that the Data Integration Service generates for the response
message. The Data Integration Service truncates the response message when the response
message exceeds the SOAP output precision. Default is 200,000.

SOAP Input
Precision

Maximum number of characters that the Data Integration Service parses in the request
message. The web service request fails when the request message exceeds the SOAP input
precision. Default is 200,000.

Web Service Operation Properties

Configure the settings that the Data Integration Service uses when it runs a web service operation.
The following tables describes the configurable web service operation property:
Property

Description

Result Set Cache Expiration Period

The number of milliseconds that the result set cache is available for
use. If set to -1, the cache never expires. If set to 0, result set caching
is disabled. Changes to the expiration period do not apply to existing
caches. If you want all caches to use the same expiration period, purge
the result set cache after you change the expiration period. Default is
0.

Enabling a Web Service

Enable a web service so that you can start the web service. Before you can start a web service, the Data
Integration Service must be running and the web service must be enabled.
1.

Select the Data Integration Service in the Navigator.

2.

In the Application view, select the web service that you want to enable.

3.

In Web Service Properties section of the Properties view, click Edit.

The Edit Properties dialog box appears.

4.

In the Startup Type field, select Enabled and click OK.

Renaming a Web Service

Rename a web service to change the service name of a web service. You can rename a web service when
the web service is stopped.
1.

Select the Data Integration Service in the Navigator.

2.

In the Application view, select the web service that you want to rename.

3.

Click Actions > Rename Web Service.

The Rename Web Service dialog box appears.

4.

166

Enter the web service name and click OK.

Chapter 7: Data Integration Service Applications

Workflows
The Applications view displays workflows included in applications that have been deployed to a Data
Integration Service. You can view workflow properties, enable a workflow, and start a workflow.

Workflow Properties
Workflow properties include read-only general properties.
The following table describes the read-only general properties for workflows:
Property

Description

Name

Name of the workflow.

Description

Short description of the workflow.

Type

Type of the object. Valid value is workflow.

Location

The location of the workflow. This includes the domain and Data Integration Service name.

Enabling a Workflow
Before you can run instances of the workflow, the Data Integration Service must be running and the workflow
must be enabled.
Enable a workflow to allow users to run instances of the workflow. Disable a workflow to prevent users from
running instances of the workflow. When you disable a workflow, the Data Integration Service aborts any
running instances of the workflow.
When a deployed application is enabled by default, the workflows in the application are also enabled.
When a deployed application is disabled by default, the workflows are also disabled. When you enable the
application manually, each workflow in the application is also enabled.
1.

Select the Data Integration Service in the Navigator.

2.

In the Applications view, select the workflow that you want to enable.

3.

Click Actions > Enable Workflow.

Starting a Workflow
After you deploy a workflow, you run an instance of the workflow from the deployed application from the
Administrator tool.
1.

In the Administrator tool, click the Data Integration Service on which you deployed the workflow.

2.

Click the Applications tab.

3.

Expand the application that contains the workflow you want to start.

4.

Select the workflow that you want to run.

5.

Click Actions > Start Workflow.

The Start Workflow dialog box appears.

6.

Optionally, browse and select a parameter file for the workflow run.

Workflows

167

168

7.

Select Show Workflow Monitoring if you want to view the workflow graph for the workflow run.

8.

Click OK.

Chapter 7: Data Integration Service Applications

CHAPTER 8

Metadata Manager Service

This chapter includes the following topics:

Metadata Manager Service Overview, 169

Configuring a Metadata Manager Service, 170

Creating a Metadata Manager Service, 172

Creating and Deleting Repository Content, 176

Enabling and Disabling the Metadata Manager Service, 178

Metadata Manager Service Properties, 178

Configuring the Associated PowerCenter Integration Service, 186

Metadata Manager Service Overview

The Metadata Manager Service is an application service that runs the Metadata Manager application in an
Informatica domain. The Metadata Manager application manages access to metadata in the Metadata
Manager repository. Create a Metadata Manager Service in the domain to access the Metadata Manager
application.

169

The following figure shows the Metadata Manager components managed by the Metadata Manager Service
on a node in an Informatica domain:

The Metadata Manager Service manages the following components:

Metadata Manager application. The Metadata Manager application is a web-based application. Use
Metadata Manager to browse and analyze metadata from disparate source repositories. You can load,
browse, and analyze metadata from application, business intelligence, data integration, data modeling,
and relational metadata sources.

PowerCenter repository for Metadata Manager. Contains the metadata objects used by the PowerCenter
Integration Service to load metadata into the Metadata Manager warehouse. The metadata objects
include sources, targets, sessions, and workflows.

PowerCenter Repository Service. Manages connections to the PowerCenter repository for Metadata
Manager.

PowerCenter Integration Service. Runs the workflows in the PowerCenter repository to read from
metadata sources and load metadata into the Metadata Manager warehouse.

Metadata Manager repository. Contains the Metadata Manager warehouse and models. The Metadata
Manager warehouse is a centralized metadata warehouse that stores the metadata from metadata
sources. Models define the metadata that Metadata Manager extracts from metadata sources.

Metadata sources. The application, business intelligence, data integration, data modeling, and database
management sources that Metadata Manager extracts metadata from.

Configuring a Metadata Manager Service

You can create and configure a Metadata Manager Service and the related components in the Administrator
tool.

170

Chapter 8: Metadata Manager Service

Note: The procedure to configure the Metadata Manager Service varies based on the operating mode of the
PowerCenter Repository Service and on whether the PowerCenter repository contents are created or not.
1.

Set up the Metadata Manager repository database. Set up a database for the Metadata Manager
repository. You supply the database information when you create the Metadata Manager Service.

2.

Create a PowerCenter Repository Service and PowerCenter Integration Service (Optional). You can use
an existing PowerCenter Repository Service and PowerCenter Integration Service, or you can create
them. If want to create the application services to use with Metadata Manager, create the services in the
following order:
a.

PowerCenter Repository Service. Create a PowerCenter Repository Service but do not create
contents. Start the PowerCenter Repository Service in exclusive mode.

b.

PowerCenter Integration Service. Create the PowerCenter Integration Service. The service will not
start because the PowerCenter Repository Service does not have content. You enable the
PowerCenter Integration Service after you create and configure the Metadata Manager Service.

3.

Create the Metadata Manager Service. Use the Administrator tool to create the Metadata Manager
Service.

4.

Configure the Metadata Manager Service. Configure the properties for the Metadata Manager Service.

5.

Create repository contents. The steps to create repository contents differ based on the code page of the
Metadata Manager and PowerCenter repositories.
If the code page is Latin-based, then create contents for the Metadata Manager repository and restore
the PowerCenter repository. Use the Metadata Manager Service Actions menu to create the contents
for both repositories.
If the code page is not Latin-based, then create the repository contents in the following order:
a.

Restore the PowerCenter repository. Use the Metadata Manager Service Actions menu to restore
the PowerCenter repository. When you restore the PowerCenter repository, enable the option to
automatically restart the PowerCenter Repository Service in normal mode.

b.

Create the Metadata Manager repository contents. Use the Metadata Manager Service Actions
menu to create the contents.

6.

Enable the PowerCenter Integration Service. Enable the associated PowerCenter Integration Service for
the Metadata Manager Service.

7.

Optionally, create a Reporting Service. To run reports on the Metadata Manager repository, create a
Reporting Service. After you create the Reporting Service, you can log in to Data Analyzer and run
reports against the Metadata Manager repository.

8.

Optionally, create a Reporting and Dashboards Service. To run reports on the Metadata Manager
repository, create a Reporting and Dashboards Service. After you create a Reporting and Dashboards
Service, add a reporting source to run reports against the data in the data source.

9.

Enable the Metadata Manager Service. Enable the Metadata Manager Service in the Informatica domain.

10.

Create or assign users. Create users and assign them privileges for the Metadata Manager Service, or
assign existing users privileges for the Metadata Manager Service.

Note: You can use a Metadata Manager Service and the associated Metadata Manager repository in one
Informatica domain. After you create the Metadata Manager Service and Metadata Manager repository in one
domain, you cannot create a second Metadata Manager Service to use the same Metadata Manager
repository. You also cannot back up and restore the repository to use with a different Metadata Manager
Service in a different domain.

Configuring a Metadata Manager Service

171

Creating a Metadata Manager Service

Use the Administrator tool to create the Metadata Manager Service. After you create the Metadata Manager
Service, create the Metadata Manager repository contents and PowerCenter repository contents to enable
the service.
1.

In the Administrator tool, click the Manage tab.

2.

Click the Services and Nodes view.

3.

Click Actions > New Metadata Manager Service.

The New Metadata Manager Service dialog box appears.

4.

Enter values for the Metadata Manager Service general properties, and click Next.

5.

Enter values for the Metadata Manager Service database properties, and click Next.

6.

Enter values for the Metadata Manager Service security properties, and click Finish.

Metadata Manager Service Properties

The following table describes the properties that you configure for the Metadata Manager Service:

172

Property

Description

Name

Name of the Metadata Manager Service. The name is not case sensitive and must be unique
within the domain. It cannot exceed 128 characters or begin with @. It also cannot contain
spaces or the following special characters:
` ~ % ^ * + = { } \ ; : ' " / ? . , < > | ! ( ) ] [

Description

The description cannot exceed 765 characters.

Location

Domain and folder where the service is created. Click Browse to choose a different folder. You
can move the Metadata Manager Service after you create it.

License

License object that allows use of the service.

Node

Node in the Informatica domain that the Metadata Manager Service runs on.

Associated
Integration
Service

PowerCenter Integration Service used by Metadata Manage to load metadata into the Metadata
Manager warehouse.

Repository
User Name

User account for the PowerCenter repository. Use the repository user account you configured
for the PowerCenter Repository Service. For a list of the required privileges for this user, see
Privileges for the Associated PowerCenter Integration Service User on page 187 .

Repository
Password

Password for the PowerCenter repository user.

Security
Domain

Name of the security domain to which the PowerCenter repository user belongs.

Database Type

Type of database for the Metadata Manager repository.

Chapter 8: Metadata Manager Service

Property

Description

Code Page

Metadata Manager repository code page. The Metadata Manager Service and Metadata
Manager application use the character set encoded in the repository code page when writing
data to the Metadata Manager repository.
Note: The Metadata Manager repository code page, the code page on the machine where the
associated PowerCenter Integration Service runs, and the code page for any database
management and PowerCenter resources that you load into the Metadata Manager warehouse
must be the same.

Connect String

Native connect string to the Metadata Manager repository database. The Metadata Manager
Service uses the connect string to create a connection object to the Metadata Manager
repository in the PowerCenter repository.

Database User

User account for the Metadata Manager repository database. Set up this account with the
appropriate database client tools.

Database
Password

Password for the Metadata Manager repository database user. Must be in 7-bit ASCII.

Tablespace
Name

Tablespace name for Metadata Manager repositories on IBM DB2. When you specify the
tablespace name, the Metadata Manager Service creates all repository tables in the same
tablespace. You cannot use spaces in the tablespace name.
To improve repository performance on IBM DB2 EEE repositories, specify a tablespace name
with one node.

Database
Hostname

Host name for the Metadata Manager repository database.

Database Port

Port number for the Metadata Manager repository database.

SID/Service
Name

Indicates whether the Database Name property contains an Oracle full service name or SID.

Database
Name

Full service name or SID for Oracle databases. Service name for IBM DB2 databases.
Database name for Microsoft SQL Server databases.

Creating a Metadata Manager Service

173

Property

Description

Additional
JDBC
Parameters

Additional JDBC parameters that you want to append to the database connection URL. Enter
the parameters as name=value pairs separated by semicolon characters (;). For example:
param1=value1;param2=value2
You can use this property to specify the following information:
- Backup server location. If you use a database server that is highly available such as Oracle RAC,
enter the location of a backup server.
- Oracle Advanced Security Option (ASO) parameters. If the Metadata Manager repository database
is an Oracle database that uses ASO, enter the following additional parameters:

EncryptionLevel=[encryption level];EncryptionTypes=[encryption
types];DataIntegrityLevel=[data integrity
level];DataIntegrityTypes=[data integrity types]
The parameter values must match the values in the sqlnet.ora file on the machine where the
Metadata Manager Service runs.
- Authentication information for Microsoft SQL Server.
Note: The Metadata Manager Service does not support the alternateID option for DB2.
To authenticate the user credentials with Windows authentication and establish a trusted
connection to a Microsoft SQL Server repository, enter the following text:
AuthenticationMethod=ntlm;LoadLibraryPath=[directory containing
DDJDBCx64Auth04.dll].

jdbc:informatica:sqlserver://[host]:[port];DatabaseName=[DB
name];AuthenticationMethod=ntlm;LoadLibraryPath=[directory
containing DDJDBCx64Auth04.dll]
When you use a trusted connection to connect to a Microsoft SQL Server database, the Metadata
Manager Service connects to the repository with the credentials of the user logged in to the
machine on which the service is running.
To start the Metadata Manager Service as a Windows service with a trusted connection, configure
the Windows service properties to log on with a trusted user account.

Secure JDBC
Parameters

Secure JDBC parameters that you want to append to the database connection URL. Use this
property to specify secure connection parameters such as passwords. The Administrator tool
does not display secure parameters or parameter values in the Metadata Manager Service
properties. Enter the parameters as name=value pairs separated by semicolon characters (;).
For example:
param1=value1;param2=value2
If secure communication is enabled for the Metadata Manager repository database, enter the
secure JDBC parameters in this property.

Port Number

Port number the Metadata Manager application runs on. Default is 10250.

Enable
Secured
Socket Layer

Indicates that you want to configure SSL security protocol for the Metadata Manager
application. If you enable this option, you must create a keystore file that contains the required
keys and certificates.
You can create a keystore file with keytool. keytool is a utility that generates and stores private
or public key pairs and associated certificates in a keystore file. When you generate a public or
private key pair, keytool wraps the public key into a self-signed certificate. You can use the
self-signed certificate or use a certificate signed by a certificate authority.

174

Chapter 8: Metadata Manager Service

Property

Description

Keystore File

Keystore file that contains the keys and certificates required if you use the SSL security
protocol with the Metadata Manager application. Required if you select Enable Secured Socket
Layer.

Keystore
Password

Password for the keystore file. Required if you select Enable Secured Socket Layer.

JDBC Parameters for Secure Databases

If secure communication is enabled for the Metadata Manager repository database, you must configure
additional JDBC parameters in the Secure JDBC Parameters property.
Enter the following parameters in the Secure JDBC Parameters property:
EncryptionMethod=SSL;TrustStore=<truststore
location>;TrustStorePassword=<password>;HostNameInCertificate=<host
name>;ValidateServerCertificate=<true|false>;KeyStore=<keystore
location>;keyStorePassword=<password>
Configure the parameters as follows:
EncryptionMethod
Encryption method for data transfer between Metadata Manager and the database server. Must be set to
SSL.
TrustStore
Path and file name of the truststore file that contains the SSL certificate of the database server.
TrustStorePassword
Password used to access the truststore file.
HostNameInCertificate
Host name of the machine that hosts the secure database. If you specify a host name, the Metadata
Manager Service validates the host name included in the connection string against the host name in the
SSL certificate.
ValidateServerCertificate
Indicates whether the Metadata Manager Service validates the certificate that the database server
presents. If you set this parameter to true, the Metadata Manager Service validates the certificate. If you
specify the HostNameInCertificate parameter, the Metadata Manager Service also validates the host
name in the certificate.
If you set this parameter to false, the Metadata Manager Service does not validate the certificate that the
database server presents. The Metadata Manager Service ignores any truststore information that you
specify.
KeyStore
Path and file name of the keystore file that contains the SSL certificates that the Metadata Manager
Service presents to the database server.
KeyStorePassword
Password used to access the keystore file.

Creating a Metadata Manager Service

175

Database Connect Strings

When you create a database connection, specify a connect string for that connection. The Metadata Manager
Service uses the connect string to create a connection object to the Metadata Manager repository database
in the PowerCenter repository.
The following table lists the native connect string syntax for each supported database:
Database

Connect String Syntax

Example

IBM DB2

dbname

mydatabase

Microsoft SQL Server

servername@dbname

sqlserver@mydatabase
Note: If you do not specify the
connect string in the syntax specified,
you must specify the ODBC entry
specified for the data source.

Oracle

dbname.world (same as TNSNAMES entry)

oracle.world

Note: The Metadata Manager Service uses the DataDirect drivers included with the Informatica installation.
Informatica does not support the use of any other database driver.

Overriding the Repository Database Code Page

You can override the default database code page for the Metadata Manager repository database when you
create or configure the Metadata Manager Service. Override the code page if the Metadata Manager
repository contains characters that the database code page does not support.
To override the code page, add the CODEPAGEOVERRIDE parameter to the Additional JDBC Options
property. Specify a code page that is compatible with the default repository database code page.
For example, use the following parameter to override the default Shift-JIS code page with MS932:
CODEPAGEOVERRIDE=MS932;

Creating and Deleting Repository Content

You can create and delete contents for the following repositories used by Metadata Manager:

Metadata Manager repository. Create the Metadata Manager warehouse tables and import models for
metadata sources into the Metadata Manager repository.

PowerCenter repository. Restore a repository backup file packaged with PowerCenter to the PowerCenter
repository database. The repository backup file includes the metadata objects used by Metadata Manager
to load metadata into the Metadata Manager warehouse. When you restore the repository, the Service
Manager creates a folder named Metadata Load in the PowerCenter repository. The Metadata Load folder
contains the metadata objects, including sources, targets, sessions, and workflows.

The tasks you complete depend on whether the Metadata Manager repository contains contents or if the
PowerCenter repository contains the PowerCenter objects for Metadata Manager.

176

Chapter 8: Metadata Manager Service

The following table describes the tasks you must complete for each repository:
Repository

Condition

Action

Metadata Manager
repository

Does not have content.

Create the Metadata Manager repository.

Metadata Manager
repository

Has content.

No action.

PowerCenter
repository

Does not have content.

Restore the PowerCenter repository if the PowerCenter

Repository Service runs in exclusive mode.

PowerCenter
repository

Has content.

No action if the PowerCenter repository has the objects

required for Metadata Manager in the Metadata Load
folder. The Service Manager imports the required
objects from an XML file when you enable the service.

Creating the Metadata Manager Repository

When you create the Metadata Manager repository, you create the Metadata Manager warehouse tables and
import models for metadata sources.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the Metadata Manager Service for which the Metadata Manager
repository has no content.

3.

Click Actions > Repository Contents > Create.

4.

Optionally, choose to restore the PowerCenter repository. You can restore the repository if the
PowerCenter Repository Service runs in exclusive mode and the repository does not contain contents.

5.

Click OK.
The activity log displays the results of the create contents operation.

Restoring the PowerCenter Repository

Restore the repository backup file for the PowerCenter repository to create the objects used by Metadata
Manager in the PowerCenter repository database.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the Metadata Manager Service for which the PowerCenter repository
has no contents.

3.

Click Actions > Restore PowerCenter Repository.

4.

Optionally, choose to restart the PowerCenter Repository Service in normal mode.

5.

Click OK.
The activity log displays the results of the restore repository operation.

Deleting the Metadata Manager Repository

Delete Metadata Manager repository content when you want to delete all metadata and repository database
tables from the repository. Delete the repository content if the metadata is obsolete. If the repository contains

Creating and Deleting Repository Content

177

information that you want to save, back up the repository with the database client or mmRepoCmd before you
delete it.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the Metadata Manager Service for which you want to delete Metadata
Manager repository content.

3.

Click Actions > Repository Contents > Delete.

4.

Enter the user name and password for the database account.

5.

Click OK.
The activity log displays the results of the delete contents operation.

Enabling and Disabling the Metadata Manager

Service
Use the Administrator tool to enable, disable, or recycle the Metadata Manager Service. Disable a Metadata
Manager Service to perform maintenance or to temporarily restrict users from accessing Metadata Manager.
When you disable the Metadata Manager Service, you also stop Metadata Manager. You might recycle a
service if you modified a property. When you recycle the service, the Metadata Manager Service is disabled
and enabled.
When you enable the Metadata Manager Service, the Service Manager starts the Metadata Manager
application on the node where the Metadata Manager Service runs. If the PowerCenter repository does not
contain the Metadata Load folder, the Administrator tool imports the metadata objects required by Metadata
Manager into the PowerCenter repository.
You can enable, disable, and recycle the Metadata Manager Service from the Actions menu.
Note: The PowerCenter Repository Service for Metadata Manager must be enabled and running before you
can enable the Metadata Manager Service.

Metadata Manager Service Properties

You can configure general, Metadata Manager Service, database, configuration, connection pool, advanced,
and custom properties for the Metadata Manager Service.
After you create a Metadata Manager Service, you can configure it. After you configure Metadata Manager
Service properties, you must disable and enable the Metadata Manager Service for the changes to take
effect.
Use the Administrator tool to configure the following Metadata Manager Service properties:

178

General properties. Include the name and description of the service, the license object for the service, and
the node where the service runs.

Metadata Manager Service properties. Include port numbers for the Metadata Manager application and
the Metadata Manager Agent, and the Metadata Manager file location.

Database properties. Include database properties for the Metadata Manager repository.

Chapter 8: Metadata Manager Service

Configuration properties. Include the HTTP security protocol and keystore file, and maximum concurrent
and queued requests to the Metadata Manager application.

Connection pool properties. Metadata Manager maintains a connection pool for connections to the
Metadata Manager repository. Connection pool properties include the number of active available
connections to the Metadata Manager repository database and the amount of time that Metadata Manager
holds database connection requests in the connection pool.

Advanced properties. Include properties for the Java Virtual Manager (JVM) memory settings, and
Metadata Manager Browse and Load tab options.

Custom properties. Configure custom properties that are unique to specific environments.

If you update any of the properties, restart the Metadata Manager Service for the modifications to take effect.

General Properties
To edit the general properties, select the Metadata Manager Service in the Navigator, select the Properties
view, and then click Edit in the General Properties section.
The following table describes the general properties for the service:
Property

Description

Name

Name of the service. The name is not case sensitive and must be unique within the
domain. It cannot exceed 128 characters or begin with @. It also cannot contain spaces
or the following special characters:
`~%^*+={}\;:'"/?.,<>|!()][
You cannot change the name of the service after you create it.

Description

Description of the service. The description cannot exceed 765 characters.

License

License object that allows use of the service.

Node

Node on which the service runs. To assign the Metadata Manager Service to a different
node, you must first disable the service.

Assigning the Metadata Manager Service to a Different Node

1.

Disable the Metadata Manager Service.

2.

Click Edit in the General Properties section.

3.

Select another node for the Node property, and then click OK.

4.

Click Edit in the Metadata Manager Service Properties section.

5.

Change the Metadata Manager File Location property to a location that is accessible from the new node,
and then click OK.

6.

Copy the contents of the Metadata Manager file location directory on the original node to the location on
the new node.

7.

If the Metadata Manager Service is running in HTTPS security mode, click Edit in the Configuration
Properties section. Change the Keystore File location to a location that is accessible from the new node,
and then click OK.

8.

Enable the Metadata Manager Service.

Metadata Manager Service Properties

179

Metadata Manager Service Properties

To edit the Metadata Manager Service properties, select the Metadata Manager Service in the Navigator,
select the Properties view, and then click Edit in the Metadata Manager Service Properties section.
The following table describes the Metadata Manager Service properties:
Property

Description

Port Number

Port number that the Metadata Manager application runs on. Default is 10250.

Agent Port

Port number for the Metadata Manager Agent when the Metadata Manager Service runs on
Windows. The agent uses this port to communicate with metadata source repositories. Default
is 10251.
If the Metadata Manager Service runs on UNIX, you must install the Metadata Manager Agent
on a separate Windows machine.

Metadata
Manager File
Location

Location of the files used by the Metadata Manager application. Files include the following file
types:
- Index files. Index files created by Metadata Manager required to search the Metadata Manager
warehouse.
- Log files. Log files generated by Metadata Manager when you load resources.
- Parameter files. Files generated by Metadata Manager and used by PowerCenter workflows.
- Repository backup files. Metadata Manager repository backup files that are generated by the
mmRepoCmd command line program.

By default, Metadata Manager stores the files in the following directory:

<Informatica services installation directory>\services
\MetadataManagerService\mm_files\<Metadata Manager Service name>
Metadata
Manager
Lineage
Graph
Location

Location that Metadata Manager uses to store graph database files for data lineage.
By default, Metadata Manager stores the graph database files in the following directory:
<Informatica services installation directory>\services
\MetadataManagerService\mm_files\<Metadata Manager Service name>

Metadata Manager File Location Rules and Guidelines

Use the following rules and guidelines when you configure the Metadata Manager file location:

If you change the Metadata Manager file location, copy the contents of the directory to the new location.

If you configure a shared file location, the location must be accessible to all nodes running a Metadata
Manager Service and to all users of the Metadata Manager application.

To decrease the load times for Cloudera Navigator resources, ensure that the Metadata Manager file
location directory is on a disk with a fast input/output rate.

Metadata Manager Lineage Graph Location Rules and Guidelines

Use the following rules and guidelines when you configure the Metadata Manager lineage graph location:

180

To change the Metadata Manager lineage graph location, you must disable the Metadata Manager
Service, copy the contents of the directory to the new location, and then restart the Metadata Manager
Service.

The lineage graph location must be accessible to all nodes that run the Metadata Manager Service and to
the Informatica domain administrator user account.

Chapter 8: Metadata Manager Service

Database Properties
You can edit the Metadata Manager repository database properties. Select the Metadata Manager Service in
the Navigator, select the Properties view, and then click Edit in the Database Properties section.
The following table describes the database properties for a Metadata Manager repository database:
Property

Description

Database
Type

Type of database for the Metadata Manager repository. To apply changes, restart the Metadata
Manager Service.

Code Page

Metadata Manager repository code page. The Metadata Manager Service and Metadata
Manager use the character set encoded in the repository code page when writing data to the
Metadata Manager repository. To apply changes, restart the Metadata Manager Service.
Note: The Metadata Manager repository code page, the code page on the machine where the
associated PowerCenter Integration Service runs, and the code page for any database
management and PowerCenter resources that you load into the Metadata Manager warehouse
must be the same.

Connect
String

Native connect string to the Metadata Manager repository database. The Metadata Manager
Service uses the connection string to create a target connection to the Metadata Manager
repository in the PowerCenter repository.
To apply changes, restart the Metadata Manager Service.

Database
User

User account for the Metadata Manager repository database. Set up this account using the
appropriate database client tools. To apply changes, restart the Metadata Manager Service.

Database
Password

Password for the Metadata Manager repository database user. Must be in 7-bit ASCII. To apply
changes, restart the Metadata Manager Service.

Tablespace
Name

Tablespace name for the Metadata Manager repository on IBM DB2. When you specify the
tablespace name, the Metadata Manager Service creates all repository tables in the same
tablespace. You cannot use spaces in the tablespace name. To apply changes, restart the
Metadata Manager Service.
To improve repository performance on IBM DB2 EEE repositories, specify a tablespace name
with one node.

Database
Hostname

Host name for the Metadata Manager repository database. To apply changes, restart the
Metadata Manager Service.

Database Port

Port number for the Metadata Manager repository database. To apply changes, restart the
Metadata Manager Service.

SID/Service
Name

Indicates whether the Database Name property contains an Oracle full service name or an SID.

Database
Name

Full service name or SID for Oracle databases. Service name for IBM DB2 databases.
Database name for Microsoft SQL Server databases. To apply changes, restart the Metadata
Manager Service.

Metadata Manager Service Properties

181

Property

Description

Additional
JDBC
Parameters

Additional JDBC parameters that you want to append to the database connection URL. Enter
the parameters as name=value pairs separated by semicolon characters (;). For example:
param1=value1;param2=value2
You can use this property to specify the following information:
- Backup server location. If you use a database server that is highly available such as Oracle RAC,
enter the location of a backup server.
- Oracle Advanced Security Option (ASO) parameters. If the Metadata Manager repository database
is an Oracle database that uses ASO, enter the following additional parameters:

EncryptionLevel=[encryption level];EncryptionTypes=[encryption
types];DataIntegrityLevel=[data integrity
level];DataIntegrityTypes=[data integrity types]
The parameter values must match the values in the sqlnet.ora file on the machine where the
Metadata Manager Service runs.
- Authentication information for Microsoft SQL Server.
Note: The Metadata Manager Service does not support the alternateID option for DB2.
To authenticate the user credentials using Windows authentication and establish a trusted
connection to a Microsoft SQL Server repository, enter the following text:
AuthenticationMethod=ntlm;LoadLibraryPath=[directory containing
DDJDBCx64Auth04.dll].

jdbc:informatica:sqlserver://[host]:[port];DatabaseName=[DB
name];AuthenticationMethod=ntlm;LoadLibraryPath=[directory
containing DDJDBCx64Auth04.dll]
When you use a trusted connection to connect to a Microsoft SQL Server database, the Metadata
Manager Service connects to the repository with the credentials of the user logged in to the
machine on which the service is running.
To start the Metadata Manager Service as a Windows service using a trusted connection, configure
the Windows service properties to log on using a trusted user account.

Secure JDBC
Parameters

Secure JDBC parameters that you want to append to the database connection URL. Use this
property to specify secure connection parameters such as passwords. The Administrator tool
does not display secure parameters or parameter values in the Metadata Manager Service
properties. Enter the parameters as name=value pairs separated by semicolon characters (;).
For example:
param1=value1;param2=value2
If secure communication is enabled for the Metadata Manager repository database, enter the
secure JDBC parameters in this property.
To update the secure JDBC parameters, click Modify Secure JDBC Parameters and enter the
new values.

JDBC Parameters for Secure Databases

If secure communication is enabled for the Metadata Manager repository database, you must configure
additional JDBC parameters in the Secure JDBC Parameters property.
Enter the following parameters in the Secure JDBC Parameters property:
EncryptionMethod=SSL;TrustStore=<truststore
location>;TrustStorePassword=<password>;HostNameInCertificate=<host
name>;ValidateServerCertificate=<true|false>;KeyStore=<keystore
location>;keyStorePassword=<password>
Configure the parameters as follows:

182

Chapter 8: Metadata Manager Service

EncryptionMethod
Encryption method for data transfer between Metadata Manager and the database server. Must be set to
SSL.
TrustStore
Path and file name of the truststore file that contains the SSL certificate of the database server.
TrustStorePassword
Password used to access the truststore file.
HostNameInCertificate
Host name of the machine that hosts the secure database. If you specify a host name, the Metadata
Manager Service validates the host name included in the connection string against the host name in the
SSL certificate.
ValidateServerCertificate
Indicates whether the Metadata Manager Service validates the certificate that the database server
presents. If you set this parameter to true, the Metadata Manager Service validates the certificate. If you
specify the HostNameInCertificate parameter, the Metadata Manager Service also validates the host
name in the certificate.
If you set this parameter to false, the Metadata Manager Service does not validate the certificate that the
database server presents. The Metadata Manager Service ignores any truststore information that you
specify.
KeyStore
Path and file name of the keystore file that contains the SSL certificates that the Metadata Manager
Service presents to the database server.
KeyStorePassword
Password used to access the keystore file.

Configuration Properties
To edit the configuration properties, select the Metadata Manager Service in the Navigator, select the
Properties view, and then click Edit in the Configuration Properties section.
The following table describes the configuration properties for a Metadata Manager Service:
Property

Description

URLScheme

Indicates the security protocol that you configure for the Metadata Manager
application: HTTP or HTTPS.

Keystore File

Keystore file that contains the keys and certificates required if you use the SSL
security protocol with the Metadata Manager application. You must use the same
security protocol for the Metadata Manager Agent if you install it on another
machine.

Keystore Password

Password for the keystore file.

Metadata Manager Service Properties

183

Property

Description

MaxConcurrentRequests

Maximum number of request processing threads available, which determines the

maximum number of client requests that Metadata Manager can handle
simultaneously. Default is 100.

MaxQueueLength

Maximum queue length for incoming connection requests when all possible request
processing threads are in use by the Metadata Manager application. Metadata
Manager refuses client requests when the queue is full. Default is 500.

You can use the MaxConcurrentRequests property to set the number of clients that can connect to Metadata
Manager. You can use the MaxQueueLength property to set the number of client requests Metadata Manager
can process at one time.
You can change the parameter values based on the number of clients that you expect to connect to Metadata
Manager. For example, you can use smaller values in a test environment. In a production environment, you
can increase the values. If you increase the values, more clients can connect to Metadata Manager, but the
connections might use more system resources.

Connection Pool Properties

To edit the connection pool properties, select the Metadata Manager Service in the Navigator, select the
Properties view, and then click Edit in the Connection Pool Properties section.
The following table describes the connection pool properties for a Metadata Manager Service:
Property

Description

Maximum Active
Connections

Number of active connections to the Metadata Manager repository database available. The
Metadata Manager application maintains a connection pool for connections to the repository
database.
Increase the number of maximum active connections when you increase the number of
maximum concurrent resource loads. For example, if you set the Max Concurrent Resource
Load property to 10, Informatica recommends that you also set this property to 50 or more.
Default is 20.

Maximum Wait
Time

Amount of time in seconds that Metadata Manager holds database connection requests in
the connection pool. If Metadata Manager cannot process the connection request to the
repository within the wait time, the connection fails.
Default is 180.

184

Chapter 8: Metadata Manager Service

Advanced Properties
To edit the advanced properties, select the Metadata Manager Service in the Navigator, select the
Properties view, and then click Edit in the Advanced Properties section.
The following table describes the advanced properties for a Metadata Manager Service:
Property

Description

Max Heap
Size

Amount of RAM in megabytes allocated to the Java Virtual Manager (JVM) that runs Metadata
Manager. Use this property to increase the performance of Metadata Manager.
For example, you can use this value to increase the performance of Metadata Manager during
indexing.
Note: If you create Cloudera Navigator resources, set this property to at least 4096 MB (4 GB).
Default is 1024.

Maximum
Catalog Child
Objects

Number of child objects that appear in the Metadata Manager metadata catalog for any parent
object. The child objects can include folders, logical groups, and metadata objects. Use this
option to limit the number of child objects that appear in the metadata catalog for any parent
object.
Default is 100.

Error Severity
Level

Level of error messages written to the Metadata Manager Service log. Specify one of the
following message levels:
-

Fatal
Error
Warning
Info
Trace
Debug

When you specify a severity level, the log includes all errors at that level and above. For
example, if the severity level is Warning, the log includes fatal, error, and warning messages.
Use Trace or Debug if Informatica Global Customer Support instructs you to use that logging
level for troubleshooting purposes.
Default is Error.

Metadata Manager Service Properties

185

Property

Description

Max
Concurrent
Resource
Load

Maximum number of resources that Metadata Manager can load simultaneously. Maximum is
10.
Metadata Manager adds resource loads to the load queue in the order that you request the
loads. If you simultaneously load more than the maximum, Metadata Manager adds the
resource loads to the load queue in a random order. For example, you set the property to 5 and
schedule eight resource loads to run at the same time. Metadata Manager adds the eight loads
to the load queue in a random order. Metadata Manager simultaneously processes the first five
resource loads in the queue. The last three resource loads wait in the load queue.
If a resource load succeeds, fails and cannot be resumed, or fails during the path building task
and can be resumed, Metadata Manager removes the resource load from the queue. Metadata
Manager starts processing the next load waiting in the queue.
If a resource load fails when the PowerCenter Integration Service runs the workflows and the
workflows can be resumed, the resource load is resumable. Metadata Manager keeps the
resumable load in the load queue until the timeout interval is exceeded or until you resume the
failed load. Metadata Manager includes a resumable load due to a failure during workflow
processing in the concurrent load count.
Default is 3.
Note: If you increase the number of maximum concurrent resource loads, increase the number
of maximum active connections to the Metadata Manager repository database. For example, if
you set this property to 10, Informatica recommends that you also set the Maximum Active
Connections property to 50 or more.

Timeout
Interval

Amount of time in minutes that Metadata Manager holds a resumable resource load in the load
queue. You can resume a resource load within the timeout period if the load fails when
PowerCenter runs the workflows and the workflows can be resumed. If you do not resume a
failed load within the timeout period, Metadata Manager removes the resource from the load
queue.
Default is 30.
Note: If a resource load fails during the path building task, you can resume the failed load at
any time.

Custom Properties for the Metadata Manager Service

Configure custom properties that are unique to specific environments.
You might need to apply custom properties in special cases. When you define a custom property, enter the
property name and an initial value. Define custom properties only at the request of Informatica Global
Customer Support.

Configuring the Associated PowerCenter Integration

Service
You can configure or remove the PowerCenter Integration Service that Metadata Manager uses to load
metadata into the Metadata Manager warehouse. If you remove the PowerCenter Integration Service,
configure another PowerCenter Integration Service to enable the Metadata Manager Service.
To edit the associated PowerCenter Integration Service properties, select the Metadata Manager Service in
the Navigator, select the Associated Services view, and click Edit. To apply changes, restart the Metadata
Manager Service.

186

Chapter 8: Metadata Manager Service

The following table describes the associated PowerCenter Integration Service properties:
Property

Description

Associated Integration
Service

Name of the PowerCenter Integration Service that you want to use with Metadata
Manager.

Repository User Name

Name of the PowerCenter repository user that has the required privileges. Not
available for a domain with Kerberos authentication.

Repository Password

Password for the PowerCenter repository user. Not available for a domain with
Kerberos authentication.

Security Domain

Name of the security domain to which the PowerCenter repository user belongs.

Privileges for the Associated PowerCenter Integration Service

User
The PowerCenter repository user for the associated PowerCenter Integration Service must be able to perform
the following tasks:

Restore the PowerCenter repository.

Import and export PowerCenter repository objects.

Create, edit, and delete connection objects in the PowerCenter repository.

Create folders in the PowerCenter repository.

Load metadata into the Metadata Manager warehouse.

To perform these tasks, the user must have the required privileges and permissions for the domain,
PowerCenter Repository Service, and Metadata Manager Service.
The following table lists the required privileges and permissions that the PowerCenter repository user for the
associated PowerCenter Integration Service must have:
Service

Privileges

Permissions

Domain

- Access Informatica Administrator

- Manage Services

Permission on PowerCenter Repository

Service

PowerCenter
Repository
Service

Access Repository Manager

Create Folders
Create, Edit, and Delete Design Objects
Create, Edit, and Delete Sources and
Targets
- Create, Edit, and Delete Run-time
Objects
- Manage Run-time Object Execution
- Create Connections

- Read, Write, and Execute on all connection

objects created by the Metadata Manager
Service
- Read, Write, and Execute on the Metadata
Load folder and all folders created to extract
profiling data from the Metadata Manager
source

Metadata Manager
Service

Load Resource

In the PowerCenter repository, the user who creates a folder or connection object is the owner of the object.
The object owner or a user assigned the Administrator role for the PowerCenter Repository Service can
delete repository folders and connection objects. If you change the associated PowerCenter Integration

Configuring the Associated PowerCenter Integration Service

187

Service user, you must assign this user as the owner of the following repository objects in the PowerCenter
Client:

188

All connection objects created by the Metadata Manager Service

The Metadata Load folder and all profiling folders created by the Metadata Manager Service

Chapter 8: Metadata Manager Service

CHAPTER 9

Model Repository Service

This chapter includes the following topics:

Model Repository Service Overview, 189

Model Repository Architecture, 190

Model Repository Connectivity, 190

Model Repository Database Requirements, 191

Enable and Disable Model Repository Services and Processes, 193

Properties for the Model Repository Service, 195

Properties for the Model Repository Service Process, 201

High Availability for the Model Repository Service, 203

Model Repository Service Management, 204

Repository Object Administration, 214

Creating a Model Repository Service, 216

Model Repository Service Overview

The Model Repository Service manages the Model repository. The Model repository stores metadata created
by Informatica products in a relational database to enable collaboration among the products. Informatica
Developer, Informatica Analyst, Data Integration Service, and the Administrator tool store metadata in the
Model repository.
Use the Administrator tool or the infacmd command line program to administer the Model Repository Service.
Create one Model Repository Service for each Model repository. When you create a Model Repository
Service, you can create a Model repository or use an existing Model repository. You can run multiple Model
Repository Services on the same node.
Manage users, groups, privileges, and roles on the Security tab of the Administrator tool. Manage
permissions for Model repository objects in the Informatica Developer and the Informatica Analyst.
Based on your license, the Model Repository Service can be highly available.

189

Model Repository Architecture

The Model Repository Service process fetches, inserts, and updates metadata in the Model repository
database tables. A Model Repository Service process is an instance of the Model Repository Service on the
node where the Model Repository Service runs.
The Model Repository Service receives requests from the following client applications:

Informatica Developer. Informatica Developer connects to the Model Repository Service to create, update,
and delete objects. Informatica Developer and Informatica Analyst share objects in the Model repository.

Informatica Analyst. Informatica Analyst connects to the Model Repository Service to create, update, and
delete objects. Informatica Developer and Informatica Analyst client applications share objects in the
Model repository.

Data Integration Service. When you start a Data Integration Service, it connects to the Model Repository
Service. The Data Integration Service connects to the Model Repository Service to run or preview project
components. The Data Integration Service also connects to the Model Repository Service to store runtime metadata in the Model repository. Application configuration and objects within an application are
examples of run-time metadata.

Note: A Model Repository Service can be associated with one Analyst Service and multiple Data Integration
Services.

Model Repository Objects

The Model Repository Service stores design-time and run-time objects in the Model repository. The
Developer and Analyst tools create, update, and manage the design-time objects in the Model repository.
The Data Integration Service creates and manages run-time objects and metadata in the Model repository.
When you deploy an application to the Data Integration Service, the Deployment Manager copies application
objects to the Model repository associated with the Data Integration Service. Run-time metadata generated
during deployment are stored in the Model repository.
If you replace or redeploy an application, the previous version is deleted from the repository. If you rename
an application, the previous application remains in the Model repository.
The Model repository locks objects by default, and when the Model repository is integrated with a version
control system, you can manage checked out objects. For more information, see Repository Object
Administration on page 214.

Model Repository Connectivity

The Model Repository Service connects to the Model repository using JDBC drivers. Informatica Developer,
Informatica Analyst, Informatica Administrator, and the Data Integration Service communicate with the Model
Repository Service over TCP/IP. Informatica Developer, Informatica Analyst, and Data Integration Service
are Model repository clients.

190

Chapter 9: Model Repository Service

The following figure shows how a Model repository client connects to the Model repository database:

1. A Model repository client sends a repository connection request to the master gateway node, which is the entry point to the domain.
2. The Service Manager sends back the host name and port number of the node running the Model Repository Service. In the diagram,
the Model Repository Service is running on node A.
3. The repository client establishes a TCP/IP connection with the Model Repository Service process on node A.
4. The Model Repository Service process communicates with the Model repository database over JDBC. The Model Repository Service
process stores objects in or retrieves objects from the Model repository database based on requests from the Model repository client.

Note: The Model repository tables have an open architecture. Although you can view the repository tables,
never manually edit them through other utilities. Informatica is not responsible for corrupted data that is
caused by customer alteration of the repository tables or data within those tables.

Model Repository Database Requirements

Before you create a repository, you need a database to store repository tables. Use the database client to
create the database. After you create a database, you can use the Administrator tool to create a Model
Repository Service.
Each Model repository must meet the following requirements:

Each Model repository must have its own schema. Two Model repositories or the Model repository and the
domain configuration database cannot share the same schema.

Each Model repository must have a unique database name.

In addition, each Model repository must meet database-specific requirements.

Model Repository Database Requirements

191

Note: The Model Repository Service uses the DataDirect drivers included with the Informatica installation.
Informatica does not support the use of any other database driver.

IBM DB2 Database Requirements

Use the following guidelines when you set up the repository on IBM DB2:

If the repository is in an IBM DB2 9.7 database, verify that IBM DB2 Version 9.7 Fix Pack 7 or a later fix
pack is installed.

On the IBM DB2 instance where you create the database, set the following parameters to ON:
- DB2_SKIPINSERTED
- DB2_EVALUNCOMMITTED
- DB2_SKIPDELETED
- AUTO_RUNSTATS

On the database, set the configuration parameters.

The following table lists the configuration parameters that you must set:
Parameter

Value

applheapsz

8192

appl_ctl_heap_sz

8192
For IBM DB2 9.5 only.

logfilsiz

8000

maxlocks

98

locklist

50000

auto_stmt_stats

ON

Set the tablespace pageSize parameter to 32768 bytes.

In a single-partition database, specify a tablespace that meets the pageSize requirements. If you do not
specify a tablespace, the default tablespace must meet the pageSize requirements.
In a multi-partition database, specify a tablespace that meets the pageSize requirements. Define the
tablespace in the catalog partition of the database.

192

Set the NPAGES parameter to at least 5000. The NPAGES parameter determines the number of pages in
the tablespace.

Verify that the database user has CREATETAB, CONNECT, and BINDADD privileges.

Informatica does not support IBM DB2 table aliases for repository tables. Verify that table aliases have not
been created for any tables in the database.

Chapter 9: Model Repository Service

In the DataDirect Connect for JDBC utility, update the DynamicSections parameter to 3000.
The default value for DynamicSections is too low for the Informatica repositories. Informatica requires a
larger DB2 package than the default. When you set up the DB2 database for the domain configuration
repository or a Model repository, you must set the DynamicSections parameter to at least 3000. If the
DynamicSections parameter is set to a lower number, you can encounter problems when you install or run
Informatica services.
For more information about updating the DynamicSections parameter, see Appendix D, Updating the
DynamicSections Parameter of a DB2 Database on page 447.

IBM DB2 Version 9.1

If the Model repository is in an IBM DB2 9.1 database, run the DB2 reorgchk command to optimize database
operations. The reorgchk command generates the database statistics used by the DB2 optimizer in queries
and updates.
Use the following command:
REORGCHK UPDATE STATISTICS on SCHEMA <SchemaName>
Run the command on the database after you create the repository content.

Microsoft SQL Server Database Requirements

Use the following guidelines when you set up the repository on Microsoft SQL Server:

Set the read committed isolation level to READ_COMMITTED_SNAPSHOT to minimize locking

contention.
To set the isolation level for the database, run the following command:
ALTER DATABASE DatabaseName SET READ_COMMITTED_SNAPSHOT ON
To verify that the isolation level for the database is correct, run the following command:
SELECT is_read_committed_snapshot_on FROM sys.databases WHERE name = DatabaseName

The database user account must have the CONNECT, CREATE TABLE, and CREATE VIEW privileges.

Oracle Database Requirements

Use the following guidelines when you set up the repository on Oracle:

Verify that the database user has the CONNECT, RESOURCE, and CREATE VIEW privileges.

Informatica does not support Oracle public synonyms for repository tables. Verify that public synonyms
have not been created for any tables in the database.

Enable and Disable Model Repository Services and

Processes
You can enable and disable the entire Model Repository Service or a single Model Repository Service
process on a particular node. If you run the Model Repository Service with the high availability option, you

Enable and Disable Model Repository Services and Processes

193

have one Model Repository Service process configured for each node. The Model Repository Service runs
the Model Repository Service process on the primary node.

Enable, Disable, or Recycle the Model Repository Service

You can enable, disable, or recycle the Model Repository Service. You might disable the service to perform
maintenance or to temporarily restrict users from accessing the Model Repository Service or Model
repository. You might recycle the service if you changed a service property.
You must enable the Model Repository Service to perform the following tasks in the Administrator tool:

Create, back up, restore, delete, or upgrade Model repository content.

Create and delete the Model repository search index.

Manage permissions on the Model repository.

Synchronize the Model repository with a version control system.

Note: When you enable the Model Repository Service, the machine on which the service runs requires at
least 750 MB of free memory. If enough free memory is not available, the service might fail to start.
When you enable a Model Repository Service that runs on a single node, a service process starts on the
node. When you enable a Model Repository Service configured to run on primary and back-up nodes, a
service process is available to run on each node, but it might not start. For example, you have the high
availability option and you configure a Model Repository Service to run on a primary node and two back-up
nodes. You enable the Model Repository Service, which enables a service process on each of the three
nodes. A single process runs on the primary node, and the other processes on the back-up nodes maintain
standby status.
When you disable the Model Repository Service, you shut down the Model Repository Service and disable all
service processes.
When you disable the Model Repository Service, you must choose the mode to disable it in. You can choose
one of the following options:

Complete. Allows the service operations to run to completion before disabling the service.

Abort. Tries to stop all service operations before aborting them and disabling the service.

When you recycle the Model Repository Service, the Service Manager restarts the Model Repository Service.

Enabling, Disabling, or Recycling the Service

You can enable, disable, or recycle the service from the Administrator tool.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the service.

3.

On the Manage tab Actions menu, click one of the following options:

Enable Service to enable the service.

Disable Service to disable the service.

Choose the mode to disable the service in. Optionally, you can choose to specify whether the action
was planned or unplanned, and enter comments about the action. If you complete these options, the
information appears in the Events and Command History panels in the Domain view on the
Manage tab.

194

Recycle Service to recycle the service.

Chapter 9: Model Repository Service

Enable or Disable a Model Repository Service Process

You can enable or disable a Model Repository Service process on a particular node.
When the Model Repository Service runs on a single node, disabling the service process disables the
service.
When you have the high availability option and you configure the Model Repository Service to run on primary
and back-up nodes, disabling a service process does not disable the service. Disabling a service process
that is running causes the service to fail over to another node.

Enabling or Disabling a Service Process

You can enable or disable a service process from the Administrator tool.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the service.

3.

In the contents panel, click the Processes view.

4.

On the Manage tab Actions menu, click one of the following options:

Enable Process to enable the service process.

Disable Process to disable the service process. Choose the mode to disable the service process in.

Properties for the Model Repository Service

Use the Administrator tool to configure the following service properties:

General properties

Repository database properties

Search properties

Advanced properties

Cache properties

Versioning properties

Custom properties

If you update any of the properties, you must restart the Model Repository Service for the modifications to
take effect.
If you modify the repository database for a Model Repository Service that is configured for monitoring, then
you must restart the domain. If you do not restart the domain after you modify the repository database, then
the Model Repository Service does not resume statistics collection.

Properties for the Model Repository Service

195

General Properties for the Model Repository Service

The following table describes the general properties for the service:
Property

Description

Name

Name of the service. The name is not case sensitive and must be unique within the
domain. It cannot exceed 128 characters or begin with @. It also cannot contain
spaces or the following special characters:
`~%^*+={}\;:'"/?.,<>|!()][
You cannot change the name of the service after you create it.

Description

Description of the service. The description cannot exceed 765 characters.

License

License object that allows use of the service.

Node

Node on which the service runs.

Backup Nodes

If your license includes high availability, nodes on which the service can run if the
primary node is unavailable.

Repository Database Properties for the Model Repository Service

The following table describes the database properties for the Model repository:
Property

Description

Database Type

The type of database.

Username

The database user name for the Model repository.

Password

Repository database password for the database user.

JDBC Connect String

The JDBC connection string used to connect to the Model repository database.
Use the following JDBC connect string syntax for each supported database:
- IBM DB2. jdbc:informatica:db2://
<host_name>:<port_number>;DatabaseName=<database_name>;Ba
tchPerformanceWorkaround=true;DynamicSections=3000
- Microsoft SQL Server that uses the default instance.

jdbc:informatica:sqlserver://
<host_name>:<port_number>;DatabaseName=<database_name>;Sn
apshotSerializable=true
- Microsoft SQL Server that uses a named instance.

jdbc:informatica:sqlserver://<host_name>
\<named_instance_name>;DatabaseName=<database_name>;Snaps
hotSerializable=true
- Oracle. jdbc:informatica:oracle://
<host_name>:<port_number>;SID=<database_name>;MaxPooledSt
atements=20;CatalogOptions=0;BatchPerformanceWorkaround=t
rue

196

Chapter 9: Model Repository Service

Property

Description

Secure JDBC Parameters

If the Model repository database is secured with the SSL protocol, you must enter
the secure database parameters.
Enter the parameters as name=value pairs separated by semicolon characters
(;). For example:
param1=value1;param2=value2

Dialect

The SQL dialect for a particular database. The dialect maps java objects to
database objects.
For example:
org.hibernate.dialect.Oracle9Dialect

Driver

The Data Direct driver used to connect to the database.

For example:
com.informatica.jdbc.oracle.OracleDriver

Database Schema

The schema name for a particular database.

Database Tablespace

The tablespace name for a particular database. For a multi-partition IBM DB2
database, the tablespace must span a single node and a single partition.

JDBC Parameters for Secure Databases

If the Model repository database is secured with the SSL protocol, you must enter the secure database
parameters in the Secure JDBC Parameters field.
Enter the parameters as name=value pairs separated by semicolon characters (;). For example:
param1=value1;param2=value2
Enter the following secure database parameters:
Secure Database Parameter

Description

EncryptionMethod

Required. Indicates whether data is encrypted when transmitted over the

network. This parameter must be set to SSL.

ValidateServerCertificate

Optional. Indicates whether Informatica validates the certificate that the

database server sends.
If this parameter is set to True, Informatica validates the certificate that the
database server sends. If you specify the HostNameInCertificate parameter,
Informatica also validates the host name in the certificate.
If this parameter is set to False, Informatica does not validate the certificate
that the database server sends. Informatica ignores any truststore
information that you specify.

HostNameInCertificate

Optional. Host name of the machine that hosts the secure database. If you
specify a host name, Informatica validates the host name included in the
connection string against the host name in the SSL certificate.

cryptoProtocolVersion

Required for Oracle if the Informatica domain runs on AIX and the Oracle
database encryption level is set to TLS. Set the parameter to
cryptoProtocolVersion=TLSv1,TLSv1.1,TLSv1.2.

Properties for the Model Repository Service

197

Secure Database Parameter

Description

TrustStore

Required. Path and file name of the truststore file that contains the SSL
certificate for the database.
If you do not include the path for the truststore file, Informatica looks for the
file in the following default directory: <Informatica installation
directory>/tomcat/bin

TrustStorePassword

Required. Password for the truststore file for the secure database.

Note: Informatica appends the secure JDBC parameters to the JDBC connection string. If you include the
secure JDBC parameters directly in the connection string, do not enter any parameter in the Secure JDBC
Parameters field.

Search Properties for the Model Repository Service

The following table describes the search properties for the Model Repository Service:
Property

Description

Search Analyzer

Fully qualified Java class name of the search analyzer.

By default, the Model Repository Service uses the following search analyzer for
English:
com.informatica.repository.service.provider.search.analysi
s.MMStandardAnalyzer
You can specify the following Java class name of the search analyzer for Chinese,
Japanese and Korean languages:
org.apache.lucene.analysis.cjk.CJKAnalyzer
Or, you can create and specify a custom search analyzer.

Search Analyzer Factory

Fully qualified Java class name of the factory class if you used a factory class when
you created a custom search analyzer.
If you use a custom search analyzer, enter the name of either the search analyzer
class or the search analyzer factory class.

198

Chapter 9: Model Repository Service

Advanced Properties for the Model Repository Service

The following table describes the Advanced properties for the Model Repository Service:
Property

Description

Maximum Heap Size

Amount of RAM allocated to the Java Virtual Machine (JVM) that runs the Model
Repository Service. Use this property to increase the performance. Append one of
the following letters to the value to specify the units:
-

b for bytes.
k for kilobytes.
m for megabytes.
g for gigabytes.

Default is 768 megabytes.

JVM Command Line
Options

Java Virtual Machine (JVM) command line options to run Java-based programs.
When you configure the JVM options, you must set the Java SDK classpath, Java
SDK minimum memory, and Java SDK maximum memory properties.
You must set the following JVM command line options:
- Xms. Minimum heap size. Default value is 256 m.
- MaxPermSize. Maximum permanent generation size. Default is 128 m.
- Dfile.encoding. File encoding. Default is UTF-8.

Cache Properties for the Model Repository Service

The following table describes the cache properties for the Model Repository Service:
Property

Description

Enable Cache

Enables the Model Repository Service to store Model repository objects in cache
memory. To apply changes, restart the Model Repository Service.

Cache JVM Options

JVM options for the Model Repository Service cache. To configure the amount of
memory allocated to cache, configure the maximum heap size. This field must
include the maximum heap size, specified by the -Xmx option. The default value
and minimum value for the maximum heap size is -Xmx128m. The options you
configure apply when Model Repository Service cache is enabled. To apply
changes, restart the Model Repository Service. The options you configure in this
field do not apply to the JVM that runs the Model Repository Service.

Versioning Properties for the Model Repository Service

To connect to a version control system, you must configure versioning properties in the Model Repository
Service.
You can configure versioning properties for the Perforce or Subversion version control systems. Subversion
is abbreviated "SVN".
Some of the properties refer to the version control system host machine and user accounts. Contact the
version control system administrator for this information.
After you configure versioning properties, you restart the Model repository, and then run infacmd mrs
PopulateVCS to synchronize Model repository contents to the version control system.

Properties for the Model Repository Service

199

Note: While the Model repository synchronizes its contents with the version control system for the first time,
the Model repository is unavailable. Model repository users must close all editable objects before the process
starts.
The following table describes the versioning properties for the Model Repository Service:
Property

Description

Version control system

type

The supported version control system that you want to connect to. You can choose
Perforce or SVN.

Host

The URL, IP address, or host name of the machine where the Perforce version
control system runs.
When you configure SVN as the version control system, this option is not available.

URL

The URL of the SVN version control system repository.

When you configure Perforce as the version control system, this option is not
available.

Port

Required. Port number that the version control system host uses to listen for
requests from the Model Repository Service.

Path to repository objects

Path to the root directory of the version control system that stores the Model
repository objects.
Note: When you complete editing Versioning properties, the Model repository
connects to the version control system and generates the specified directory if the
directory does not exist yet.
Only one Model Repository Service can use this directory.
For Perforce, use the syntax:
//directory/path
where directory is the Perforce directory root, and path is the remainder of the
path to the root directory of Model repository objects.
Example:
//depot/Informatica/repository_copy
When you configure SVN as the version control system, this option is not available.
Note: If you change the depot path after you synchronize the Model repository with
the version control system, version history for objects in the Model repository is lost.

Username

User account for the version control system user.

This account must have write permissions on the version control system. After you
configure the connection with this single version control system user and password,
all Model repository users use this account.
For the Perforce version control system, the account type must be a Standard user.

Password

Password for the version control system user.

Custom Properties for the Model Repository Service

Configure custom properties that are unique to specific environments.
You might need to apply custom properties in special cases. When you define a custom property, enter the
property name and an initial value. Define custom properties only at the request of Informatica Global
Customer Support.

200

Chapter 9: Model Repository Service

Properties for the Model Repository Service Process

The Model Repository Service runs the Model Repository Service process on one node. When you select the
Model Repository Service in the Administrator tool, you can view information about the Model Repository
Service process on the Processes tab. You can also configure search and logging for the Model Repository
Service process.
Note: You must select the node to view the service process properties in the Service Process Properties
section.

Node Properties for the Model Repository Service Process

Use the Administrator tool to configure the following types of Model Repository Service process properties:

Search properties

Repository performance properties

Audit properties

Repository log properties

Custom properties

Environment variables

Search Properties for the Model Repository Service Process

Search properties for the Model Repository Service process.
The following table describes the search properties for the Model Repository Service process:
Property

Description

Search Index Root

Directory

The directory that contains the search index files.

Default is:
<Informatica_Installation_Directory>/tomcat/bin/target/
repository/<system_time>/<service_name>/index
system_time is the system time when the directory is created.

Repository Performance Properties for the Model Repository Service Process

Performance tuning properties for storage of data objects in the Model Repository Service.
The Model Repository Service uses an open source object-relational mapping tool called Hibernate to map
and store data objects and metadata to the Model repository database. For each service process, you can
set Hibernate options to configure connection and statement pooling for the Model repository.

Properties for the Model Repository Service Process

201

The following table describes the performance properties for the Model Repository Service process:
Property

Description

Hibernate Connection
Pool Size

The maximum number of pooled connections in the Hibernate internal connection

pooling. Equivalent to the hibernate.connection.pool_size property. Default is 10.

Hibernate c3p0 Minimum

Size

Minimum number of connections a pool will maintain at any given time. Equivalent
to the c3p0 minPoolSize property. Default is 1.

Hibernate c3p0 Maximum

Statements

Size of the c3p0 global cache for prepared statements. This property controls the
total number of statements cached. Equivalent to the c3p0 maxStatements property.
Default is 1000.
The Model Repository Service uses the value of this property to set the c3p0
maxStatementsPerConnection property based on the number of connections set in
the Hibernate Connection Pool Size property.

Audit Properties for the Model Repository Service Process

Audit properties for the Model Repository Service process.
The following table describes the audit properties for the Model Repository Service process:
Property

Description

Audit Enabled

Displays audit logs in the Log Viewer. Default is False.

Repository Logs for the Model Repository Service Process

Repository log properties for the Model Repository Service process.
The following table describes the repository log properties for the Model Repository Service process:
Property

Description

Repository Logging
Directory

The directory that stores logs for Log Persistence Configuration or Log Persistence
SQL. To disable the logs, do not specify a logging directory. These logs are not the
repository logs that appear in the Log Viewer. Default is blank.

Log Level

The severity level for repository logs.

- Fatal. Writes FATAL messages to the log. FATAL messages include nonrecoverable
system failures that cause the service to shut down or become unavailable.
- Error. Writes FATAL and ERROR code messages to the log. ERROR messages
include connection failures, failures to save or retrieve metadata, service errors.
- Warning. Writes FATAL, WARNING, and ERROR messages to the log. WARNING
errors include recoverable system failures or warnings.
- Info. Writes FATAL, INFO, WARNING, and ERROR messages to the log. INFO
messages include system and service change messages.
- Trace. Write FATAL, TRACE, INFO, WARNING, and ERROR code messages to the
log. TRACE messages log user request failures.
- Debug. Write FATAL, DEBUG, TRACE, INFO, WARNING, and ERROR messages to
the log. DEBUG messages are user request logs.

The default value is Info.

202

Chapter 9: Model Repository Service

Property

Description

Log Persistence
Configuration to File

Indicates whether to write persistence configuration to a log file. The Model

Repository Service logs information about the database schema, object relational
mapping, repository schema change audit log, and registered IMF packages. The
Model Repository Service creates the log file when the Model repository is enabled,
created, or upgraded. The Model Repository Service stores the logs in the specified
repository logging directory. If a repository logging directory is not specified, the
Model Repository Service does not generate the log files. You must disable and reenable the Model Repository Service after you change this option. Default is False.

Log Persistence SQL to

File

Indicates whether to write parameterized SQL statements to a log file in the

specified repository logging directory. If a repository logging directory is not
specified, the Model Repository Service does not generate the log files. You must
disable and re-enable the Model Repository Service after you change this option.
Default is False.

Custom Properties for the Model Repository Service Process

Configure custom properties that are unique to specific environments.
You might need to apply custom properties in special cases. When you define a custom property, enter the
property name and an initial value. Define custom properties only at the request of Informatica Global
Customer Support.

Environment Variables for the Model Repository Service Process

You can edit environment variables for a Model Repository Service process.
The following table describes the environment variables for the Model Repository Service process:
Property

Description

Environment Variables

Environment variables defined for the Model Repository Service process.

High Availability for the Model Repository Service

Model Repository high availability features minimize interruptions to data integration tasks by enabling the
Service Manager and Model Repository Service to react to network failures and failures of the Model
Repository Service.
Model Repository Service high availability includes restart and failover of the service. When the Model
Repository Service becomes unavailable, the Service Manager can restart the Model Repository Service on
the same node or on a backup node.
For more information about how to configure a highly available domain, see the Informatica Administrator
Guide.

High Availability for the Model Repository Service

203

Model Repository Service Restart and Failover

To minimize Model Repository Service downtime, the Service Manager restarts the Model Repository Service
on the same node or on a backup node if the Model Repository Service is unavailable.
The Model Repository Service fails over to a backup node in the following situations:

The Model Repository Service fails and the primary node is not available.

The Model Repository Service is running on a node that fails.

The Service Manager restarts the Model Repository Service based on domain property values set for the
amount of time spent trying to restart the service and the maximum number of attempts to try within the
restart period.
Model Repository Service clients are resilient to temporary connection failures during failover and restart of
the service.

Model Repository Service Management

Use the Administrator tool to manage the Model Repository Service and the Model repository content. For
example, you can use the Administrator tool to manage repository content, search, and repository logs.

Content Management for the Model Repository Service

When you create the Model Repository Service, you can create the repository content. Alternatively, you can
create the Model Repository Service using existing repository content. The repository name is the same as
the name of the Model Repository Service.
You can also delete the repository content. You may choose to delete repository content to delete a
corrupted repository or to increase disk or database space.

Creating and Deleting Repository Content

1.

On the Manage tab, select the Services and Nodes view.

2.

In the Domain Navigator, select the Model Repository Service.

3.

To create the repository content, on the Manage tab Actions menu, click Repository Contents >
Create.

4.

Or, to delete repository content, on the Manage tab Actions menu, click Repository Contents >
Delete.

If you delete and create new repository content for a Model Repository Service that is configured for
monitoring, then you must restart the domain after you create new content. If you do not restart the domain,
then the Model Repository Service does not resume statistics collection.

Model Repository Backup and Restoration

Regularly back up repositories to prevent data loss due to hardware or software problems. When you back up
a repository, the Model Repository Service saves the repository to a file, including the repository objects and

204

Chapter 9: Model Repository Service

the search index. If you need to recover the repository, you can restore the content of the repository from this
file.
When you back up a repository, the Model Repository Service writes the file to the service backup directory.
The service backup directory is a subdirectory of the node backup directory with the name of the Model
Repository Service. For example, a Model Repository Service named MRS writes repository backup files to
the following location:
<node_backup_directory>\MRS
You specify the node backup directory when you set up the node. View the general properties of the node to
determine the path of the backup directory. The Model Repository Service uses the extension .mrep for all
Model repository backup files.
To ensure that the Model Repository Service creates a consistent backup file, the backup operation blocks all
other repository operations until the backup completes. You might want to schedule repository backups when
users are not logged in.
To restore the backup file of a Model Repository Service to a different Model Repository Service, you must
copy the backup file and place it in backup directory of the Model Repository Service to which you want to
restore the backup. For example, you want to restore the backup file of a Model Repository Service named
MRS1 to a Model Repository Service named MRS2. You must copy the backup file of MRS1 from
<node_backup_directory>\MRS1 and place the file in <node_backup_directory>\MRS2.
Note: When you back up and then delete the contents of a Model repository, you must restart the Model
Repository Service before you restore the contents from the backup. If you try to restore the Model repository
contents and have not recycled the service, you may get an error related to search indices.

Backing Up the Repository Content

You can back up the content of a Model repository to restore the repository content to another repository or
to retain a copy of the repository.
1.

On the Manage tab, select the Services and Nodes view.

2.

In the Domain Navigator, select the Model Repository Service.

3.

On the Manage tab Actions menu, click Repository Contents > Back Up.
The Back Up Repository Contents dialog box appears.

4.

Enter the following information:

Option

Description

Username

User name of any user in the domain.

Password

Password of the domain user.

SecurityDomain

Domain to which the domain user belongs. Default is Native.

Output File Name

Name of the output file.

Description

Description of the contents of the output file.

5.

Click Overwrite to overwrite a file with the same name.

6.

Click OK.
The Model Repository Service writes the backup file to the service backup directory.

Model Repository Service Management

205

Restoring the Repository Content

You can restore repository content to a Model repository from a repository backup file.
Verify that the repository is empty. If the repository contains content, the restore option is disabled.
1.

On the Manage tab, select the Services and Nodes view.

2.

In the Navigator, select the Model Repository Service.

3.

On the Manage tab Actions menu, click Repository Contents > Restore.
The Restore Repository Contents dialog box appears.

4.

Select a backup file to restore.

5.

Enter the following information:

6.

Option

Description

Username

User name of any user in the domain.

Password

Password of the domain user.

Security Domain

Domain to which the domain user belongs. Default is Native.

Click OK.

If the Model Repository service is configured for monitoring, then you must recycle the Model Repository
Service. If you do not recycle the Model Repository Service, then the service does not resume statistics
collection.

Viewing Repository Backup Files

You can view the repository backup files written to the Model Repository Service backup directory.
1.

On the Manage tab, select the Services and Nodes view.

2.

In the Navigator, select the Model Repository Service.

3.

On the Manage tab Actions menu, click Repository Contents > View Backup Files.
The View Repository Backup Files dialog box appears and shows the backup files for the Model
Repository Service.

Security Management for the Model Repository Service

You manage users, groups, privileges, and roles on the Security tab of the Administrator tool.
You manage permissions for repository objects in Informatica Developer and Informatica Analyst.
Permissions control access to projects in the repository. Even if a user has the privilege to perform certain
actions, the user may also require permission to perform the action on a particular object.
To secure data in the repository, you can create a project and assign permissions to it. When you create a
project, you are the owner of the project by default. The owner has all permissions, which you cannot
change. The owner can assign permissions to users or groups in the repository.

206

Chapter 9: Model Repository Service

Search Management for the Model Repository Service

The Model Repository Service uses a search engine to create search index files.
When users perform a search, the Model Repository Service searches for metadata objects in the index files
instead of the Model repository.
To correctly index the metadata, the Model Repository Service uses a search analyzer appropriate for the
language of the metadata that you are indexing. The Model Repository Service includes the following
packaged search analyzers:

com.informatica.repository.service.provider.search.analysis.MMStandardAnalyzer. Default search

analyzer for English.

org.apache.lucene.analysis.cjk.CJKAnalyzer. Search analyzer for Chinese, Japanese, and Korean.

You can change the default search analyzer. You can use a packaged search analyzer or you can create and
use a custom search analyzer.
The Model Repository Service stores the index files in the search index root directory that you define for the
service process. The Model Repository Service updates the search index files each time a user saves,
modifies, or deletes a Model repository object. You must manually update the search index if you change the
search analyzer, if you create a Model Repository Service to use existing repository content, if you upgrade
the Model Repository Service, or if the search index files become corrupted.

Creating a Custom Search Analyzer

If you do not want to use one of the packaged search analyzers, you can create a custom search analyzer.
1.

Extend the following Apache Lucene Java class:

org.apache.lucene.analysis.Analyzer

2.

If you use a factory class when you extend the Analyzer class, the factory class implementation must
have a public method with the following signature:
public org.apache.lucene.analysis.Analyzer createAnalyzer(Properties settings)
The Model Repository Service uses the factory to connect to the search analyzer.

3.

Place the custom search analyzer and required .jar files in the following directory:
<Informatica_Installation_Directory>/services/ModelRepositoryService

Changing the Search Analyzer

You can change the default search analyzer that the Model Repository Service uses. You can use a
packaged search analyzer or you can create and use a custom search analyzer.
1.

In the Administrator tool, select the Services and Nodes view on the Manage tab.

2.

In the Navigator, select the Model Repository Service.

3.

To use one of the packaged search analyzers, specify the fully qualified java class name of the search
analyzer in the Model Repository Service search properties.

4.

To use a custom search analyzer, specify the fully qualified java class name of either the search
analyzer or the search analyzer factory in the Model Repository Service search properties.

5.

Recycle the Model Repository Service to apply the changes.

6.

Click Actions > Search Index > Re-Index on the Manage tab Actions menu to re-index the search
index.

Model Repository Service Management

207

Manually Updating Search Index Files

You manually update the search index if you change the search analyzer, if you create a Model Repository
Service to use existing repository content, if you upgrade the Model Repository Service, or if the search index
files become corrupted. For example, search index files can become corrupted due to insufficient disk space
in the search index root directory.
The amount of time needed to re-index depends on the number of objects in the Model repository. During the
re-indexing process, design-time objects in the Model repository are read-only.
Users in the Developer tool and Analyst tool can view design-time objects but cannot edit or create designtime objects.
If you re-index after changing the search analyzer, users can perform searches on the existing index while
the re-indexing process runs. When the re-indexing process completes, any subsequent user search request
uses the new index.
To correct corrupted search index files, you must delete, create, and then re-index the search index. When
you delete and create a search index, users cannot perform a search until the re-indexing process finishes.
You might want to manually update the search index files during a time when most users are not logged in.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the Model Repository Service.

3.

To re-index after changing the search analyzer, creating the Model Repository Service to use existing
repository content, or upgrading the Model Repository Service, click Actions > Search Index > ReIndex on the Manage tab Actions menu.

4.

To correct corrupted search index files, complete the following steps on the Manage tab Actions menu:
a.

Click Actions > Search Index > Delete to delete the corrupted search index.

b.

Click Actions > Search Index > Create to create a search index.

c.

Click Actions > Search Index > Re-Index to re-index the search index.

Repository Log Management for the Model Repository Service

The Model Repository Service generates repository logs. The repository logs contain repository messages of
different severity levels, such as fatal, error, warning, info, trace, and debug. You can configure the level of
detail that appears in the repository log files. You can also configure where the Model Repository Service
stores the log files.

Configuring Repository Logging

1.

In the Administrator tool, click the Manage tab.

2.

Click the Services and Nodes view.

3.

In the Domain Navigator, select the Model Repository Service.

4.

In the contents panel, select the Processes view.

5.

Select the node.

The service process details appear in the Service Process Properties section.

6.

Click Edit in the Repository section.

The Edit Processes page appears.

208

7.

Enter the directory path in the Repository Logging Directory field.

8.

Specify the level of logging in the Repository Logging Severity Level field.

Chapter 9: Model Repository Service

9.

Click OK.

Audit Log Management for the Model Repository Service

The Model Repository Service can generate audit logs in the Log Viewer.
The audit log provides information about the following types of operations performed on the Model repository:

Logging in and out of the Model repository.

Creating a project.

Creating a folder.

By default, audit logging is disabled.

Enabling and Disabling Audit Logging

1.

In the Administrator tool, click the Manage tab.

2.

Click the Services and Nodes view.

3.

In the Domain Navigator, select the Model Repository Service.

4.

In the contents panel, select the Processes view.

5.

Select the node.

The service process details appear in the Service Process Properties section.

6.

Click Edit in the Audit section.

The Edit Processes page appears.

7.

8.

Enter one of the following values in the Audit Enabled field:

True. Enables audit logging.

False. Disables audit logging. Default is false.

Click OK.

Cache Management for the Model Repository Service

To improve Model Repository Service performance, you can configure the Model Repository Service to use
cache memory. When you configure the Model Repository Service to use cache memory, the Model
Repository Service stores objects that it reads from the Model repository in memory. The Model Repository
Service can read the repository objects from memory instead of the Model repository. Reading objects from
memory reduces the load on the database server and improves response time.

Model Repository Cache Processing

When the cache process starts, the Model Repository Service stores each object it reads in memory. When
the Model Repository Service gets a request for an object from a client application, the Model Repository
Service compares the object in memory with the object in the repository. If the latest version of the object is
not in memory, the Model repository updates the cache and then returns the object to the client application
that requested the object. When the amount of memory allocated to cache is full, the Model Repository
Service deletes the cache for least recently used objects to allocate space for another object.
The Model Repository Service cache process runs as a separate process. The Java Virtual Manager (JVM)
that runs the Model Repository Service is not affected by the JVM options you configure for the Model
Repository Service cache.

Model Repository Service Management

209

Configuring Cache
1.

In the Administrator tool, click the Manage tab.

2.

Click the Services and Nodes view.

3.

In the Domain Navigator, select the Model Repository Service.

4.

Click Edit in the Cache Properties section.

5.

Select Enable Cache.

6.

Specify the amount of memory allocated to cache in the Cache JVM Options field.

7.

Restart the Model Repository Service.

8.

Verify that the cache process is running.

The Model Repository Service logs display the following message when the cache process is running:
MRSI_35204 "Caching process has started on host [host name] at port [port number]
with JVM options [JVM options]."

Version Control for the Model Repository Service

You can integrate a Model repository with a version control system. Version control system integration
protects Model repository objects from overwriting on a team where multiple developers work on the same
projects.
To enable version control, configure versioning properties, and then synchronize the Model repository with
the version control system.
You can integrate the Model repository with the Perforce or Subversion version control systems. You must
use a version control system that has not been integrated with a Model repository. Only one Model repository
can use a version control system instance.
You can configure versioning properties when you create or update a Model repository service.
The versioning properties include a version control system user ID and password. The connection uses this
single account to access the version control system for all actions related to versioned object management.
After you configure version control, ask Model repository users to close all editable objects, and then you
restart the Model repository.
When the Model repository restarts, it checks whether the version control system is in use by another Model
repository. If the version control system connects to a different Model repository, the Model Repository
Service cannot restart. You must configure versioning properties to connect to a version control system that
has not been integrated with a Model repository.
When you synchronize Model repository contents to the version control system, the Model repository
populates a directory in the version control system depot with Model repository objects. After the Model
repository copies its contents to the version control system directory, you cannot disable version control
system integration.
When the Model repository is integrated with a version control system, you can perform the following tasks:

210

Check in revised objects.

Undo the checkout of objects.

Reassign the checked-out state of objects to another user.

Chapter 9: Model Repository Service

How to Configure and Synchronize a Model Repository with a

Version Control System
To enable version control, you configure versioning properties, and then synchronize the Model repository
with the version control system.
After you configure versioning and synchronize the Model repository with the version control system, the
version control system begins to save version history. If you change the version control system type, host,
URL, or directory properties, you can choose to retain or discard version history.
Perform one of the following tasks:

To retain version history, manually copy the contents of the version control system directory to the new
version control system location, change versioning properties, and then recycle the Model Repository
Service.

To discard version history, change versioning properties, recycle the Model Repository Service, and then
re-synchronize the Model repository with the new version control system type or location.

Note: When you change Model repository properties, you must recycle the Model Repository Service for your
changes to take effect. Ask users to save changes and close Model repository objects that they have open
for editing. While synchronization is in progress, the Model repository is unavailable.

Model Repository Service Management

211

The following image shows the process of configuring, synchronizing, and re-synchronizing the Model
repository with a version control system:

1.

Configure versioning properties and restart the Model repository service.

2.

Synchronize the Model repository contents with the version control system.

3.

Optionally, change the version control system type.

4.

212

a.

Back up the Model repository contents.

b.

Change the version control system type and restart the Model Repository Service.

c.

Choose whether to retain or discard the version history:

To retain version history, copy the contents of the existing version control system directory to the
new version control system, and configure the Model repository for the new location.

To discard version history, re-synchronize the Model repository to the new version control
system.

Optionally, change the version control system host or URL.

Chapter 9: Model Repository Service

If you use Perforce as the version control system, you can change the Perforce host or port number. If
you use Subversion, you can change the URL.

5.

6.

a.

Back up the Model repository contents.

b.

Change the version control system location and restart the Model Repository Service.

c.

Choose whether to retain or discard the version history:

To retain version history, copy the contents of the existing version control system directory to the
new version control system location, and configure the Model repository for the new location.

To discard version history, re-synchronize the Model repository to the new version control
system host or URL.

Optionally, change the version control system directory location.

a.

Back up the Model repository contents.

b.

Change the version control system directory and restart the Model Repository Service.

c.

Choose whether to retain or discard the version history:

To retain version history, copy the contents of the existing version control system directory to the
new directory, and configure the Model repository for the new location.

To discard version history, re-synchronize the Model repository to the new version control
system directory.

Optionally, change the version control system username or password.

a.

Back up the Model repository contents.

b.

Change the version control system type.

c.

Restart the Model Repository Service.

You can perform these tasks from the command line or from the Administrator tool.

Synchronizing the Model Repository with a Version Control System

Before you synchronize the Model repository with the version control system, you configure versioning
properties, and then recycle the Model Repository Service for property changes to take effect. Then
synchronize the contents of the Model repository with the version control system.
Note: While synchronization is in progress, the Model repository is unavailable. Ask users to save changes
and close Model repository objects before synchronization begins.
1.

Instruct Model repository users to save changes to and close repository objects.

2.

On the Manage tab, select the Services and Nodes view.

3.

Select the Model repository to synchronize with the version control system.

4.

Click Actions > Synchronize With Version Control System.

5.

Click OK.
The Model Repository Service copies the contents of the repository to the version control system
directory. During synchronization, the Model repository is unavailable.

When synchronization is complete, versioning is active for Model repository objects. All Model repository
objects are checked in to the version control system. Users can check out, check in, view version history, and
retrieve historical versions of objects.
After the Model repository is synchronized with the version control system, you cannot disable version control
system integration.

Model Repository Service Management

213

Troubleshooting Team-based Development

Consider the following troubleshooting tips when you use features related to team-based development:

The Perforce version control system fails to check in some objects, with an error about excessively long
object path names.
Due to Windows OS limitations on the number of characters in a file path, Model repository objects with long
path and file names fail when you try to check them in. The Perforce error message reads "Submit aborted"
and says the file path exceeds the internal length limit.
To work around this problem, limit the length of directory names in the path to the Perforce depot, and limit
the length of project, folder, and object names in the Model repository. Shorter names in all instances help
limit the total number of characters in the object path name.

Repository Object Administration

The Model repository locks objects to prevent users from overwriting work. The Model repository can lock any
object that the Developer tool or the Analyst tool displays, except for projects and folders.
You can manage locked objects in a Model repository that is not integrated with a version control system.
You can manage checked out objects in a Model repository that is integrated with a version control system.
When the Model repository is integrated with a version control system, you can view, undo, or re-assign the
checked-out state of an object.

Objects View
You can view and manage repository objects from the Objects tab of the Model Repository Service.
The following image shows the Objects tab with a filter on the Type column:

Note: If a Model repository is not integrated with a version control system, the Checked out on column is
replaced with Locked on, and the Checked out by column is replaced with Locked by.
When you manage Model repository objects, you filter the list of objects and then select an action:
1.

When you open the Objects tab, the display is empty. Enter filter criteria in the filter bar and then click
the Filter icon to get a list of objects to manage. For example, to display a list of objects with Type
names beginning with "ma," type ma in the filter bar, and then click the Filter icon.

2.

Select one or more objects. Then right-click a selected object and select an action, or click one of the
action icons.

To reset the Objects tab, click the Reset Filter icon.

214

Chapter 9: Model Repository Service

Locked Object Administration

If the Developer tool or the Analyst tool shuts down, or if the Model repository becomes unavailable, objects
retain locks. After the Model repository becomes available, you can view locked objects and unlock them.
You might want to unlock objects if the user who locked them is unavailable and another user is assigned to
edit them.
You can perform the following operations:
List locked objects.
You can list the objects that are locked in the Model repository. You can filter the list by the time that a
user locked the object. You might want to do this to identify the developers working on each object.
Unlock an object.
You can unlock any object that is locked in the Model repository.
Note: When you unlock a locked object that a user edited, the changes are lost.

Versioned Object Administration

If a developer is not available to check in a checked-out object, you can list and undo or reassign the
checked-out state of an object.
You can view objects that are locked or checked out by all users. You can select locked objects and unlock
them so that another user can edit them. You can select checked out objects and undo the checked-out
state, or assign the checked-out state to another user.
You can perform the following operations:
List checked-out objects.
You can list the objects that are checked out from the Model repository. You can filter the list by the time
that a user checked out the object. You might want to do this to identify the developers working on each
object.
Check in an object.
You can check in any object that is checked out from the Model repository.
Undo the checkout of a checked-out object.
When a developer has checked out an object from the Model repository and is unavailable to check it in,
you can undo the checkout. When you undo the checkout of an object that a user edited, the changes
are lost.
Note: If a user moved an object while it was checked out and you undo the checkout, the object remains
in its current location, and its version history restarts. Undoing the checkout does not restore it to its precheckout location.
Reassign the ownership of checked-out objects.
You can reassign ownership of a checked-out object from one user to another. You might want to do this
if a team member goes on vacation with objects still checked out.
If the owner of a checked-out object saved changes, the changes are retained when you reassign the
object. If the changes are not saved, the changes are lost when you reassign the object.

Versioned Object Administration Example

You are the Model repository administrator for a development team. One of the team members, abcar, begins
an extended, unexpected absence. The user had objects checked out when the absence began.

Repository Object Administration

215

To assign the checked-out objects to other team members, complete the following steps:
1.

Filter the list of checked out objects to list all the objects that abcar has checked out.

2.

Select some objects and undo the checkout.

The objects are checked in to the Model repository, and any changes that abcar made are lost.

3.

Select the remainder of the objects and reassign them to user zovar.
Any changes that abcar made are retained. User zovar can continue development on the objects, or
check in the objects without additional changes. User zovar can also choose to undo the check-out of
the objects and lose any changes that abcar made.

Troubleshooting Team-based Development

Consider the following troubleshooting tips when you use features related to team-based development:

The Perforce version control system fails to check in some objects, with an error about excessively long
object path names.
Due to Windows OS limitations on the number of characters in a file path, Model repository objects with long
path and file names fail when you try to check them in. The Perforce error message reads "Submit aborted"
and says the file path exceeds the internal length limit.
To work around this problem, limit the length of directory names in the path to the Perforce depot, and limit
the length of project, folder, and object names in the Model repository. Shorter names in all instances help
limit the total number of characters in the object path name.
Alternatively, you can install Informatica or the Perforce instance on non-Windows hosts that do not have this
limitation.

Creating a Model Repository Service

1.

Create a database for the Model repository.

2.

In the Administrator tool, click the Manage tab > Services and Nodes view.

3.

On the Domain Actions menu, click New > Model Repository Service .

4.

In the properties view, enter the general properties for the Model Repository Service.

5.

Click Next.

6.

Enter the database properties for the Model Repository Service.

7.

Click Test Connection to test the connection to the database.

8.

Select one of the following options:

9.
10.

216

Do Not Create New Content. Select this option if the specified database contains existing content for
the Model repository. This is the default.

Create New Content. Select this option to create content for the Model repository in the specified
database.

Click Finish.
If you created the Model Repository Service to use existing content, select the Model Repository Service
in the Navigator, and then click Actions > Search Index > Re-Index on the Manage tab Actions menu.

Chapter 9: Model Repository Service

CHAPTER 10

PowerCenter Integration Service

This chapter includes the following topics:

PowerCenter Integration Service Overview, 217

Creating a PowerCenter Integration Service, 218

Enabling and Disabling PowerCenter Integration Services and Processes, 220

Operating Mode, 221

PowerCenter Integration Service Properties, 225

Operating System Profiles, 235

Associated Repository for the PowerCenter Integration Service, 236

PowerCenter Integration Service Processes, 237

Configuration for the PowerCenter Integration Service Grid, 242

Load Balancer for the PowerCenter Integration Service , 247

PowerCenter Integration Service Overview

The PowerCenter Integration Service is an application service that runs sessions and workflows. Use the
Administrator tool to manage the PowerCenter Integration Service.
You can use the Administrator tool to complete the following configuration tasks for the PowerCenter
Integration Service:

Create a PowerCenter Integration Service. Create a PowerCenter Integration Service to replace an

existing PowerCenter Integration Service or to use multiple PowerCenter Integration Services.

Enable or disable the PowerCenter Integration Service. Enable the PowerCenter Integration Service to
run sessions and workflows. You might disable the PowerCenter Integration Service to prevent users from
running sessions and workflows while performing maintenance on the machine or modifying the
repository.

Configure normal or safe mode. Configure the PowerCenter Integration Service to run in normal or safe
mode.

Configure the PowerCenter Integration Service properties. Configure the PowerCenter Integration Service
properties to change behavior of the PowerCenter Integration Service.

Configure the associated repository. You must associate a repository with a PowerCenter Integration
Service. The PowerCenter Integration Service uses the mappings in the repository to run sessions and
workflows.

217

Configure the PowerCenter Integration Service processes. Configure service process properties for each
node, such as the code page and service process variables.

Configure permissions on the PowerCenter Integration Service.

Remove a PowerCenter Integration Service. You may need to remove a PowerCenter Integration Service
if it becomes obsolete.

Based on your license, the PowerCenter Integration Service can be highly available.

Creating a PowerCenter Integration Service

You can create a PowerCenter Integration Service when you configure Informatica application services. You
may need to create an additional PowerCenter Integration Service to replace an existing one or create
multiple PowerCenter Integration Services.
You must assign a PowerCenter repository to the PowerCenter Integration Service. You can assign the
repository when you create the PowerCenter Integration Service or after you create the PowerCenter
Integration Service. You must assign a repository before you can run the PowerCenter Integration Service.
The repository that you assign to the PowerCenter Integration Service is called the associated repository.
The PowerCenter Integration Service retrieves metadata, such as workflows and mappings, from the
associated repository.
After you create a PowerCenter Integration Service, you must assign a code page for each PowerCenter
Integration Service process. The code page for each PowerCenter Integration Service process must be a
subset of the code page of the associated repository. You must select the associated repository before you
can select the code page for a PowerCenter Integration Service process. The PowerCenter Repository
Service must be enabled to set up a code page for a PowerCenter Integration Service process.
Note: If you configure a PowerCenter Integration Service to run on a node that is unavailable, you must start
the node and configure $PMRootDir for the service process before you run workflows with the PowerCenter
Integration Service.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

On the Domain Navigator Actions menu, click New > PowerCenter Integration Service.
The New Integration Service dialog box appears.

3.

Enter values for the following PowerCenter Integration Service options.

The following table describes the PowerCenter Integration Service options:
Property

Description

Name

Name of the PowerCenter Integration Service. The characters must be

compatible with the code page of the associated repository. The name is not
case sensitive and must be unique within the domain. It cannot exceed 128
characters or begin with @. It also cannot contain spaces or the following
special characters:
`~%^*+={}\;:'"/?.,<>|!()][

Description

218

Chapter 10: PowerCenter Integration Service

Description of the PowerCenter Integration Service. The description cannot

exceed 765 characters.

Property

Description

Location

Domain and folder where the service is created. Click Browse to choose a
different folder. You can also move the PowerCenter Integration Service to a
different folder after you create it.

License

License to assign to the PowerCenter Integration Service. If you do not select

a license now, you can assign a license to the service later. Required if you
want to enable the PowerCenter Integration Service.
The options allowed in your license determine the properties you must set for
the PowerCenter Integration Service.

Node

Node on which the PowerCenter Integration Service runs. Required if you do

not select a license or your license does not include the high availability
option.

Assign

Indicates whether the PowerCenter Integration Service runs on a grid or

nodes.

Grid

Name of the grid on which the PowerCenter Integration Service run.

Available if your license includes the high availability option. Required if you
assign the PowerCenter Integration Service to run on a grid.

Primary Node

Primary node on which the PowerCenter Integration Service runs.

Required if you assign the PowerCenter Integration Service to run on nodes.

Backup Nodes

Nodes used as backup to the primary node.

Displays if you configure the PowerCenter Integration Service to run on
mutiple nodes and you have the high availability option. Click Select to choose
the nodes to use for backup.

Associated Repository
Service

PowerCenter Repository Service associated with the PowerCenter Integration

Service. If you do not select the associated PowerCenter Repository Service
now, you can select it later. You must select the PowerCenter Repository
Service before you run the PowerCenter Integration Service.

Repository User Name

User name to access the repository.

Repository Password

Password for the user. Required when you select an associated PowerCenter
Repository Service.

Security Domain

Security domain for the user. Required when you select an associated
PowerCenter Repository Service. To apply changes, restart the PowerCenter
Integration Service.
The Security Domain field appears when the Informatica domain contains an
LDAP security domain.

Data Movement Mode

Mode that determines how the PowerCenter Integration Service handles

character data. Choose ASCII or Unicode. ASCII mode passes 7-bit ASCII or
EBCDIC character data. Unicode mode passes 8-bit ASCII and multibyte
character data from sources to targets.
Default is ASCII.

4.

Click Finish.
You must specify a PowerCenter Repository Service before you can enable the PowerCenter Integration
Service.

Creating a PowerCenter Integration Service

219

You can specify the code page for each PowerCenter Integration Service process node and select the
Enable Service option to enable the service. If you do not specify the code page information now, you
can specify it later. You cannot enable the PowerCenter Integration Service until you assign the code
page for each PowerCenter Integration Service process node.
5.

Click OK.

Enabling and Disabling PowerCenter Integration

Services and Processes
You can enable and disable a PowerCenter Integration Service process or the entire PowerCenter Integration
Service. If you run the PowerCenter Integration Service on a grid or with the high availability option, you have
one PowerCenter Integration Service process configured for each node. For a grid, the PowerCenter
Integration Service runs all enabled PowerCenter Integration Service processes. With high availability, the
PowerCenter Integration Service runs the PowerCenter Integration Service process on the primary node.

Enabling or Disabling a PowerCenter Integration Service Process

Use the Administrator tool to enable and disable a PowerCenter Integration Service process. Each service
process runs on one node. You must enable the PowerCenter Integration Service process if you want the
node to perform PowerCenter Integration Service tasks. You may want to disable the service process on a
node to perform maintenance on that node or to enable safe mode for the PowerCenter Integration Service.
To enable or disable a PowerCenter Integration Service process:
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Integration Service.

3.

In the contents panel, click the Processes view.

4.

Select a process.

5.

To disable a process, click Actions > Disable Process.

The Disable Process dialog box displays.

6.

Choose a disable mode, and then click OK.

7.

To enable a process, click Actions > Enable Process.

Enabling or Disabling the PowerCenter Integration Service

Use the Administrator tool to enable and disable a PowerCenter Integration Service. You may want to disable
a PowerCenter Integration Service if you need to perform maintenance or if you want temporarily restrict
users from using the service. You can enable a disabled PowerCenter Integration Service to make it available
again.
When you disable the PowerCenter Integration Service, you shut down the PowerCenter Integration Service
and disable all service processes for the PowerCenter Integration Service. If you are running a PowerCenter
Integration Service on a grid, you disable all service processes on the grid.
When you disable the PowerCenter Integration Service, you must choose what to do if a process or workflow
is running. You must choose one of the following options:

220

Complete. Allows the sessions and workflows to run to completion before shutting down the service.

Chapter 10: PowerCenter Integration Service

Stop. Stops all sessions and workflows and then shuts down the service.

Abort. Tries to stop all sessions and workflows before aborting them and shutting down the service.

When you enable the PowerCenter Integration Service, the service starts. The associated PowerCenter
Repository Service must be started before you can enable the PowerCenter Integration Service. If you enable
a PowerCenter Integration Service when the associated PowerCenter Repository Service is not running, the
following error appears:
The Service Manager could not start the service due to the following error: [DOM_10076]
Unable to enable service [<Integration Service] because of dependent services
[<PowerCenter Repository Service>] are not initialized.
If the PowerCenter Integration Service is unable to start, the Service Manager keeps trying to start the
service until it reaches the maximum restart attempts defined in the domain properties. For example, if you
try to start the PowerCenter Integration Service without specifying the code page for each PowerCenter
Integration Service process, the domain tries to start the service. The service does not start without
specifying a valid code page for each PowerCenter Integration Service process. The domain keeps trying to
start the service until it reaches the maximum number of attempts.
If the service fails to start, review the logs for this PowerCenter Integration Service to determine the reason
for failure and fix the problem. After you fix the problem, you must disable and re-enable the PowerCenter
Integration Service to start it.
To enable or disable a PowerCenter Integration Service:
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Integration Service.

3.

On the Manage tab Actions menu, select Disable Service to disable the service or select Enable
Service to enable the service.

4.

To disable and immediately enable the PowerCenter Integration Service, select Recycle.

Operating Mode
You can run the PowerCenter Integration Service in normal or safe operating mode. Normal mode provides
full access to users with permissions and privileges to use a PowerCenter Integration Service. Safe mode
limits user access to the PowerCenter Integration Service and workflow activity during environment migration
or PowerCenter Integration Service maintenance activities.
Run the PowerCenter Integration Service in normal mode during daily operations. In normal mode, users with
workflow privileges can run workflows and get session and workflow information for workflows assigned to
the PowerCenter Integration Service.
You can configure the PowerCenter Integration Service to run in safe mode or to fail over in safe mode.
When you enable the PowerCenter Integration Service to run in safe mode or when the PowerCenter
Integration Service fails over in safe mode, it limits access and workflow activity to allow administrators to
perform migration or maintenance activities.
Run the PowerCenter Integration Service in safe mode to control which workflows a PowerCenter Integration
Service runs and which users can run workflows during migration and maintenance activities. Run in safe
mode to verify a production environment, manage workflow schedules, or maintain a PowerCenter Integration
Service. In safe mode, users that have the Administrator role for the associated PowerCenter Repository
Service can run workflows and get information about sessions and workflows assigned to the PowerCenter
Integration Service.

Operating Mode

221

Normal Mode
When you enable a PowerCenter Integration Service to run in normal mode, the PowerCenter Integration
Service begins running scheduled workflows. It also completes workflow failover for any workflows that failed
while in safe mode, recovers client requests, and recovers any workflows configured for automatic recovery
that failed in safe mode.
Users with workflow privileges can run workflows and get session and workflow information for workflows
assigned to the PowerCenter Integration Service.
When you change the operating mode from safe to normal, the PowerCenter Integration Service begins
running scheduled workflows and completes workflow failover and workflow recovery for any workflows
configured for automatic recovery. You can use the Administrator tool to view the log events about the
scheduled workflows that started, the workflows that failed over, and the workflows recovered by the
PowerCenter Integration Service.

Safe Mode
In safe mode, access to the PowerCenter Integration Service is limited. You can configure the PowerCenter
Integration Service to run in safe mode or to fail over in safe mode:

Enable in safe mode. Enable the PowerCenter Integration Service in safe mode to perform migration or
maintenance activities. When you enable the PowerCenter Integration Service in safe mode, you limit
access to the PowerCenter Integration Service.
When you enable a PowerCenter Integration Service in safe mode, you can choose to have the
PowerCenter Integration Service complete, abort, or stop running workflows. In addition, the operating
mode on failover also changes to safe.

Fail over in safe mode. Configure the PowerCenter Integration Service process to fail over in safe mode
during migration or maintenance activities. When the PowerCenter Integration Service process fails over
to a backup node, it restarts in safe mode and limits workflow activity and access to the PowerCenter
Integration Service. The PowerCenter Integration Service restores the state of operations for any
workflows that were running when the service process failed over, but does not fail over or automatically
recover the workflows. You can manually recover the workflow.
After the PowerCenter Integration Service fails over in safe mode during normal operations, you can
correct the error that caused the PowerCenter Integration Service process to fail over and restart the
service in normal mode.

The behavior of the PowerCenter Integration Service when it fails over in safe mode is the same as when you
enable the PowerCenter Integration Service in safe mode. All scheduled workflows, including workflows
scheduled to run continuously or start on service initialization, do not run. The PowerCenter Integration
Service does not fail over schedules or workflows, does not automatically recover workflows, and does not
recover client requests.

Running the PowerCenter Integration Service in Safe Mode

This section describes the specific migration and maintenance activities that you can complete in the
PowerCenter Workflow Manager and PowerCenter Workflow Monitor, the behavior of the PowerCenter
Integration Service in safe mode, and the privileges required to run and monitor workflows in safe mode.

222

Chapter 10: PowerCenter Integration Service

Performing Migration or Maintenance

You might want to run a PowerCenter Integration Service in safe mode for the following reasons:

Test a development environment. Run the PowerCenter Integration Service in safe mode to test a
development environment before migrating to production. You can run workflows that contain session and
command tasks to test the environment. Run the PowerCenter Integration Service in safe mode to limit
access to the PowerCenter Integration Service when you run the test sessions and command tasks.

Manage workflow schedules. During migration, you can unschedule workflows that only run in a
development environment. You can enable the PowerCenter Integration Service in safe mode, unschedule
the workflow, and then enable the PowerCenter Integration Service in normal mode. After you enable the
service in normal mode, the workflows that you unscheduled do not run.

Troubleshoot the PowerCenter Integration Service. Configure the PowerCenter Integration Service to fail
over in safe mode and troubleshoot errors when you migrate or test a production environment configured
for high availability. After the PowerCenter Integration Service fails over in safe mode, you can correct the
error that caused the PowerCenter Integration Service to fail over.

Perform maintenance on the PowerCenter Integration Service. When you perform maintenance on a
PowerCenter Integration Service, you can limit the users who can run workflows. You can enable the
PowerCenter Integration Service in safe mode, change PowerCenter Integration Service properties, and
verify the PowerCenter Integration Service functionality before allowing other users to run workflows. For
example, you can use safe mode to test changes to the paths for PowerCenter Integration Service files for
PowerCenter Integration Service processes.

Workflow Tasks
The following table describes the tasks that users with the Administrator role can perform when the
PowerCenter Integration Service runs in safe mode:
Task

Task Description

Run workflows.

Start, stop, abort, and recover workflows. The workflows may contain session or
command tasks required to test a development or production environment.

Unschedule workflows.

Unschedule workflows in the PowerCenter Workflow Manager.

Monitor PowerCenter
Integration Service
properties.

Connect to the PowerCenter Integration Service in the PowerCenter Workflow

Monitor. Get PowerCenter Integration Service details and monitor information.

Monitor workflow and task

details.

Connect to the PowerCenter Integration Service in the PowerCenter Workflow

Monitor and get task, session, and workflow details.

Recover workflows.

Manually recover failed workflows.

Operating Mode

223

PowerCenter Integration Service Behavior

Safe mode affects PowerCenter Integration Service behavior for the following workflow and high availability
functionality:

Workflow schedules. Scheduled workflows remain scheduled, but they do not run if the PowerCenter
Integration Service is running in safe mode. This includes workflows scheduled to run continuously and
run on service initialization.
Workflow schedules do not fail over when a PowerCenter Integration Service fails over in safe mode. For
example, you configure a PowerCenter Integration Service to fail over in safe mode. The PowerCenter
Integration Service process fails for a workflow scheduled to run five times, and it fails over after it runs
the workflow three times. The PowerCenter Integration Service does not complete the remaining
workflows when it fails over to the backup node. The PowerCenter Integration Service completes the
workflows when you enable the PowerCenter Integration Service in safe mode.

Workflow failover. When a PowerCenter Integration Service process fails over in safe mode, workflows do
not fail over. The PowerCenter Integration Service restores the state of operations for the workflow. When
you enable the PowerCenter Integration Service in normal mode, the PowerCenter Integration Service
fails over the workflow and recovers it based on the recovery strategy for the workflow.

Workflow recovery.The PowerCenter Integration Service does not recover workflows when it runs in safe
mode or when the operating mode changes from normal to safe.
The PowerCenter Integration Service recovers a workflow that failed over in safe mode when you change
the operating mode from safe to normal, depending on the recovery strategy for the workflow. For
example, you configure a workflow for automatic recovery and you configure the PowerCenter Integration
Service to fail over in safe mode. If the PowerCenter Integration Service process fails over, the workflow is
not recovered while the PowerCenter Integration Service runs in safe mode. When you enable the
PowerCenter Integration Service in normal mode, the workflow fails over and the PowerCenter Integration
Service recovers it.
You can manually recover the workflow if the workflow fails over in safe mode. You can recover the
workflow after the resilience timeout for the PowerCenter Integration Service expires.

Client request recovery. The PowerCenter Integration Service does not recover client requests when it
fails over in safe mode. For example, you stop a workflow and the PowerCenter Integration Service
process fails over before the workflow stops. The PowerCenter Integration Service process does not
recover your request to stop the workflow when the workflow fails over.
When you enable the PowerCenter Integration Service in normal mode, it recovers the client requests.

Configuring the PowerCenter Integration Service Operating Mode

You can use the Administrator tool to configure the PowerCenter Integration Service to run in safe mode, run
in normal mode, or run in safe or normal mode on failover. To configure the operating mode on failover, you
must have the high availability option.
Note: When you change the operating mode on fail over from safe to normal, the change takes effect
immediately.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select a PowerCenter Integration Service.

3.

Click the Properties view.

4.

Go to the Operating Mode Configuration section and click Edit.

5.

To run the PowerCenter Integration Service in normal mode, set OperatingMode to Normal.
To run the service in safe mode, set OperatingMode to Safe.

224

Chapter 10: PowerCenter Integration Service

6.

To run the service in normal mode on failover, set OperatingModeOnFailover to Normal.

To run the service in safe mode on failover, set OperatingModeOnFailover to Safe.

7.

Click OK.

8.

Restart the PowerCenter Integration Service.

The PowerCenter Integration Service starts in the selected mode. The service status at the top of the content
pane indicates when the service has restarted.

PowerCenter Integration Service Properties

You can configure general properties, PowerCenter Integration Services properties, custom properties, and
more for the PowerCenter Integration Service.
Use the Administrator tool to configure the following PowerCenter Integration Service properties:

General properties. Assign a license and configure the PowerCenter Integration Service to run on a grid
or nodes.

PowerCenter Integration Service properties. Set the values for the PowerCenter Integration Service
variables.

Advanced properties. Configure advanced properties that determine security and control the behavior of
sessions and logs

Operating mode configuration. Set the PowerCenter Integration Service to start in normal or safe mode
and to fail over in normal or safe mode.

Compatibility and database properties. Configure the source and target database properties, such the
maximum number of connections, and configure properties to enable compatibility with previous versions
of PowerCenter.

Configuration properties. Configure the configuration properties, such as the data display format.

HTTP proxy properties. Configure the connection to the HTTP proxy server.

Custom properties. Configure custom properties that are unique to specific environments.

To view the properties, select the PowerCenter Integration Service in the Navigator and click Properties view.
To modify the properties, edit the section for the property you want to modify.

General Properties
The amount of system resources that the PowerCenter Integration Services uses depends on how you set up
the PowerCenter Integration Service. You can configure a PowerCenter Integration Service to run on a grid
or on nodes. You can view the system resource usage of the PowerCenter Integration Service using the
PowerCenter Workflow Monitor.
When you use a grid, the PowerCenter Integration Service distributes workflow tasks and session threads
across multiple nodes. You can increase performance when you run sessions and workflows on a grid. If you
choose to run the PowerCenter Integration Service on a grid, select the grid. You must have the server grid
option to run the PowerCenter Integration Service on a grid. You must create the grid before you can select
the grid.
If you configure the PowerCenter Integration Service to run on nodes, choose one or more PowerCenter
Integration Service process nodes. If you have only one node and it becomes unavailable, the domain cannot

PowerCenter Integration Service Properties

225

accept service requests. With the high availability option, you can run the PowerCenter Integration Service on
multiple nodes. To run the service on multiple nodes, choose the primary and backup nodes.
To edit the general properties, select the PowerCenter Integration Service in the Navigator, and then click the
Properties view. Edit the section General Properties section. To apply changes, restart the PowerCenter
Integration Service.
The following table describes the general properties for the service:
Property

Description

Name

Name of the service. The name is not case sensitive and must be unique within the domain.
It cannot exceed 128 characters or begin with @. It also cannot contain spaces or the
following special characters:
`~%^*+={}\;:'"/?.,<>|!()][
You cannot change the name of the service after you create it.

Description

Description of the service. The description cannot exceed 765 characters.

License

License object that allows use of the service.

Assign

Indicates whether the PowerCenter Integration Service runs on a grid or on nodes.

Grid

Name of the grid on which the PowerCenter Integration Service runs. Required if you run the
PowerCenter Integration Service on a grid.

Primary Node

Primary node on which the PowerCenter Integration Service runs. Required if you run the
PowerCenter Integration Service on nodes and you specify at least one backup node. You
can select any node in the domain.

Backup Node

Backup node on which the PowerCenter Integration Service can run on. If the primary node
becomes unavailable, the PowerCenter Integration Service runs on a backup node. You can
select multiple nodes as backup nodes. Available if you have the high availability option and
you run the PowerCenter Integration Service on nodes.

PowerCenter Integration Service Properties

You can set the values for the service variables at the service level. You can override some of the
PowerCenter Integration Service variables at the session level or workflow level. To override the properties,
configure the properties for the session or workflow.
To edit the service properties, select the PowerCenter Integration Service in the Navigator, and then click the
Properties view. Edit the PowerCenter Integration Service Properties section.

226

Chapter 10: PowerCenter Integration Service

The following table describes the service properties:

Property

Description

DataMovementMode

Mode that determines how the PowerCenter Integration Service handles

character data.
In ASCII mode, the PowerCenter Integration Service recognizes 7-bit ASCII and
EBCDIC characters and stores each character in a single byte. Use ASCII mode
when all sources and targets are 7-bit ASCII or EBCDIC character sets.
In Unicode mode, the PowerCenter Integration Service recognizes multibyte
character sets as defined by supported code pages. Use Unicode mode when
sources or targets use 8-bit or multibyte character sets and contain character
data.
Default is ASCII.
To apply changes, restart the PowerCenter Integration Service.

$PMSuccessEmailUser

Service variable that specifies the email address of the user to receive email
messages when a session completes successfully. Use this variable for the
Email User Name attribute for success email. If multiple email addresses are
associated with a single user, messages are sent to all of the addresses.
If the Integration Service runs on UNIX, you can enter multiple email addresses
separated by a comma. If the Integration Service runs on Windows, you can
enter multiple email addresses separated by a semicolon or use a distribution
list. The PowerCenter Integration Service does not expand this variable when
you use it for any other email type.

$PMFailureEmailUser

Service variable that specifies the email address of the user to receive email
messages when a session fails to complete. Use this variable for the Email User
Name attribute for failure email. If multiple email addresses are associated with
a single user, messages are sent to all of the addresses.
If the Integration Service runs on UNIX, you can enter multiple email addresses
separated by a comma. If the Integration Service runs on Windows, you can
enter multiple email addresses separated by a semicolon or use a distribution
list. The PowerCenter Integration Service does not expand this variable when
you use it for any other email type.

$PMSessionLogCount

Service variable that specifies the number of session logs the PowerCenter
Integration Service archives for the session.
Minimum value is 0. Default is 0.

$PMWorkflowLogCount

Service variable that specifies the number of workflow logs the PowerCenter
Integration Service archives for the workflow.
Minimum value is 0. Default is 0.

$PMSessionErrorThreshold

Service variable that specifies the number of non-fatal errors the PowerCenter
Integration Service allows before failing the session. Non-fatal errors include
reader, writer, and DTM errors. If you want to stop the session on errors, enter
the number of non-fatal errors you want to allow before stopping the session.
The PowerCenter Integration Service maintains an independent error count for
each source, target, and transformation. Use to configure the Stop On option in
the session properties.
Defaults to 0. If you use the default setting 0, non-fatal errors do not cause the
session to stop.

PowerCenter Integration Service Properties

227

Advanced Properties
You can configure the properties that control the behavior of PowerCenter Integration Service security,
sessions, and logs. To edit the advanced properties, select the PowerCenter Integration Service in the
Navigator, and then click the Properties view. Edit the Advanced Properties section.
The following table describes the advanced properties:
Property

Description

Error Severity Level

Level of error logging for the domain. These messages are written to the Log
Manager and log files. Specify one of the following message levels:
-

Error. Writes ERROR code messages to the log.

Warning. Writes WARNING and ERROR code messages to the log.
Information. Writes INFO, WARNING, and ERROR code messages to the log.
Tracing. Writes TRACE, INFO, WARNING, and ERROR code messages to the log.
Debug. Writes DEBUG, TRACE, INFO, WARNING, and ERROR code messages to the
log.

Default is INFO.
Resilience Timeout

Number of seconds that the service tries to establish or reestablish a connection to

another service. If blank, the value is derived from the domain-level settings.
Valid values are between 0 and 2,592,000, inclusive. Default is 180 seconds.

Limit on Resilience
Timeouts

Number of seconds that the service holds on to resources for resilience purposes.
This property places a restriction on clients that connect to the service. Any
resilience timeouts that exceed the limit are cut off at the limit. If blank, the value is
derived from the domain-level settings.
Valid values are between 0 and 2,592,000, inclusive. Default is 180 seconds.

Timestamp Workflow Log

Messages

Appends a timestamp to messages that are written to the workflow log. Default is
No.

Allow Debugging

Allows you to run debugger sessions from the Designer. Default is Yes.

LogsInUTF8

Writes to all logs using the UTF-8 character set.

Disable this option to write to the logs using the PowerCenter Integration Service
code page.
This option is available when you configure the PowerCenter Integration Service to
run in Unicode mode. When running in Unicode data movement mode, default is
Yes. When running in ASCII data movement mode, default is No.

Use Operating System

Profiles

TrustStore

Enables the use of operating system profiles. You can select this option if the
PowerCenter Integration Service runs on UNIX. To apply changes, restart the
PowerCenter Integration Service.
Enter the value for TrustStore using the following syntax:
<path>/<filename >
For example:
./Certs/trust.keystore

ClientStore

Enter the value for ClientStore using the following syntax:

<path>/<filename >
For example:
./Certs/client.keystore

228

Chapter 10: PowerCenter Integration Service

Property

Description

JCEProvider

Enter the JCEProvider class name to support NTLM authentication.

For example:
com.unix.crypto.provider.UnixJCE.

IgnoreResourceRequirem
ents

Ignores task resource requirements when distributing tasks across the nodes of a
grid. Used when the PowerCenter Integration Service runs on a grid. Ignored when
the PowerCenter Integration Service runs on a node.
Enable this option to cause the Load Balancer to ignore task resource requirements.
It distributes tasks to available nodes whether or not the nodes have the resources
required to run the tasks.
Disable this option to cause the Load Balancer to match task resource requirements
with node resource availability when distributing tasks. It distributes tasks to nodes
that have the required resources.
Default is Yes.

Run sessions impacted by

dependency updates

Runs sessions that are impacted by dependency updates. By default, the

PowerCenter Integration Service does not run impacted sessions. When you modify
a dependent object, the parent object can become invalid. The PowerCenter client
marks a session with a warning if the session is impacted. At run time, the
PowerCenter Integration Service fails the session if it detects errors.

Persist Run-time Statistics

to Repository

Level of run-time information stored in the repository. Specify one of the following
levels:
- None. PowerCenter Integration Service does not store any session or workflow runtime information in the repository.
- Normal. PowerCenter Integration Service stores workflow details, task details, session
statistics, and source and target statistics in the repository. Default is Normal.
- Verbose. PowerCenter Integration Service stores workflow details, task details,
session statistics, source and target statistics, partition details, and performance
details in the repository.

To store session performance details in the repository, you must also configure the
session to collect performance details and write them to the repository.
The PowerCenter Workflow Monitor shows run-time statistics stored in the
repository.

PowerCenter Integration Service Properties

229

Property

Description

Flush Session Recovery

Data

Flushes session recovery data for the recovery file from the operating system buffer
to the disk. For real-time sessions, the PowerCenter Integration Service flushes the
recovery data after each flush latency interval. For all other sessions, the
PowerCenter Integration Service flushes the recovery data after each commit
interval or user-defined commit. Use this property to prevent data loss if the
PowerCenter Integration Service is not able to write recovery data for the recovery
file to the disk.
Specify one of the following levels:
- Auto. PowerCenter Integration Service flushes recovery data for all real-time sessions
with a JMS or WebSphere MQ source and a non-relational target.
- Yes. PowerCenter Integration Service flushes recovery data for all sessions.
- No. PowerCenter Integration Service does not flush recovery data. Select this option if
you have highly available external systems or if you need to optimize performance.

Required if you enable session recovery.

Default is Auto.
Note: If you select Yes or Auto, you might impact performance.
Store High Availability
Persistence in Database

Enables the PowerCenter Integration Service to store process state information in

the high availability persistence tables in the PowerCenter repository database.
The process state information contains information about which node was running
the master PowerCenter Integration Service and which node was running the
sessions.
Default is no.
Note: This property does not determine where the service stores the state of
operation files used for recovery. The PowerCenter Integration Service always
stores the state of each workflow and session operation in files in the
$PMStorageDir directory of the PowerCenter Integration Service process.

Operating Mode Configuration

The operating mode determines how much user access and workflow activity the PowerCenter Integration
Service allows when runs. You can set the service to run in normal mode to allow users full access or in safe
mode to limit access. You can also set how the services operates when it fails over to another node.
The following table describes the operating mode properties:
Property

Description

OperatingMode

Mode in which the PowerCenter Integration Service runs.

OperatingModeOnFailover

Operating mode of the PowerCenter Integration Service when the service process
fails over to another node.

Compatibility and Database Properties

You can configure properties to reinstate previous Informatica behavior or to configure database behavior. To
edit the compatibility and database properties, select the PowerCenter Integration Service in the Navigator,
and then click the Properties view > Compatibility and Database Properties > Edit.

230

Chapter 10: PowerCenter Integration Service

The following table describes the compatibility and database properties:

Property

Description

PMServer3XCompatibility

Handles Aggregator transformations as it did in version 3.5. The

PowerCenter Integration Service treats null values as zeros in aggregate
calculations and performs aggregate calculations before flagging records
for insert, update, delete, or reject in Update Strategy expressions.
Disable this option to treat null values as NULL and perform aggregate
calculations based on the Update Strategy transformation.
This overrides both Aggregate treat nulls as zero and Aggregate treat
rows as insert.
Default is No.

JoinerSourceOrder6xCompatibility

Processes master and detail pipelines sequentially as it did in versions

prior to 7.0. The PowerCenter Integration Service processes all data from
the master pipeline before it processes the detail pipeline. When the
target load order group contains multiple Joiner transformations, the
PowerCenter Integration Service processes the detail pipelines
sequentially.
The PowerCenter Integration Service fails sessions when the mapping
meets any of the following conditions:
- The mapping contains a multiple input group transformation, such as the
Custom transformation. Multiple input group transformations require the
PowerCenter Integration Service to read sources concurrently.
- You configure any Joiner transformation with transaction level
transformation scope.

Disable this option to process the master and detail pipelines

concurrently.
Default is No.
AggregateTreatNullAsZero

Treats null values as zero in Aggregator transformations.

Disable this option to treat null values as NULL in aggregate calculations.
Default is No.

AggregateTreatRowAsInsert

When enabled, the PowerCenter Integration Service ignores the update

strategy of rows when it performs aggregate calculations. This option
ignores sorted input option of the Aggregator transformation. When
disabled, the PowerCenter Integration Service uses the update strategy
of rows when it performs aggregate calculations.
Default is No.

DateHandling40Compatibility

Handles dates as in version 4.0.

Disable this option to handle dates as defined in the current version of
PowerCenter.
Date handling significantly improved in version 4.5. Enable this option to
revert to version 4.0 behavior.
Default is No.

TreatCHARasCHARonRead

If you have PowerExchange for PeopleSoft, use this option for

PeopleSoft sources on Oracle. You cannot, however, use it for
PeopleSoft lookup tables on Oracle or PeopleSoft sources on Microsoft
SQL Server.

PowerCenter Integration Service Properties

231

Property

Description

Max Lookup SP DB Connections

Maximum number of connections to a lookup or stored procedure

database when you start a session.
If the number of connections needed exceeds this value, session threads
must share connections. This can result in decreased performance. If
blank, the PowerCenter Integration Service allows an unlimited number of
connections to the lookup or stored procedure database.
If the PowerCenter Integration Service allows an unlimited number of
connections, but the database user does not have permission for the
number of connections required by the session, the session fails.
Minimum value is 0. Default is 0.

Max Sybase Connections

Maximum number of connections to a Sybase ASE database when you

start a session. If the number of connections required by the session is
greater than this value, the session fails.
Minimum value is 100. Maximum value is 2147483647. Default is 100.

Max MSSQL Connections

Maximum number of connections to a Microsoft SQL Server database

when you start a session. If the number of connections required by the
session is greater than this value, the session fails.
Minimum value is 100. Maximum value is 2147483647. Default is 100.

NumOfDeadlockRetries

Number of times the PowerCenter Integration Service retries a target

write on a database deadlock.
Minimum value is 10. Maximum value is 1,000,000,000.
Default is 10.

DeadlockSleep

Number of seconds before the PowerCenter Integration Service retries a

target write on database deadlock. If set to 0 seconds, the PowerCenter
Integration Service retries the target write immediately.
Minimum value is 0. Maximum value is 2147483647. Default is 0.

Configuration Properties
You can configure session and miscellaneous properties, such as whether to enforce code page
compatibility.
To edit the configuration properties, select the PowerCenter Integration Service in the Navigator, and then
click the Properties view > Configuration Properties > Edit.
The following table describes the configuration properties:
Property

Description

XMLWarnDupRows

Writes duplicate row warnings and duplicate rows for XML targets to the
session log.
Default is Yes.

CreateIndicatorFiles

Creates indicator files when you run a workflow with a flat file target.
Default is No.

232

Chapter 10: PowerCenter Integration Service

Property

Description

OutputMetaDataForFF

Writes column headers to flat file targets. The PowerCenter Integration

Service writes the target definition port names to the flat file target in the
first line, starting with the # symbol.
Default is No.

TreatDBPartitionAsPassThrough

Uses pass-through partitioning for non-DB2 targets when the partition

type is Database Partitioning. Enable this option if you specify Database
Partitioning for a non-DB2 target. Otherwise, the PowerCenter
Integration Service fails the session.
Default is No.

ExportSessionLogLibName

Name of an external shared library to handle session event messages.

Typically, shared libraries in Windows have a file name extension of .dll.
In UNIX, shared libraries have a file name extension of .sl.
If you specify a shared library and the PowerCenter Integration Service
encounters an error when loading the library or getting addresses to the
functions in the shared library, then the session will fail.
The library name you specify can be qualified with an absolute path. If
you do not provide the path for the shared library, the PowerCenter
Integration Service will locate the shared library based on the library
path environment variable specific to each platform.

TreatNullInComparisonOperatorsAs

Determines how the PowerCenter Integration Service evaluates null

values in comparison operations. Specify one of the following options:
- Null. The PowerCenter Integration Service evaluates null values as NULL
in comparison expressions. If either operand is NULL, the result is NULL.
- High. The PowerCenter Integration Service evaluates null values as
greater than non-null values in comparison expressions. If both operands
are NULL, the PowerCenter Integration Service evaluates them as equal.
When you choose High, comparison expressions never result in NULL.
- Low. The PowerCenter Integration Service evaluates null values as less
than non-null values in comparison expressions. If both operands are
NULL, the PowerCenter Integration Service treats them as equal. When
you choose Low, comparison expressions never result in NULL.

Default is NULL.
WriterWaitTimeOut

In target-based commit mode, the amount of time in seconds the writer

remains idle before it issues a commit when the following conditions are
true:
- The PowerCenter Integration Service has written data to the target.
- The PowerCenter Integration Service has not issued a commit.

The PowerCenter Integration Service may commit to the target before or

after the configured commit interval.
Minimum value is 60. Maximum value is 2147483647. Default is 60. If
you configure the timeout to be 0 or a negative number, the
PowerCenter Integration Service defaults to 60 seconds.
MSExchangeProfile

Microsoft Exchange profile used by the Service Start Account to send

post-session email. The Service Start Account must be set up as a
Domain account to use this feature.

PowerCenter Integration Service Properties

233

Property

Description

DateDisplayFormat

Date format the PowerCenter Integration Service uses in log entries.

The PowerCenter Integration Service validates the date format you
enter. If the date display format is invalid, the PowerCenter Integration
Service uses the default date display format.
Default is DY MON DD HH24:MI:SS YYYY.

ValidateDataCodePages

Enforces data code page compatibility.

Disable this option to lift restrictions for source and target data code
page selection, stored procedure and lookup database code page
selection, and session sort order selection. The PowerCenter Integration
Service performs data code page validation in Unicode data movement
mode only. Option available if you run the PowerCenter Integration
Service in Unicode data movement mode. Option disabled if you run the
PowerCenter Integration Service in ASCII data movement mode.
Default is Yes.

HTTP Proxy Properties

You can configure properties for the HTTP proxy server for Web Services and the HTTP transformation.
To edit the HTTP proxy properties, select the PowerCenter Integration Service in the Navigator, and click the
Properties view > HTTP Proxy Properties > Edit.
The following table describes the HTTP proxy properties:
Property

Description

HttpProxyServer

Name of the HTTP proxy server.

HttpProxyPort

Port number of the HTTP proxy server. This must be a number.

HttpProxyUser

Authenticated user name for the HTTP proxy server. This is required if the proxy server
requires authentication.

HttpProxyPassword

Password for the authenticated user. This is required if the proxy server requires
authentication.

HttpProxyDomain

Domain for authentication.

Custom Properties for the PowerCenter Integration Service

Configure custom properties that are unique to specific environments.
You might need to apply custom properties in special cases. When you define a custom property, enter the
property name and an initial value. Define custom properties only at the request of Informatica Global
Customer Support.

234

Chapter 10: PowerCenter Integration Service

Operating System Profiles

By default, the PowerCenter Integration Service process runs all workflows using the permissions of the
operating system user that starts Informatica Services. The PowerCenter Integration Service writes output
files to a single shared location specified in the $PMRootDir service process variable.
When you configure the PowerCenter Integration Service to use operating system profiles, the PowerCenter
Integration Service process runs workflows with the permission of the operating system user you define in the
operating system profile. The operating system profile contains the operating system user name, service
process variables, and environment variables. The operating system user must have access to the directories
you configure in the profile and the directories the PowerCenter Integration Service accesses at run time.
You can use operating system profiles for a PowerCenter Integration Service that runs on UNIX. When you
configure operating system profiles on UNIX, you must enable setuid for the file system that contains the
Informatica installation.
To use an operating system profile, assign the profile to a repository folder or assign the profile to a workflow
when you start a workflow. You must have permission on the operating system profile to assign it to a folder
or workflow. For example, you assign operating system profile Sales to workflow A. The user that runs
workflow A must also have permissions to use operating system profile Sales. The PowerCenter Integration
Service stores the output files for workflow A in a location specified in the $PMRootDir service process
variable that the profile can access.
To manage permissions for operating system profiles, go to the Security page of the Administrator tool.

Operating System Profile Components

Configure the following components in an operating system profile:

Operating system user name. Configure the operating system user that the PowerCenter Integration
Service uses to run workflows.

Service process variables. Configure service process variables in the operating system profile to specify
different output file locations based on the profile assigned to the workflow.

Environment variables. Configure environment variables that the PowerCenter Integration Services uses
at run time.

Permissions. Configure permissions for users to use operating system profiles.

Configuring Operating System Profiles

To use operating system profiles to run workflows, complete the following steps:
1.

On UNIX, verify that setuid is enabled on the file system that contains the Informatica installation. If
necessary, remount the file system with setuid enabled.

2.

Enable operating system profiles in the advanced properties section of the PowerCenter Integration
Service properties.
Note: You can use the default umask value 0022. Or, set the value to 0027 or 0077 for better security.

3.

Configure pmimpprocess on every node where the PowerCenter Integration Service runs. pmimpprocess
is a tool that the DTM process, command tasks, and parameter files use to switch between operating
system users.

4.

Create the operating system profiles on the Security page of the Administrator tool.
On the Security tab Actions menu, select Configure operating system profiles

5.

Assign permissions on operating system profiles to users or groups.

Operating System Profiles

235

6.

You can assign operating system profiles to repository folders or to a workflow.

To configure pmimpprocess:
1.

At the command prompt, switch to the following directory:

2.

Enter the following information at the command line to log in as the administrator user:

<Informatica installation directory>/server/bin

su <administrator user name>
For example, if the administrator user name is root enter the following command:
su root
3.

Enter the following commands to set the owner and group to the administrator user:
chown <administrator user name> pmimpprocess
chgrp <administrator user name> pmimpprocess

4.

Enter the following commands to set the setuid bit:

chmod +g
chmod +s

pmimpprocess
pmimpprocess

Troubleshooting Operating System Profiles

After I selected Use Operating System Profiles, the PowerCenter Integration Service failed to start.
The PowerCenter Integration Service will not start if operating system profiles is enabled on Windows or a
grid that includes a Windows node. You can enable operating system profiles on PowerCenter Integration
Services that run on UNIX.
Or, pmimpprocess was not configured. To use operating system profiles, you must set the owner and group
of pmimpprocess to administrator and enable the setuid bit for pmimpprocess.

Associated Repository for the PowerCenter

Integration Service
When you create the PowerCenter Integration Service, you specify the repository associated with the
PowerCenter Integration Service. You may need to change the repository connection information. For
example, you need to update the connection information if the repository is moved to another database. You
may need to choose a different repository when you move from a development repository to a production
repository.
When you update or choose a new repository, you must specify the PowerCenter Repository Service and the
user account used to access the repository. The Administrator tool lists the PowerCenter Repository Services
defined in the same domain as the PowerCenter Integration Service.
You can edit the associated repository properties in the Services and Nodes view on the Manage tab. In the
Navigator, select the PowerCenter Integration Service. In Associated Repository Properties, click Edit.

236

Chapter 10: PowerCenter Integration Service

The following table describes the associated repository properties:

Property

Description

Associated
Repository Service

PowerCenter Repository Service name to which the PowerCenter Integration Service

connects. To apply changes, restart the PowerCenter Integration Service.

Repository User
Name

User name to access the repository. To apply changes, restart the PowerCenter
Integration Service.
Not available for a domain with Kerberos authentication.

Repository
Password

Password for the user. To apply changes, restart the PowerCenter Integration Service.

Security Domain

Security domain for the user. To apply changes, restart the PowerCenter Integration
Service.

Not available for a domain with Kerberos authentication.

The Security Domain field appears when the Informatica domain contains an LDAP
security domain.

PowerCenter Integration Service Processes

The PowerCenter Integration Service can run each PowerCenter Integration Service process on a different
node. When you select the PowerCenter Integration Service in the Administrator tool, you can view the
PowerCenter Integration Service process nodes on the Processes tab.
You can change the following properties to configure the way that a PowerCenter Integration Service process
runs on a node:

General properties

Custom properties

Environment variables

General properties include the code page and directories for PowerCenter Integration Service files and Java
components.
To configure the properties, select the PowerCenter Integration Service in the Administrator tool and click the
Processes view. When you select a PowerCenter Integration Service process, the detail panel displays the
properties for the service process.

Code Pages
You must specify the code page of each PowerCenter Integration Service process node. The node where the
process runs uses the code page when it extracts, transforms, or loads data.
Before you can select a code page for a PowerCenter Integration Service process, you must select an
associated repository for the PowerCenter Integration Service. The code page for each PowerCenter
Integration Service process node must be a subset of the repository code page. When you edit this property,
the field displays code pages that are a subset of the associated PowerCenter Repository Service code page.
When you configure the PowerCenter Integration Service to run on a grid or a backup node, you can use a
different code page for each PowerCenter Integration Service process node. However, all codes pages for
the PowerCenter Integration Service process nodes must be compatible.

PowerCenter Integration Service Processes

237

Directories for PowerCenter Integration Service Files

PowerCenter Integration Service files include run-time files, state of operation files, and session log files.
The PowerCenter Integration Service creates files to store the state of operations for the service. The state of
operations includes information such as the active service requests, scheduled tasks, and completed and
running processes. If the service fails, the PowerCenter Integration Service can restore the state and recover
operations from the point of interruption.
The PowerCenter Integration Service process uses run-time files to run workflows and sessions. Run-time
files include parameter files, cache files, input files, and output files. If the PowerCenter Integration Service
uses operating system profiles, the operating system user specified in the profile must have access to the
run-time files.
By default, the installation program creates a set of PowerCenter Integration Service directories in the server
\infa_shared directory. You can set the shared location for these directories by configuring the service
process variable $PMRootDir to point to the same location for each PowerCenter Integration Service
process. Each PowerCenter Integration Service can use a separate shared location.

Configuring $PMRootDir
When you configure the PowerCenter Integration Service process variables, you specify the paths for the root
directory and its subdirectories. You can specify an absolute directory for the service process variables. Make
sure all directories specified for service process variables exist before running a workflow.
Set the root directory in the $PMRootDir service process variable. The syntax for $PMRootDir is different for
Windows and UNIX:

On Windows, enter a path beginning with a drive letter, colon, and backslash. For example:
C:\Informatica\<infa_vesion>\server\infa_shared

On UNIX: Enter an absolute path beginning with a slash. For example:

/Informatica/<infa_vesion>/server/infa_shared

You can use $PMRootDir to define subdirectories for other service process variable values. For example, set
the $PMSessionLogDir service process variable to $PMRootDir/SessLogs.

Configuring Service Process Variables for Multiple Nodes

When you configure the PowerCenter Integration Service to run on a grid or a backup node, all PowerCenter
Integration Service processes associated with a PowerCenter Integration Service must use the same shared
directories for PowerCenter Integration Service files.
Configure service process variables with identical absolute paths to the shared directories on each node that
is configured to run the PowerCenter Integration Service. If you use a mounted drive or a mapped drive, the
absolute path to the shared location must also be identical.
For example, if you have a primary and a backup node for the PowerCenter Integration Service, recovery
fails when nodes use the following drives for the storage directory:

Mapped drive on node1: F:\shared\Informatica\<infa_version>\infa_shared\Storage

Mapped drive on node2: G:\shared\Informatica\<infa_version>\infa_shared\Storage

Recovery also fails when nodes use the following drives for the storage directory:

Mounted drive on node1: /mnt/shared/Informatica/<infa_version>/infa_shared/Storage

Mounted drive on node2: /mnt/shared_filesystem/Informatica/<infa_version>/infa_shared/Storage

To use the mapped or mounted drives successfully, both nodes must use the same drive.

238

Chapter 10: PowerCenter Integration Service

Service Process Variables for Operating System Profiles

When you use operating system profiles, define the absolute or relative directory path for
$PMWorkflowLogDir in the PowerCenter Integration Service properties. Define the absolute directory path for
$PMStorageDir in the PowerCenter Integration Service properties and the operating system profile.
The PowerCenter Integration Service writes the workflow log file in the directory specified in
$PMWorkflowLogDir. The PowerCenter Integration Service saves workflow recovery files to the
$PMStorageDir configured in the PowerCenter Integration Service properties and saves the session recovery
files to the $PMStorageDir configured in the operating system profile. Define the other service process
variables within each operating system profile.
You can use a relative directory path to define $PMWorkflowLogDir, but you must use an absolute directory
path to define $PMStorageDir.

Directories for Java Components

You must specify the directory containing the Java components. The PowerCenter Integration Service uses
the Java components for the following PowerCenter components:

Custom transformation that uses Java code

Java transformation

PowerExchange for JMS

PowerExchange for Web Services

PowerExchange for webMethods

General Properties
The following table describes the general properties:
Property

Description

Codepage

Code page of the PowerCenter Integration Service process node.

$PMRootDir

Root directory accessible by the node. This is the root directory for other service
process variables. It cannot include the following special characters:
*?<>|,
Default is <Installation_Directory>\server\infa_shared.
The installation directory is based on the service version of the service that you
created. When you upgrade the PowerCenter Integration Service, the $PMRootDir is
not updated to the upgraded service version installation directory.

$PMSessionLogDir

Default directory for session logs. It cannot include the following special characters:
*?<>|,
Default is $PMRootDir/SessLogs.

$PMBadFileDir

Default directory for reject files. It cannot include the following special characters:
*?<>|,
Default is $PMRootDir/BadFiles.

PowerCenter Integration Service Processes

239

Property

Description

$PMCacheDir

Default directory for index and data cache files.

You can increase performance when the cache directory is a drive local to the
PowerCenter Integration Service process. Do not use a mapped or mounted drive for
cache files. It cannot include the following special characters:
*?<>|,
Default is $PMRootDir/Cache.

$PMTargetFileDir

Default directory for target files. It cannot include the following special characters:
*?<>|,
Default is $PMRootDir/TgtFiles.

$PMSourceFileDir

Default directory for source files. It cannot include the following special characters:
*?<>|,
Default is $PMRootDir/SrcFiles.
Note: If you use Metadata Manager, use the default value. Metadata Manager stores
transformed metadata for packaged resource types in files in the $PMRootDir/SrcFiles
directory. If you change this property, Metadata Manager cannot retrieve the
transformed metadata when you load a packaged resource.

$PMExtProcDir

Default directory for external procedures. It cannot include the following special
characters:
*?<>|,
Default is $PMRootDir/ExtProc.

$PMTempDir

Default directory for temporary files. It cannot include the following special characters:
*?<>|,
Default is $PMRootDir/Temp.

$PMWorkflowLogDir

Default directory for workflow logs. It cannot include the following special characters:
*?<>|,
Default is $PMRootDir/WorkflowLogs.

$PMLookupFileDir

Default directory for lookup files. It cannot include the following special characters:
*?<>|,
Default is $PMRootDir/LkpFiles.

$PMStorageDir

Default directory for state of operation files. The PowerCenter Integration Service uses
these files for recovery if you have the high availability option or if you enable a
workflow for recovery. These files store the state of each workflow and session
operation. It cannot include the following special characters:
*?<>|,
Default is $PMRootDir/Storage.

Java SDK ClassPath

240

Java SDK classpath. You can set the classpath to any JAR files you need to run a
session that require java components. The PowerCenter Integration Service appends
the values you set to the system CLASSPATH. For more information, see Directories
for Java Components on page 239.

Chapter 10: PowerCenter Integration Service

Property

Description

Java SDK Minimum

Memory

Minimum amount of memory the Java SDK uses during a session.

If the session fails due to a lack of memory, you may want to increase this value.
Default is 32 MB.

Java SDK Maximum

Memory

Maximum amount of memory the Java SDK uses during a session.

If the session fails due to a lack of memory, you may want to increase this value.
Default is 64 MB.

Custom Properties for the PowerCenter Integration Service

Process
Configure custom properties that are unique to specific environments.
You might need to apply custom properties in special cases. When you define a custom property, enter the
property name and an initial value. Define custom properties only at the request of Informatica Global
Customer Support.

Environment Variables
The database client path on a node is controlled by an environment variable.
Set the database client path environment variable for the PowerCenter Integration Service process if the
PowerCenter Integration Service process requires a different database client than another PowerCenter
Integration Service process that is running on the same node. For example, the service version of each
PowerCenter Integration Service running on the node requires a different database client version. You can
configure each PowerCenter Integration Service process to use a different value for the database client
environment variable.
The database client code page on a node is usually controlled by an environment variable. For example,
Oracle uses NLS_LANG, and IBM DB2 uses DB2CODEPAGE. All PowerCenter Integration Services and
PowerCenter Repository Services that run on this node use the same environment variable. You can
configure a PowerCenter Integration Service process to use a different value for the database client code
page environment variable than the value set for the node.
You might want to configure the code page environment variable for a PowerCenter Integration Service
process for the following reasons:

A PowerCenter Integration Service and PowerCenter Repository Service running on the node require
different database client code pages. For example, you have a Shift-JIS repository that requires that the
code page environment variable be set to Shift-JIS. However, the PowerCenter Integration Service reads
from and writes to databases using the UTF-8 code page. The PowerCenter Integration Service requires
that the code page environment variable be set to UTF-8.
Set the environment variable on the node to Shift-JIS. Then add the environment variable to the
PowerCenter Integration Service process properties and set the value to UTF-8.

PowerCenter Integration Service Processes

241

Multiple PowerCenter Integration Services running on the node use different data movement modes. For
example, you have one PowerCenter Integration Service running in Unicode mode and another running in
ASCII mode on the same node. The PowerCenter Integration Service running in Unicode mode requires
that the code page environment variable be set to UTF-8. For optimal performance, the PowerCenter
Integration Service running in ASCII mode requires that the code page environment variable be set to 7bit ASCII.
Set the environment variable on the node to UTF-8. Then add the environment variable to the properties
of the PowerCenter Integration Service process running in ASCII mode and set the value to 7-bit ASCII.

If the PowerCenter Integration Service uses operating system profiles, environment variables configured in
the operating system profile override the environment variables set in the general properties for the
PowerCenter Integration Service process.

Configuration for the PowerCenter Integration

Service Grid
A grid is an alias assigned to a group of nodes that run sessions and workflows. When you run a workflow on
a grid, you improve scalability and performance by distributing Session and Command tasks to service
processes running on nodes in the grid. When you run a session on a grid, you improve scalability and
performance by distributing session threads to multiple DTM processes running on nodes in the grid.
To run a workflow or session on a grid, you assign resources to nodes, create and configure the grid, and
configure the PowerCenter Integration Service to run on a grid.
To configure a grid, complete the following tasks:
1.

Create a grid and assign nodes to the grid.

2.

Configure the PowerCenter Integration Service to run on a grid.

3.

Configure the PowerCenter Integration Service processes for the nodes in the grid. If the PowerCenter
Integration Service uses operating system profiles, all nodes on the grid must run on UNIX.

4.

Assign resources to nodes. You assign resources to a node to allow the PowerCenter Integration
Service to match the resources required to run a task or session thread with the resources available on a
node.

After you configure the grid and PowerCenter Integration Service, you configure a workflow to run on the
PowerCenter Integration Service assigned to a grid.

Creating a Grid
To create a grid, create the grid object and assign nodes to the grid. You can assign a node to more than one
grid.
When you create a grid for the Data Integration Service, the nodes assigned to the grid must have specific
roles depending on the types of jobs that the Data Integration Service runs. For more information, see Grid
Configuration by Job Type on page 125.

242

1.

In the Administrator tool, click the Manage tab.

2.

Click the Services and Nodes view.

Chapter 10: PowerCenter Integration Service

3.

In the Domain Navigator, select the domain.

4.

On the Navigator Actions menu, click New > Grid.

The Create Grid dialog box appears.

5.

Enter the following properties:

Property

Description

Name

Name of the grid. The name is not case sensitive and must be unique within the domain. It
cannot exceed 128 characters or begin with @. It also cannot contain spaces or the following
special characters:
`~%^*+={}\;:'"/?.,<>|!()][

Description

Description of the grid. The description cannot exceed 765 characters.

Nodes

Select nodes to assign to the grid.

Path

Location in the Navigator, such as:

DomainName/ProductionGrids

6.

Click OK.

Configuring the PowerCenter Integration Service to Run on a Grid

You configure the PowerCenter Integration Service by assigning the grid to the PowerCenter Integration
Service.
To assign the grid to a PowerCenter Integration Service:
1.

In the Administrator tool, select the PowerCenter Integration Service Properties tab.

2.

Edit the grid and node assignments, and select Grid.

3.

Select the grid you want to assign to the PowerCenter Integration Service.

Configuring the PowerCenter Integration Service Processes

When you run a session or a workflow on a grid, a service process runs on each node in the grid. Each
service process running on a node must be compatible or configured the same. It must also have access to
the directories and input files used by the PowerCenter Integration Service.

Configuration for the PowerCenter Integration Service Grid

243

To ensure consistent results, complete the following tasks:

Verify the shared storage location. Verify that the shared storage location is accessible to each node in
the grid. If the PowerCenter Integration Service uses operating system profiles, the operating system user
must have access to the shared storage location.

Configure the service process. Configure $PMRootDir to the shared location on each node in the grid.
Configure service process variables with identical absolute paths to the shared directories on each node
in the grid. If the PowerCenter Integration Service uses operating system profiles, the service process
variables you define in the operating system profile override the service process variable setting for every
node. The operating system user must have access to the $PMRootDir configured in the operating system
profile on every node in the grid.

Complete the following process to configure the service processes:

1.

Select the PowerCenter Integration Service in the Navigator.

2.

Click the Processes tab.

The tab displays the service process for each node assigned to the grid.

3.

Configure $PMRootDir to point to the shared location.

4.

Configure the following service process settings for each node in the grid:

Code pages. For accurate data movement and transformation, verify that the code pages are
compatible for each service process. Use the same code page for each node where possible.

Service process variables. Configure the service process variables the same for each service
process. For example, the setting for $PMCacheDir must be identical on each node in the grid.

Directories for Java components. Point to the same Java directory to ensure that java components
are available to objects that access Java, such as Custom transformations that use Java coding.

Resources
Informatica resources are the database connections, files, directories, node names, and operating system
types required by a task. You can configure the PowerCenter Integration Service to check resources. When
you do this, the Load Balancer matches the resources available to nodes in the grid with the resources
required by the workflow. It dispatches tasks in the workflow to nodes where the required resources are
available. If the PowerCenter Integration Service is not configured to run on a grid, the Load Balancer ignores
resource requirements.
For example, if a session uses a parameter file, it must run on a node that has access to the file. You create
a resource for the parameter file and make it available to one or more nodes. When you configure the
session, you assign the parameter file resource as a required resource. The Load Balancer dispatches the
Session task to a node that has the parameter file resource. If no node has the parameter file resource
available, the session fails.
Resources for a node can be predefined or user-defined. Informatica creates predefined resources during
installation. Predefined resources include the connections available on a node, node name, and operating
system type. When you create a node, all connection resources are available by default. Disable the
connection resources that are not available on the node. For example, if the node does not have Oracle client
libraries, disable the Oracle Application connections. If the Load Balancer dispatches a task to a node where
the required resources are not available, the task fails. You cannot disable or remove node name or
operating system type resources.
User-defined resources include file/directory and custom resources. Use file/directory resources for
parameter files or file server directories. Use custom resources for any other resources available to the node,
such as database client version.

244

Chapter 10: PowerCenter Integration Service

The following table lists the types of resources you use in Informatica:
Type

Predefined/
UserDefined

Description

Connection

Predefined

Any resource installed with PowerCenter, such as a plug-in or a connection

object. A connection object may be a relational, application, FTP, external
loader, or queue connection.
When you create a node, all connection resources are available by default.
Disable the connection resources that are not available to the node.
Any Session task that reads from or writes to a relational database requires
one or more connection resources. The Workflow Manager assigns
connection resources to the session by default.

Node Name

Predefined

A resource for the name of the node.

A Session, Command, or predefined Event-Wait task requires a node name
resource if it must run on a specific node.

Operating
System Type

Predefined

Custom

User-defined

A resource for the type of operating system on the node.

A Session or Command task requires an operating system type resource if it
must run a specific operating system.
Any resource for all other resources available to the node, such as a specific
database client version.
For example, a Session task requires a custom resource if it accesses a
Custom transformation shared library or if it requires a specific database client
version.

File/Directory

User-defined

Any resource for files or directories, such as a parameter file or a file server
directory.
For example, a Session task requires a file resource if it accesses a session
parameter file.

You configure resources required by Session, Command, and predefined Event-Wait tasks in the task
properties.
You define resources available to a node on the Resources tab of the node in the Administrator tool.
Note: When you define a resource for a node, you must verify that the resource is available to the node. If
the resource is not available and the PowerCenter Integration Service runs a task that requires the resource,
the task fails.
You can view the resources available to all nodes in a domain on the Resources view of the domain. The
Administrator tool displays a column for each node. It displays a checkmark when a resource is available for
a node

Assigning Connection Resources

You can assign the connection resources available to a node in the Administrator tool.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select a node.

3.

In the contents panel, click the Resources view.

4.

Click on a resource that you want to edit.

5.

On the Manage tab Actions menu, click Enable Selected Resource or Disable Selected Resource.

Configuration for the PowerCenter Integration Service Grid

245

Defining Custom and File/Directory Resources

You can define custom and file/directory resources available to a node in the Administrator tool. When you
define a custom or file/directory resource, you assign a resource name. The resource name is a logical name
that you create to identify the resource.
You assign the resource to a PowerCenter task or PowerCenter mapping object instance using this name. To
coordinate resource usage, you may want to use a naming convention for file/directory and custom
resources.
To define a custom or file/directory resource:
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select a node.

3.

In the contents panel, click the Resources view.

4.

On the Manage tab Actions menu, click New Resource.

5.

Enter a name for the resource.

The name is not case sensitive and must be unique within the domain. It cannot exceed 128 characters
or begin with @. It also cannot contain spaces or the following special characters: ` ~ % ^ * + = { }
\;:/?.,<>|!()][

6.

Select a resource type.

7.

Click OK.
To remove a custom or file/directory resource, select a resource and click Delete Selected Resource on
the Manage tab Actions menu.

Resource Naming Conventions

Using resources with PowerCenter requires coordination and communication between the domain
administrator and the workflow developer. The domain administrator defines resources available to nodes.
The workflow developer assigns resources required by Session, Command, and predefined Event-Wait tasks.
To coordinate resource usage, you can use a naming convention for file/directory and custom resources.
Use the following naming convention:
resourcetype_description
For example, multiple nodes in a grid contain a session parameter file called sales1.txt. Create a file resource
for it named sessionparamfile_sales1 on each node that contains the file. A workflow developer creates a
session that uses the parameter file and assigns the sessionparamfile_sales1 file resource to the session.
When the PowerCenter Integration Service runs the workflow on the grid, the Load Balancer distributes the
session assigned the sessionparamfile_sales1 resource to nodes that have the resource defined.

Editing and Deleting a Grid

You can edit or delete a grid from the domain. Edit the grid to change the description, add nodes to the grid,
or remove nodes from the grid. You can delete the grid if the grid is no longer required.
Before you remove a node from the grid, disable the PowerCenter Integration Service process running on the
node.
Before you delete a grid, disable any PowerCenter Integration Services running on the grid.

246

1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

Select the grid in the Domain Navigator.

Chapter 10: PowerCenter Integration Service

3.

To edit the grid, click Edit in the Grid Details section.

You can change the grid description, add nodes to the grid, or remove nodes from the grid.

4.

To delete the grid, select Actions > Delete.

Troubleshooting a Grid
I changed the nodes assigned to the grid, but the Integration Service to which the grid is assigned does
not show the latest Integration Service processes.
When you change the nodes in a grid, the Service Manager performs the following transactions in the domain
configuration database:
1.

Updates the grid based on the node changes. For example, if you add a node, the node appears in the
grid.

2.

Updates the Integration Services to which the grid is assigned. All nodes with the service role in the grid
appear as service processes for the Integration Service.

If the Service Manager cannot update an Integration Service and the latest service processes do not appear
for the Integration Service, restart the Integration Service. If that does not work, reassign the grid to the
Integration Service.

Load Balancer for the PowerCenter Integration

Service
The Load Balancer is a component of the PowerCenter Integration Service that dispatches tasks to
PowerCenter Integration Service processes running on nodes in a grid. It matches task requirements with
resource availability to identify the best PowerCenter Integration Service process to run a task. It can
dispatch tasks on a single node or across nodes.
You can configure Load Balancer settings for the domain and for nodes in the domain. The settings you
configure for the domain apply to all PowerCenter Integration Services in the domain.
You configure the following settings for the domain to determine how the Load Balancer dispatches tasks:

Dispatch mode. The dispatch mode determines how the Load Balancer dispatches tasks. You can
configure the Load Balancer to dispatch tasks in a simple round-robin fashion, in a round-robin fashion
using node load metrics, or to the node with the most available computing resources.

Service level. Service levels establish dispatch priority among tasks that are waiting to be dispatched. You
can create different service levels that a workflow developer can assign to workflows.

You configure the following Load Balancer settings for each node:

Resources. When the PowerCenter Integration Service runs on a grid, the Load Balancer can compare
the resources required by a task with the resources available on each node. The Load Balancer
dispatches tasks to nodes that have the required resources. You assign required resources in the task
properties. You configure available resources using the Administrator tool or infacmd.

CPU profile. In adaptive dispatch mode, the Load Balancer uses the CPU profile to rank the computing
throughput of each CPU and bus architecture in a grid. It uses this value to ensure that more powerful
nodes get precedence for dispatch.

Load Balancer for the PowerCenter Integration Service

247

Resource provision thresholds. The Load Balancer checks one or more resource provision thresholds to
determine if it can dispatch a task. The Load Balancer checks different thresholds depending on the
dispatch mode.

Configuring the Dispatch Mode

The Load Balancer uses the dispatch mode to select a node to run a task. You configure the dispatch mode
for the domain. Therefore, all PowerCenter Integration Services in a domain use the same dispatch mode.
When you change the dispatch mode for a domain, you must restart each PowerCenter Integration Service in
the domain. The previous dispatch mode remains in effect until you restart the PowerCenter Integration
Service.
You configure the dispatch mode in the domain properties.
The Load Balancer uses the following dispatch modes:

Round-robin. The Load Balancer dispatches tasks to available nodes in a round-robin fashion. It checks
the Maximum Processes threshold on each available node and excludes a node if dispatching a task
causes the threshold to be exceeded. This mode is the least compute-intensive and is useful when the
load on the grid is even and the tasks to dispatch have similar computing requirements.

Metric-based. The Load Balancer evaluates nodes in a round-robin fashion. It checks all resource
provision thresholds on each available node and excludes a node if dispatching a task causes the
thresholds to be exceeded. The Load Balancer continues to evaluate nodes until it finds a node that can
accept the task. This mode prevents overloading nodes when tasks have uneven computing requirements.

Adaptive. The Load Balancer ranks nodes according to current CPU availability. It checks all resource
provision thresholds on each available node and excludes a node if dispatching a task causes the
thresholds to be exceeded. This mode prevents overloading nodes and ensures the best performance on
a grid that is not heavily loaded.

The following table compares the differences among dispatch modes:

Dispatch Mode

Checks resource
provision thresholds?

Uses task
statistics?

Uses CPU
profile?

Allows bypass in
dispatch queue?

Round-Robin

Checks maximum
processes.

No

No

No

Metric-Based

Checks all thresholds.

Yes

No

No

Adaptive

Checks all thresholds.

Yes

Yes

Yes

Round-Robin Dispatch Mode

In round-robin dispatch mode, the Load Balancer dispatches tasks to nodes in a round-robin fashion. The
Load Balancer checks the Maximum Processes resource provision threshold on the first available node. It
dispatches the task to this node if dispatching the task does not cause this threshold to be exceeded. If
dispatching the task causes this threshold to be exceeded, the Load Balancer evaluates the next node. It
continues to evaluate nodes until it finds a node that can accept the task.
The Load Balancer dispatches tasks for execution in the order the Workflow Manager or scheduler submits
them. The Load Balancer does not bypass any task in the dispatch queue. Therefore, if a resource-intensive
task is first in the dispatch queue, all other tasks with the same service level must wait in the queue until the
Load Balancer dispatches the resource-intensive task.

248

Chapter 10: PowerCenter Integration Service

Metric-Based Dispatch Mode

In metric-based dispatch mode, the Load Balancer evaluates nodes in a round-robin fashion until it finds a
node that can accept the task. The Load Balancer checks the resource provision thresholds on the first
available node. It dispatches the task to this node if dispatching the task causes none of the thresholds to be
exceeded. If dispatching the task causes any threshold to be exceeded, or if the node is out of free swap
space, the Load Balancer evaluates the next node. It continues to evaluate nodes until it finds a node that
can accept the task.
To determine whether a task can run on a particular node, the Load Balancer collects and stores statistics
from the last three runs of the task. It compares these statistics with the resource provision thresholds
defined for the node. If no statistics exist in the repository, the Load Balancer uses the following default
values:

40 MB memory

15% CPU

The Load Balancer dispatches tasks for execution in the order the Workflow Manager or scheduler submits
them. The Load Balancer does not bypass any tasks in the dispatch queue. Therefore, if a resource intensive
task is first in the dispatch queue, all other tasks with the same service level must wait in the queue until the
Load Balancer dispatches the resource intensive task.

Adaptive Dispatch Mode

In adaptive dispatch mode, the Load Balancer evaluates the computing resources on all available nodes. It
identifies the node with the most available CPU and checks the resource provision thresholds on the node. It
dispatches the task if doing so does not cause any threshold to be exceeded. The Load Balancer does not
dispatch a task to a node that is out of free swap space.
In adaptive dispatch mode, the Load Balancer can use the CPU profile to rank nodes according to the
amount of computing resources on the node.
To identify the best node to run a task, the Load Balancer also collects and stores statistics from the last
three runs of the task and compares them with node load metrics. If no statistics exist in the repository, the
Load Balancer uses the following default values:

40 MB memory

15% CPU

In adaptive dispatch mode, the order in which the Load Balancer dispatches tasks from the dispatch queue
depends on the task requirements and dispatch priority. For example, if multiple tasks with the same service
level are waiting in the dispatch queue and adequate computing resources are not available to run a resource
intensive task, the Load Balancer reserves a node for the resource intensive task and keeps dispatching less
intensive tasks to other nodes.

Service Levels
Service levels establish priorities among tasks that are waiting to be dispatched.
When the Load Balancer has more tasks to dispatch than the PowerCenter Integration Service can run at the
time, the Load Balancer places those tasks in the dispatch queue. When multiple tasks are waiting in the
dispatch queue, the Load Balancer uses service levels to determine the order in which to dispatch tasks from
the queue.
Service levels are domain properties. Therefore, you can use the same service levels for all repositories in a
domain. You create and edit service levels in the domain properties or using infacmd.

Load Balancer for the PowerCenter Integration Service

249

When you create a service level, a workflow developer can assign it to a workflow in the Workflow Manager.
All tasks in a workflow have the same service level. The Load Balancer uses service levels to dispatch tasks
from the dispatch queue. For example, you create two service levels:

Service level Low has dispatch priority 10 and maximum dispatch wait time 7,200 seconds.

Service level High has dispatch priority 2 and maximum dispatch wait time 1,800 seconds.

When multiple tasks are in the dispatch queue, the Load Balancer dispatches tasks with service level High
before tasks with service level Low because service level High has a higher dispatch priority. If a task with
service level Low waits in the dispatch queue for two hours, the Load Balancer changes its dispatch priority
to the maximum priority so that the task does not remain in the dispatch queue indefinitely.
The Administrator tool provides a default service level named Default with a dispatch priority of 5 and
maximum dispatch wait time of 1800 seconds. You can update the default service level, but you cannot
delete it.
When you remove a service level, the Workflow Manager does not update tasks that use the service level. If
a workflow service level does not exist in the domain, the Load Balancer dispatches the tasks with the default
service level.

Creating Service Levels

Create service levels in the Administrator tool.
1.

In the Administrator tool, select a domain in the Navigator.

2.

Click the Properties tab.

3.

In the Service Level Management area, click Add.

4.

Enter values for the service level properties.

5.

Click OK.

6.

To remove a service level, click the Remove button for the service level you want to remove.

Configuring Resources
When you configure the PowerCenter Integration Service to run on a grid and to check resource
requirements, the Load Balancer dispatches tasks to nodes based on the resources available on each node.
You configure the PowerCenter Integration Service to check available resources in the PowerCenter
Integration Service properties in Informatica Administrator.
You assign resources required by a task in the task properties in the PowerCenter Workflow Manager.
You define the resources available to each node in the Administrator tool. Define the following types of
resources:

Connection. Any resource installed with PowerCenter, such as a plug-in or a connection object. When you
create a node, all connection resources are available by default. Disable the connection resources that
are not available to the node.

File/Directory. A user-defined resource that defines files or directories available to the node, such as
parameter files or file server directories.

Custom. A user-defined resource that identifies any other resources available to the node. For example,
you may use a custom resource to identify a specific database client version.

Enable and disable available resources on the Resources tab for the node in the Administrator tool or using
infacmd.

250

Chapter 10: PowerCenter Integration Service

Calculating the CPU Profile

In adaptive dispatch mode, the Load Balancer uses the CPU profile to rank the computing throughput of each
CPU and bus architecture in a grid. This ensures that nodes with higher processing power get precedence for
dispatch. This value is not used in round-robin or metric-based dispatch modes.
The CPU profile is an index of the processing power of a node compared to a baseline system. The baseline
system is a Pentium 2.4 GHz computer running Windows 2000. For example, if a SPARC 480 MHz computer
is 0.28 times as fast as the baseline computer, the CPU profile for the SPARC computer should be set
to 0.28.
By default, the CPU profile is set to 1.0. To calculate the CPU profile for a node, select the node in the
Navigator and click Actions > Recalculate CPU Profile Benchmark. To get the most accurate value,
calculate the CPU profile when the node is idle. The calculation takes approximately five minutes and uses
100% of one CPU on the machine.
You can also calculate the CPU profile using infacmd. Or, you can edit the node properties and update the
value manually.

Defining Resource Provision Thresholds

The Load Balancer dispatches tasks to PowerCenter Integration Service processes running on a node. It can
continue to dispatch tasks to a node as long as the resource provision thresholds defined for the node are not
exceeded. When the Load Balancer has more Session and Command tasks to dispatch than the
PowerCenter Integration Service can run at a time, the Load Balancer places the tasks in the dispatch queue.
It dispatches tasks from the queue when a PowerCenter Integration Service process becomes available.
You can define the following resource provision thresholds for each node in a domain:

Maximum CPU run queue length. The maximum number of runnable threads waiting for CPU resources
on the node. The Load Balancer does not count threads that are waiting on disk or network I/Os. If you set
this threshold to 2 on a 4-CPU node that has four threads running and two runnable threads waiting, the
Load Balancer does not dispatch new tasks to this node.
This threshold limits context switching overhead. You can set this threshold to a low value to preserve
computing resources for other applications. If you want the Load Balancer to ignore this threshold, set it to
a high number such as 200. The default value is 10.
The Load Balancer uses this threshold in metric-based and adaptive dispatch modes.

Maximum memory %. The maximum percentage of virtual memory allocated on the node relative to the
total physical memory size. If you set this threshold to 120% on a node, and virtual memory usage on the
node is above 120%, the Load Balancer does not dispatch new tasks to the node.
The default value for this threshold is 150%. Set this threshold to a value greater than 100% to allow the
allocation of virtual memory to exceed the physical memory size when dispatching tasks. If you want the
Load Balancer to ignore this threshold, set it to a high number such as 1,000.
The Load Balancer uses this threshold in metric-based and adaptive dispatch modes.

Load Balancer for the PowerCenter Integration Service

251

Maximum processes. The maximum number of running processes allowed for each PowerCenter
Integration Service process that runs on the node. This threshold specifies the maximum number of
running Session or Command tasks allowed for each PowerCenter Integration Service process that runs
on the node. For example, if you set this threshold to 10 when two PowerCenter Integration Services are
running on the node, the maximum number of Session tasks allowed for the node is 20 and the maximum
number of Command tasks allowed for the node is 20. Therefore, the maximum number of processes that
can run simultaneously is 40.
The default value for this threshold is 10. Set this threshold to a high number, such as 200, to cause the
Load Balancer to ignore it. To prevent the Load Balancer from dispatching tasks to the node, set this
threshold to 0.
The Load Balancer uses this threshold in all dispatch modes.

You define resource provision thresholds in the node properties.

252

Chapter 10: PowerCenter Integration Service

CHAPTER 11

PowerCenter Integration Service

Architecture
This chapter includes the following topics:

PowerCenter Integration Service Architecture Overview, 253

PowerCenter Integration Service Connectivity, 254

PowerCenter Integration Service Process, 254

Load Balancer, 256

Data Transformation Manager (DTM) Process, 259

Processing Threads, 260

DTM Processing, 263

Grids, 265

System Resources, 267

Code Pages and Data Movement Modes, 268

Output Files and Caches, 269

PowerCenter Integration Service Architecture

Overview
The PowerCenter Integration Service moves data from sources to targets based on PowerCenter workflow
and mapping metadata stored in a PowerCenter repository. When a workflow starts, the PowerCenter
Integration Service retrieves mapping, workflow, and session metadata from the repository. It extracts data
from the mapping sources and stores the data in memory while it applies the transformation rules configured
in the mapping. The PowerCenter Integration Service loads the transformed data into one or more targets.
To move data from sources to targets, the PowerCenter Integration Service uses the following components:

PowerCenter Integration Service process. The PowerCenter Integration Service starts one or more
PowerCenter Integration Service processes to run and monitor workflows. When you run a workflow, the
PowerCenter Integration Service process starts and locks the workflow, runs the workflow tasks, and
starts the process to run sessions.

Load Balancer. The PowerCenter Integration Service uses the Load Balancer to dispatch tasks. The Load
Balancer dispatches tasks to achieve optimal performance. It may dispatch tasks to a single node or
across the nodes in a grid.

253

Data Transformation Manager (DTM) process. The PowerCenter Integration Service starts a DTM process
to run each Session and Command task within a workflow. The DTM process performs session
validations, creates threads to initialize the session, read, write, and transform data, and handles pre- and
post- session operations.

The PowerCenter Integration Service can achieve high performance using symmetric multi-processing
systems. It can start and run multiple tasks concurrently. It can also concurrently process partitions within a
single session. When you create multiple partitions within a session, the PowerCenter Integration Service
creates multiple database connections to a single source and extracts a separate range of data for each
connection. It also transforms and loads the data in parallel.

PowerCenter Integration Service Connectivity

The PowerCenter Integration Service is a repository client. It connects to the PowerCenter Repository
Service to retrieve workflow and mapping metadata from the repository database. When the PowerCenter
Integration Service process requests a repository connection, the request is routed through the master
gateway, which sends back PowerCenter Repository Service information to the PowerCenter Integration
Service process. The PowerCenter Integration Service process connects to the PowerCenter Repository
Service. The PowerCenter Repository Service connects to the repository and performs repository metadata
transactions for the client application.
The PowerCenter Workflow Manager communicates with the PowerCenter Integration Service process over a
TCP/IP connection. The PowerCenter Workflow Manager communicates with the PowerCenter Integration
Service process each time you schedule or edit a workflow, display workflow details, and request workflow
and session logs. Use the connection information defined for the domain to access the PowerCenter
Integration Service from the PowerCenter Workflow Manager.
The PowerCenter Integration Service process connects to the source or target database using ODBC or
native drivers. The PowerCenter Integration Service process maintains a database connection pool for stored
procedures or lookup databases in a workflow. The PowerCenter Integration Service process allows an
unlimited number of connections to lookup or stored procedure databases. If a database user does not have
permission for the number of connections a session requires, the session fails. You can optionally set a
parameter to limit the database connections. For a session, the PowerCenter Integration Service process
holds the connection as long as it needs to read data from source tables or write data to target tables.
The following table summarizes the software you need to connect the PowerCenter Integration Service to the
platform components, source databases, and target databases:
Note: Both the Windows and UNIX versions of the PowerCenter Integration Service can use ODBC drivers to
connect to databases. Use native drivers to improve performance.

PowerCenter Integration Service Process

The PowerCenter Integration Service starts a PowerCenter Integration Service process to run and monitor
workflows. The PowerCenter Integration Service process is also known as the pmserver process. The
PowerCenter Integration Service process accepts requests from the PowerCenter Client and from pmcmd. It
performs the following tasks:

254

Manage workflow scheduling.

Chapter 11: PowerCenter Integration Service Architecture

Lock and read the workflow.

Read the parameter file.

Create the workflow log.

Run workflow tasks and evaluates the conditional links connecting tasks.

Start the DTM process or processes to run the session.

Write historical run information to the repository.

Send post-session email in the event of a DTM failure.

Manage PowerCenter Workflow Scheduling

The PowerCenter Integration Service process manages workflow scheduling in the following situations:

When you start the PowerCenter Integration Service. When you start the PowerCenter Integration
Service, it queries the repository for a list of workflows configured to run on it.

When you save a workflow. When you save a workflow assigned to a PowerCenter Integration Service to
the repository, the PowerCenter Integration Service process adds the workflow to or removes the
workflow from the schedule queue.

Lock and Read the PowerCenter Workflow

When the PowerCenter Integration Service process starts a workflow, it requests an execute lock on the
workflow from the repository. The execute lock allows the PowerCenter Integration Service process to run the
workflow and prevents you from starting the workflow again until it completes. If the workflow is already
locked, the PowerCenter Integration Service process cannot start the workflow. A workflow may be locked if it
is already running.
The PowerCenter Integration Service process also reads the workflow from the repository at workflow run
time. The PowerCenter Integration Service process reads all links and tasks in the workflow except sessions
and worklet instances. The PowerCenter Integration Service process reads session instance information from
the repository. The DTM retrieves the session and mapping from the repository at session run time. The
PowerCenter Integration Service process reads worklets from the repository when the worklet starts.

Read the Parameter File

When the workflow starts, the PowerCenter Integration Service process checks the workflow properties for
use of a parameter file. If the workflow uses a parameter file, the PowerCenter Integration Service process
reads the parameter file and expands the variable values for the workflow and any worklets invoked by the
workflow.
The parameter file can also contain mapping parameters and variables and session parameters for sessions
in the workflow, as well as service and service process variables for the service process that runs the
workflow. When starting the DTM, the PowerCenter Integration Service process passes the parameter file
name to the DTM.

Create the PowerCenter Workflow Log

The PowerCenter Integration Service process creates a log for the PowerCenter workflow. The workflow log
contains a history of the workflow run, including initialization, workflow task status, and error messages. You
can use information in the workflow log in conjunction with the PowerCenter Integration Service log and
session log to troubleshoot system, workflow, or session problems.

Run the PowerCenter Workflow Tasks

The PowerCenter Integration Service process runs workflow tasks according to the conditional links
connecting the tasks. Links define the order of execution for workflow tasks. When a task in the workflow
completes, the PowerCenter Integration Service process evaluates the completed task according to specified

PowerCenter Integration Service Process

255

conditions, such as success or failure. Based on the result of the evaluation, the PowerCenter Integration
Service process runs successive links and tasks.

Run the PowerCenter Workflows Across the Nodes in a Grid

When you run a PowerCenter Integration Service on a grid, the service processes run workflow tasks across
the nodes of the grid. The domain designates one service process as the master service process. The master
service process monitors the worker service processes running on separate nodes. The worker service
processes run workflows across the nodes in a grid.

Start the DTM Process

When the workflow reaches a session, the PowerCenter Integration Service process starts the DTM process.
The PowerCenter Integration Service process provides the DTM process with session and parameter file
information that allows the DTM to retrieve the session and mapping metadata from the repository. When you
run a session on a grid, the worker service process starts multiple DTM processes that run groups of session
threads.
When you use operating system profiles, the PowerCenter Integration Services starts the DTM process with
the system user account you specify in the operating system profile.

Write Historical Information

The PowerCenter Integration Service process monitors the status of workflow tasks during the workflow run.
When workflow tasks start or finish, the PowerCenter Integration Service process writes historical run
information to the repository. Historical run information for tasks includes start and completion times and
completion status. Historical run information for sessions also includes source read statistics, target load
statistics, and number of errors. You can view this information using the PowerCenter Workflow Monitor.

Send Post-Session Email

The PowerCenter Integration Service process sends post-session email if the DTM terminates abnormally.
The DTM sends post-session email in all other cases.

Load Balancer
The Load Balancer dispatches tasks to achieve optimal performance and scalability. When you run a
workflow, the Load Balancer dispatches the Session, Command, and predefined Event-Wait tasks within the
workflow. The Load Balancer matches task requirements with resource availability to identify the best node to
run a task. It dispatches the task to a PowerCenter Integration Service process running on the node. It may
dispatch tasks to a single node or across nodes.
The Load Balancer dispatches tasks in the order it receives them. When the Load Balancer needs to dispatch
more Session and Command tasks than the PowerCenter Integration Service can run, it places the tasks it
cannot run in a queue. When nodes become available, the Load Balancer dispatches tasks from the queue in
the order determined by the workflow service level.
The following concepts describe Load Balancer functionality:

256

Dispatch process. The Load Balancer performs several steps to dispatch tasks.

Resources. The Load Balancer can use PowerCenter resources to determine if it can dispatch a task to a
node.

Resource provision thresholds. The Load Balancer uses resource provision thresholds to determine
whether it can start additional tasks on a node.

Dispatch mode. The dispatch mode determines how the Load Balancer selects nodes for dispatch.

Chapter 11: PowerCenter Integration Service Architecture

Service levels. When multiple tasks are waiting in the dispatch queue, the Load Balancer uses service
levels to determine the order in which to dispatch tasks from the queue.

Dispatch Process
The Load Balancer uses different criteria to dispatch tasks depending on whether the PowerCenter
Integration Service runs on a node or a grid.

Dispatch Tasks on a Node

When the PowerCenter Integration Service runs on a node, the Load Balancer performs the following steps
to dispatch a task:
1.

The Load Balancer checks resource provision thresholds on the node. If dispatching the task causes any
threshold to be exceeded, the Load Balancer places the task in the dispatch queue, and it dispatches the
task later.
The Load Balancer checks different thresholds depending on the dispatch mode.

2.

The Load Balancer dispatches all tasks to the node that runs the master PowerCenter Integration
Service process.

Dispatch Tasks Across a Grid

When the PowerCenter Integration Service runs on a grid, the Load Balancer performs the following steps to
determine on which node to run a task:
1.

The Load Balancer verifies which nodes are currently running and enabled.

2.

If you configure the PowerCenter Integration Service to check resource requirements, the Load Balancer
identifies nodes that have the PowerCenter resources required by the tasks in the workflow.

3.

The Load Balancer verifies that the resource provision thresholds on each candidate node are not
exceeded. If dispatching the task causes a threshold to be exceeded, the Load Balancer places the task
in the dispatch queue, and it dispatches the task later.
The Load Balancer checks thresholds based on the dispatch mode.

4.

The Load Balancer selects a node based on the dispatch mode.

Resources
You can configure the PowerCenter Integration Service to check the resources available on each node and
match them with the resources required to run the task. If you configure the PowerCenter Integration Service
to run on a grid and to check resources, the Load Balancer dispatches a task to a node where the required
PowerCenter resources are available. For example, if a session uses an SAP source, the Load Balancer
dispatches the session only to nodes where the SAP client is installed. If no available node has the required
resources, the PowerCenter Integration Service fails the task.
You configure the PowerCenter Integration Service to check resources in the Administrator tool.
You define resources available to a node in the Administrator tool. You assign resources required by a task in
the task properties.
The PowerCenter Integration Service writes resource requirements and availability information in the
workflow log.

Load Balancer

257

Resource Provision Thresholds

The Load Balancer uses resource provision thresholds to determine the maximum load acceptable for a
node. The Load Balancer can dispatch a task to a node when dispatching the task does not cause the
resource provision thresholds to be exceeded.
The Load Balancer checks the following thresholds:

Maximum CPU Run Queue Length. The maximum number of runnable threads waiting for CPU resources
on the node. The Load Balancer excludes the node if the maximum number of waiting threads is
exceeded.
The Load Balancer checks this threshold in metric-based and adaptive dispatch modes.

Maximum Memory %. The maximum percentage of virtual memory allocated on the node relative to the
total physical memory size. The Load Balancer excludes the node if dispatching the task causes this
threshold to be exceeded.
The Load Balancer checks this threshold in metric-based and adaptive dispatch modes.

Maximum Processes. The maximum number of running processes allowed for each PowerCenter
Integration Service process that runs on the node. The Load Balancer excludes the node if dispatching
the task causes this threshold to be exceeded.
The Load Balancer checks this threshold in all dispatch modes.

If all nodes in the grid have reached the resource provision thresholds before any PowerCenter task has
been dispatched, the Load Balancer dispatches tasks one at a time to ensure that PowerCenter tasks are still
executed.
You define resource provision thresholds in the node properties.

Dispatch Mode
The dispatch mode determines how the Load Balancer selects nodes to distribute workflow tasks. The Load
Balancer uses the following dispatch modes:

Round-robin. The Load Balancer dispatches tasks to available nodes in a round-robin fashion. It checks
the Maximum Processes threshold on each available node and excludes a node if dispatching a task
causes the threshold to be exceeded. This mode is the least compute-intensive and is useful when the
load on the grid is even and the tasks to dispatch have similar computing requirements.

Metric-based. The Load Balancer evaluates nodes in a round-robin fashion. It checks all resource
provision thresholds on each available node and excludes a node if dispatching a task causes the
thresholds to be exceeded. The Load Balancer continues to evaluate nodes until it finds a node that can
accept the task. This mode prevents overloading nodes when tasks have uneven computing requirements.

Adaptive. The Load Balancer ranks nodes according to current CPU availability. It checks all resource
provision thresholds on each available node and excludes a node if dispatching a task causes the
thresholds to be exceeded. This mode prevents overloading nodes and ensures the best performance on
a grid that is not heavily loaded.

When the Load Balancer runs in metric-based or adaptive mode, it uses task statistics to determine whether
a task can run on a node. The Load Balancer averages statistics from the last three runs of the task to
estimate the computing resources required to run the task. If no statistics exist in the repository, the Load
Balancer uses default values.
In adaptive dispatch mode, the Load Balancer can use the CPU profile for the node to identify the node with
the most computing resources.
You configure the dispatch mode in the domain properties.

258

Chapter 11: PowerCenter Integration Service Architecture

Service Levels
Service levels establish priority among tasks that are waiting to be dispatched.
When the Load Balancer has more Session and Command tasks to dispatch than the PowerCenter
Integration Service can run at the time, the Load Balancer places the tasks in the dispatch queue. When
nodes become available, the Load Balancer dispatches tasks from the queue. The Load Balancer uses
service levels to determine the order in which to dispatch tasks from the queue.
You create and edit service levels in the domain properties in the Administrator tool. You assign service
levels to workflows in the workflow properties in the PowerCenter Workflow Manager.

Data Transformation Manager (DTM) Process

The DTM process is the operating system process that the PowerCenter Integration Service creates to run a
DTM instance. The PowerCenter Integration Service creates a DTM instance to run each session, and it runs
each DTM instance within a DTM process. The DTM process is also called the pmdtm process.
The DTM process performs the following tasks:
Reads the session information
The PowerCenter Integration Service process provides the DTM with session instance information when
it starts the DTM. The DTM retrieves the mapping and session metadata from the repository and
validates it.
Performs pushdown optimization
If the session is configured for pushdown optimization, the DTM runs an SQL statement to push
transformation logic to the source or target database.
Creates dynamic partitions
The DTM adds partitions to the session if you configure the session for dynamic partitioning. The DTM
scales the number of session partitions based on factors such as source database partitions or the
number of nodes in a grid.
Forms partition groups
If you run a session on a grid, the DTM forms partition groups. A partition group is a group of reader,
writer, and transformation threads that runs in a single DTM process. The DTM process forms partition
groups and distributes them to worker DTM processes running on nodes in the grid.
Expands variables and parameters
If the workflow uses a parameter file, the PowerCenter Integration Service process sends the parameter
file to the DTM when it starts the DTM. The DTM creates and expands session-level, service-level, and
mapping-level variables and parameters.
Creates the session log
The DTM creates logs for the session. The session log contains a complete history of the session run,
including initialization, transformation, status, and error messages. You can use information in the
session log in conjunction with the PowerCenter Integration Service log and the workflow log to
troubleshoot system or session problems.
Validates code pages
The PowerCenter Integration Service processes data internally using the UCS-2 character set. When
you disable data code page validation, the PowerCenter Integration Service verifies that the source

Data Transformation Manager (DTM) Process

259

query, target query, lookup database query, and stored procedure call text convert from the source,
target, lookup, or stored procedure data code page to the UCS-2 character set without loss of data in
conversion. If the PowerCenter Integration Service encounters an error when converting data, it writes
an error message to the session log.
Verifies connection object permissions
After validating the session code pages, the DTM verifies permissions for connection objects used in the
session. The DTM verifies that the user who started or scheduled the workflow has execute permissions
for connection objects associated with the session.
Starts worker DTM processes
The DTM sends a request to the PowerCenter Integration Service process to start worker DTM
processes on other nodes when the session is configured to run on a grid.
Runs pre-session operations
After verifying connection object permissions, the DTM runs pre-session shell commands. The DTM then
runs pre-session stored procedures and SQL commands.
Runs the processing threads
After initializing the session, the DTM uses reader, transformation, and writer threads to extract,
transform, and load data. The number of threads the DTM uses to run the session depends on the
number of partitions configured for the session.
Runs post-session operations
After the DTM runs the processing threads, it runs post-session SQL commands and stored procedures.
The DTM then runs post-session shell commands.
Sends post-session email
When the session finishes, the DTM composes and sends email that reports session completion or
failure. If the DTM terminates abnormally, the PowerCenter Integration Service process sends postsession email.
Note: If you use operating system profiles, the PowerCenter Integration Service runs the DTM process as the
operating system user you specify in the operating system profile.

Processing Threads
The DTM allocates process memory for the session and divides it into buffers. This is also known as buffer
memory. The DTM uses multiple threads to process data in a session. The main DTM thread is called the
master thread.
The master thread creates and manages other threads. The master thread for a session can create mapping,
pre-session, post-session, reader, transformation, and writer threads.
For each target load order group in a mapping, the master thread can create several threads. The types of
threads depend on the session properties and the transformations in the mapping. The number of threads
depends on the partitioning information for each target load order group in the mapping.

260

Chapter 11: PowerCenter Integration Service Architecture

The following figure shows the threads the master thread creates for a simple mapping that contains one
target load order group:

1. One reader thread.

2. One transformation thread.
3. One writer thread.

The mapping contains a single partition. In this case, the master thread creates one reader, one
transformation, and one writer thread to process the data. The reader thread controls how the PowerCenter
Integration Service process extracts source data and passes it to the source qualifier, the transformation
thread controls how the PowerCenter Integration Service process handles the data, and the writer thread
controls how the PowerCenter Integration Service process loads data to the target.
When the pipeline contains only a source definition, source qualifier, and a target definition, the data
bypasses the transformation threads, proceeding directly from the reader buffers to the writer. This type of
pipeline is a pass-through pipeline.
The following figure shows the threads for a pass-through pipeline with one partition:

1. One reader thread.

2. Bypassed transformation thread.
3. One writer thread.

Thread Types
The master thread creates different types of threads for a session. The types of threads the master thread
creates depend on the pre- and post-session properties, as well as the types of transformations in the
mapping.
The master thread can create the following types of threads:

Mapping threads

Pre- and post-session threads

Reader threads

Transformation threads

Writer threads

Processing Threads

261

Mapping Threads
The master thread creates one mapping thread for each session. The mapping thread fetches session and
mapping information, compiles the mapping, and cleans up after session execution.

Pre- and Post-Session Threads

The master thread creates one pre-session and one post-session thread to perform pre- and post-session
operations.

Reader Threads
The master thread creates reader threads to extract source data. The number of reader threads depends on
the partitioning information for each pipeline. The number of reader threads equals the number of partitions.
Relational sources use relational reader threads, and file sources use file reader threads.
The PowerCenter Integration Service creates an SQL statement for each reader thread to extract data from a
relational source. For file sources, the PowerCenter Integration Service can create multiple threads to read a
single source.

Transformation Threads
The master thread creates one or more transformation threads for each partition. Transformation threads
process data according to the transformation logic in the mapping.
The master thread creates transformation threads to transform data received in buffers by the reader thread,
move the data from transformation to transformation, and create memory caches when necessary. The
number of transformation threads depends on the partitioning information for each pipeline.
Transformation threads store transformed data in a buffer drawn from the memory pool for subsequent
access by the writer thread.
If the pipeline contains a Rank, Joiner, Aggregator, Sorter, or a cached Lookup transformation, the
transformation thread uses cache memory until it reaches the configured cache size limits. If the
transformation thread requires more space, it pages to local cache files to hold additional data.
When the PowerCenter Integration Service runs in ASCII mode, the transformation threads pass character
data in single bytes. When the PowerCenter Integration Service runs in Unicode mode, the transformation
threads use double bytes to move character data.

Writer Threads
The master thread creates writer threads to load target data. The number of writer threads depends on the
partitioning information for each pipeline. If the pipeline contains one partition, the master thread creates one
writer thread. If it contains multiple partitions, the master thread creates multiple writer threads.
Each writer thread creates connections to the target databases to load data. If the target is a file, each writer
thread creates a separate file. You can configure the session to merge these files.
If the target is relational, the writer thread takes data from buffers and commits it to session targets. When
loading targets, the writer commits data based on the commit interval in the session properties. You can
configure a session to commit data based on the number of source rows read, the number of rows written to
the target, or the number of rows that pass through a transformation that generates transactions, such as a
Transaction Control transformation.

262

Chapter 11: PowerCenter Integration Service Architecture

Pipeline Partitioning
When running sessions, the PowerCenter Integration Service process can achieve high performance by
partitioning the pipeline and performing the extract, transformation, and load for each partition in parallel. To
accomplish this, use the following session and PowerCenter Integration Service configuration:

Configure the session with multiple partitions.

Install the PowerCenter Integration Service on a machine with multiple CPUs.

You can configure the partition type at most transformations in the pipeline. The PowerCenter Integration
Service can partition data using round-robin, hash, key-range, database partitioning, or pass-through
partitioning.
You can also configure a session for dynamic partitioning to enable the PowerCenter Integration Service to
set partitioning at run time. When you enable dynamic partitioning, the PowerCenter Integration Service
scales the number of session partitions based on factors such as the source database partitions or the
number of nodes in a grid.
For relational sources, the PowerCenter Integration Service creates multiple database connections to a
single source and extracts a separate range of data for each connection.
The PowerCenter Integration Service transforms the partitions concurrently, it passes data between the
partitions as needed to perform operations such as aggregation. When the PowerCenter Integration Service
loads relational data, it creates multiple database connections to the target and loads partitions of data
concurrently. When the PowerCenter Integration Service loads data to file targets, it creates a separate file
for each partition. You can choose to merge the target files.

DTM Processing
When you run a session, the DTM process reads source data and passes it to the transformations for
processing. To help understand DTM processing, consider the following DTM process actions:

Reading source data. The DTM reads the sources in a mapping at different times depending on how you
configure the sources, transformations, and targets in the mapping.

Blocking data. The DTM sometimes blocks the flow of data at a transformation in the mapping while it
processes a row of data from a different source.

Block processing. The DTM reads and processes a block of rows at a time.

Reading Source Data

Mappings contain one or more target load order groups. A target load order group is the collection of source
qualifiers, transformations, and targets linked together in a mapping. Each target load order group contains
one or more source pipelines. A source pipeline consists of a source qualifier and all of the transformations
and target instances that receive data from that source qualifier.
By default, the DTM reads sources in a target load order group concurrently, and it processes target load
order groups sequentially. You can configure the order that the DTM processes target load order groups.

DTM Processing

263

The following figure shows a mapping that contains two target load order groups and three source pipelines:

In the mapping, the DTM processes the target load order groups sequentially. It first processes Target Load
Order Group 1 by reading Source A and Source B at the same time. When it finishes processing Target Load
Order Group 1, the DTM begins to process Target Load Order Group 2 by reading Source C.

Blocking Data
You can include multiple input group transformations in a mapping. The DTM passes data to the input groups
concurrently. However, sometimes the transformation logic of a multiple input group transformation requires
that the DTM block data on one input group while it waits for a row from a different input group.
Blocking is the suspension of the data flow into an input group of a multiple input group transformation. When
the DTM blocks data, it reads data from the source connected to the input group until it fills the reader and
transformation buffers. After the DTM fills the buffers, it does not read more source rows until the
transformation logic allows the DTM to stop blocking the source. When the DTM stops blocking a source, it
processes the data in the buffers and continues to read from the source.
The DTM blocks data at one input group when it needs a specific row from a different input group to perform
the transformation logic. After the DTM reads and processes the row it needs, it stops blocking the source.

Block Processing
The DTM reads and processes a block of rows at a time. The number of rows in the block depend on the row
size and the DTM buffer size. In the following circumstances, the DTM processes one row in a block:

264

Log row errors. When you log row errors, the DTM processes one row in a block.

Connect CURRVAL. When you connect the CURRVAL port in a Sequence Generator transformation, the
session processes one row in a block. For optimal performance, connect only the NEXTVAL port in
mappings.

Configure array-based mode for Custom transformation procedure. When you configure the data access
mode for a Custom transformation procedure to be row-based, the DTM processes one row in a block. By
default, the data access mode is array-based, and the DTM processes multiple rows in a block.

Chapter 11: PowerCenter Integration Service Architecture

Grids
When you run a PowerCenter Integration Service on a grid, a master service process runs on one node and
worker service processes run on the remaining nodes in the grid. The master service process runs the
workflow and workflow tasks, and it distributes the Session, Command, and predefined Event-Wait tasks to
itself and other nodes. A DTM process runs on each node where a session runs. If you run a session on a
grid, a worker service process can run multiple DTM processes on different nodes to distribute session
threads.

Workflow on a Grid
When you run a workflow on a grid, the PowerCenter Integration Service designates one service process as
the master service process, and the service processes on other nodes as worker service processes. The
master service process can run on any node in the grid.
The master service process receives requests, runs the workflow and workflow tasks including the Scheduler,
and communicates with worker service processes on other nodes. Because it runs on the master service
process node, the Scheduler uses the date and time for the master service process node to start scheduled
workflows. The master service process also runs the Load Balancer, which dispatches tasks to nodes in the
grid.
Worker service processes running on other nodes act as Load Balancer agents. The worker service process
runs predefined Event-Wait tasks within its process. It starts a process to run Command tasks and a DTM
process to run Session tasks.
The master service process can also act as a worker service process. So the Load Balancer can distribute
Session, Command, and predefined Event-Wait tasks to the node that runs the master service process or to
other nodes.
For example, you have a workflow that contains two Session tasks, a Command task, and a predefined
Event-Wait task.
The following figure shows an example of service process distribution when you run the workflow on a grid
with three nodes:

When you run the workflow on a grid, the PowerCenter Integration Service process distributes the tasks in
the following way:

On Node 1, the master service process starts the workflow and runs workflow tasks other than the
Session, Command, and predefined Event-Wait tasks. The Load Balancer dispatches the Session,
Command, and predefined Event-Wait tasks to other nodes.

On Node 2, the worker service process starts a process to run a Command task and starts a DTM process
to run Session task 1.

Grids

265

On Node 3, the worker service process runs a predefined Event-Wait task and starts a DTM process to
run Session task 2.

Session on a Grid
When you run a session on a grid, the master service process runs the workflow and workflow tasks,
including the Scheduler. Because it runs on the master service process node, the Scheduler uses the date
and time for the master service process node to start scheduled workflows. The Load Balancer distributes
Command tasks as it does when you run a workflow on a grid. In addition, when the Load Balancer
dispatches a Session task, it distributes the session threads to separate DTM processes.
The master service process starts a temporary preparer DTM process that fetches the session and prepares
it to run. After the preparer DTM process prepares the session, it acts as the master DTM process, which
monitors the DTM processes running on other nodes.
The worker service processes start the worker DTM processes on other nodes. The worker DTM runs the
session. Multiple worker DTM processes running on a node might be running multiple sessions or multiple
partition groups from a single session depending on the session configuration.
For example, you run a workflow on a grid that contains one Session task and one Command task. You also
configure the session to run on the grid.
The following figure shows the service process and DTM distribution when you run a session on a grid on
three nodes:

When the PowerCenter Integration Service process runs the session on a grid, it performs the following
tasks:

266

On Node 1, the master service process runs workflow tasks. It also starts a temporary preparer DTM
process, which becomes the master DTM process. The Load Balancer dispatches the Command task and
session threads to nodes in the grid.

On Node 2, the worker service process runs the Command task and starts the worker DTM processes that
run the session threads.

On Node 3, the worker service process starts the worker DTM processes that run the session threads.

Chapter 11: PowerCenter Integration Service Architecture

System Resources
To allocate system resources for read, transformation, and write processing, you should understand how the
PowerCenter Integration Service allocates and uses system resources. The PowerCenter Integration Service
uses the following system resources:

CPU usage

DTM buffer memory

Cache memory

CPU Usage
The PowerCenter Integration Service process performs read, transformation, and write processing for a
pipeline in parallel. It can process multiple partitions of a pipeline within a session, and it can process multiple
sessions in parallel.
If you have a symmetric multi-processing (SMP) platform, you can use multiple CPUs to concurrently process
session data or partitions of data. This provides increased performance, as true parallelism is achieved. On a
single processor platform, these tasks share the CPU, so there is no parallelism.
The PowerCenter Integration Service process can use multiple CPUs to process a session that contains
multiple partitions. The number of CPUs used depends on factors such as the number of partitions, the
number of threads, the number of available CPUs, and amount or resources required to process the
mapping.

DTM Buffer Memory

The PowerCenter Integration Service launches the DTM process. The DTM allocates buffer memory to the
session based on the DTM Buffer Size setting in the session properties. By default, the PowerCenter
Integration Service calculates the size of the buffer memory and the buffer block size.
The DTM divides the memory into buffer blocks as configured in the Buffer Block Size setting in the session
properties. The reader, transformation, and writer threads use buffer blocks to move data from sources and
to targets.
You may want to configure the buffer memory and buffer block size manually. In Unicode mode, the
PowerCenter Integration Service uses double bytes to move characters, so increasing buffer memory might
improve session performance.
If the DTM cannot allocate the configured amount of buffer memory for the session, the session cannot
initialize. Informatica recommends you allocate no more than 1 GB for DTM buffer memory.

Cache Memory
The DTM process creates in-memory index and data caches to temporarily store data used by the following
transformations:

Aggregator transformation (without sorted input)

Rank transformation

Joiner transformation

Lookup transformation (with caching enabled)

System Resources

267

You can configure memory size for the index and data cache in the transformation properties. By default, the
PowerCenter Integration Service determines the amount of memory to allocate for caches. However, you can
manually configure a cache size for the data and index caches.
By default, the DTM creates cache files in the directory configured for the $PMCacheDir service process
variable. If the DTM requires more space than it allocates, it pages to local index and data files.
The DTM process also creates an in-memory cache to store data for the Sorter transformations and XML
targets. You configure the memory size for the cache in the transformation properties. By default, the
PowerCenter Integration Service determines the cache size for the Sorter transformation and XML target at
run time. The PowerCenter Integration Service allocates a minimum value of 16,777,216 bytes for the Sorter
transformation cache and 10,485,760 bytes for the XML target. The DTM creates cache files in the directory
configured for the $PMTempDir service process variable. If the DTM requires more cache space than it
allocates, it pages to local cache files.
When processing large amounts of data, the DTM may create multiple index and data files. The session does
not fail if it runs out of cache memory and pages to the cache files. It does fail, however, if the local directory
for cache files runs out of disk space.
After the session completes, the DTM releases memory used by the index and data caches and deletes any
index and data files. However, if the session is configured to perform incremental aggregation or if a Lookup
transformation is configured for a persistent lookup cache, the DTM saves all index and data cache
information to disk for the next session run.

Code Pages and Data Movement Modes

You can configure PowerCenter to move single byte and multibyte data. The PowerCenter Integration
Service can move data in either ASCII or Unicode data movement mode. These modes determine how the
PowerCenter Integration Service handles character data. You choose the data movement mode in the
PowerCenter Integration Service configuration settings. If you want to move multibyte data, choose Unicode
data movement mode. To ensure that characters are not lost during conversion from one code page to
another, you must also choose the appropriate code pages for your connections.

ASCII Data Movement Mode

Use ASCII data movement mode when all sources and targets are 7-bit ASCII or EBCDIC character sets. In
ASCII mode, the PowerCenter Integration Service recognizes 7-bit ASCII and EBCDIC characters and stores
each character in a single byte. When the PowerCenter Integration Service runs in ASCII mode, it does not
validate session code pages. It reads all character data as ASCII characters and does not perform code page
conversions. It also treats all numerics as U.S. Standard and all dates as binary data.
You can also use ASCII data movement mode when sources and targets are 8-bit ASCII.

Unicode Data Movement Mode

Use Unicode data movement mode when sources or targets use 8-bit or multibyte character sets and contain
character data. In Unicode mode, the PowerCenter Integration Service recognizes multibyte character sets
as defined by supported code pages.
If you configure the PowerCenter Integration Service to validate data code pages, the PowerCenter
Integration Service validates source and target code page compatibility when you run a session. If you
configure the PowerCenter Integration Service for relaxed data code page validation, the PowerCenter
Integration Service lifts source and target compatibility restrictions.

268

Chapter 11: PowerCenter Integration Service Architecture

The PowerCenter Integration Service converts data from the source character set to UCS-2 before
processing, processes the data, and then converts the UCS-2 data to the target code page character set
before loading the data. The PowerCenter Integration Service allots two bytes for each character when
moving data through a mapping. It also treats all numerics as U.S. Standard and all dates as binary data.
The PowerCenter Integration Service code page must be a subset of the PowerCenter repository code page.

Output Files and Caches

The PowerCenter Integration Service process generates output files when you run workflows and sessions.
By default, the PowerCenter Integration Service logs status and error messages to log event files. Log event
files are binary files that the Log Manager uses to display log events. During each session, the PowerCenter
Integration Service also creates a reject file. Depending on transformation cache settings and target types,
the PowerCenter Integration Service may create additional files as well.
The PowerCenter Integration Service stores output files and caches based on the service process variable
settings. Generate output files and caches in a specified directory by setting service process variables in the
session or workflow properties, PowerCenter Integration Service properties, a parameter file, or an operating
system profile.
If you define service process variables in more than one place, the PowerCenter Integration Service reviews
the precedence of each setting to determine which service process variable setting to use:
1.

PowerCenter Integration Service process properties. Service process variables set in the PowerCenter
Integration Service process properties contain the default setting.

2.

Operating system profile. Service process variables set in an operating system profile override service
process variables set in the PowerCenter Integration Service properties. If you use operating system
profiles, the PowerCenter Integration Service saves workflow recovery files to the $PMStorageDir
configured in the PowerCenter Integration Service process properties. The PowerCenter Integration
Service saves session recovery files to the $PMStorageDir configured in the operating system profile.

3.

Parameter file. Service process variables set in parameter files override service process variables set in
the PowerCenter Integration Service process properties or an operating system profile.

4.

Session or workflow properties. Service process variables set in the session or workflow properties
override service process variables set in the PowerCenter Integration Service properties, a parameter
file, or an operating system profile.

For example, if you set the $PMSessionLogFile in the operating system profile and in the session properties,
the PowerCenter Integration Service uses the location specified in the session properties.
The PowerCenter Integration Service creates the following output files:

Workflow log

Session log

Session details file

Performance details file

Reject files

Row error logs

Recovery tables and files

Control file

Post-session email

Output Files and Caches

269

Output file

Cache files

When the PowerCenter Integration Service process on UNIX creates any file other than a recovery file, it sets
the file permissions according to the umask of the shell that starts the PowerCenter Integration Service
process. For example, when the umask of the shell that starts the PowerCenter Integration Service process is
022, the PowerCenter Integration Service process creates files with rw-r--r-- permissions. To change the file
permissions, you must change the umask of the shell that starts the PowerCenter Integration Service process
and then restart it.
The PowerCenter Integration Service process on UNIX creates recovery files with rw------- permissions.
The PowerCenter Integration Service process on Windows creates files with read and write permissions.

Workflow Log
The PowerCenter Integration Service process creates a workflow log for each workflow it runs. It writes
information in the workflow log such as initialization of processes, workflow task run information, errors
encountered, and workflow run summary. Workflow log error messages are categorized into severity levels.
You can configure the PowerCenter Integration Service to suppress writing messages to the workflow log file.
You can view workflow logs from the PowerCenter Workflow Monitor. You can also configure the workflow to
write events to a log file in a specified directory.
As with PowerCenter Integration Service logs and session logs, the PowerCenter Integration Service process
enters a code number into the workflow log file message along with message text.

Session Log
The PowerCenter Integration Service process creates a session log for each session it runs. It writes
information in the session log such as initialization of processes, session validation, creation of SQL
commands for reader and writer threads, errors encountered, and load summary. The amount of detail in the
session log depends on the tracing level that you set. You can view the session log from the PowerCenter
Workflow Monitor. You can also configure the session to write the log information to a log file in a specified
directory.
As with PowerCenter Integration Service logs and workflow logs, the PowerCenter Integration Service
process enters a code number along with message text.

Session Details
When you run a session, the PowerCenter Workflow Manager creates session details that provide load
statistics for each target in the mapping. You can monitor session details during the session or after the
session completes. Session details include information such as table name, number of rows written or
rejected, and read and write throughput. To view session details, double-click the session in the PowerCenter
Workflow Monitor.

Performance Detail File

The PowerCenter Integration Service process generates performance details for session runs. The
PowerCenter Integration Service process writes the performance details to a file. The file stores performance
details for the last session run.
You can review a performance details file to determine where session performance can be improved.
Performance details provide transformation-by-transformation information on the flow of data through the
session.

270

Chapter 11: PowerCenter Integration Service Architecture

You can also view performance details in the PowerCenter Workflow Monitor if you configure the session to
collect performance details.

Reject Files
By default, the PowerCenter Integration Service process creates a reject file for each target in the session.
The reject file contains rows of data that the writer does not write to targets.
The writer may reject a row in the following circumstances:

It is flagged for reject by an Update Strategy or Custom transformation.

It violates a database constraint such as primary key constraint.

A field in the row was truncated or overflowed, and the target database is configured to reject truncated or
overflowed data.

By default, the PowerCenter Integration Service process saves the reject file in the directory entered for the
service process variable $PMBadFileDir in the PowerCenter Workflow Manager, and names the reject file
target_table_name.bad.
Note: If you enable row error logging, the PowerCenter Integration Service process does not create a reject
file.

Row Error Logs

When you configure a session, you can choose to log row errors in a central location. When a row error
occurs, the PowerCenter Integration Service process logs error information that allows you to determine the
cause and source of the error. The PowerCenter Integration Service process logs information such as source
name, row ID, current row data, transformation, timestamp, error code, error message, repository name,
folder name, session name, and mapping information.
When you enable flat file logging, by default, the PowerCenter Integration Service process saves the file in
the directory entered for the service process variable $PMBadFileDir.

Recovery Tables Files

The PowerCenter Integration Service process creates recovery tables on the target database system when it
runs a session enabled for recovery. When you run a session in recovery mode, the PowerCenter Integration
Service process uses information in the recovery tables to complete the session.
When the PowerCenter Integration Service process performs recovery, it restores the state of operations to
recover the workflow from the point of interruption. The workflow state of operations includes information
such as active service requests, completed and running status, workflow variable values, running workflows
and sessions, and workflow schedules.

Control File
When you run a session that uses an external loader, the PowerCenter Integration Service process creates a
control file and a target flat file. The control file contains information about the target flat file such as data
format and loading instructions for the external loader. The control file has an extension of .ctl. The
PowerCenter Integration Service process creates the control file and the target flat file in the PowerCenter
Integration Service variable directory, $PMTargetFileDir, by default.

Output Files and Caches

271

Email
You can compose and send email messages by creating an Email task in the Workflow Designer or Task
Developer. You can place the Email task in a workflow, or you can associate it with a session. The Email task
allows you to automatically communicate information about a workflow or session run to designated
recipients.
Email tasks in the workflow send email depending on the conditional links connected to the task. For postsession email, you can create two different messages, one to be sent if the session completes successfully,
the other if the session fails. You can also use variables to generate information about the session name,
status, and total rows loaded.

Indicator File
If you use a flat file as a target, you can configure the PowerCenter Integration Service to create an indicator
file for target row type information. For each target row, the indicator file contains a number to indicate
whether the row was marked for insert, update, delete, or reject. The PowerCenter Integration Service
process names this file target_name.ind and stores it in the PowerCenter Integration Service variable
directory, $PMTargetFileDir, by default.

Output File
If the session writes to a target file, the PowerCenter Integration Service process creates the target file based
on a file target definition. By default, the PowerCenter Integration Service process names the target file
based on the target definition name. If a mapping contains multiple instances of the same target, the
PowerCenter Integration Service process names the target files based on the target instance name.
The PowerCenter Integration Service process creates this file in the PowerCenter Integration Service
variable directory, $PMTargetFileDir, by default.

Cache Files
When the PowerCenter Integration Service process creates memory cache, it also creates cache files. The
PowerCenter Integration Service process creates cache files for the following mapping objects:

Aggregator transformation

Joiner transformation

Rank transformation

Lookup transformation

Sorter transformation

XML target

By default, the DTM creates the index and data files for Aggregator, Rank, Joiner, and Lookup
transformations and XML targets in the directory configured for the $PMCacheDir service process variable.
The PowerCenter Integration Service process names the index file PM*.idx, and the data file PM*.dat. The
PowerCenter Integration Service process creates the cache file for a Sorter transformation in the
$PMTempDir service process variable directory.

Incremental Aggregation Files

If the session performs incremental aggregation, the PowerCenter Integration Service process saves index
and data cache information to disk when the session finished. The next time the session runs, the
PowerCenter Integration Service process uses this historical information to perform the incremental

272

Chapter 11: PowerCenter Integration Service Architecture

aggregation. By default, the DTM creates the index and data files in the directory configured for the
$PMCacheDir service process variable. The PowerCenter Integration Service process names the index file
PMAGG*.dat and the data file PMAGG*.idx.

Persistent Lookup Cache

If a session uses a Lookup transformation, you can configure the transformation to use a persistent lookup
cache. With this option selected, the PowerCenter Integration Service process saves the lookup cache to disk
the first time it runs the session, and then uses this lookup cache during subsequent session runs. By default,
the DTM creates the index and data files in the directory configured for the $PMCacheDir service process
variable. If you do not name the files in the transformation properties, these files are named PMLKUP*.idx
and PMLKUP*.dat.

Output Files and Caches

273

CHAPTER 12

High Availability for the

PowerCenter Integration Service
This chapter includes the following topics:

High Availability for the PowerCenter Integration Service Overview, 274

Resilience, 274

Restart and Failover, 276

Recovery, 278

PowerCenter Integration Service Failover and Recovery Configuration, 279

High Availability for the PowerCenter Integration

Service Overview
Configure high availability for the PowerCenter Integration Service to minimize interruptions to data
integration tasks.
The PowerCenter Integration Service has the following high availability features that are available based on
your license:

Resilience. A PowerCenter Integration Service process is resilient to connections with PowerCenter

Integration Service clients and with external components.

Restart and failover. If the PowerCenter Integration Service process becomes unavailable, the Service
Manager can restart the process or fail it over to another node.

Recovery. When the PowerCenter Integration Service restarts or fails over a service process, it can
automatically recover interrupted workflows that are configured for recovery.

Resilience
Based on your license, the PowerCenter Integration Service is resilient to the temporary unavailability of
PowerCenter Integration Service clients and external components such databases and FTP servers.
The PowerCenter Integration Service tries to reconnect to PowerCenter Integration Service clients within the
PowerCenter Integration Service resilience timeout period. The PowerCenter Integration Service resilience
timeout period is based on the resilience properties that you configure for the PowerCenter Integration
274

Service, PowerCenter Integration Service clients, and the domain. The PowerCenter Integration Service tries
to reconnect to external components within the resilience timeout for the database or FTP connection object.

PowerCenter Integration Service Client Resilience

PowerCenter Integration Service clients are resilient to the temporary unavailability of the PowerCenter
Integration Service.
The PowerCenter Integration Service can be unavailable because of network failure or because a
PowerCenter Integration Service process fails. PowerCenter Integration Service clients include the
application services, PowerCenter Client, the Service Manager, the Web Services Hub, and pmcmd.
PowerCenter Integration Service clients also include applications developed using LMAPI.

External Component Resilience

A PowerCenter Integration Service process is resilient to temporary unavailability of external components.
External components can be temporarily unavailable because of network failure or because the component
experiences a failure. If the PowerCenter Integration Service process loses the connection to an external
component, it tries to reconnect to the component within the retry period for the connection object.
You can configure the following types of external resilience for the PowerCenter Integration Service:
Database and application connection resilience
The PowerCenter Integration Service depends on external database systems and applications to run
sessions and workflows. It is resilient if the database or application supports resilience. The
PowerCenter Integration Service is resilient to failures when it initializes the connection to the source or
target and when it reads data from a source or writes data to a target. If a database or application is
temporarily unavailable, the PowerCenter Integration Service tries to connect for a specified amount of
time. You can configure the connection retry period for relational connection objects for some application
connection objects.
PowerExchange does not support session-level runtime connection resilience for database connections
other than those used for PowerExchange Express CDC for Oracle. If recovery from a dropped
PowerExchange connection is required, configure the workflow for automatic recovery of terminated
tasks.
Runtime resilience of connections between the PowerCenter Integration Service and PowerExchange
Listener is optionally available for the initial connection attempt only. You must set the Connection
Retry Period attribute to a value greater than 0 when you define PowerExchange Client for
PowerCenter (PWXPC) relational and application connections. The Integration Service then retries the
connection to the PowerExchange Listener after the initial connection attempt fails. If the Integration
Service cannot connect to the PowerExchange Listener within the retry period, the session fails.
FTP connection resilience
If a connection is lost while the PowerCenter Integration Service is transferring files to or from an FTP
server, the PowerCenter Integration Service tries to reconnect for the amount of time configured in the
FTP connection object. The PowerCenter Integration Service is resilient to interruptions if the FTP server
supports resilience.
Client connection resilience
You can configure connection resilience for PowerCenter Integration Service clients that are external
applications using C/Java LMAPI. You configure this type of resilience in the Application connection
object.

Resilience

275

Example
You configure a retry period of 180 for an Oracle relational database connection object. If the PowerCenter
Integration Service loses connectivity to the database during the initial connection or when it reads data from
the database, it tries to reconnect for 180 seconds. If it cannot reconnect to the database, the session fails.

Restart and Failover

If a PowerCenter Integration Service process becomes unavailable, the Service Manager tries to restart it or
fails it over to another node based on the shutdown mode, the service configuration, and the operating mode
for the service. Restart and failover behavior is different for services that run on a single node, primary and
backup nodes, or on a grid.
When the PowerCenter Integration Service fails over, the behavior of completed tasks depends on the
following situations:

If a completed task reported a completed status to the PowerCenter Integration Service process prior to
the PowerCenter Integration Service failure, the task will not restart.

If a completed task did not report a completed status to the PowerCenter Integration Service process prior
to the PowerCenter Integration Service failure, the task will restart.

Running on a Single Node

When a single process is running, the failover behavior depends on the following sources of failure:
Service Process
If the service process shuts down unexpectedly, the Service Manager tries to restart the service process.
If the Service Manager cannot restart the process, the process stops or fails.
When you restart the process, the PowerCenter Integration Service restores the state of operation for
the service and restores workflow schedules, service requests, and workflows.
The failover and recovery behavior of the PowerCenter Integration Service after a service process fails
depends on the operating mode:

Normal. When you restart the process, the workflow fails over on the same node. The PowerCenter
Integration Service can recover the workflow based on the workflow state and recovery strategy. If
the workflow is enabled for high availability recovery, the PowerCenter Integration Service restores
the state of operation for the workflow and recovers the workflow from the point of interruption. The
PowerCenter Integration Service performs failover and recovers the schedules, requests, and
workflows. If a scheduled workflow is not enabled for high availability recovery, the PowerCenter
Integration Service removes the workflow from the schedule.

Safe. When you restart the process, the workflow does not fail over and the PowerCenter Integration
Service does not recover the workflow. It performs failover and recovers the schedules, requests, and
workflows when you enable the service in normal mode.

Service
When the PowerCenter Integration Service becomes unavailable, you must enable the service and start
the service processes. You can manually recover workflows and sessions based on the state and the
configured recovery strategy.

276

Chapter 12: High Availability for the PowerCenter Integration Service

The workflows that run after you start the service processes depend on the operating mode:

Normal. Workflows start if they are configured to run continuously or on initialization. You must
reschedule all other workflows.

Safe. Scheduled workflows do not start. You must enable the service in normal mode for the
scheduled workflows to run.

Node
When the node becomes unavailable, the restart and failover behavior is the same as restart and failover
for the service process, based on the operating mode.

Running on a Primary Node

When both primary and backup services are running, the failover behavior depends on the following sources
of failure:
Service Process
When you disable the service process on a primary node, the service process fails over to a backup
node. When the service process on a primary node shuts down unexpectedly, the Service Manager tries
to restart the service process before failing it over to a backup node.
After the service process fails over to a backup node, the PowerCenter Integration Service restores the
state of operation for the service and restores workflow schedules, service requests, and workflows.
The failover and recovery behavior of the PowerCenter Integration Service after a service process fails
depends on the operating mode:

Normal. The PowerCenter Integration Service can recover the workflow based on the workflow state
and recovery strategy. If the workflow was enabled for high availability recovery, the PowerCenter
Integration Service restores the state of operation for the workflow and recovers the workflow from
the point of interruption. The PowerCenter Integration Service performs failover and recovers the
schedules, requests, and workflows. If a scheduled workflow is not enabled for high availability
recovery, the PowerCenter Integration Service removes the workflow from the schedule.

Safe. The PowerCenter Integration Service does not run scheduled workflows and it disables
schedule failover, automatic workflow recovery, workflow failover, and client request recovery. It
performs failover and recovers the schedules, requests, and workflows when you enable the service
in normal mode.

Service
When the PowerCenter Integration Service becomes unavailable, you must enable the service and start
the service processes. You can manually recover workflows and sessions based on the state and the
configured recovery strategy. Workflows start if they are configured to run continuously or on
initialization. You must reschedule all other workflows.
The workflows that run after you start the service processes depend on the operating mode:

Normal. Workflows start if they are configured to run continuously or on initialization. You must
reschedule all other workflows.

Safe. Scheduled workflows do not start. You must enable the service in normal mode to run the
scheduled workflows.

Node
When the node becomes unavailable, the failover behavior is the same as the failover for the service
process, based on the operating mode.

Restart and Failover

277

Running on a Grid
When a service is running on a grid, the failover behavior depends on the following sources of failure:
Master Service Process
If you disable the master service process, the Service Manager elects another node to run the master
service process. If the master service process shuts down unexpectedly, the Service Manager tries to
restart the process before electing another node to run the master service process.
The master service process then reconfigures the grid to run on one less node. The PowerCenter
Integration Service restores the state of operation, and the workflow fails over to the newly elected
master service process.
The PowerCenter Integration Service can recover the workflow based on the workflow state and
recovery strategy. If the workflow was enabled for high availability recovery, the PowerCenter Integration
Service restores the state of operation for the workflow and recovers the workflow from the point of
interruption. When the PowerCenter Integration Service restores the state of operation for the service, it
restores workflow schedules, service requests, and workflows. The PowerCenter Integration Service
performs failover and recovers the schedules, requests, and workflows.
If a scheduled workflow is not enabled for high availability recovery, the PowerCenter Integration Service
removes the workflow from the schedule.
Worker Service Process
If you disable a worker service process, the master service process reconfigures the grid to run on one
less node. If the worker service process shuts down unexpectedly, the Service Manager tries to restart
the process before the master service process reconfigures the grid.
After the master service process reconfigures the grid, it can recover tasks based on task state and
recovery strategy.
Because workflows do not run on the worker service process, workflow failover is not applicable.
Service
When the PowerCenter Integration Service becomes unavailable, you must enable the service and start
the service processes. You can manually recover workflows and sessions based on the state and the
configured recovery strategy. Workflows start if they are configured to run continuously or on
initialization. You must reschedule all other workflows.
Node
When the node running the master service process becomes unavailable, the failover behavior is the
same as the failover for the master service process. When the node running the worker service process
becomes unavailable, the failover behavior is the same as the failover for the worker service process.
Note: You cannot configure a PowerCenter Integration Service to fail over in safe mode when it runs on a
grid.

Recovery
Based on your license, the PowerCenter Integration Service can automatically recover workflows and tasks
based on the recovery strategy, the state of the workflows and tasks, and the PowerCenter Integration
Service operating mode.

278

Chapter 12: High Availability for the PowerCenter Integration Service

Stopped, Aborted, or Terminated Workflows

When the PowerCenter Integration Service restarts or fails over a service process, it can automatically
recover interrupted workflows that are configured for recovery, based on the operating mode. When you run a
workflow that is enabled for HA recovery, the PowerCenter Integration Service stores the state of operation in
the $PMStorageDir directory. When the PowerCenter Integration Service recovers a workflow, it restores the
state of operation and begins recovery from the point of interruption. The PowerCenter Integration Service
can recover a workflow with a stopped, aborted, or terminated status.
In normal mode, the PowerCenter Integration Service can automatically recover the workflow. In safe mode,
the PowerCenter Integration Service does not recover the workflow until you enable the service in normal
mode
When the PowerCenter Integration Service recovers a workflow that failed over, it begins recovery at the
point of interruption. The PowerCenter Integration Service can recover a task with a stopped, aborted, or
terminated status according to the recovery strategy for the task. The PowerCenter Integration Service
behavior for task recovery does not depend on the operating mode.
Note: The PowerCenter Integration Service does not automatically recover a workflow or task that you stop
or abort through the PowerCenter Workflow Monitor or pmcmd.

Running Workflows
You can configure automatic task recovery in the workflow properties. When you configure automatic task
recovery, the PowerCenter Integration Service can recover terminated tasks while the workflow is running.
You can also configure the number of times that the PowerCenter Integration Service tries to recover the
task. If the PowerCenter Integration Service cannot recover the task in the configured number of times for
recovery, the task and the workflow are terminated.
The PowerCenter Integration Service behavior for task recovery does not depend on the operating mode.

Suspended Workflows
The PowerCenter Integration Service can restore the workflow state after a suspended workflow fails over to
another node if you enable recovery in the workflow properties.
If a service process shuts down while a workflow is suspended, the PowerCenter Integration Service marks
the workflow as terminated. It fails the workflow over to another node, and changes the workflow state to
terminated. The PowerCenter Integration Service does not recover any workflow task. You can fix the errors
that caused the workflow to suspend, and manually recover the workflow.

PowerCenter Integration Service Failover and

Recovery Configuration
During failover and recovery, the PowerCenter Integration Service needs to access state of operation files
and process state information.
The state of operation files store the state of each workflow and session operation. The PowerCenter
Integration Service always stores the state of each workflow and session operation in files in the
$PMStorageDir directory of the PowerCenter Integration Service process.

PowerCenter Integration Service Failover and Recovery Configuration

279

Process state information includes information about which node was running the master PowerCenter
Integration Service process and which node was running each session. You can configure the PowerCenter
Integration Service to store process state information on a cluster file system or in the PowerCenter
repository database.

Store High Availability Persistence on a Cluster File System

By default, the PowerCenter Integration Service stores process state information along with the state of
operation files in the $PMStorageDir directory of the Integration Service process. You must configure the
$PMStorageDir directory for each PowerCenter Integration Service process to use the same directory on a
cluster file system.
Nodes that run the PowerCenter Integration Service must be on the same cluster file system so that they can
share resources. Also, nodes within a cluster must be on the cluster file systems heartbeat network. Use a
highly available cluster file system that is configured for I/O fencing. The hardware requirements and
configuration of an I/O fencing solution are different for each file system.
The following cluster file systems are certified by Informatica for use for PowerCenter Integration Service
failover and session recovery:
Storage Array Network
Veritas Cluster Files System (VxFS)
IBM General Parallel File System (GPFS)
Network Attached Storage using NFS v3 protocol
EMC UxFS hosted on an EMV Celerra NAS appliance
NetApp WAFL hosted on a NetApp NAS appliance
Contact the file system vendors directly to evaluate which file system matches your requirements.

Store High Availability Persistence in a Database

You can configure the PowerCenter Integration Service to store process state information in database tables.
When you configure the PowerCenter Integration Service to store process state information in a database,
the service still stores the state of each workflow and session operation in files in the $PMStorageDir
directory. You can configure the $PMStorageDir directory to use a POSIX compliant shared file system. You
do not need to use a cluster file system.
Configure the PowerCenter Integration Service to store process state information in database tables in the
advanced properties. The PowerCenter Integration Service stores process state information in persistent
database tables in the associated PowerCenter repository database.
During failover, automatic recovery of workflows resume when the service process can access the database
tables.

280

Chapter 12: High Availability for the PowerCenter Integration Service

CHAPTER 13

PowerCenter Repository Service

This chapter includes the following topics:

PowerCenter Repository Service Overview, 281

Creating a Database for the PowerCenter Repository, 282

Creating the PowerCenter Repository Service, 282

PowerCenter Repository Service Properties, 285

PowerCenter Repository Service Process Properties, 290

High Availability for the PowerCenter Repository Service, 291

PowerCenter Repository Service Overview

A PowerCenter repository is a collection of database tables that contains metadata. A PowerCenter
Repository Service manages the PowerCenter repository. It performs all metadata transactions between the
PowerCenter repository database and PowerCenter repository clients.
Create a PowerCenter Repository Service to manage the metadata in repository database tables. Each
PowerCenter Repository Service manages a single repository. You need to create a unique PowerCenter
Repository Service for each PowerCenter repository in a Informatica domain.
Creating and configuring a PowerCenter Repository Service involves the following tasks:

Create a database for the repository tables. Before you can create the repository tables, you need to
create a database to store the tables. If you create a PowerCenter Repository Service for an existing
repository, you do not need to create a new database. You can use the existing database, as long as it
meets the minimum requirements for a repository database.

Create the PowerCenter Repository Service. Create the PowerCenter Repository Service to manage the
repository. When you create a PowerCenter Repository Service, you can choose to create the repository
tables. If you do not create the repository tables, you can create them later or you can associate the
PowerCenter Repository Service with an existing repository.

Configure the PowerCenter Repository Service. After you create a PowerCenter Repository Service, you
can configure its properties. You can configure properties such as the error severity level or maximum
user connections.

Based on your license, the PowerCenter Repository Service can be highly available.

281

Creating a Database for the PowerCenter Repository

Before you can manage a repository with a PowerCenter Repository Service, you need a database to hold
the repository database tables. You can create the repository on any supported database system.
Use the database management system client to create the database. The repository database name must be
unique. If you create a repository in a database with an existing repository, the create operation fails. You
must delete the existing repository in the target database before creating the new repository.
To protect the repository and improve performance, do not create the repository on an overloaded machine.
The machine running the repository database system must have a network connection to the node that runs
the PowerCenter Repository Service.
Tip: You can optimize repository performance on IBM DB2 EEE databases when you store a PowerCenter
repository in a single-node tablespace. When setting up an IBM DB2 EEE database, the database
administrator must define the database on a single node.

Creating the PowerCenter Repository Service

Use the Administrator tool to create a PowerCenter Repository Service.

Before You Begin

Before you create a PowerCenter Repository Service, complete the following tasks:

Determine repository requirements. Determine whether the repository needs to be version-enabled and
whether it is a local, global, or standalone repository.

Verify license. Verify that you have a valid license to run application services. Although you can create a
PowerCenter Repository Service without a license, you need a license to run the service. In addition, you
need a license to configure some options related to version control and high availability.

Determine code page. Determine the code page to use for the PowerCenter repository. The PowerCenter
Repository Service uses the character set encoded in the repository code page when writing data to the
repository. The repository code page must be compatible with the code pages for the PowerCenter Client
and all application services in the Informatica domain.
Tip: After you create the PowerCenter Repository Service, you cannot change the code page in the
PowerCenter Repository Service properties. To change the repository code page after you create the
PowerCenter Repository Service, back up the repository and restore it to a new PowerCenter Repository
Service. When you create the new PowerCenter Repository Service, you can specify a compatible code
page.

Creating a PowerCenter Repository Service

1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the folder where you want to create the PowerCenter Repository
Service.
Note: If you do not select a folder, you can move the PowerCenter Repository Service into a folder after
you create it.

3.

282

In the Domain Actions menu, click New > PowerCenter Repository Service.

Chapter 13: PowerCenter Repository Service

The Create New Repository Service dialog box appears.

4.

Enter values for the following PowerCenter Repository Service options.

The following table describes the PowerCenter Repository Service options:
Property

Description

Name

Name of the PowerCenter Repository Service. The characters must be compatible

with the code page of the repository. The name is not case sensitive and must be
unique within the domain. It cannot exceed 128 characters or begin with @. It also
cannot contain spaces or the following special characters:
`~%^*+={}\;:'"/?.,<>|!()][
The PowerCenter Repository Service and the repository have the same name.

Description

Description of PowerCenter Repository Service. The description cannot exceed 765

characters.

Location

Domain and folder where the service is created. Click Select Folder to choose a
different folder. You can also move the PowerCenter Repository Service to a
different folder after you create it.

License

License that allows use of the service. If you do not select a license when you create
the service, you can assign a license later. The options included in the license
determine the selections you can make for the repository. For example, you must
have the team-based development option to create a versioned repository. Also, you
need the high availability option to run the PowerCenter Repository Service on more
than one node.

Node

Node on which the service process runs. Required if you do not select a license with
the high availability option. If you select a license with the high availability option, this
property does not appear.

Primary Node

Node on which the service process runs by default. Required if you select a license
with the high availability option. This property appears if you select a license with the
high availability option.

Backup Nodes

Nodes on which the service process can run if the primary node is unavailable.
Optional if you select a license with the high availability option. This property appears
if you select a license with the high availability option.

Database Type

Type of database storing the repository.

Code Page

Repository code page. The PowerCenter Repository Service uses the character set
encoded in the repository code page when writing data to the repository. You cannot
change the code page in the PowerCenter Repository Service properties after you
create the PowerCenter Repository Service.

Connect String

Native connection string the PowerCenter Repository Service uses to access the
repository database. For example, use servername@dbname for Microsoft SQL
Server and dbname.world for Oracle.

Username

Account for the repository database. Set up this account using the appropriate
database client tools.

Password

Repository database password corresponding to the database user. Must be in 7-bit

ASCII.

Creating the PowerCenter Repository Service

283

Property

Description

TablespaceName

Tablespace name for IBM DB2 and Sybase repositories. When you specify the
tablespace name, the PowerCenter Repository Service creates all repository tables
in the same tablespace. You cannot use spaces in the tablespace name.
To improve repository performance on IBM DB2 EEE repositories, specify a
tablespace name with one node.

Creation Mode

Creates or omits new repository content.

Select one of the following options:
- Create repository content. Select if no content exists in the database. Optionally,
choose to create a global repository, enable version control, or both. If you do not
select these options during service creation, you can select them later. However, if you
select the options during service creation, you cannot later convert the repository to a
local repository or to a non-versioned repository. The option to enable version control
appears if you select a license with the team-based development option.
- Do not create repository content. Select if content exists in the database or if you plan
to create the repository content later.

Enable the
Repository Service

5.

Enables the service. When you select this option, the service starts running when it
is created. Otherwise, you need to click the Enable button to run the service. You
need a valid license to run a PowerCenter Repository Service.

If you create a PowerCenter Repository Service for a repository with existing content and the repository
existed in a different Informatica domain, verify that users and groups with privileges for the
PowerCenter Repository Service exist in the current domain.
The Service Manager periodically synchronizes the list of users and groups in the repository with the
users and groups in the domain configuration database. During synchronization, users and groups that
do not exist in the current domain are deleted from the repository. You can use infacmd to export users
and groups from the source domain and import them into the target domain.

6.

Click OK.

Database Connect Strings

When you create a database connection, specify a connect string for that connection. The PowerCenter
Repository Service uses native connectivity to communicate with the repository database.
The following table lists the native connect string syntax for each supported database:

284

Database

Connect String Syntax

Example

IBM DB2

<database name>

mydatabase

Microsoft SQL Server

<server name>@<database name>

sqlserver@mydatabase

Oracle

<database name>.world (same as

TNSNAMES entry)

oracle.world

Sybase

<server name>@<database name>

sybaseserver@mydatabase

Chapter 13: PowerCenter Repository Service

PowerCenter Repository Service Properties

You can configure repository, node assignment, database, advanced, and custom properties for the
PowerCenter Repository Service.
Use the Administrator tool to configure the following PowerCenter Repository Service properties:

Repository properties. Configure repository properties, such as the Operating Mode.

Node assignments. If you have the high availability option, configure the primary and backup nodes to run
the service.

Database properties. Configure repository database properties, such as the database user name,
password, and connection string.

Advanced properties. Configure advanced repository properties, such as the maximum connections and
locks on the repository.

Custom properties. Configure custom properties that are unique to specific environments.

To view and update properties, select the PowerCenter Repository Service in the Navigator. The Properties
tab for the service appears.

Node Assignments
If you have the high availability option, you can designate primary and backup nodes to run the service. By
default, the service runs on the primary node. If the node becomes unavailable, the service fails over to a
backup node.

General Properties
To edit the general properties, select the PowerCenter Repository Service in the Navigator, select the
Properties view, and then click Edit in the General Properties section.
The following table describes the general properties for the service:
Property

Description

Name

Name of the service. The name is not case sensitive and must be unique within the
domain. It cannot exceed 128 characters or begin with @. It also cannot contain spaces
or the following special characters:
`~%^*+={}\;:'"/?.,<>|!()][
You cannot change the name of the service after you create it.

Description

Description of the service. The description cannot exceed 765 characters.

License

License object that allows use of the service.

Primary Node

Node on which the service runs. To assign the PowerCenter Repository Service to a
different node, you must first disable the service.

Repository Properties
You can configure some of the repository properties when you create the service.

PowerCenter Repository Service Properties

285

The following table describes the repository properties:

Property

Description

Operating Mode

Mode in which the PowerCenter Repository Service is running. Values are Normal and
Exclusive. Run the PowerCenter Repository Service in exclusive mode to perform some
administrative tasks, such as promoting a local repository to a global repository or
enabling version control. To apply changes, restart the PowerCenter Repository
Service.

Security Audit Trail

Tracks changes made to users, groups, privileges, and permissions. The Log Manager
tracks the changes. To apply changes, restart the PowerCenter Repository Service.

Global Repository

Creates a global repository. If the repository is a global repository, you cannot revert
back to a local repository. To promote a local repository to a global repository, the
PowerCenter Repository Service must be running in exclusive mode.

Version Control

Creates a versioned repository. After you enable a repository for version control, you
cannot disable the version control.
To enable a repository for version control, you must run the PowerCenter Repository
Service in exclusive mode. This property appears if you have the team-based
development option.

Database Properties
Database properties provide information about the database that stores the repository metadata. You specify
the database properties when you create the PowerCenter Repository Service. After you create a repository,
you may need to modify some of these properties. For example, you might need to change the database user
name and password, or you might want to adjust the database connection timeout.
The following table describes the database properties:
Property

Description

Database Type

Type of database storing the repository. To apply changes, restart the

PowerCenter Repository Service.

Code Page

Repository code page. The PowerCenter Repository Service uses the

character set encoded in the repository code page when writing data to the
repository. You cannot change the code page in the PowerCenter Repository
Service properties after you create the PowerCenter Repository Service.
This is a read-only field.

Connect String

Native connection string the PowerCenter Repository Service uses to access

the database containing the repository. For example, use
servername@dbname for Microsoft SQL Server and dbname.world for Oracle.
To apply changes, restart the PowerCenter Repository Service.

286

Chapter 13: PowerCenter Repository Service

Property

Description

Table Space Name

Tablespace name for IBM DB2 and Sybase repositories. When you specify
the tablespace name, the PowerCenter Repository Service creates all
repository tables in the same tablespace. You cannot use spaces in the
tablespace name.
You cannot change the tablespace name in the repository database properties
after you create the service. If you create a PowerCenter Repository Service
with the wrong tablespace name, delete the PowerCenter Repository Service
and create a new one with the correct tablespace name.
To improve repository performance on IBM DB2 EEE repositories, specify a
tablespace name with one node.
To apply changes, restart the PowerCenter Repository Service.

Optimize Database Schema

Enables optimization of repository database schema when you create

repository contents or back up and restore an IBM DB2 or Microsoft SQL
Server repository. When you enable this option, the Repository Service
creates repository tables using Varchar(2000) columns instead of CLOB
columns wherever possible. Using Varchar columns improves repository
performance because it reduces disk input and output and because the
database buffer cache can cache Varchar columns.
To use this option, the repository database must meet the following page size
requirements:
- IBM DB2: Database page size 4 KB or greater. At least one temporary
tablespace with page size 16 KB or greater.
- Microsoft SQL Server: Database page size 8 KB or greater.

Default is disabled.
Database Username

Account for the database containing the repository. Set up this account using
the appropriate database client tools. To apply changes, restart the
PowerCenter Repository Service.

Database Password

Repository database password corresponding to the database user. Must be

in 7-bit ASCII. To apply changes, restart the PowerCenter Repository Service.

Database Connection Timeout

Period of time that the PowerCenter Repository Service tries to establish or

reestablish a connection to the database system. Default is 180 seconds.

Database Array Operation Size

Number of rows to fetch each time an array database operation is issued,

such as insert or fetch. Default is 100.
To apply changes, restart the PowerCenter Repository Service.

Database Pool Size

Maximum number of connections to the repository database that the

PowerCenter Repository Service can establish. If the PowerCenter Repository
Service tries to establish more connections than specified for
DatabasePoolSize, it times out the connection after the number of seconds
specified for DatabaseConnectionTimeout. Default is 500. Minimum is 20.

Table Owner Name

Name of the owner of the repository tables for a DB2 repository.

Note: You can use this option for DB2 databases only.

Advanced Properties
Advanced properties control the performance of the PowerCenter Repository Service and the repository
database.

PowerCenter Repository Service Properties

287

The following table describes the advanced properties:

Property

Description

Authenticate MS-SQL User

Uses Windows authentication to access the Microsoft SQL Server database.

The user name that starts the PowerCenter Repository Service must be a
valid Windows user with access to the Microsoft SQL Server database. To
apply changes, restart the PowerCenter Repository Service.

Required Comments for Checkin

Requires users to add comments when checking in repository objects. To

apply changes, restart the PowerCenter Repository Service.

Minimum Severity for Log

Entries

Level of error messages written to the PowerCenter Repository Service log.

Specify one of the following message levels:
- Fatal
- Error
- Warning
- Info
- Trace
- Debug

When you specify a severity level, the log includes all errors at that level and
above. For example, if the severity level is Warning, fatal, error, and warning
messages are logged. Use Trace or Debug if Informatica Global Customer
Support instructs you to use that logging level for troubleshooting purposes.
Default is INFO.
Resilience Timeout

Period of time that the service tries to establish or reestablish a connection to

another service. If blank, the service uses the domain resilience timeout.
Default is 180 seconds.

Limit on Resilience Timeout

Maximum amount of time that the service holds on to resources to

accommodate resilience timeouts. This property limits the resilience timeouts
for client applications connecting to the service. If a resilience timeout
exceeds the limit, the limit takes precedence. If blank, the service uses the
domain limit on resilience timeouts. Default is 180 seconds.
To apply changes, restart the PowerCenter Repository Service.

288

Repository Agent Caching

Enables repository agent caching. Repository agent caching provides optimal

performance of the repository when you run workflows. When you enable
repository agent caching, the PowerCenter Repository Service process
caches metadata requested by the PowerCenter Integration Service. Default
is Yes.

Agent Cache Capacity

Number of objects that the cache can contain when repository agent caching
is enabled. You can increase the number of objects if there is available
memory on the machine where the PowerCenter Repository Service process
runs. The value must not be less than 100. Default is 10,000.

Allow Writes With Agent Caching

Allows you to modify metadata in the repository when repository agent

caching is enabled. When you allow writes, the PowerCenter Repository
Service process flushes the cache each time you save metadata through the
PowerCenter Client tools. You might want to disable writes to improve
performance in a production environment where the PowerCenter Integration
Service makes all changes to repository metadata. Default is Yes.

Heart Beat Interval

Interval at which the PowerCenter Repository Service verifies its connections

with clients of the service. Default is 60 seconds.

Chapter 13: PowerCenter Repository Service

Property

Description

Maximum Active Users

Maximum number of connections the repository accepts from repository

clients. Default is 200.

Maximum Object Locks

Maximum number of locks the repository places on metadata objects. Default

is 50,000.

Database Pool Expiration

Threshold

Minimum number of idle database connections allowed by the PowerCenter

Repository Service. For example, if there are 20 idle connections, and you
set this threshold to 5, the PowerCenter Repository Service closes no more
than 15 connections. Minimum is 3. Default is 5.

Database Pool Expiration

Timeout

Interval, in seconds, at which the PowerCenter Repository Service checks for

idle database connections. If a connection is idle for a period of time greater
than this value, the PowerCenter Repository Service can close the
connection. Minimum is 300. Maximum is 2,592,000 (30 days). Default is
3,600 (1 hour).

Preserve MX Data for Old

Mappings

Preserves MX data for old versions of mappings. When disabled, the

PowerCenter Repository Service deletes MX data for old versions of
mappings when you check in a new version. Default is disabled.

If you update the following properties, restart the PowerCenter Repository Service for the modifications to
take effect:

Minimum severity for log entries

Maximum active users

Maximum object locks

Metadata Manager Service Properties

You can access data lineage analysis for a PowerCenter repository from the PowerCenter Designer. To
access data lineage from the Designer, you configure the Metadata Manager Service properties for the
PowerCenter Repository Service.
Before you configure data lineage for a PowerCenter repository, complete the following tasks:

Make sure Metadata Manager is running. Create a Metadata Manager Service in the Administrator tool or
verify that an enabled Metadata Manager Service exists in the domain that contains the PowerCenter
Repository Service for the PowerCenter repository.

Load the PowerCenter repository metadata. Create a resource for the PowerCenter repository in
Metadata Manager and load the PowerCenter repository metadata into the Metadata Manager warehouse.

The following table describes the Metadata Manager Service properties:

Property

Description

Metadata Manager
Service

Name of the Metadata Manager Service used to run data lineage. Select from the
available Metadata Manager Services in the domain.

Resource Name

Name of the PowerCenter resource in Metadata Manager.

PowerCenter Repository Service Properties

289

Custom Properties for the PowerCenter Repository Service

Configure custom properties that are unique to specific environments.
You might need to apply custom properties in special cases. When you define a custom property, enter the
property name and an initial value. Define custom properties only at the request of Informatica Global
Customer Support.

PowerCenter Repository Service Process Properties

You can configure custom and environment variable properties for the PowerCenter Repository Service
process.
Use the Administrator tool to configure the following PowerCenter Repository Service process properties:

Custom properties. Configure custom properties that are unique to specific environments.

Environment variables. Configure environment variables for each PowerCenter Repository Service
process.

To view and update properties, select a PowerCenter Repository Service in the Navigator and click the
Processes view.

Custom Properties for the PowerCenter Repository Service

Process
Configure custom properties that are unique to specific environments.
You might need to apply custom properties in special cases. When you define a custom property, enter the
property name and an initial value. Define custom properties only at the request of Informatica Global
Customer Support.

Environment Variables
The database client path on a node is controlled by an environment variable.
Set the database client path environment variable for the PowerCenter Repository Service process if the
PowerCenter Repository Service process requires a different database client than another PowerCenter
Repository Service process that is running on the same node.
The database client code page on a node is usually controlled by an environment variable. For example,
Oracle uses NLS_LANG, and IBM DB2 uses DB2CODEPAGE. All PowerCenter Integration Services and
PowerCenter Repository Services that run on this node use the same environment variable. You can
configure a PowerCenter Repository Service process to use a different value for the database client code
page environment variable than the value set for the node.
You can configure the code page environment variable for a PowerCenter Repository Service process when
the PowerCenter Repository Service process requires a different database client code page than the
PowerCenter Integration Service process running on the same node.
For example, the PowerCenter Integration Service reads from and writes to databases using the UTF-8 code
page. The PowerCenter Integration Service requires that the code page environment variable be set to
UTF-8. However, you have a Shift-JIS repository that requires that the code page environment variable be
set to Shift-JIS. Set the environment variable on the node to UTF-8. Then add the environment variable to the
PowerCenter Repository Service process properties and set the value to Shift-JIS.

290

Chapter 13: PowerCenter Repository Service

High Availability for the PowerCenter Repository

Service
Configure high availability for the PowerCenter Repository Service to minimize interruptions to data
integration tasks.
The PowerCenter Repository Service has the following high availability features that are available based on
your license:

Resilience. The PowerCenter Repository Service is resilient to the temporary unavailability of other
services and the repository database. PowerCenter Repository Service clients are resilient to connections
with the PowerCenter Repository Service.

Restart and failover. If the PowerCenter Repository Service fails, the Service Manager can restart the
service or fail it over to another node, based on node availability.

Recovery. After restart or failover, the PowerCenter Repository Service can recover operations from the
point of interruption.

Resilience
The PowerCenter Repository Service is resilient to temporary unavailability of PowerCenter Repository
Service clients and the PowerCenter Repository database.
An application service can be unavailable because of network failure or because a service process fails. You
can configure the resilience timeout for the connection between the PowerCenter Repository Service and the
following components:
PowerCenter Repository Service Clients
A PowerCenter Repository Service client can be a PowerCenter Client or a PowerCenter service that
depends on the PowerCenter Repository Service. For example, the PowerCenter Integration Service is a
PowerCenter Repository Service client because it depends on the PowerCenter Repository Service for a
connection to the repository.
The PowerCenter Repository Service resilience timeout period is based on the resilience properties that
you configure for the PowerCenter Repository Service, PowerCenter Repository Service clients, and the
domain.
Note: The Web Services Hub is not resilient to the PowerCenter Repository Service.
PowerCenter Repository Database
The PowerCenter repository database might become unavailable because of network failure or because
the repository database system becomes unavailable. If the repository database becomes unavailable,
the PowerCenter Repository Service tries to reconnect to the repository database within the period
specified by the database connection timeout configured in the PowerCenter Repository Service
properties.
Tip: If the repository database system has high availability features, set the database connection timeout
to allow the repository database system enough time to become available before the PowerCenter
Repository Service tries to reconnect to it. Test the database system features that you plan to use to
determine the optimum database connection timeout.

High Availability for the PowerCenter Repository Service

291

Restart and Failover

If the PowerCenter Repository Service process fails, the Service Manager can restart the process on the
same node. If the node is not available, the PowerCenter Repository Service process fails over to the backup
node.
The PowerCenter Repository Service process fails over to a backup node in the following situations:

The PowerCenter Repository Service process fails and the primary node is not available.

The PowerCenter Repository Service process is running on a node that fails.

You disable the PowerCenter Repository Service process.

After failover, PowerCenter Repository Service clients synchronize and connect to the PowerCenter
Repository Service process without loss of service.
You can disable a PowerCenter Repository Service process to shut down a node for maintenance. If you
disable a PowerCenter Repository Service process in complete or abort mode, the PowerCenter Repository
Service process fails over to another node.

Recovery
After a PowerCenter Repository Service restarts or fails over, it restores the state of operation from the
repository and recovers operations from the point of interruption.
The PowerCenter Repository Service maintains the state of operation in the repository. The state of
operations includes information about repository locks, requests in progress, and connected clients.
The PowerCenter Repository Service performs the following tasks to recover operations:

292

Gets locks on repository objects, such as mappings and sessions

Reconnects to clients, such as the PowerCenter Designer and the PowerCenter Integration Service

Completes requests in progress, such as saving a mapping

Sends outstanding notifications about metadata changes, such as workflow schedule changes

Chapter 13: PowerCenter Repository Service

CHAPTER 14

PowerCenter Repository
Management
This chapter includes the following topics:

PowerCenter Repository Management Overview, 293

PowerCenter Repository Service and Service Processes, 294

Operating Mode, 296

PowerCenter Repository Content, 297

Enabling Version Control, 299

Managing a Repository Domain, 299

Managing User Connections and Locks, 303

Sending Repository Notifications, 306

Backing Up and Restoring the PowerCenter Repository, 306

Copying Content from Another Repository, 308

Repository Plug-in Registration, 309

Audit Trails, 310

Repository Performance Tuning, 310

PowerCenter Repository Management Overview

You use the Administrator tool to manage PowerCenter Repository Services and repository content. A
PowerCenter Repository Service manages a single repository.
You can use the Administrator tool to complete the following repository tasks:

Enable and disable a PowerCenter Repository Service or service process.

Change the operating mode of a PowerCenter Repository Service.

Create and delete repository content.

Back up, copy, restore, and delete a repository.

Promote a local repository to a global repository.

Register and unregister a local repository.

Manage user connections and locks.

293

Send repository notification messages.

Manage repository plug-ins.

Configure permissions on the PowerCenter Repository Service.

Upgrade a repository.

Upgrade a PowerCenter Repository Service and its dependent services to the latest service version.

PowerCenter Repository Service and Service

Processes
When you enable a PowerCenter Repository Service, a service process starts on a node designated to run
the service. The service is available to perform repository transactions. If you have the high availability
option, the service can fail over to another node if the current node becomes unavailable. If you disable the
PowerCenter Repository Service, the service cannot run on any node until you reenable the service.
When you enable a service process, the service process is available to run, but it may not start. For example,
if you have the high availability option and you configure a PowerCenter Repository Service to run on a
primary node and two backup nodes, you enable PowerCenter Repository Service processes on all three
nodes. A single process runs at any given time, and the other processes maintain standby status. If you
disable a PowerCenter Repository Service process, the PowerCenter Repository Service cannot run on the
particular node of the service process. The PowerCenter Repository Service continues to run on another
node that is designated to run the service, as long as the node is available.

Enabling and Disabling a PowerCenter Repository Service

You can enable the PowerCenter Repository Service when you create it or after you create it. You need to
enable the PowerCenter Repository Service to perform the following tasks in the Administrator tool:

Assign privileges and roles to users and groups for the PowerCenter Repository Service.

Create or delete content.

Back up or restore content.

Upgrade content.

Copy content from another PowerCenter repository.

Register or unregister a local repository with a global repository.

Promote a local repository to a global repository.

Register plug-ins.

Manage user connections and locks.

Send repository notifications.

You must disable the PowerCenter Repository Service to run it in it exclusive mode.
Note: Before you disable a PowerCenter Repository Service, verify that all users are disconnected from the
repository. You can send a repository notification to inform users that you are disabling the service.

Enabling a PowerCenter Repository Service

1.

294

In the Administrator tool, click the Manage tab > Services and Nodes view.

Chapter 14: PowerCenter Repository Management

2.

In the Domain Navigator, select the PowerCenter Repository Service.

3.

In the Manage tab Actions menu, click Enable

The status indicator at the top of the contents panel indicates when the service is available.

Disabling a PowerCenter Repository Service

1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Repository Service.

3.

On the Manage tab Actions menu, select Disable Service.

4.

In the Disable Repository Service, select to abort all service processes immediately or allow services
processes to complete.

5.

Click OK.

Enabling and Disabling PowerCenter Repository Service

Processes
A service process is the physical representation of a service running on a node. The process for a
PowerCenter Repository Service is the pmrepagent process. At any given time, only one service process is
running for the service in the domain.
When you create a PowerCenter Repository Service, service processes are enabled by default on the
designated nodes, even if you do not enable the service. You disable and enable service processes on the
Processes view. You may want to disable a service process to perform maintenance on the node or to tune
performance.
If you have the high availability option, you can configure the service to run on multiple nodes. At any given
time, a single process is running for the PowerCenter Repository Service. The service continues to be
available as long as one of the designated nodes for the service is available. With the high availability option,
disabling a service process does not disable the service if the service is configured to run on multiple nodes.
Disabling a service process that is running causes the service to fail over to another node.

Enabling a PowerCenter Repository Service Process

1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Repository Service associated with the service process
you want to enable.

3.

In the contents panel, click the Processes view.

4.

Select the process you want to enable.

5.

In the Manage tab Actions menu, click Enable Process to enable the service process on the node.

Disabling a PowerCenter Repository Service Process

1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Repository Service associated with the service process
you want to disable.

3.

In the contents panel, click the Processes view.

4.

Select the process you want to disable.

5.

On the Manage tab Actions menu, select Disable Process.

PowerCenter Repository Service and Service Processes

295

6.

In the dialog box that appears, select to abort service processes immediately or allow service processes
to complete.

7.

Click OK.

Operating Mode
You can run the PowerCenter Repository Service in normal or exclusive operating mode. When you run the
PowerCenter Repository Service in normal mode, you allow multiple users to access the repository to update
content. When you run the PowerCenter Repository Service in exclusive mode, you allow only one user to
access the repository. Set the operating mode to exclusive to perform administrative tasks that require a
single user to access the repository and update the configuration. If a PowerCenter Repository Service has
no content associated with it or if a PowerCenter Repository Service has content that has not been upgraded,
the PowerCenter Repository Service runs in exclusive mode only.
When the PowerCenter Repository Service runs in exclusive mode, it accepts connection requests from the
Administrator tool and pmrep.
Run a PowerCenter Repository Service in exclusive mode to perform the following administrative tasks:

Delete repository content. Delete the repository database tables for the PowerCenter repository.

Enable version control. If you have the team-based development option, you can enable version control
for the repository. A versioned repository can store multiple versions of an object.

Promote a PowerCenter repository. Promote a local repository to a global repository to build a repository
domain.

Register a local repository. Register a local repository with a global repository to create a repository
domain.

Register a plug-in. Register or unregister a repository plug-in that extends PowerCenter functionality.

Upgrade the PowerCenter repository. Upgrade the repository metadata.

Before running a PowerCenter Repository Service in exclusive mode, verify that all users are disconnected
from the repository. You must stop and restart the PowerCenter Repository Service to change the operating
mode.
When you run a PowerCenter Repository Service in exclusive mode, repository agent caching is disabled,
and you cannot assign privileges and roles to users and groups for the PowerCenter Repository Service.
Note: You cannot use pmrep to log in to a new PowerCenter Repository Service running in exclusive mode if
the Service Manager has not synchronized the list of users and groups in the repository with the list in the
domain configuration database. To synchronize the list of users and groups, restart the PowerCenter
Repository Service.

Running a PowerCenter Repository Service in Exclusive Mode

296

1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Repository Service.

3.

In the Properties view, click Edit in the repository properties section.

4.

Set the operating mode to Exclusive.

5.

Click OK.

Chapter 14: PowerCenter Repository Management

The Administrator tool prompts you to restart the PowerCenter Repository Service.
6.

Verify that you have notified users to disconnect from the repository, and click Yes if you want to log out
users who are still connected.
A warning message appears.

7.

Choose to allow processes to complete or abort all processes, and then click OK.
The PowerCenter Repository Service stops and then restarts. The service status at the top of the right
pane indicates when the service has restarted. The Disable button for the service appears when the
service is enabled and running.
Note: PowerCenter does not provide resilience for a repository client when the PowerCenter Repository
Service runs in exclusive mode.

Running a PowerCenter Repository Service in Normal Mode

1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Repository Service.

3.

In the Properties view, click Edit in the repository properties section.

4.

Select Normal as the operating mode.

5.

Click OK.
The Administrator tool prompts you to restart the PowerCenter Repository Service.
Note: You can also use the infacmd UpdateRepositoryService command to change the operating mode.

PowerCenter Repository Content

Repository content are repository tables in the database. You can create or delete repository content for a
PowerCenter Repository Service.

Creating PowerCenter Repository Content

You can create repository content for a PowerCenter Repository Service if you did not create content when
you created the service or if you deleted the repository content. You cannot create content for a PowerCenter
Repository Service that already has content.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select a PowerCenter Repository Service that has no content associated with
it.

3.

On the Manage tab Actions menu, select Repository Content > Create.
The page displays the options to create content.

4.

Optionally, choose to create a global repository.

Select this option if you are certain you want to create a global repository. You can promote a local
repository to a global repository at any time, but you cannot convert a global repository to a local
repository.

5.

Optionally, enable version control.

PowerCenter Repository Content

297

You must have the team-based development option to enable version control. Enable version control if
you are certain you want to use a versioned repository. You can convert a non-versioned repository to a
versioned repository at any time, but you cannot convert a versioned repository to a non-versioned
repository.
6.

Click OK.

Deleting PowerCenter Repository Content

Delete repository content when you want to delete all metadata and repository database tables from the
repository. When you delete repository content, you also delete all privileges and roles assigned to users for
the PowerCenter Repository Service.
You might delete the repository content if the metadata is obsolete. Deleting repository content is an
irreversible action. If the repository contains information that you might need later, back up the repository
before you delete it.
To delete a global repository, you must unregister all local repositories. Also, you must run the PowerCenter
Repository Service in exclusive mode to delete repository content.
Note: You can also use the pmrep Delete command to delete repository content.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Repository Service from which you want to delete the
content.

3.

Change the operating mode of the PowerCenter Repository Service to exclusive.

4.

On the Manage tab Actions menu, click Repository Content > Delete.

5.

Enter your user name, password, and security domain.

The Security Domain field appears when the Informatica domain contains an LDAP security domain.

6.

If the repository is a global repository, choose to unregister local repositories when you delete the
content.
The delete operation does not proceed if it cannot unregister the local repositories. For example, if a
Repository Service for one of the local repositories is running in exclusive mode, you may need to
unregister that repository before you delete the global repository.

7.

Click OK.
The activity log displays the results of the delete operation.

Upgrading PowerCenter Repository Content

To upgrade the PowerCenter repository content, you must have permission on the PowerCenter Repository
Service.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Repository Service for the repository you want to
upgrade.

3.

On the Manage tab Actions menu, click Repository Contents > Upgrade.

4.

Enter the repository administrator user name and password.

5.

Click OK.
The activity log displays the results of the upgrade operation.

298

Chapter 14: PowerCenter Repository Management

Enabling Version Control

If you have the team-based development option, you can enable version control for a new or existing
repository. A versioned repository can store multiple versions of objects. If you enable version control, you
can maintain multiple versions of an object, control development of the object, and track changes. You can
also use labels and deployment groups to associate groups of objects and copy them from one repository to
another. After you enable version control for a repository, you cannot disable it.
When you enable version control for a repository, the repository assigns all versioned objects version number
1, and each object has an active status.
You must run the PowerCenter Repository Service in exclusive mode to enable version control for the
repository.
1.

Ensure that all users disconnect from the PowerCenter repository.

2.

In the Administrator tool, click the Manage tab > Services and Nodes view.

3.

Change the operating mode of the PowerCenter Repository Service to exclusive.

4.

Enable the PowerCenter Repository Service.

5.

In the Domain Navigator, select the PowerCenter Repository Service.

6.

In the repository properties section of the Properties view, click Edit.

7.

Select Version Control.

8.

Click OK.
The Repository Authentication dialog box appears.

9.

Enter your user name, password, and security domain.

The Security Domain field appears when the Informatica domain contains an LDAP security domain.

10.

Change the operating mode of the PowerCenter Repository Service to normal.

The repository is now versioned.

Managing a Repository Domain

A repository domain is a group of linked PowerCenter repositories that consists of one global repository and
one or more local repositories. You group repositories in a repository domain to share data and metadata
between repositories. When working in a repository domain, you can perform the following tasks:

Promote metadata from a local repository to a global repository, making it accessible to all local
repositories in the repository domain.

Copy objects from or create shortcuts to metadata in the global repository.

Copy objects from the local repository to the global repository.

Prerequisites for a PowerCenter Repository Domain

Before building a repository domain, verify that you have the following required elements:

A licensed copy of Informatica to create the global repository.

A license for each local repository you want to create.

A database created and configured for each repository.

Enabling Version Control

299

A PowerCenter Repository Service created and configured to manage each repository.

A PowerCenter Repository Service accesses the repository faster if the PowerCenter Repository Service
process runs on the machine where the repository database resides.

Network connections between the PowerCenter Repository Services and PowerCenter Integration
Services.

Compatible repository code pages.

To register a local repository, the code page of the global repository must be a subset of each local
repository code page in the repository domain. To copy objects from the local repository to the global
repository, the code pages of the local and global repository must be compatible.

Building a PowerCenter Repository Domain

Use the following steps as a guideline to connect separate PowerCenter repositories into a repository
domain:
1.

Create a repository and configure it as a global repository. You can specify that a repository is the global
repository when you create the PowerCenter Repository Service. Alternatively, you can promote an
existing local repository to a global repository.

2.

Register local repositories with the global repository. After a local repository is registered, you can
connect to the global repository from the local repository and you can connect to the local repository
from the global repository.

3.

Create user accounts for users performing cross-repository work. A user who needs to connect to
multiple repositories must have privileges for each PowerCenter Repository Service.
When the global and local repositories exist in different Informatica domains, the user must have an
identical user name, password, and security domain in each Informatica domain. Although the user
name, password, and security domain must be the same, the user can be a member of different user
groups and can have a different set of privileges for each PowerCenter Repository Service.

4.

Configure the user account used to access the repository associated with the PowerCenter Integration
Service. To run a session that uses a global shortcut, the PowerCenter Integration Service must access
the repository in which the mapping is saved and the global repository with the shortcut information. You
enable this behavior by configuring the user account used to access the repository associated with the
PowerCenter Integration Service. This user account must have privileges for the following services:

The local PowerCenter Repository Service associated with the PowerCenter Integration Service

The global PowerCenter Repository Service in the domain

Promoting a Local Repository to a Global Repository

You can promote an existing repository to a global repository. After you promote a repository to a global
repository, you cannot change it to a local or standalone repository. After you promote a repository, you can
register local repositories to create a repository domain.
When registering local repositories with a global repository, the global and local repository code pages must
be compatible. Before promoting a repository to a global repository, make sure the repository code page is
compatible with each local repository you plan to register.
To promote a repository to a global repository, you need to change the operating mode of the PowerCenter
Repository Service to exclusive. If users are connected to the repository, have them disconnect before you
run the repository in exclusive mode.
1.

300

In the Administrator tool, click the Manage tab > Services and Nodes view.

Chapter 14: PowerCenter Repository Management

2.

In the Domain Navigator, select the PowerCenter Repository Service for the repository you want to
promote.

3.

If the PowerCenter Repository Service is running in normal mode, change the operating mode to
exclusive.

4.

If the PowerCenter Repository Service is not enabled, click Enable.

5.

In the repository properties section for the service, click Edit.

6.

Select Global Repository, and click OK.

The Repository Authentication dialog box appears.

7.

Enter your user name, password, and security domain.

The Security Domain field appears when the Informatica Domain contains an LDAP security domain.

8.

Click OK.

After you promote a local repository, the value of the GlobalRepository property is true in the general
properties for the PowerCenter Repository Service.

Registering a Local Repository

You can register local repositories with a global repository to create a repository domain.When you register a
local repository, the code pages of the local and global repositories must be compatible. You can copy
objects from the local repository to the global repository and create shortcuts. You can also copy objects from
the global repository to the local repository.
If you unregister a repository from the global repository and register it again, the PowerCenter Repository
Service re-establishes global shortcuts. For example, if you create a copy of the global repository and delete
the original, you can register all local repositories with the copy of the global repository. The PowerCenter
Repository Service reestablishes all global shortcuts unless you delete objects from the copied repository.
A separate PowerCenter Repository Service manages each repository. For example, if a repository domain
has three local repositories and one global repository, it must have four PowerCenter Repository Services.
The PowerCenter Repository Services and repository databases do not need to run on the same machine.
However, you improve performance for repository transactions if the PowerCenter Repository Service
process runs on the same machine where the repository database resides.
You can move a registered local or global repository to a different PowerCenter Repository Service in the
repository domain or to a different Informatica domain.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Repository Service associated with the local
repository.

3.

If the PowerCenter Repository Service is running in normal mode, change the operating mode to
exclusive.

4.

If the PowerCenter Repository Service is not enabled, click Enable.

5.

To register a local repository, on the Manage tab Actions menu, click Repository Domain > Register
Local Repository. Continue to the next step. To unregister a local repository, on the Manage tab Actions
menu, click Repository Domain > Unregister Local Repository. Skip to step 11.

6.

Select the Informatica domain of the PowerCenter Repository Service for the global repository.
If the PowerCenter Repository Service is in a domain that does not appear in the list of Informatica
domains, click Manage Domain List to update the list.
The Manage List of Domains dialog box appears.

Managing a Repository Domain

301

7.

8.

To add a domain to the list, enter the following information:

Field

Description

Domain Name

Name of a Informatica Domain that you want to link to.

Host Name

Machine hosting the master gateway node for the linked domain. The machine hosting the
master gateway for the local Informatica Domain must have a network connection to this
machine.

Host Port

Gateway port number for the linked domain.

Click Add to add more than one domain to the list, and repeat step 7 for each domain.
To edit the connection information for a linked domain, go to the section for the domain you want to
update and click Edit.
To remove a linked domain from the list, go to the section for the domain you want to remove and click
Delete.

9.

Click Done to save the list of domains.

10.

Select the PowerCenter Repository Service for the global repository.

11.

Enter the user name, password, and security domain for the user who manages the global PowerCenter
Repository Service.
The Security Domain field appears when the Informatica Domain contains an LDAP security domain.

12.

Enter the user name, password, and security domain for the user who manages the local PowerCenter
Repository Service.

13.

Click OK.

Viewing Registered Local and Global Repositories

For a global repository, you can view a list of all the registered local repositories. Likewise, if a local
repository is registered with a global repository, you can view the name of the global repository and the
Informatica domain where it resides.
A PowerCenter Repository Service manages a single repository. The name of a repository is the same as the
name of the PowerCenter Repository Service that manages it.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Repository Service that manages the local or global
repository.

3.

On the Manage tab Actions menu, click Repository Domain > View Registered Repositories.
For a global repository, a list of local repositories appears.
For a local repository, the name of the global repository appears.
Note: The Administrator tool displays a message if a local repository is not registered with a global
repository or if a global repository has no registered local repositories.

302

Chapter 14: PowerCenter Repository Management

Moving Local and Global Repositories

If you need to move a local or global repository to another Informatica domain, complete the following steps:
1.

Unregister the local repositories. For each local repository, follow the procedure to unregister a local
repository from a global repository. To move a global repository to another Informatica domain,
unregister all local repositories associated with the global repository.

2.

Create the PowerCenter Repository Services using existing content. For each repository in the target
domain, follow the procedure to create a PowerCenter Repository Service using the existing repository
content in the source Informatica domain.
Verify that users and groups with privileges for the source PowerCenter Repository Service exist in the
target domain. The Service Manager periodically synchronizes the list of users and groups in the
repository with the users and groups in the domain configuration database. During synchronization,
users and groups that do not exist in the target domain are deleted from the repository.
You can use infacmd to export users and groups from the source domain and import them into the target
domain.

3.

Register the local repositories. For each local repository in the target Informatica domain, follow the
procedure to register a local repository with a global repository.

Managing User Connections and Locks

You can use the Administrator tool to manage user connections and locks and perform the following tasks:

View locks. View object locks and lock type. The PowerCenter repository locks repository objects and
folders by user. The repository uses locks to prevent users from duplicating or overwriting work. The
repository creates different types of locks depending on the task.

View user connections. View all user connections to the repository.

Close connections and release locks. Terminate residual connections and locks. When you close a
connection, you release all locks associated with that connection.

Viewing Locks
You can view locks and identify residual locks in the Administrator tool.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Repository Service with the locks that you want to
view.

3.

In the contents panel, click the Connections & Locks view.

4.

In the details panel, click the Locks view.

Managing User Connections and Locks

303

The following table describes the object lock information:

Column Name

Description

Server Thread ID

Identification number assigned to the repository connection.

Folder

Folder in which the locked object is saved.

Object Type

Type of object, such as folder, version, mapping, or source.

Object Name

Name of the locked object.

Lock Type

Type of lock: in-use, write-intent, or execute.

Lock Name

Name assigned to the lock.

Viewing User Connections

You can view user connection details in the Administrator tool. You might want to view user connections to
verify all users are disconnected before you disable the PowerCenter Repository Service.
To view user connection details:
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Repository Service with the locks that you want to
view.

3.

In the contents panel, click the Connections & Locks view.

4.

In the details panel, click the Properties view.

The following table describes the user connection information:

304

Property

Description

Connection ID

Identification number assigned to the repository connection.

Status

Connection status.

Username

User name associated with the connection.

Security Domain

Security domain of the user.

Application

Repository client associated with the connection.

Service

Service that connects to the PowerCenter Repository Service.

Host Name

Name of the machine running the application.

Host Address

IP address for the host machine.

Host Port

Port number of the machine hosting the repository client used to communicate with the
repository.

Chapter 14: PowerCenter Repository Management

Property

Description

Process ID

Identifier assigned to the PowerCenter Repository Service process.

Login Time

Time when the user connected to the repository.

Last Active Time

Time of the last metadata transaction between the repository client and the repository.

Closing User Connections and Releasing Locks

Sometimes, the PowerCenter Repository Service does not immediately disconnect a user from the repository.
The repository has a residual connection when the repository client or machine is shut down but the
connection remains in the repository. This can happen in the following situations:

Network problems occur.

A PowerCenter Client, PowerCenter Integration Service, PowerCenter Repository Service, or database

machine shuts down improperly.

A residual repository connection also retains all repository locks associated with the connection. If an object
or folder is locked when one of these events occurs, the repository does not release the lock. This lock is
called a residual lock.
If a system or network problem causes a repository client to lose connectivity to the repository, the
PowerCenter Repository Service detects and closes the residual connection. When the PowerCenter
Repository Service closes the connection, it also releases all repository locks associated with the connection.
A PowerCenter Integration Service may have multiple connections open to the repository. If you close one
PowerCenter Integration Service connection to the repository, you close all connections for that service.
Important: Closing an active connection can cause repository inconsistencies. Close residual connections
only.
To close a connection and release locks:
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Repository Service with the connection you want to
close.

3.

In the contents panel, click the Connections & Locks view.

4.

In the contents panel, select a connection.

The details panel displays connection properties in the properties view and locks in the locks view.

5.

In the Manage tab Actions menu, select Delete User Connection.

The Delete Selected Connection dialog box appears.

6.

Enter a user name, password, and security domain.

You can enter the login information associated with a particular connection, or you can enter the login
information for the user who manages the PowerCenter Repository Service.
The Security Domain field appears when the Informatica domain contains an LAP security domain.

7.

Click OK.

The PowerCenter Repository Service closes connections and releases all locks associated with the
connections.

Managing User Connections and Locks

305

Sending Repository Notifications

You create and send notification messages to all users connected to a repository.
You might want to send a message to notify users of scheduled repository maintenance or other tasks that
require you to disable a PowerCenter Repository Service or run it in exclusive mode. For example, you might
send a notification message to ask users to disconnect before you promote a local repository to a global
repository.
1.

Select the PowerCenter Repository Service in the Navigator.

2.

In the Manage tab Actions menu, select Notify Users.

The Notify Users window appears.

3.

Enter the message text.

4.

Click OK.
The PowerCenter Repository Service sends the notification message to the PowerCenter Client users. A
message box informs users that the notification was received. The message text appears on the
Notifications tab of the PowerCenter Client Output window.

Backing Up and Restoring the PowerCenter

Repository
Regularly back up repositories to prevent data loss due to hardware or software problems. When you back up
a repository, the PowerCenter Repository Service saves the repository in a binary file, including the
repository objects, connection information, and code page information. If you need to recover the repository,
you can restore the content of the repository from this binary file.
If you back up a repository that has operating system profiles assigned to folders, the PowerCenter
Repository Service does not back up the folder assignments. After you restore the repository, you must
assign the operating system profiles to the folders.
Before you back up a repository and restore it in a different domain, verify that users and groups with
privileges for the source PowerCenter Repository Service exist in the target domain. The Service Manager
periodically synchronizes the list of users and groups in the repository with the users and groups in the
domain configuration database. During synchronization, users and groups that do not exist in the target
domain are deleted from the repository.
You can use infacmd to export users and groups from the source domain and import them into the target
domain.

Backing Up a PowerCenter Repository

When you back up a repository, the PowerCenter Repository Service stores the file in the backup location
you specify for the node. You specify the backup location when you set up the node. View the general
properties of the node to determine the path of the backup directory. The PowerCenter Repository Service
uses the extension .rep for all repository backup files.

306

1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Repository Service for the repository you want to back
up.

Chapter 14: PowerCenter Repository Management

3.

On the Manage tab Actions menu, select Repository Contents > Back Up.

4.

Enter your user name, password, and security domain.

The Security Domain field appears when the Informatica domain contains an LDAP security domain.

5.

Enter a file name and description for the repository backup file.
Use an easily distinguishable name for the file. For example, if the name of the repository is
DEVELOPMENT, and the backup occurs on May 7, you might name the file DEVELOPMENTMay07.rep.
If you do not include the .rep extension, the PowerCenter Repository Service appends that extension to
the file name.

6.

If you use the same file name that you used for a previous backup file, select whether or not to replace
the existing file with the new backup file.
To overwrite an existing repository backup file, select Replace Existing File. If you specify a file name
that already exists in the repository backup directory and you do not choose to replace the existing file,
the PowerCenter Repository Service does not back up the repository.

7.

Choose to skip or back up workflow and session logs, deployment group history, and MX data. You
might want to skip these operations to increase performance when you restore the repository.

8.

Click OK.
The results of the backup operation appear in the activity log.

Viewing a List of Backup Files

You can view the backup files you create for a repository in the backup directory where they are saved. You
can also view a list of existing backup files in the Administrator tool. If you back up a repository through
pmrep, you must provide a file extension of .rep to view it in the Administrator tool.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Repository Service for a repository that has been
backed up.

3.

On the Manage tab Actions menu, select Repository Contents > View Backup Files.
The list of the backup files shows the repository version and the options skipped during the backup.

Restoring a PowerCenter Repository

You can restore metadata from a repository binary backup file. When you restore a repository, you must have
a database available for the repository. You can restore the repository in a database that has a compatible
code page with the original database.
If a repository exists at the target database location, you must delete it before you restore a repository
backup file.
Informatica restores repositories from the current product version. If you have a backup file from an earlier
product version, you must use the earlier product version to restore the repository.
Verify that the repository license includes the license keys necessary to restore the repository backup file.
For example, you must have the team-based development option to restore a versioned repository.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Repository Service that manages the repository
content you want to restore.

3.

On the Manage tab Actions menu, click Repository Contents > Restore.
The Restore Repository Contents options appear.

Backing Up and Restoring the PowerCenter Repository

307

4.

Select a backup file to restore.

5.

Select whether or not to restore the repository as new.

When you restore a repository as new, the PowerCenter Repository Service restores the repository with
a new repository ID and deletes the log event files.
Note: When you copy repository content, you create the repository as new.

6.

Optionally, choose to skip restoring the workflow and session logs, deployment group history, and
Metadata Exchange (MX) data to improve performance.

7.

Click OK.
The activity log indicates whether the restore operation succeeded or failed.
Note: When you restore a global repository, the repository becomes a standalone repository. After
restoring the repository, you need to promote it to a global repository.

Copying Content from Another Repository

Copy content into a repository when no content exists for the repository and you want to use the content from
a different repository. Copying repository content provides a quick way to copy the metadata that you want to
use as a basis for a new repository. You can copy repository content to preserve the original repository
before upgrading. You can also copy repository content when you need to move a repository from
development into production.
To copy repository content, you must create the PowerCenter Repository Service for the target repository.
When you create the PowerCenter Repository Service, set the creation mode to create the PowerCenter
Repository Service without content. Also, you must select a code page that is compatible with the original
repository. Alternatively, you can delete the content from a PowerCenter Repository Service that already has
content associated with it.
You must copy content into an empty repository. If repository in the target database already has content, the
copy operation fails. You must back up the repository the target database and delete its content before
copying the repository content.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerCenter Repository Service to which you want to add copied
content.
You cannot copy content to a repository that has content. If necessary, back up and delete existing
repository content before copying in the new content.

3.

On the Manage tab Actions menu, click Repository Contents > Copy From.
The dialog box displays the options for the Copy From operation.

4.

Select the name of the PowerCenter Repository Service.

The source PowerCenter Repository Service and the PowerCenter Repository Service to which you want
to add copied content must be in the same domain and it must be of the same service version.

5.

Enter a user name, password, and security domain for the user who manages the repository from which
you want to copy content.
The Security Domain field appears when the Informatica domain contains an LDAP security domain.

6.

308

To skip copying the workflow and session logs, deployment group history, and Metadata Exchange (MX)
data, select the check boxes in the advanced options. Skipping this data can increase performance.

Chapter 14: PowerCenter Repository Management

7.

Click OK.
The activity log displays the results of the copy operation.

Repository Plug-in Registration

Use the Administrator tool to register and remove repository plug-ins. Repository plug-ins are third-party or
other Informatica applications that extend PowerCenter functionality by introducing new repository metadata.
For installation issues specific to the plug-in, consult the plug-in documentation.

Registering a Repository Plug-in

Register a repository plug-in to add its functionality to the repository. You can also update an existing
repository plug-in.
1.

Run the PowerCenter Repository Service in exclusive mode.

2.

In the Administrator tool, click the Manage tab > Services and Nodes view.

3.

In the Domain Navigator, select the PowerCenter Repository Service to which you want to add the plugin.

4.

In the contents panel, click the Plug-ins view.

5.

In the Manage tab Actions menu, select Register Plug-in.

6.

On the Register Plugin page, click the Browse button to locate the plug-in file.

7.

If the plug-in was registered previously and you want to overwrite the registration, select the check box
to update the existing plug-in registration. For example, you can select this option when you upgrade a
plug-in to the latest version.

8.

Enter your user name, password, and security domain.

The Security Domain field appears when the Informatica Domain contains an LDAP security domain.

9.

Click OK.
The PowerCenter Repository Service registers the plug-in with the repository. The results of the
registration operation appear in the activity log.

10.

Run the PowerCenter Repository Service in normal mode.

Unregistering a Repository Plug-in

To unregister a repository plug-in, the PowerCenter Repository Service must be running in exclusive mode.
Verify that all users are disconnected from the repository before you unregister a plug-in.
The list of registered plug-ins for a PowerCenter Repository Service appears on the Plug-ins tab.
If the PowerCenter Repository Service is not running in exclusive mode, the Remove buttons for plug-ins are
disabled.
1.

Run the PowerCenter Repository Service in exclusive mode.

2.

In the Administrator tool, click the Manage tab > Services and Nodes view.

3.

In the Domain Navigator, select the PowerCenter Repository Service from which you want to remove the
plugin.

Repository Plug-in Registration

309

4.

Click the Plug-ins view.

The list of registered plug-ins appears.

5.

Select a plug-in and click the unregister Plug-in button.

6.

Enter your user name, password, and security domain.

The Security Domain field appears when the Informatica Domain contains an LDAP security domain.

7.

Click OK.

8.

Run the PowerCenter Repository Service in normal mode.

Audit Trails
You can track changes to users, groups, and permissions on repository objects by selecting the
SecurityAuditTrail configuration option in the PowerCenter Repository Service properties in the Administrator
tool. When you enable the audit trail, the PowerCenter Repository Service logs security changes to the
PowerCenter Repository Service log. The audit trail logs the following operations:

Changing the owner or permissions for a folder or connection object.

Adding or removing a user or group.

The audit trail does not log the following operations:

Changing your own password.

Changing the owner or permissions for a deployment group, label, or query.

Repository Performance Tuning

You can use the Informatica features to improve the performance of the repository. You can update statistics
and skip information when you copy, back up, or restore the repository.

Repository Statistics
Almost all PowerCenter repository tables use at least one index to speed up queries. Most databases keep
and use column distribution statistics to determine which index to use to execute SQL queries optimally.
Database servers do not update these statistics continuously.
In frequently used repositories, these statistics can quickly become outdated, and SQL query optimizers
might not choose the best query plan. In large repositories, choosing a sub-optimal query plan can have a
negative impact on performance. Over time, repository operations gradually become slower.
Informatica identifies and updates the statistics of all repository tables and indexes when you copy, upgrade,
and restore repositories. You can also update statistics using the pmrep UpdateStatistics command.

310

Chapter 14: PowerCenter Repository Management

Repository Copy, Back Up, and Restore Processes

Large repositories can contain a large volume of log and historical information that slows down repository
service performance. This information is not essential to repository service operation. When you back up,
restore, or copy a repository, you can choose to skip the following types of information:

Workflow and session logs

Deployment group history

Metadata Exchange (MX) data

By skipping this information, you reduce the time it takes to copy, back up, or restore a repository.
You can also skip this information when you use the pmrep commands.

Repository Performance Tuning

311

CHAPTER 15

PowerExchange Listener Service

This chapter includes the following topics:

PowerExchange Listener Service Overview, 312

DBMOVER Statements for the Listener Service, 313

Creating a Listener Service, 314

Listener Service Properties, 314

Editing Listener Service Properties, 316

Enabling, Disabling, and Restarting the Listener Service, 317

Listener Service Logs, 318

Listener Service Restart and Failover, 318

PowerExchange Listener Service Overview

The PowerExchange Listener Service is an application service that manages the PowerExchange Listener.
The PowerExchange Listener manages communication between PowerExchange and a data source for bulk
data movement or change data capture. You can define a PowerExchange Listener service so that when you
run a workflow, PowerExchange on the PowerCenter Integration Service or Data Integration Service node
connects to the PowerExchange Listener through the Listener Service. Use the Administrator tool to manage
the service and view service logs.
When managed by the Listener Service, the PowerExchange Listener is also called the Listener Service
process.
The Service Manager, Listener Service, and Listener Service process must reside on the same node in the
Informatica domain.
On a Linux, UNIX, or Windows machine, you can use the Listener Service to manage the Listener process
instead of issuing PowerExchange commands such as DTLLST to start the Listener process or CLOSE to
stop the Listener process.
Note: If the PowerExchange Listener is running on i5/OS or z/OS, you cannot manage it with a
PowerExchange Listener Service. Instead, manage the PowerExchange Listener by issuing z/OS or i5/OS
commands or by issuing pwxcmd commands. For more information, see the PowerExchange Command
Reference.
You can use the Administrator tool to perform the following Listener Service tasks:

312

Create a service.

View or edit service properties.

View logs of service events.

Enable, disable, or restart a service.

You can also use the infacmd pwx commands to perform many of these tasks.
Before you create a Listener Service, install PowerExchange and configure a PowerExchange Listener on the
node where you want to create the Listener Service. When you create a Listener Service, the Service
Manager associates it with the PowerExchange Listener on the node. When you start or stop the Listener
Service, the PowerExchange Listener also starts or stops.

DBMOVER Statements for the Listener Service

Before you create a Listener Service, define LISTENER and SVCNODE statements in the DBMOVER file on
each node in the Informatica domain where a PowerExchange Listener runs. Also, define a NODE statement
in the DBMOVER file on each node where an Informatica client tool or integration service that connects to the
Listener runs.
A client tool is the Developer tool or PowerCenter Client. An integration service is the PowerCenter
Integration Service or Data Integration Service.
Define the following DBMOVER statements on all nodes where a PowerExchange Listener runs:
LISTENER
Required. Defines the TCP/IP port on which a named PowerExchange Listener process listens for work
requests.
The node name in the LISTENER statement must match the name that you provide in the Start
Parameters configuration property when you define the Listener Service.
SVCNODE
Optional. On Linux, UNIX, and Windows, use the SVCNODE statement to specify the TCP/IP port on
which a PowerExchange Listener listens for infacmd pwx or pwxcmd commands.
This name must match the node name specified in the LISTENER statement in the DBMOVER
configuration file.
Also, to issue infacmd pwx commands to connect to the Listener through the Listener application
service, this name must match one of the following values:

If you created the application service through Informatica Administrator, the node name value that
you specified in the Start Parameters property.

If you created the application service through the infacmd pwx CreateListenerService command, the
node name value that you specified for the -StartParameters option on the command.

Use the same port number that you specify for the SVCNODE Port Number configuration property for the
service.
Define the following DBMOVER statement on each node where an Informatica client tool or integration
service that connects to the Listener runs:
NODE
Configures the Informatica client tool or integration service to connect to the PowerExchange Listener at
the specified IP address or host name or to locate the Listener Service in the domain.

DBMOVER Statements for the Listener Service

313

To configure the client tool or integration service to locate the Listener Service in the domain, include the
optional service_name parameter in the NODE statement. The service_name parameter identifies the
node, and the port parameter in the NODE statement identifies the port number.
Note: If the NODE statement does not include the service_name parameter, the Informatica client tool or
integration service connects directly to the Listener at the specified IP address or host name. It does not
locate the Listener Service in the domain.
For more information about customizing the DBMOVER configuration file for bulk data movement or CDC
sessions, see the following guides:

PowerExchange Bulk Data Movement Guide

PowerExchange CDC Guide for Linux, UNIX, and Windows

Creating a Listener Service

1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

Click Actions > New > PowerExchange Listener Service.

The New PowerExchange Listener Service dialog box appears.

3.

Enter the general properties for the service, and click Next.
For more information, see PowerExchange Listener Service General Properties on page 315.

4.

Enter the configuration properties for the service.

For more information, see PowerExchange Listener Service Configuration Properties on page 316.

5.

Click OK.

6.

To enable the Listener Service, select the service in the Domain Navigator and click Enable the
Service.

Listener Service Properties

To view the properties of a Listener Service, select the service in the Domain Navigator and click the
Properties tab.
You can change the properties while the service is running, but you must restart the service for the properties
to take effect.

314

Chapter 15: PowerExchange Listener Service

PowerExchange Listener Service General Properties

The following table describes the general properties for the service:
Property

Description

Name

Name of the service. The name is not case sensitive and must be unique within the
domain. It cannot exceed 128 characters or begin with @. It also cannot contain
spaces or the following special characters:
`~%^*+={}\;:'"/?.,<>|!()][
You cannot change the name of the service after you create it.

Description

Description of the service. The description cannot exceed 765 characters.

Location

Domain and folder where the service is created. Click Browse to choose a different
folder. You can move the service after you create it.

Node

Node on which the service runs.

License

License object that allows use of the service.

Backup Nodes

If your license includes high availability, nodes on which the service can run if the
primary node is unavailable.

Listener Service Properties

315

PowerExchange Listener Service Configuration Properties

The following table describes the configuration properties of a Listener Service:
Configuration Property

Description

Service Process

Read only. Type of PowerExchange process that the service manages. For the
Listener Service, the service process is named Listener.

Start Parameters

Parameters to include when you start the Listener Service. Separate the
parameters with the space character.
You can include the following parameters:
- service_name
Required. Name that identifies the Listener Service. This name must match the name
in the LISTENER statement in the DBMOVER configuration file on the machine where
the PowerExchange Listener runs.
- config=directory
Optional. Specifies the full path and file name for a DBMOVER configuration file that
overrides the default dbmover.cfg file in the installation directory.
This override file takes precedence over any other override configuration file that you
optionally specify with the PWX_CONFIG environment variable.
- license=directory/license_key_file
Optional. Specifies the full path and file name for any license key file that you want to
use instead of the default license.key file in the installation directory. This override
license key file must have a file name or path that is different from that of the default
file.
This override file takes precedence over any other override license key file that you
optionally specify with the PWX_LICENSE environment variable.

Note: In the config and license parameters, you must provide the full path only if the
file does not reside in the installation directory. Include double quotation marks
around any path and file name that contains spaces.
SVC NODE Port Number

Specifies the port on which the Listener Service connects to the PowerExchange
Listener.
Use the same port number that is specified in the SVCNODE statement of the
DBMOVER file.

Environment Variables for the Listener Service Process

You can edit environment variables for a Listener Service process on the Processes tab.
The following table describes the environment variables that are defined for the Listener Service process:
Property

Description

Environment Variables

Environment variables that are defined for the Listener Service process.

Editing Listener Service Properties

You can edit general and configuration properties for the Listener Service in the Administrator tool.

316

Chapter 15: PowerExchange Listener Service

Editing Listener Service General Properties

Use the Properties tab in the Administrator tool to edit Listener Service general properties.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerExchange Listener Service.

The PowerExchange Listener Service Properties window appears.

3.

In the General Properties area of the Properties tab, click Edit.

The Edit PowerExchange Listener Service dialog box appears.

4.

Edit the general properties of the service.

5.

Click OK.

Editing Listener Service Configuration Properties

Use the Properties tab in the Administrator tool to configure Listener Service configuration properties.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerExchange Listener Service.

3.

In the Configuration Properties area of the Properties tab, click Edit.

The Edit PowerExchange Listener Service dialog box appears.

4.

Edit the configuration properties.

Enabling, Disabling, and Restarting the Listener

Service
You can enable, disable, or restart a Listener Service from the Administrator tool. You might disable the
Listener Service if you need to temporarily restrict users from using the service. You might restart a service if
you modified a property.

Enabling the Listener Service

To enable the Listener Service, select the service in the Domain Navigator and click Enable the Service.

Disabling the Listener Service

If you need to temporarily restrict users from using a Listener Service, you can disable it.
1.

Select the service in the Domain Navigator, and click Disable the Service.

2.

Select one of the following options:

3.

Complete. Allows all Listener subtasks to run to completion before shutting down the service and the
Listener Service process. Corresponds to the PowerExchange Listener CLOSE command.

Stop. Waits up to 30 seconds for subtasks to complete, and then shuts down the service and the
Listener Service process. Corresponds to the PowerExchange Listener CLOSE FORCE command.

Abort. Stops all processes immediately and shuts down the service.

Click OK.

Enabling, Disabling, and Restarting the Listener Service

317

For more information about the CLOSE and CLOSE FORCE commands, see the PowerExchange Command
Reference.
Note: After you select an option and click OK, the Administrator tool displays a busy icon until the service
stops. If you select the Complete option but then want to disable the service more quickly with the Stop or
Abort option, you must issue the infacmd isp disableService command.

Restarting the Listener Service

You can restart a Listener Service that you previously disabled.
To restart the Listener Service, select the service in the Navigator and click Restart.

Listener Service Logs

The Listener Service generates operational and error log events that the Log Manager collects in the domain.
You can view Listener Service logs by performing one of the following actions in the Administrator tool:

In the Logs tab, select the Domain view. You can filter on any of the columns.

In the Logs tab, click the Service view. In the Service Type column, select PowerExchange Listener
Service. In the Service Name list, optionally select the name of the service.

On the Manage tab, click the Domain view. Click the Listener Service Actions menu, and then select
View Logs.

Messages appear by default in time stamp order, with the most recent messages on top.

Listener Service Restart and Failover

If you have the PowerCenter high availability option, the Listener Service provides restart and failover
capabilities.
If the Listener Service or the Listener Service process fails on the primary node, the Service Manager restarts
the service on the primary node.
If the primary node fails, the Listener Service fails over to the backup node, if one is defined. After failover,
the Service Manager synchronizes and connects to the PowerExchange Listener on the backup node.
For the PowerExchange service to fail over successfully, the backup node must be able to connect to the
data source or target. Configure the PowerExchange Listener and, if applicable, the PowerExchange Logger
for Linux, UNIX, and Windows on the backup node as you do on the primary node.
If the PowerExchange Listener fails during a PowerCenter session, the session fails, and you must restart it.
For CDC sessions, PWXPC performs warm start processing. For more information, see the PowerExchange
Interfaces Guide for PowerCenter.

318

Chapter 15: PowerExchange Listener Service

CHAPTER 16

PowerExchange Logger Service

This chapter includes the following topics:

PowerExchange Logger Service Overview, 319

Configuration Statements for the Logger Service, 320

Creating a Logger Service, 320

Properties of the PowerExchange Logger Service, 321

Logger Service Management, 323

Enabling, Disabling, and Restarting the Logger Service, 324

Logger Service Logs, 325

Logger Service Restart and Failover, 325

PowerExchange Logger Service Overview

The Logger Service is an application service that manages the PowerExchange Logger for Linux, UNIX, and
Windows. The PowerExchange Logger captures change data from a data source and writes the data to
PowerExchange Logger log files. Use the Administrator tool to manage the service and view service logs.
When managed by the Logger Service, the PowerExchange Logger is also called the Logger Service
process.
The Service Manager, Logger Service, and PowerExchange Logger must reside on the same node in the
Informatica domain.
On a Linux, UNIX, or Windows machine, you can use the Logger Service to manage the PowerExchange
Logger process instead of issuing PowerExchange commands such as PWXCCL to start the Logger process
or SHUTDOWN to stop the Logger process.
You can run multiple Logger Services on the same node. Create a Logger Service for each PowerExchange
Logger process that you want to manage on the node. You must run one PowerExchange Logger process for
each source type and instance, as defined in a PowerExchange registration group.
Perform the following tasks to manage the Logger Service:

Create a service.

View the service properties.

View service logs

Enable, disable, and restart the service.

You can use the Administrator tool or the infacmd command line program to administer the Logger Service.

319

Before you create a Logger Service, install PowerExchange and configure a PowerExchange Logger on the
node where you want to create the Logger Service. When you create a Logger Service, the Service Manager
associates it with the PowerExchange Logger that you specify. When you start or stop the Logger Service,
you also start or stop the Logger Service process.

Configuration Statements for the Logger Service

The Logger Service reads configuration information from the DBMOVER and PowerExchange Logger
Configuration (pwxccl.cfg) files.
Optionally, define the following statement in the DBMOVER file on each node that you configure to run the
Logger Service:
SVCNODE
Optional. On Linux, UNIX, and Windows, use the SVCNODE statement to specify the TCP/IP port on
which a PowerExchange Logger listens for infacmd pwx or pwxcmd commands.
The service name must match the service name that you specify in the associated CONDENSENAME
statement in the pwxccl.cfg file. The port number must match the port number that you specify for the
SVCNODE Port Number configuration property for the service.
Define the following statement in the PowerExchange Logger configuration file on each node that you
configure to run the Logger Service:
CONDENSENAME
Name for the command-handling service for a PowerExchange Logger process to which commands are
issued from the Logger Service.
Enter a service name up to 64 characters in length. No default is available.
The service name must match the service name that is specified in the associated SVCNODE statement
in the dbmover.cfg file.
For more information about customizing the DBMOVER and PowerExchange Logger Configuration files for
CDC sessions, see the PowerExchange CDC Guide for Linux, UNIX, and Windows.

Creating a Logger Service

1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

Click Actions > New > PowerExchange Logger Service.

The New PowerExchange Logger Service dialog box appears.

3.

Enter the service properties.

For more information, see the following topics:

320

PowerExchange Logger Service General Properties on page 321

PowerExchange Logger Service Configuration Properties on page 321

4.

Click OK.

5.

To enable the Logger Service, select the service in the Navigator and click Enable the Service.

Chapter 16: PowerExchange Logger Service

Properties of the PowerExchange Logger Service

To view the properties of a PowerExchange Logger Service, select the service in the Domain Navigator and
click the Properties tab.
You can change the properties while the service is running, but you must restart the service for the properties
to take effect.

PowerExchange Logger Service General Properties

The following table describes the general properties for the service:
Property

Description

Name

Name of the service. The name is not case sensitive and must be unique within
the domain. It cannot exceed 128 characters or begin with @. It also cannot
contain spaces or the following special characters:
`~%^*+={}\;:'"/?.,<>|!()][
You cannot change the name of the service after you create it.

Description

Description of the service. The description cannot exceed 765 characters.

Location

Domain and folder where the service is created. Click Browse to choose a
different folder. You can move the service after you create it.

Node

Node on which the service runs.

License

License object that allows use of the service.

Backup Nodes

If your license includes high availability, nodes on which the service can run if the
primary node is unavailable.

PowerExchange Logger Service Configuration Properties

The following table describes the configuration properties of a Logger Service:
Service Process
Read only. The type of PowerExchange process that the service manages. For a Logger Service, this
value must be Logger.
Start Parameters
Optional. Parameters that you can specify when you start the Logger Service. If you specify more than
one parameter, separate them with a space character.
Parameter descriptions:

coldstart={Y|N}
Indicates whether to cold start or warm start the Logger Service. Enter Y to cold start the Logger
Service. If the CDCT file contains log entries, the Logger Service deletes these entries. Enter N to
warm start the Logger Service from the restart point that is specified in the CDCT file. If no restart
information exists in the CDCT file, the Logger Service ends with an error.
Default is N.

Properties of the PowerExchange Logger Service

321

config=directory/pwx_config_file
Specifies the full path and file name for a dbmover configuration file that overrides the default
dbmover.cfg file. The override file must have a path or file name that is different from that of the
default file. This override file takes precedence over any configuration file that you optionally specify
in the PWX_CONFIG environment variable.

cs=directory/pwxlogger_config_file
Specifies the full path and file name for a Logger Service configuration file that overrides the default
pwxccl.cfg configuration file. The override file must have a path or file name that is different from that
of the default file.

encryptepwd=encrypted_password
A password in encrypted format for enabling the encryption of PowerExchange Logger log files. With
this password, the PowerExchange Logger can generate a unique encryption key for each Logger log
file. The password is stored in the CDCT file in encrypted format. For security purposes, the
password is not stored in CDCT backup files and is not displayed in the CDCT reports that you can
generate with the PowerExchange PWXUCDCT utility.
If you specify this parameter, you must also specify coldstart=Y.
If you specify this parameter and also specify the ENCRYPTEPWD parameter in the PowerExchange
Logger configuration file, pwxccl.cfg, the parameter in the configuration file takes precedence. If you
specify this parameter and also specify the ENCRYPTPWD parameter in the PowerExchange Logger
configuration file, an error occurs.
You can set the AES algorithm to use for log file encryption in the ENCRYPTOPT parameter of the
pwxccl.cfg file. The default is AES128.
Tip: For optimal security, Informatica recommends that you specify the encryption password when
cold starting the PowerExchange Logger rather than in the pwxccl.cfg configuration file. This practice
can reduce the risk of malicious access to the encryption password for the following reasons: 1) The
encryption password is not stored in the pwxccl.cfg file, and 2) You can remove the password from
the command line after a successful cold start. If you specify the encryption password for a cold start
and then need to restore the CDCT file later, you must enter the same encryption password in the
RESTORE_CDCT command of the PWXUCDCT utility.
To not encrypt PowerExchange Logger log files, do not enter an encryption password.

license=directory/license_key_file
Specifies the full path and file name for a license key file that overrides the default license.key file.
The override file must have a path or file name that is different from that of the default file. This
override file takes precedence over any license key file that you optionally specify in the
PWX_LICENSE environment variable.

specialstart={Y|N}
Indicates whether to perform a special start of the PowerExchange Logger. A special start begins
PowerExchange capture processing from the point in the change stream that you specify in the
pwxccl.cfg file. This start point overrides the restart point from the CDCT file for the PowerExchange
Logger run. A special start does not delete any content from the CDCT file.

322

Chapter 16: PowerExchange Logger Service

Use this parameter to skip beyond problematic parts in the source logs without losing captured data.
For example, use a special start in the following situations:
- You do not want the PowerExchange Logger to capture an upgrade of an Oracle catalog. In this

case, stop the PowerExchange Logger before the upgrade. After the upgrade is complete, generate
new sequence and restart tokens for the PowerExchange Logger based on the post-upgrade SCN.
Enter these token values in the SEQUENCE_TOKEN and RESTART_TOKEN parameters in the
pwxccl.cfg, and then special start the PowerExchange Logger.
- You do not want the PowerExchange Logger to reprocess old, unavailable logs that were caused by

outstanding UOWs that are not of CDC interest. In this case, stop the PowerExchange Logger. Edit
the RESTART_TOKEN value to reflect the SCN of the earliest available log, and then perform a
special start. If any of the outstanding UOWs that started before this restart point are of CDC
interest, data might be lost.
Valid values:
- Y. Perform a special start of the PowerExchange Logger from the point in the change stream that is

defined by the SEQUENCE_TOKEN and RESTART_TOKEN parameter values in the pwxccl.cfg

configuration file. You must specify valid token values in the pwxccl.cfg file to perform a special
start. These token values override the token values from the CDCT file. Ensure that the
SEQUENCE_TOKEN value in the pwxccl.cfg is greater than or equal to the current sequence token
from the CDCT file.
Do not also specify the coldstart=Y parameter. If you do, the coldstart=Y parameter takes
precedence.
- N. Do not perform a special start. Perform a cold start or warm start as indicated by the coldstart

parameter.
Default is N.
Note: In the config, cs, and license parameters, provide the full path only if the file does not reside in the
PowerExchange installation directory. Include quotes around any path and file name that contains
spaces.
SVC NODE Port Number
Specifies the port on which the Logger Service connects to the PowerExchange Logger.
Use the same port number that is in the SVCNODE statement of the DBMOVER file.

Logger Service Management

Use the Properties tab in the Administrator tool to configure general or configuration properties for the Logger
Service.

Configuring Logger Service General Properties

Use the Properties tab in the Administrator tool to configure Logger Service general properties.
1.

In the Navigator, select the PowerExchange Logger Service.

The PowerExchange Logger Service properties window appears.

2.

In the General Properties area of the Properties tab, click Edit.

The Edit PowerExchange Logger Service dialog box appears.

Logger Service Management

323

3.

Edit the general properties of the service.

4.

Click OK.

Configuring Logger Service Configuration Properties

Use the Properties tab in the Administrator tool to configure Logger Service configuration properties.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the PowerExchange Logger Service.

The PowerExchange Logger Service properties window appears.

3.

In the Configuration Properties area of the Properties tab, click Edit.

The Edit PowerExchange Logger Service dialog box appears.

4.

Edit the configuration properties for the service.

Configuring the Logger Service Process Properties

Use the Processes tab in the Administrator tool to configure the environment variables for each service
process.

Environment Variables for the Logger Service Process

You can edit environment variables for a Logger Service process.
The following table describes the environment variables for the Logger Service process:
Property

Description

Environment Variables

Environment variables defined for the Logger Service process.

Enabling, Disabling, and Restarting the Logger

Service
You can enable, disable, or restart a PowerExchange Logger Service by using the Administrator tool. You
can disable a PowerExchange service if you need to temporarily restrict users from using the service. You
might restart a service if you modified a property.

Enabling the Logger Service

To enable the Logger Service, select the service in the Navigator and click Enable the Service.

Disabling the Logger Service

If you need to temporarily restrict users from using the Logger Service, you can disable it.
1.

324

Select the service in the Domain Navigator, and click Disable the Service.

Chapter 16: PowerExchange Logger Service

2.

3.

Select one of the following options:

Complete. Initiates a controlled shutdown of all processes and shuts down the service. Corresponds
to the PowerExchange SHUTDOWN command.

Abort. Stops all processes immediately and shuts down the service.

Click OK.

Restarting the Logger Service

You can restart a Logger Service that you previously disabled.
To restart the Logger Service, select the service in the Navigator and click Restart.

Logger Service Logs

The Logger Service generates operational and error log events that the Log Manager in the domain collects.
To view Logger Service logs, perform one of the following actions in the Administrator tool:

In the Logs tab, select the Domain view. You can filter on any of the columns.

In the Logs tab, click the Service view. In the Service Type column, select PowerExchange Logger
Service. In the Service Name list, optionally select the name of the service.

On the Manage tab, click the Domain view. Click the Logger Service Actions menu, and then select
View Logs.

Messages appear by default in time stamp order, with the most recent messages on top.

Logger Service Restart and Failover

If you have the PowerCenter high availability option, the Logger Service provides restart and failover
capabilities.
If the Logger Service or the Logger Service process fails on the primary node, the Service Manager restarts
the service on the primary node.
If the primary node fails, the Logger Service fails over to the backup node, if one is defined. After failover, the
Service Manager synchronizes and connects to the Logger Service process on the backup node.
For the Logger Service to fail over successfully, the Logger Service process on the backup node must be
able to connect to the data source. Include the same statements in the DBMOVER and PowerExchange
Logger configuration files on each node.

Logger Service Logs

325

CHAPTER 17

Reporting Service
This chapter includes the following topics:

Reporting Service Overview, 326

Creating the Reporting Service, 328

Managing the Reporting Service, 330

Configuring the Reporting Service, 334

Granting Users Access to Reports, 337

Reporting Service Overview

The Reporting Service is an application service that runs the Data Analyzer application in an Informatica
domain. Create and enable a Reporting Service on the Manage tab of the Administrator tool.
When you create a Reporting Service, choose the data source to report against:

PowerCenter repository. Choose the associated PowerCenter Repository Service and specify the
PowerCenter repository details to run PowerCenter Repository Reports.

Metadata Manager warehouse. Choose the associated Metadata Manager Service and specify the
Metadata Manager warehouse details to run Metadata Manager Reports.

Data Profiling warehouse. Choose the Data Profiling option and specify the data profiling warehouse
details to run Data Profiling Reports.

Other reporting sources. Choose the Other Reporting Sources option and specify the data warehouse
details to run custom reports.

Data Analyzer stores metadata for schemas, metrics and attributes, queries, reports, user profiles, and other
objects in the Data Analyzer repository. When you create a Reporting Service, specify the Data Analyzer
repository details. The Reporting Service configures the Data Analyzer repository with the metadata
corresponding to the selected data source.
You can create multiple Reporting Services on the same node. Specify a data source for each Reporting
Service. To use multiple data sources with a single Reporting Service, create additional data sources in Data
Analyzer. After you create the data sources, follow the instructions in the Data Analyzer Schema Designer
Guide to import table definitions and create metrics and attributes for the reports.
When you enable the Reporting Service, the Administrator tool starts Data Analyzer. Click the URL in the
Properties view to access Data Analyzer.
The name of the Reporting Service is the name of the Data Analyzer instance and the context path for the
Data Analyzer URL. The Data Analyzer context path can include only alphanumeric characters, hyphens (-),

326

and underscores (_). If the name of the Reporting Service includes any other character, PowerCenter
replaces the invalid characters with an underscore and the Unicode value of the character. For example, if
the name of the Reporting Service is ReportingService#3, the context path of the Data Analyzer URL is the
Reporting Service name with the # character replaced with _35. For example:
http://<HostName>:<PortNumber>/ReportingService_353

PowerCenter Repository Reports

When you choose the PowerCenter repository as a data source, you can run the PowerCenter Repository
Reports from Data Analyzer.
PowerCenter Repository Reports are prepackaged dashboards and reports that allow you to analyze the
following types of PowerCenter repository metadata:

Source and target metadata. Includes shortcuts, descriptions, and corresponding database names and
field-level attributes.

Transformation metadata in mappings and mapplets. Includes port-level details for each transformation.

Mapping and mapplet metadata. Includes the targets, transformations, and dependencies for each
mapping.

Workflow and worklet metadata. Includes schedules, instances, events, and variables.

Session metadata. Includes session execution details and metadata extensions defined for each session.

Change management metadata. Includes versions of sources, targets, labels, and label properties.

Operational metadata. Includes run-time statistics.

Metadata Manager Repository Reports

When you choose the Metadata Manager warehouse as a data source, you can run the Metadata Manager
Repository Reports from Data Analyzer.
Metadata Manager is the PowerCenter metadata management and analysis tool.
You can create a single Reporting Service for a Metadata Manager warehouse.

Data Profiling Reports

When you choose the Data Profiling warehouse as a data source, you can run the Data Profiling reports from
Data Analyzer.
Use the Data Profiling dashboard to access the Data Profiling reports. Data Analyzer provides the following
types of reports:

Composite reports. Display a set of sub-reports and the associated metadata. The sub-reports can be
multiple report types in Data Analyzer.

Metadata reports. Display basic metadata about a data profile. The Metadata reports provide the sourcelevel and column-level functions in a data profile, and historic statistics on previous runs of the same data
profile.

Summary reports. Display data profile results for source-level and column-level functions in a data profile.

Other Reporting Sources

When you choose other warehouses as data sources, you can run other reports from Data Analyzer. Create
the reports in Data Analyzer and save them in the Data Analyzer repository.

Reporting Service Overview

327

Data Analyzer Repository

When you run reports for any data source, Data Analyzer uses the metadata in the Data Analyzer repository
to determine the location from which to retrieve the data for the report and how to present the report.
Use the database management system client to create the Data Analyzer repository database. When you
create the Reporting Service, specify the database details and select the application service or data
warehouse for which you want to run the reports. When you enable the Reporting Service, PowerCenter
imports the metadata for schemas, metrics and attributes, queries, reports, user profiles, and other objects to
the repository tables.
Note: If you create a Reporting Service for another reporting source, you need to create or import the
metadata for the data source manually.

Creating the Reporting Service

Before you create a Reporting Service, complete the following tasks:

Create the Data Analyzer repository. Create a database for the Data Analyzer repository. If you create a
Reporting Service for an existing Data Analyzer repository, you can use the existing database. When you
enable a Reporting Service that uses an existing Data Analyzer repository, PowerCenter does not import
the metadata for the prepackaged reports.

Create PowerCenter Repository Services and Metadata Manager Services. To create a Reporting Service
for the PowerCenter Repository Service or Metadata Manager Service, create the application service in
the domain.

1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, click Actions > New Reporting Service.

The New Reporting Service dialog box appears.

3.

Enter the general properties for the Reporting Service.

The following table describes the Reporting Service general properties:
Property

Description

Name

Name of the Reporting Service. The name is not case sensitive and must be unique
within the domain. It cannot exceed 128 characters or begin with @. It also cannot
contain spaces or the following special characters:
`~%^*+={}\;:'"/?.,<>|!()][

328

Description

Description of the Reporting Service. The description cannot exceed 765 characters.

Location

Domain and folder where the service is created. Click Browse to choose a different
folder. You can move the Reporting Service after you create it.

License

License that allows the use of the service. Select from the list of licenses available in the
domain.

Primary Node

Node on which the service process runs. Since the Reporting Service is not highly
available, it can run on one node.

Chapter 17: Reporting Service

Property

Description

Enable HTTP
on port

The TCP port that the Reporting Service uses. Enter a value between 1 and 65535.

Enable HTTPS
on port

The SSL port that the Reporting Service uses for secure connections. You can edit the
value if you have configured the HTTPS port for the node where you create the Reporting
Service. Enter a value between 1 and 65535 and ensure that it is not the same as the
HTTP port. If the node where you create the Reporting Service is not configured for the
HTTPS port, you cannot configure HTTPS for the Reporting Service.

Default value is 16080.

Default value is 16443.

Advanced Data
Source Mode

Edit mode that determines where you can edit Datasource properties.
When enabled, the edit mode is advanced, and the value is true. In advanced edit mode,
you can edit Datasource and Dataconnector properties in the Administrator tool and the
Data Analyzer instance.
When disabled, the edit mode is basic, and the value is false. In basic edit mode, you can
edit Datasource properties in the Administrator tool.
Note: After you enable the Reporting Service in advanced edit mode, you cannot change
it back to basic edit mode.

4.

Click Next.

5.

Enter the repository properties.

The following table describes the repository properties:
Property

Description

Database Type

The type of database that contains the Data Analyzer repository.

Repository Host

The name of the machine that hosts the database server.

Repository Port

The port number on which you configure the database server listener service.

Repository Name

The name of the database server.

SID/Service Name

For database type Oracle only. Indicates whether to use the SID or service name
in the JDBC connection string. For Oracle RAC databases, select from Oracle
SID or Oracle Service Name. For other Oracle databases, select Oracle SID.

Repository Username

Account for the Data Analyzer repository database. Set up this account from the
appropriate database client tools.

Repository Password

Repository database password corresponding to the database user.

Tablespace Name

Tablespace name for DB2 repositories. When you specify the tablespace name,
the Reporting Service creates all repository tables in the same tablespace.
Required if you choose DB2 as the Database Type.
Note: Data Analyzer does not support DB2 partitioned tablespaces for the
repository.

Additional JDBC
Parameters
6.

Enter additional JDBC options.

Click Next.

Creating the Reporting Service

329

7.

Enter the data source properties.

The following table describes the data source properties:
Property

Description

Reporting Source

Source of data for the reports. Choose from one of the following options:
- Data Profiling
- PowerCenter Repository Services
- Metadata Manager Services
- Other Reporting Sources

Data Source
Driver

The database driver to connect to the data source.

Data Source
JDBC URL

Displays the JDBC URL based on the database driver you select. For example, if you
select the Oracle driver as your data source driver, the data source JDBC URL
displays the following: jdbc:informatica:oracle://[host]:1521;SID=[sid];.
Enter the database host name and the database service name.
For an Oracle data source driver, specify the SID or service name of the Oracle
instance to which you want to connect. To indicate the service name, modify the JDBC
URL to use the ServiceName parameter:
jdbc:informatica:oracle://[host]:1521;ServiceName=[Service Name];
To configure Oracle RAC as a data source, specify the following URL:
jdbc:informatica:oracle://[hostname]:1521;ServiceName=[Service Name];
AlternateServers=(server2:1521);LoadBalancing=true

8.

Data Source User

Name

User name for the data source database.

Data Source
Password

Password corresponding to the data source user name.

Data Source Test

Table

Displays the table name used to test the connection to the data source. The table
name depends on the data source driver you select.

Enter the PowerCenter repository user name, the Metadata Manager repository user
name, or the data warehouse user name based on the service you want to report on.

Click Finish.

Managing the Reporting Service

Use the Administrator tool to manage the Reporting Service and the Data Analyzer repository content.
You can use the Administrator tool to complete the following tasks:

330

Configure the edit mode.

Enable and disable a Reporting Service.

Create contents in the repository.

Back up contents of the repository.

Restore contents to the repository.

Chapter 17: Reporting Service

Delete contents from the repository.

Upgrade contents of the repository.

View last activity logs.

Note: You must disable the Reporting Service in the Administrator tool to perform tasks related to repository
content.

Configuring the Edit Mode

To configure the edit mode for Datasource, set the Data Source Advanced Mode to false for basic mode or to
true for advanced mode.
The following table describes the properties of basic and advanced mode in the Data Analyzer instance:
Component

Function

Basic Mode

Advanced Mode

Datasource

Edit the Administrator tool

configured properties

No

Yes

Datasource

Enable/disable

Yes

Yes

Dataconnector

Activate/deactivate

Yes

Yes

Dataconnector

Edit user/group assignment

No

Yes

Dataconnector

Edit Primary Data Source

No

Yes

Dataconnector

Edit Primary Time Dimension

Yes

Yes

Dataconnector

Add Schema Mappings

No

Yes

Basic Mode
When you configure the Data Source Advanced Mode to be false for basic mode, you can manage
Datasource in the Administrator tool. Datasource and Dataconnector properties are read-only in the Data
Analyzer instance. You can edit the Primary Time Dimension Property of the data source. By default, the edit
mode is basic.

Advanced Mode
When you configure the Data Source Advanced Mode to be true for advanced mode, you can manage
Datasource and Dataconnector in the Administrator tool and the Data Analyzer instance. You cannot return to
the basic edit mode after you select the advanced edit mode. Dataconnector has a primary data source that
can be configured to JDBC, Web Service, or XML data source types.

Enabling and Disabling a Reporting Service

Use the Administrator tool to enable, disable, or recycle the Reporting Service. Disable a Reporting Service
to perform maintenance or to temporarily restrict users from accessing Data Analyzer. When you disable the
Reporting Service, you also stop Data Analyzer. You might recycle a service if you modified a property. When
you recycle the service, the Reporting Service is disabled and enabled.

Managing the Reporting Service

331

When you enable a Reporting Service, the Administrator tool starts Data Analyzer on the node designated to
run the service. Click the URL in the Properties view to open Data Analyzer in a browser window and run the
reports.
You can also launch Data Analyzer from the PowerCenter Client tools, from Metadata Manager, or by
accessing the Data Analyzer URL from a browser.
To enable the service, select the service in the Navigator and click Actions > Enable.
To disable the service, select the service in the Navigator and click Actions > Disable.
Note: Before you disable a Reporting Service, ensure that all users are disconnected from Data Analyzer.
To recycle the service, select the service in the Navigator and click Actions > Recycle.

Creating Contents in the Data Analyzer Repository

You can create content for the Data Analyzer repository after you create the Reporting Service. You cannot
create content for a repository that already includes content. In addition, you cannot enable a Reporting
Service that manages a repository without content.
The database account you use to connect to the database must have the privileges to create and drop tables
and indexes and to select, insert, update, or delete data from the tables.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the Reporting Service that manages the repository for which you want to
create content.

3.

Click Actions > Repository Contents > Create.

4.

Select the user assigned the Administrator role for the domain.

5.

Click OK.
The activity log indicates the status of the content creation action.

6.

Enable the Reporting Service after you create the repository content.

Backing Up Contents of the Data Analyzer Repository

To prevent data loss due to hardware or software problems, back up the contents of the Data Analyzer
repository.
When you back up a repository, the Reporting Service saves the repository to a binary file, including the
repository objects, connection information, and code page information. If you need to recover the repository,
you can restore the content of the repository from the backup file.
When you back up the Data Analyzer repository, the Reporting Service stores the file in the backup location
specified for the node where the service runs. You specify the backup location when you set up the node.
View the general properties of the node to determine the path of the backup directory.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the Reporting Service that manages the repository content you want to
back up.

3.

Click Actions > Repository Contents > Back Up.

4.

Enter a file name for the repository backup file.

The backup operation copies the backup file to the following location:
<node_backup_directory>/da_backups/

332

Chapter 17: Reporting Service

Or you can enter a full directory path with the backup file name to copy the backup file to a different
location.
5.

To overwrite an existing file, select Replace Existing File.

6.

Click OK.
The activity log indicates the results of the backup action.

Restoring Contents to the Data Analyzer Repository

You can restore metadata from a repository backup file. You can restore a backup file to an empty database
or an existing database. If you restore the backup file on an existing database, the restore operation
overwrites the existing contents.
The database account you use to connect to the database must have the privileges to create and drop tables
and indexes and to select, insert, update, or delete data from the tables.
To restore contents to the Data Analyzer repository:
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the Reporting Service that manages the repository content you want to
restore.

3.

Click Actions > Repository Contents > Restore.

4.

Select a repository backup file, or select other and provide the full path to the backup file.

5.

Click OK.
The activity log indicates the status of the restore operation.

Deleting Contents from the Data Analyzer Repository

Delete repository content when you want to delete all metadata and repository database tables from the
repository.
You can delete the repository content if the metadata is obsolete. Deleting repository content is an
irreversible action. If the repository contains information that you might need later, back up the repository
before you delete it.
To delete the contents of the Data Analyzer repository:
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the Reporting Service that manages the repository content you want to
delete.

3.

Click Actions > Repository Contents > Delete.

4.

Verify that you backed up the repository before you delete the contents.

5.

Click OK.
The activity log indicates the status of the delete operation.

Upgrading Contents of the Data Analyzer Repository

When you create a Reporting Service, you can specify the details of an existing version of the Data Analyzer
repository. You need to upgrade the contents of the repository to ensure that the repository contains the
objects and metadata of the latest version.

Managing the Reporting Service

333

Viewing Last Activity Logs

You can view the status of the activities that you perform on the Data Analyzer repository contents. The
activity logs contain the status of the last activity that you performed on the Data Analyzer repository.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the Reporting Service for which you want to view the last activity log.

3.

Click Actions > Last Activity Log.

The Last Activity Log displays the activity status.

Configuring the Reporting Service

After you create a Reporting Service, you can configure it. Use the Administrator tool to view or edit the
following Reporting Service properties:

General Properties. Include the Data Analyzer license key used and the name of the node where the
service runs.

Reporting Service Properties. Include the TCP port where the Reporting Service runs, the SSL port if you
have specified it, and the Data Source edit mode.

Data Source Properties. Include the data source driver, the JDBC URL, and the data source database
user account and password.

Repository Properties. Include the Data Analyzer repository database user account and password.

To view and update properties, select the Reporting Service in the Navigator. In the Properties view, click
Edit in the properties section that you want to edit. If you update any of the properties, restart the Reporting
Service for the modifications to take effect.

General Properties
You can view and edit the general properties after you create the Reporting Service.
Click Edit in the General Properties section to edit the general properties.
The following table describes the general properties for the service:
Property

Description

Name

Name of the service. The name is not case sensitive and must be unique within the domain. It
cannot exceed 128 characters or begin with @. It also cannot contain spaces or the following
special characters:
`~%^*+={}\;:'"/?.,<>|!()][
You cannot change the name of the service after you create it.

Description

334

Description of the service. The description cannot exceed 765 characters.

Chapter 17: Reporting Service

Property

Description

License

License object that allows use of the service. To apply changes, restart the Reporting Service.

Node

Node on which the service runs. You can move a Reporting Service to another node in the
domain. Informatica disables the Reporting Service on the original node and enables it in the
new node. You can see the Reporting Service on both the nodes, but it runs only on the new
node.
If you move the Reporting Service to another node, you must reapply the custom color
schemes to the Reporting Service. Informatica does not copy the color schemes to the
Reporting Service on the new node, but retains them on the original node.

Reporting Service Properties

You can view and edit the Reporting Service properties after you create the Reporting Service.
Click Edit in the Reporting Service Properties section to edit the properties.
The following table describes the Reporting Service properties:
Property

Description

HTTP Port

The TCP port that the Reporting Service uses. You can change this value. To apply changes,
restart the Reporting Service.

HTTPS Port

The SSL port that the Reporting Service uses for secure connections. You can edit the value if
you have configured the HTTPS port for the node where you create the Reporting Service. If
the node where you create the Reporting Service is not configured for the HTTPS port, you
cannot configure HTTPS for the Reporting Service. To apply changes, restart the Reporting
Service.

Data Source
Advanced
Mode

Edit mode that determines where you can edit Datasource properties.
When enabled, the edit mode is advanced, and the value is true. In advanced edit mode, you
can edit Datasource and Dataconnector properties in the Data Analyzer instance.
When disabled, the edit mode is basic, and the value is false. In basic edit mode, you can edit
Datasource properties in the Administrator tool.
Note: After you enable the Reporting Service in advanced edit mode, you cannot change it
back to basic edit mode.

Note: If multiple Reporting Services run on the same node, you need to stop all the Reporting Services on
that node to update the port configuration.

Data Source Properties

You must specify a reporting source for the Reporting Service. The Reporting Service creates the following
objects in Data Analyzer for the reporting source:

A data source with the name Datasource

A data connector with the name Dataconnector

Use the Administrator tool to manage the data source and data connector for the reporting source. To view or
edit the Datasource or Dataconnector in the advanced mode, click the data source or data connector link in
the Administrator tool.

Configuring the Reporting Service

335

You can create multiple data sources in Data Analyzer. You manage the data sources you create in Data
Analyzer within Data Analyzer. Changes you make to data sources created in Data Analyzer will not be lost
when you restart the Reporting Service.
The following table describes the data source properties that you can edit:
Property

Description

Reporting Source

The service which the Reporting Service uses as the data source.

Data Source Driver

The driver that the Reporting Service uses to connect to the data source.
Note: The Reporting Service uses the DataDirect drivers included with the
Informatica installation. Informatica does not support the use of any other
database driver.

Data Source JDBC URL

The JDBC connect string that the Reporting Service uses to connect to the data
source.

Data Source User Name

The account for the data source database.

Data Source Password

Password corresponding to the data source user.

Data Source Test Table

The test table that the Reporting Service uses to verify the connection to the data
source.

Code Page Override

By default, when you create a Reporting Service to run reports against a PowerCenter repository or Metadata
Manager warehouse, the Service Manager adds the CODEPAGEOVERRIDE parameter to the JDBC URL.
The Service Manager sets the parameter to a code page that the Reporting Service uses to read data in the
PowerCenter repository or Metadata Manager warehouse.
If you use a PowerCenter repository or Metadata Manager warehouse as a reporting data source and the
reports do not display correctly, verify that the code page set in the JDBC URL for the Reporting Service
matches the code page for the PowerCenter Service or Metadata Manager Service.

Repository Properties
Repository properties provide information about the database that stores the Data Analyzer repository
metadata. Specify the database properties when you create the Reporting Service. After you create a
Reporting Service, you can modify some of these properties.
Note: If you edit a repository property or restart the system that hosts the repository database, you need to
restart the Reporting Service.
Click Edit in the Repository Properties section to edit the properties.
The following table describes the repository properties that you can edit:

336

Property

Description

Database Driver

The JDBC driver that the Reporting Service uses to connect to the Data Analyzer repository
database. To apply changes, restart the Reporting Service.

Repository Host

Name of the machine that hosts the database server. To apply changes, restart the
Reporting Service.

Chapter 17: Reporting Service

Property

Description

Repository Port

The port number on which you have configured the database server listener service. To
apply changes, restart the Reporting Service.

Repository Name

The name of the database service. To apply changes, restart the Reporting Service.

SID/Service Name

For repository type Oracle only. Indicates whether to use the SID or service name in the
JDBC connection string. For Oracle RAC databases, select from Oracle SID or Oracle
Service Name. For other Oracle databases, select Oracle SID.

Repository User

Account for the Data Analyzer repository database. To apply changes, restart the Reporting
Service.

Repository
Password

Data Analyzer repository database password corresponding to the database user. To apply
changes, restart the Reporting Service.

Tablespace Name

Tablespace name for DB2 repositories. When you specify the tablespace name, the
Reporting Service creates all repository tables in the same tablespace. To apply changes,
restart the Reporting Service.

Additional JDBC
Parameters

Enter additional JDBC options.

Granting Users Access to Reports

Limit access to Data Analyzer to secure information in the Data Analyzer repository and data sources. To
access Data Analyzer, each user needs an account to perform tasks and access data. Users can perform
tasks based on their privileges.
You can grant access to users through the following components:

User accounts. Create users in the Informatica domain. Use the Security tab of the Administrator tool to
create users.

Privileges and roles. You assign privileges and roles to users and groups for a Reporting Service. Use the
Security tab of the Administrator tool to assign privileges and roles to a user.

Permissions. You assign Data Analyzer permissions in Data Analyzer.

Granting Users Access to Reports

337

CHAPTER 18

Reporting and Dashboards

Service
This chapter includes the following topics:

Reporting and Dashboards Service Overview, 338

Users and Privileges, 339

Configuration Prerequisites, 339

Reporting and Dashboards Service Properties, 339

Creating a Reporting and Dashboards Service, 342

Upgrading Jaspersoft Repository Contents from 9.1.0 HotFix 3 or Later, 343

Reports, 343

Enabling and Disabling the Reporting and Dashboards Service, 345

Editing a Reporting and Dashboards Service, 345

Reporting and Dashboards Service Overview

The Reporting and Dashboards Service is an application service that runs the JasperReports application in
an Informatica domain.
Create and enable the Reporting and Dashboards Service on the Manage tab of the Administrator tool. You
can use the service to run reports from the JasperReports application. You can also run the reports from the
PowerCenter Client and Metadata Manager to view them in JasperReports Server.
After you create a Reporting and Dashboards Service, add a reporting source to run reports against the data
in the data source.
After you enable the Reporting and Dashboards Service, click the service URL in the Properties view to view
reports in JasperReports Server.

JasperReports Overview
JasperReports is an open source reporting library that users can embed into any Java application.
Jaspersoft iReports Designer is an application that you can use with JasperReports Server to design reports.
You can run Jaspersoft iReports Designer from the shortcut menu after you install the PowerCenter Client.

338

Informatica does not support creating custom reports or modifying reports that Informatica provides in
Jaspersoft iReports Designer. For more information about the Jaspersoft iReports Designer, visit the
Jaspersoft community.

Users and Privileges

To access Jaspersoft, users need the appropriate privileges. Jaspersoft user details are available in the
Jaspersoft repository database.
You can assign the Administrator privilege, Superuser privilege, or Normal User privilege to users in
Informatica domain. These privileges map to the ROLE_ADMINISTRATOR, ROLE_SUPERUSER, and
ROLE_USER roles in Jaspersoft.
The first time you enable the Reporting and Dashboards Service, all users in the Informatica domain are
added to the Jaspersoft repository. Subsequent users that you add to the domain are mapped to the
ROLE_USER role in Jaspersoft and then added to the Jaspersoft repository. Privileges you assign to the
users are updated in the Jaspersoft repository after you restart the Reporting and Dashboards Service.
Note: Users who belong to different security domains in the Informatica domain can have the same name.
However, these different users are treated as a single user and there is one entry for the user in the
Jaspersoft repository.

Configuration Prerequisites
Before you configure the Reporting and Dashboards Service, you must configure the Jaspersoft repository
based on your environment.
The repository database type can be IBM DB2, Microsoft SQL Server, or Oracle.

Reporting and Dashboards Service Properties

Specify the general properties when you create or edit the Reporting and Dashboards Service. Specify the
general and advanced properties when you edit the service.
If you update any of the properties, restart the Reporting and Dashboards Service for the modifications to
take effect.

Users and Privileges

339

Reporting and Dashboards Service General Properties

Specify the general properties when you create or edit the Reporting and Dashboards Service.
The following table describes the general properties for the service:
Property

Description

Name

Name of the service. The name is not case sensitive and must be unique within the
domain. It cannot exceed 128 characters or begin with @. It also cannot contain
spaces or the following special characters:
`~%^*+={}\;:'"/?.,<>|!()][
You cannot change the name of the service after you create it.

Description

Description of the service. The description cannot exceed 765 characters.

Location

Domain and folder where the service is created. Click Browse to choose a different
folder. You can move the service after you create it.

License

License object that allows use of the service. To apply changes, restart the
Reporting and Dashboards Service.

Node

Node on which the service runs.

Reporting and Dashboards Service Security Properties

You can enable the Transport Layer Security (TLS) protocol to provide secure communication with the
Reporting and Dashboards Service. When you create or edit the Reporting and Dashboards Service, you can
configure the security properties for the service.
The following table describes the security properties that you configure for the Reporting and Dashboards
Service:
Property

Description

HTTP Port

Unique HTTP port number for the Reporting and Dashboards Service.

HTTPS Port

HTTPS port number for the Reporting and Dashboards Service when you enable the TLS
protocol. Use a different port number than the HTTP port number.

Keystore File

Path and file name of the keystore file that contains the private or public key pairs and
associated certificates. Required if you enable TLS and use HTTPS connections for the
Reporting and Dashboards Service.
You can create a keystore file with keytool. keytool is a utility that generates and stores private
or public key pairs and associated certificates in a keystore file. When you generate a public or
private key pair, keytool wraps the public key into a self-signed certificate. You can use the selfsigned certificate or use a certificate signed by a certificate authority.

Keystore
Password

340

Plain-text password for the keystore file.

Chapter 18: Reporting and Dashboards Service

Reporting and Dashboards Service Database Properties

Configure the database type and connection information in the database properties for the Reporting and
Dashboards Service.
The following table describes the database properties for the Reporting and Dashboards Service:
Property

Description

Database Type

Database type for the Jaspersoft repository database. Select one of the following values
based on the database type:
- oracle
- db2
- sqlserver

Database User Name

Database user name for the Jaspersoft repository database.

Database Password

Password for the Jaspersoft repository database.

Connection String

The connection string used to access data from the database.

- IBM DB2. jdbc:db2://<hostname>:<port>/

<databaseName>:driverType=4;fullyMaterializeLobData=true;ful
lyMaterializeInputStreams=true;progressiveStreaming=2;progre
sssiveLocators=2;currentSchema=<databaseName>;
- Microsoft SQL Server. jdbc:sqlserver://
<hostname>:<port>;databaseName=<databaseName>;SelectMethod=c
ursor
Note: When you use instance name for Microsoft SQL Server, use the following connection
string: jdbc:sqlserver://

<hostname>;instanceName=<dbInstance>;databaseName=<databaseN
ame>;SelectMethod=cursor
- Oracle. jdbc:oracle:thin:@<hostname>:<port>:<SID>
Note: When you use a service name for Oracle, use the following connection string:

jdbc:oracle:thin:@<hostname>:<port>/<ServiceName>

Reporting and Dashboards Service Properties

341

Reporting and Dashboards Service Advanced Properties

When you edit the Reporting and Dashboards Service, you can update the advanced properties for the
service.
The following table describes the advanced properties for the Reporting and Dashboards Service:
Property

Description

Maximum Heap
Size

Amount of RAM allocated to the Java Virtual Machine (JVM) that runs the Service. Use this
property to increase the performance. Append one of the following letters to the value to
specify the units:
-

b for bytes
k for kilobytes
m for megabytes
g for gigabytes

Default is 512 megabytes.

JVM Command
Line Options

Java Virtual Machine (JVM) command line options to run Java-based programs. When you
configure the JVM options, you must set the Java SDK classpath, Java SDK minimum
memory, and Java SDK maximum memory properties.

Environment Variables for the Reporting and Dashboards Service

You can configure the environment variables for the Reporting and Dashboards Service.
The following table describes the properties that you specify to define the environment variables for the
Reporting and Dashboards Service:
Property

Description

Name

Name of the environment variable.

Value

Value of the environment variable.

Creating a Reporting and Dashboards Service

Use the Administrator tool to create and enable the Reporting and Dashboards Service. Reporting and
Dashboards Service creates PowerCenter reports and Metadata Manager reports using the Jaspersoft
application.

342

1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

Click Actions > New > Reporting and Dashboards Service.

3.

Specify the general properties of the Reporting and Dashboards Service, and click Next.

4.

Specify the security properties for the Reporting and Dashboards Service, and click Next.

5.

Specify the database properties for the Reporting and Dashboards Service.

6.

Click Test Connection to verify that the database connection configuration is correct.

7.

Choose to use existing content or create new content.

Chapter 18: Reporting and Dashboards Service

To use existing content, select Do Not Create New Content.You can create the Reporting and
Dashboard Service with the repository content that exists in the database. Select this option if the
specified database already contains Jasper repository content. This is the default.

To create new content, select Create New Content.You can create Jasper repository content if no
content exists in the database. Select this option to create Jasper repository content in the specified
database.

When you create repository content, the Informatica service platform creates database schema that the
Reporting and Dashboards Service needs. If the specified database already contains the database
schema of an existing Reporting and Dashboards Service, you can use the database without creating
new content.
8.

Click Finish.

After you create a Reporting and Dashboards Service, you can edit the advanced properties for the service in
the Processes tab.

Upgrading Jaspersoft Repository Contents from 9.1.0

HotFix 3 or Later
When you upgrade from 9.1.0 HotFix 3 or later versions, you need to upgrade the Jaspersoft repository
contents for the Reporting and Dashboard Service.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the Reporting and Dashboard Service for the repository that you want to
upgrade.

3.

On the Manage tab Actions menu, click Repository Contents > Upgrade Jasper Repository
Contents.

The activity log displays the result of the operation.

Reports
You can run the PowerCenter and Metadata Manager reports from JasperReports Server. You can also run
the reports from the PowerCenter Client and Metadata Manager to view them in JasperReports Server.

Reporting Source
To run reports associated with a service, you must add a reporting source for the Reporting and Dashboards
Service.
When you add a reporting source, choose the data source to report against. To run the reports against the
PowerCenter repository, select the associated PowerCenter Repository Service and specify the PowerCenter
repository details. To run the Metadata Manager reports, select the associated Metadata Manager Service
and specify the repository details.
The database type of the reporting source can be IBM DB2, Oracle, Microsoft SQL Server, or Sybase ASE.
Based on the database type, specify the database driver, JDBC URL, and database user credentials. For the

Upgrading Jaspersoft Repository Contents from 9.1.0 HotFix 3 or Later

343

JDBC connect string, specify the host name and the port number. Additionally, specify the SID for Oracle and
specify the database name for IBM DB2, Microsoft SQL Server, and Sybase ASE.
For an instance of the Reporting and Dashboards Service, you can create multiple reporting data sources.
For example, to one Reporting and Dashboards Service, you can add a PowerCenter data source and a
Metadata Manager data source.

Adding a Reporting Source

You can choose the PowerCenter or Metadata Manager repository as data source to view the reports from
JasperReports Server.
1.

Select the Reporting and Dashboards Service in the Navigator and click Action > Add Reporting
Source.

2.

Select the PowerCenter Reporting Service or Metadata Manager Service that you want to use as the
data source.

3.

Specify the type of database of the data source.

4.

Specify the database driver that the Reporting and Dashboards Service uses to connect to the data
source.

5.

Specify the JDBC connect string based on the database driver you select.

6.

Specify the user name for the data source database.

7.

Specify the password corresponding to the data source user.

8.

Click Test Connection to validate the connection to the data source.

Running Reports
After you create a Reporting and Dashboards Service, add a reporting source to run reports against the data
in the data source.
All reports available for the specified reporting source are available in Jaspersoft Server. Click View >
Repository > Service Name to view the reports.

Exporting Jasper Resources

You can run the export Jasper resources command to export reports from the JasperSoft repository.
Verify that the default_master.properties file contains valid data.
1.

Navigate to the following directory: INFA_HOME\jasperreports-server\buildomatic

2.

Enter the following command to export the Jaspersoft repository resources:

js-ant export DexportArgs=--roles <role name> --roles-users <user name>
--uris /<Report_Folder_Name> --repository-permissions --report-jobs
--include-access-events -DdatabasePass=<password>
-DdatabaseUser=<username> -DexportFile=<File_Name>.zip

3.

Repeat the process for all the report folders that you want to export.

Importing Jasper Resources

You can run the import Jasper resources command to import reports from the JasperSoft repository.
Verify that the default_master.properties file contains valid data.
1.

344

Navigate to the following directory: INFA_HOME\jasperreports-server\buildomatic

Chapter 18: Reporting and Dashboards Service

2.

Enter the following command to import the Jaspersoft repository resources:

js-ant import -DdatabaseUser=<username> -DdatabasePass=<password>
-DimportFile=<File_Name>.zip

3.

Repeat the process for all the report folders that you want to export.

Connection to the Jaspersoft Repository from Jaspersoft iReport

Designer
You can connect to the Jaspersoft repository when you configure access to JasperReports Server from the
Repository Navigator in Jaspersoft iReports Designer.
Add a server and specify the JasperReports Server URL using the following format:
http(s)://<host name>:<port number>/ReportingandDashboardsService/services/repository
After you specify the database user credentials and save the details, you can use this server configuration to
connect to the Jaspersoft repository.
To run Jaspersoft iReport Designer, you must set the JAVA_HOME environment variable to the Java
installation directory. You can use the Java installation available with the Informatica client.
You can set the JAVA_HOME environment variable to the following location: <Informatica client
installation location>\clients\java)
Note: If you use a separate Java installation, ensure that you use Java 1.7.

Enabling and Disabling the Reporting and

Dashboards Service
You can enable, disable, or recycle the Reporting and Dashboards Service from the Actions menu.
When you enable the Reporting and Dashboards Service, the Service Manager starts the Jaspersoft
application on the node where the Reporting and Dashboards Service runs. After enabling the service, click
the service URL and the Jaspersoft Administrator screen appears.
Disable a Reporting and Dashboards Service to perform maintenance or to temporarily restrict users from
accessing Jaspersoft. You might recycle a service if you modified a property. When you recycle the service,
the Reporting and Dashboards Service is disabled and enabled.

Editing a Reporting and Dashboards Service

Use the Administrator tool to edit a Reporting and Dashboards Service.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

Select the service in the Domain Navigator and click Edit.

3.

Modify values for the Reporting and Dashboards Service general properties.
Note: You cannot enable the Reporting and Dashboards Service if you change the node.

4.

Click the Processes tab to edit the service process properties.

Enabling and Disabling the Reporting and Dashboards Service

345

5.

346

Click Edit to create repository contents or to modify the security properties, the database properties, the
advanced properties, and the environment variables.

Chapter 18: Reporting and Dashboards Service

CHAPTER 19

SAP BW Service
This chapter includes the following topics:

SAP BW Service Overview, 347

Creating the SAP BW Service, 348

Enabling and Disabling the SAP BW Service, 350

Configuring the SAP BW Service Properties, 351

Configuring the Associated Integration Service, 353

Configuring the SAP BW Service Processes, 353

Load Balancing for the SAP BW System and the SAP BW Service, 354

Viewing Log Events, 354

SAP BW Service Overview

Create an SAP BW Service when you want to read data from or write data to SAP BW. Use the Administrator
tool to create and manage the SAP BW Service.
The SAP BW Service is an application service that performs the following tasks:

Listens for RFC requests from SAP BW.

Initiates workflows to extract from or load to SAP BW.

Sends log events to the Log Manager.

Use the Administrator tool to complete the following SAP BW Service tasks:

Create the SAP BW Service.

Enable and disable the SAP BW Service.

Configure the SAP BW Service properties.

Configure the associated PowerCenter Integration Service or Data Integration Service.

Configure the SAP BW Service processes.

Configure permissions for the SAP BW Service.

View messages that the SAP BW Service sends to the Log Manager.

347

Creating the SAP BW Service

Create an SAP BW Service when you want to read data from or write data to SAP BW. Use the Administrator
tool to create the SAP BW Service.
1.

Log in to the Administrator tool.

2.

In the Domain Navigator, select the domain.

3.

Perform one of the following steps:

4.

To create an SAP BW Service for PowerCenter, click Actions > New > PowerCenter SAP BW
Service. The New PowerCenter SAP BW Service window appears.

To create an SAP BW Service for the Developer tool, click Actions > New > SAP BW Service. The
New SAP BW Service window appears.

Configure the SAP BW Service properties.

The following table describes the information that you must enter when you create an SAP BW Service
for PowerCenter:
Property

Description

Name

Name of the SAP BW Service.

The characters must be compatible with the code page of the associated repository.
The name is not case sensitive and must be unique within the domain. It cannot
exceed 128 characters or begin with @. It also cannot contain spaces or the following
special characters:
` ~ % ^ * + = { } \ ; : ' " / ? . , < > | ! ( ) ] [

Description

Description of the SAP BW Service.

The description cannot exceed 765 characters.

348

Location

Name of the domain and folder in which the Administrator tool must create the SAP
BW Service. By default, the Administrator tool creates the SAP BW Service in the
domain where you are connected. Click Browse to select a new folder in the domain.

License

License file.

Node

Node on which the SAP BW Service must run.

SAP Destination
R Type

DEST entry defined in the sapnwrfc.ini file to connect to the SAP BW Service.

Associated
Integration
Service

The PowerCenter Integration Service that you want to associate with the SAP BW
Service.

Repository User
Name

Account used to access the repository.

Chapter 19: SAP BW Service

Property

Description

Repository
Password

Password for the user.

Security Domain

Note: If secure communication is enabled for the domain, you do not need to specify
the repository password.
Security domain for the user. Appears when the Informatica domain contains an LDAP
security domain.

The following table describes the information that you must enter when you create an SAP BW Service
for the Developer tool:
Property

Description

Name

Name of the SAP BW Service.

The characters must be compatible with the code page of the associated repository.
The name is not case sensitive and must be unique within the domain. It cannot
exceed 128 characters or begin with @. It also cannot contain spaces or the following
special characters:
` ~ % ^ * + = { } \ ; : ' " / ? . , < > | ! ( ) ] [

Description

Description of the SAP BW Service.

The description cannot exceed 765 characters.

Location

Name of the domain and folder in which the Administrator tool must create the SAP
BW Service. By default, the Administrator tool creates the SAP BW Service in the
domain where you are connected. Click Browse to select a new folder in the domain.

License

License file.

Node

Node on which the SAP BW Service must run.

Program ID

Program ID for the logical system that you create in SAP BW for the SAP BW Service.
The Program ID in SAP BW must match this parameter, including case.

Gateway Host

Host name of the SAP gateway.

Gateway Server

Server name of the SAP gateway.

SAP Connection

SAP connection that you want to use.

Specify a connection to a specific SAP application server or an SAP load balancing
connection.

Trace

Use this option to track the JCo calls that the SAP system makes. SAP stores the
information about the JCo calls in a trace file.
Specify one of the following values:
- 0. Off
- 1. Full

Default is 0.
You can access the trace files from the following directory on the machine where you
installed the Informatica services:
<Informatica installation directory>/tomcat/bin

Creating the SAP BW Service

349

Property

Description

Other Connection
Parameters

Enter any other connection parameter that you want to use.

Associated Data
Integration
Service

The Data Integration Service that you want to associate with the SAP BW Service.

Repository User
Name

Account used to access the repository.

Repository
Password

5.

Use the following format:

<parameter name>=<value>

Password for the user.

Note: If secure communication is enabled for the domain, you do not need to specify
the repository password.

Click OK.
The SAP BW Service is created.

Enabling and Disabling the SAP BW Service

Use the Administrator tool to enable and disable the SAP BW Service. You might disable the SAP BW
Service if you need to perform maintenance on the machine where the SAP BW Service runs. Enable the
disabled SAP BW Service to make it available again.
Before you enable the SAP BW Service, you must define Informatica as a logical system in SAP BW.
When you enable the SAP BW Service, the service starts. If the service cannot start, the domain tries to
restart the service based on the restart options configured in the domain properties.
If the service is enabled but fails to start after reaching the maximum number of attempts, the following
message appears:
The SAP BW Service <service name> is enabled.
The service did not start. Please check the logs for more information.
You can review the logs to determine the reason for failure and fix the problem. After you fix the problem,
disable and re-enable the SAP BW Service to start it.
When you enable the SAP BW Service, it tries to connect to the associated Integration Service. If the
Integration Service is not enabled and the SAP BW Service cannot connect to it, the SAP BW Service still
starts successfully. When the SAP BW Service receives a request from SAP BW to start a PowerCenter or
Developer tool workflow, the service tries to connect to the associated Integration Service again. If it cannot
connect, the SAP BW Service returns the following message to the SAP BW system:
The SAP BW Service could not find Integration Service <service name> in domain <domain
name>.
To resolve this problem, verify that the Integration Service is enabled, and that the domain name and
Integration Service name that you entered under the third-party details of the InfoPackage are valid. Then,
restart the process chain in the SAP BW system.

350

Chapter 19: SAP BW Service

When you disable the SAP BW Service, select one of the following options:

Complete. Disables the SAP BW Service after all service processes complete.

Abort. Aborts all processes immediately and then disables the SAP BW Service. You might choose abort if
a service process stops responding.

Enabling the SAP BW Service

1.

In the Domain Navigator of the Administrator tool, select the SAP BW Service.

2.

Click Actions > Enable Service.

Disabling the SAP BW Service

1.

In the Domain Navigator of the Administrator tool, select the SAP BW Service.

2.

Click Actions > Disable Service.

The Disable SAP BW Service window appears.

3.

Select the disable mode and click OK.

Configuring the SAP BW Service Properties

Use the Properties tab in the Administrator tool to configure general properties for the SAP BW Service and
to configure the node on which the service runs.
1.

In the Domain Navigator, select the SAP BW Service.

The SAP BW Service Properties window appears.

2.

In the Properties tab, click Edit corresponding to the category of properties that you want to update.

3.

Update the property values and restart the SAP BW Service for the changes to take effect.

General Properties
The following table describes the general properties for the service:
Property

Description

Name

Name of the service. The name is not case sensitive and must be unique within the domain. It
cannot exceed 128 characters or begin with @. It also cannot contain spaces or the following
special characters:
`~%^*+={}\;:'"/?.,<>|!()][
You cannot change the name of the service after you create it.

Description

Description of the service.

License

License object that allows use of the service.

Node

Node on which the service runs.

Configuring the SAP BW Service Properties

351

SAP BW Service Properties

The following table describes the SAP BW Service properties for PowerCenter:
Property
SAP Destination
R Type

Retry Period

Description
DEST entry defined in the sapnwrfc.ini file for a connection to an RFC server program.
Edit this property if you have created a different DEST entry in the sapnwrfc.ini file for
the SAP BW Service.
Number of seconds the SAP BW Service waits before trying to connect to the SAP BW
system if a previous connection failed. The SAP BW Service tries to connect five times.
Between connection attempts, it waits the number of seconds you specify. After five
unsuccessful attempts, the SAP BW Service shuts down.
Default is 5 seconds.

The following table describes the SAP BW Service properties for the Developer tool:
Property

Description

Program ID

Program ID for the logical system you create in SAP BW for the SAP BW Service.
The Program ID in SAP BW must match this parameter, including case.

Gateway Host

Host name of the SAP gateway.

Gateway Server

Server name of the SAP gateway.

SAP Connection

SAP connection.
Specify a connection to a specific SAP application server or an SAP load balancing
connection.

Trace

Use this option to track the JCo calls that the SAP system makes. SAP stores the information
about the JCo calls in a trace file.
Specify one of the following values:
- 0. Off
- 1. Full

Default is 0.
You can access the trace files from the following directory on the machine where you
installed the Informatica services:
<Informatica installation directory>/tomcat/bin
Other
Connection
Parameters
Retry Period

Enter any other connection parameter that you want to use.

Use the following format:
<parameter name>=<value>
Number of seconds the SAP BW Service waits before trying to connect to the SAP BW
system if a previous connection failed. The SAP BW Service tries to connect five times.
Between connection attempts, it waits the number of seconds you specify. After five
unsuccessful attempts, the SAP BW Service shuts down.
Default is 5 seconds.

352

Chapter 19: SAP BW Service

Configuring the Associated Integration Service

Use the Administrator tool to configure the associated Integration Service and connection information for the
repository database. To read data from or write data to SAP BW, you must also configure a Workflow
Orchestration Service for the Integration Service that is associated with the SAP BW Service.
1.

Log in to the Administrator tool.

2.

In the Domain Navigator, select the SAP BW Service.

3.

Perform one of the following steps:

4.

To configure an SAP BW Service for PowerCenter, click Associated Integration Service.

To configure an SAP BW Service for the Developer tool, click Associated Data Integration Service.

Click Edit and edit the following properties:

Property

Description

Associated Integration
Service

Name of the PowerCenter Integration Service or the Data Integration Service to

which you want to associate the SAP BW Service.

or
Assoicated Data
Integration Service
Repository User Name

Account used to access the repository.

Repository Password

Password for the user.

Note: If secure communication is enabled for the domain, you need not specify
the repository password.

Security Domain

5.

Security domain for the user. Appears when the Informatica domain contains an
LDAP security domain.

Click OK to save the changes.

Configuring the SAP BW Service Processes

When you use PowerCenter to filter and load data to SAP BW, you can configure the temporary parameter
file directory that the SAP BW Service must use.
1.

Log in to the Administrator tool.

2.

In the Domain Navigator, select the SAP BW Service.

3.

Click Processes.

4.

Click Edit.

Configuring the Associated Integration Service

353

5.

Edit the following property:

Property

Description

ParamFileDir

Temporary parameter file directory. The SAP BW Service stores SAP BW data selection
entries in the parameter file when you filter data to load into SAP BW.
The directory must exist on the node where the SAP BW Service runs. Verify that the
directory you specify has read and write permissions enabled.
The default directory is <Informatica installation directory>/services/
shared/BWParam.

Load Balancing for the SAP BW System and the SAP

BW Service
You can configure the SAP BW system to use load balancing. To support an SAP BW system configured for
load balancing, the SAP BW Service records the host name and system number of the SAP BW server
requesting data from PowerCenter. The SAP BW Service passes this information to the PowerCenter
Integration Service. The PowerCenter Integration Service uses this information to load data to the same SAP
BW server that made the request. For more information about configuring the SAP BW system to use load
balancing, see the SAP documentation.
You can also configure the SAP BW Service in PowerCenter to use load balancing. When you create the
SAP BW Service, define an SAP load balancing connection. If the load on the SAP BW Service becomes too
high, you can create multiple instances of the SAP BW Service to balance the load. To run multiple SAP BW
Services configured for load balancing, create each service with a unique name but use the same values for
all other parameters. The services can run on the same node or on different nodes. The SAP BW server
distributes data to the multiple SAP BW Services in a round-robin fashion.

Viewing Log Events

The SAP BW Service sends log events to the Log Manager. The SAP BW Service captures log events that
track interactions between PowerCenter and SAP BW. You can view SAP BW Service log events in the
following locations:

Administrator tool. On the Logs tab, enter search criteria to find log events that the SAP BW Service
captures when extracting from or loading into SAP NetWeaver BI.

SAP BW Monitor. In the Monitor - Administrator Workbench window, you can view log events that the SAP
BW Service captures for an InfoPackage that is included in a process chain to load data into SAP BW.
SAP BW pulls the messages from the SAP BW Service and displays them in the monitor. The SAP BW
Service must be running to view the messages in the SAP BW Monitor.

To view log events about how the Integration Service processes an SAP BW workflow, view the session log
or workflow log.

354

Chapter 19: SAP BW Service

CHAPTER 20

Search Service
This chapter includes the following topics:

Search Service Overview, 355

Search Service Architecture, 356

Search Index, 357

Search Request Process, 358

Search Service Properties, 358

Search Service Process Properties, 360

Creating a Search Service, 361

Enabling the Search Service, 362

Recycling and Disabling the Search Service, 362

Search Service Overview

The Search Service manages search in the Analyst tool and Business Glossary Desktop. By default, the
Search Service returns search results from a Model repository, such as data objects, mapping specifications,
profiles, reference tables, rules, and scorecards.
The Search Service can also return additional results. The results can include related assets, business terms,
and policies. The results can include column profile results and domain discovery results from a profiling
warehouse. In addition, you can perform a search based on patterns, datatypes, unique values, or null
values.
You can associate each Search Service with one Model repository and one profiling warehouse. To perform
searches on multiple Model repositories or profiling warehouses, you must create multiple Search Services.
The Search Service performs each search on a search index instead of the Model repository or profiling
warehouse. To create the search index, the Search Service extracts information about content from the
Model repository and profiling warehouse. You can configure the interval at which the Search Service
extracts this information. To enable faster searches, the Search Service indexes all extracted content.

355

Search Service Architecture

The Search Service interacts with different components in the Informatica domain when it builds the search
index and returns search results. The Search Service can build a search index based on content in a Model
repository and a profiling warehouse.
The following diagram shows the Informatica domain components with which the Search Service interacts:

When you create the Search Service, you specify the associated Model Repository Service. The Search
Service determines the associated Data Integration Service based on the Model Repository Service.
To enable search across multiple repositories, the Search Service builds a search index based on content in
one Model repository and one profiling warehouse. To enable search on multiple Model repositories or
multiple profiling warehouses, create multiple Search Services.
The Search Service extracts content, including business glossary terms, from the Model repository
associated with the Model Repository Service. The Search Service extracts column profile results and
domain discovery results from the profiling warehouse associated with the Data Integration Service. The
Search Service also extracts permission information to ensure that the user who submits a search request
has permission to view each object returned in the search results. The Search Service stores the permission
information in a permission cache.
Users can perform a search in the Analyst tool or Business Glossary Desktop. When a user performs a
search in the Analyst tool, the Analyst Service submits the request to the Search Service. When a user
performs a search in Business Glossary Desktop, Business Glossary Desktop submits the request to the
Search Service. The Search Service returns results from the search index based on permissions in the
permission cache.

356

Chapter 20: Search Service

Search Index
The Search Service performs each search on a search index instead of the Model repository or profiling
warehouse. The search index enables faster searches and searches on content from the Model repository
and profiling warehouse.
The Search Service generates the search index based on content in the Model repository and profiling
warehouse. The Search Service contains extractors to extract content from each repository.
The Search Service contains the following extractors:
Model Repository extractor
Extracts content from a Model repository.
Business Glossary extractor
Extracts business glossary terms from the Model repository.
Profiling Warehouse extractor
Extracts column profiling results and domain discovery results from a profiling warehouse.
The Search Service indexes all content that it extracts. The Search Service maintains one search index for all
extracted content. If a search index does not exist when the Search Service starts, the Search Service
generates the search index.
During the initial extraction, the Search Service extracts and indexes all content. After the first extraction, the
Search Service updates the search index based on content that has been added to, changed in, or removed
from the Model repository and profiling warehouse since the previous extraction. You can configure the
interval at which the Search Service generates the search index.
The Search Service extracts and indexes batches of objects. If it fails to extract or index an object, it retries
again. After the third attempt, the Search Service ignores the object, writes an error message to the Search
Service log, and then processes the next object.
The Search Service stores the search index in files in the extraction directory that you specify when you
create the Search Service.

Extraction Interval
The Search Service extracts content based on the interval that you configure. You can configure the interval
when you create the Search Service or update the service properties.
The extraction interval is the number of seconds between each extraction.
The Search Service returns search results from the search index. The search results depend on the
extraction interval. For example, if you set the extraction interval to 360 seconds, a user may have to wait up
to 360 seconds before an object appears in the search results.

Search Index

357

Search Request Process

The Search Service processes search requests differently based on whether the request comes from the
Analyst tool or Business Glossary Desktop.
The following steps describe the search request process:
1.

A user enters search criteria in the Analyst tool or Business Glossary Desktop.

2.

For a search in the Analyst tool, the corresponding Analyst Service sends the search request to the
Search Service. For a search in Business Glossary Desktop, Business Glossary Desktop sends the
search request to the Search Service.

3.

The Search Service retrieves the search results from the search index based on the search criteria.

4.

The Search Service verifies permissions on each search result and returns objects on which the user
has read permission.

Note: The domain administrator must start the Search Service before the Search Service can return any
search results. If the Search Service is not running when a user performs a search, an error appears.

Search Service Properties

When you create a Search Service, you configure the Search Service properties. You can edit the Search
Service properties on the Properties tab in the Administrator tool.
You can configure the following types of Search Service properties:

General properties

Logging options

Search options

Custom properties

If you update any of the properties, recycle the Search Service for the modifications to take effect.

General Properties for the Search Service

General properties for the Search Service include the name and description of the Search Service, the node
on which the Search Service runs, and the license associated with the Search Service.
You can configure the following general properties for the service:
Name
Name of the service. The name is not case sensitive and must be unique within the domain. It cannot
exceed 128 characters or begin with @. It also cannot contain spaces or the following special
characters:
`~%^*+={}\;:'"/?.,<>|!()][
You cannot change the name of the service after you create it.
Description
Description of the service. The description cannot exceed 765 characters.

358

Chapter 20: Search Service

License
License object that allows use of the service.
Node
Node on which the service runs.

Logging Options for the Search Service

The logging options include properties for the severity level for Search Service logs.
Configure the Log Level property to configure the level of error messages written to the Search Service log.
Choose one of the following message levels:

Error. Writes ERROR code messages to the log. ERROR messages include connection failures, failures
to save or retrieve metadata, service errors.

Warning. Writes WARNING and ERROR code messages to the log. WARNING errors include recoverable
system failures or warnings.

Info. Writes INFO, WARNING, and ERROR code messages to the log. INFO messages include system
and service change messages.

Tracing. Writes TRACE, INFO, WARNING, and ERROR code messages to the log. TRACE messages log
user request failures such as SQL request failures, mapping run request failures, and deployment failures.

Debug. Writes DEBUG, TRACE, INFO, WARNING, and ERROR code messages to the log. DEBUG
messages are user request logs.

Default is INFO.

Search Options for the Search Service

Search options for the Search Service include the port number, index location, extraction interval, and the
Model repository details.
You can configure the following search options for the Search Service:
Port Number
Port on which the Search Service runs. Default is 8084.
Index Location
Directory that contains the search index files. Enter a directory on the machine that runs the Search
Service. If the directory does not exist, Informatica creates the directory when it creates the Search
Service.
Extraction Interval
Interval in seconds at which the Search Service updates the search index. Set to 60 seconds or more to
enable the Search Service to complete an extraction and index before starting the next extraction.
Default is 60 seconds. Minimum is 20 seconds.
Model Repository Service
Model Repository Service associated with the Model repository from which the Search Service extracts
assets. A Model Repository Service appears only if it is not associated with a Search Service.
User Name
User name to access the Model repository. The Model repository user must have the Administrator role
for the Model Repository Service. Not available for a domain with Kerberos authentication.

Search Service Properties

359

Password
An encrypted version of the user password to access the Model repository. Not available for a domain
with Kerberos authentication.
Modify Password
Select to specify a different password than the one associated with the Model repository user. Select this
option if the password changes for a user. Not available for a domain with Kerberos authentication.
Security Domain
LDAP security domain for the Model repository user. The field appears when the Informatica domain
contains an LDAP security domain. Not available for a domain with Kerberos authentication.

Custom Properties for the Search Service

Configure custom properties that are unique to specific environments.
You might need to apply custom properties in special cases. When you define a custom property, enter the
property name and an initial value. Define custom properties only at the request of Informatica Global
Customer Support.

Search Service Process Properties

When you create a Search Service, you configure the Search Service process properties. You can edit the
Search Service process properties on the Processes tab in the Administrator tool.
The Search Service runs the Search Service process on a node. When you select the Search Service in the
Administrator tool, you can view the service processes for the Search Service on the Processes tab. You
can view the node properties for the service process in the Service panel. You can view the service process
properties in the Service Process Properties panel.
Note: You must select the node to view the service process properties in the Service Process Properties
panel.
You can configure the following types of Search Service process properties:

Advanced properties

Environment variables

Custom properties

If you update any of the process properties, restart the Search Service for the modifications to take effect.

Advanced Properties of the Search Service Process

Advanced properties include properties for the maximum heap size and the Java Virtual Manager (JVM)
memory settings.
You can configure the following advanced properties for the Search Service process:

360

Chapter 20: Search Service

Maximum Heap Size

Amount of RAM allocated to the Java Virtual Machine (JVM) that runs the Search Service. Use this
property to increase the performance. Append one of the following letters to the value to specify the
units:

b for bytes.

k for kilobytes.

m for megabytes.

g for gigabytes.

Default is 768 megabytes. Specify 1 gigabyte if you run the Search Service on a 64-bit machine.
JVM Command Line Options
Java Virtual Machine (JVM) command line options to run Java-based programs.
You must set the following JVM command line options:

-Dfile.encoding. File encoding. Default is UTF-8.

-Xms. Minimum heap size. Default value is 256 m.

-XX:MaxPermSize. Maximum permanent generation size. Default is 128 m.

-XX:+HeapDumpOutOfMemoryError. Include option to write heap memory to a file if a

java.lang.OutOfMemoryError error occurs.

Environment Variables for the Search Service Process

You can edit environment variables for the Search Service process.
You can define environment variables for the Search Service in the Environment Variables property.

Custom Properties for the Search Service Process

Configure custom properties that are unique to specific environments.
You might need to apply custom properties in special cases. When you define a custom property, enter the
property name and an initial value. Define custom properties only at the request of Informatica Global
Customer Support.

Creating a Search Service

Create the Search Service in the domain to enable searching in the Analyst tool and Business Glossary
Desktop.
Before you create the Search Service, create the associated Model Repository Service, and Analyst Service.
To enable search on objects in a profiling warehouse, create the Data Integration Service also.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

On the Domain Actions menu, click New > Search Service.

The New Search Service - Step 1 of 2 window appears.

3.

Enter the general properties for the service.

Creating a Search Service

361

4.

Optionally, click Browse in the Location field to select the location in the Navigator where you want to
the service to appear.
The Select Folder dialog box appears.

5.

Optionally, click Create Folder to create another folder.

6.

Click OK.
The Select Folder dialog box closes.

7.

Click Next.
The New Search Service - Step 2 of 2 window appears.

8.

Enter the search options for the service.

9.

Click Finish.

Enabling the Search Service

Enable the Search Service to enable search in the Analyst tool and Business Glossary Desktop.
Before you enable the Search Service, verify that you enabled the Model Repository Service, Data
Integration Service, and the Analyst Service.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator of the Administrator tool, select the Search Service.

3.

Click the Enable Service button.

The Search Service starts.

Recycling and Disabling the Search Service

Disable the Search Service to perform maintenance or temporarily restrict users from performing searches in
the associated Analyst tool or Business Glossary Desktop. Recycle the Search Service to restart the Search
Service and apply the latest service and service process properties.
Before you recycle the Search Service, verify that you enabled the Model Repository Service, Data
Integration Service, and the Analyst Service.
You must recycle the Search Service when you change the user name or password of the Model Repository
Service or associate a different Model Repository Service with the Search Service. You must also recycle the
Search Service when you update any of the Search Service properties or Search Service process properties.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator of the Administrator tool, select the Search Service.

3.

Click the Disable the Service button or the Recycle the Service button.
The Disable Service or Recycle Service dialog box appears.

4.

362

Select the shut down mode for the Search Service.

Chapter 20: Search Service

Select one of the following modes:

Complete. Runs jobs to completion before disabling or recycling the service.

Stop. Waits up to 30 seconds to complete jobs that are running before disabling or recycling the
service.

Abort. Tries to stop all jobs before aborting them and disabling or recycling the service.

Recycling and Disabling the Search Service

363

CHAPTER 21

System Services
This chapter includes the following topics:

System Services Overview, 364

Email Service, 365

Resource Manager Service, 368

Scheduler Service, 371

System Services Overview

A system service is an application service that can have a single instance in the domain. When you create
the domain, the system services are created for you. You can enable, disable, and configure system
services.
System services are created in the System Services folder. Expand the System Services folder in the Domain
Navigator to view and configure the system services. You cannot delete, move, or edit the properties or
contents of the System Services folder.
The following image shows the System Services folder in the Domain Navigator:

By default, system services are disabled and are assigned to run on the master gateway node. You can
change the node assignment and enable the service to use the functionality that the service provides.
The domain includes the following system services:
Email Service
The Email Service emails notifications for business glossaries and workflows. Enable the Email Service
to allow users to configure email notifications.

364

Resource Manager Service

The Resource Manager Service manages computing resources in the domain and dispatches jobs to
achieve optimal performance and scalability. The Resource Manager Service collects information about
nodes with the compute role. The service matches job requirements with resource availability to identify
the best compute node to run the job.
The Resource Manager Service communicates with compute nodes in a Data Integration Service grid.
Enable the Resource Manager Service when you configure a Data Integration Service grid to run jobs in
separate remote processes.
Scheduler Service
The Scheduler Service manages schedules for deployed mappings and workflows that the Data
Integration Service runs.

Email Service
The Email Service emails notifications for business glossaries and workflows. Enable the Email Service to
allow users to configure email notifications.
The Email Service emails the following notifications:

Business glossary notifications.

Workflow notifications. Workflow notifications include emails sent from Human tasks and Notification tasks
in workflows that the Data Integration Service runs.

The Email Service is associated with a Model Repository Service. The Model repository stores metadata for
the email notifications that users configure. Both the Model Repository Service and the Email Service must
be available for the Email Service to send email notifications.
The Email Service is highly available. High availability enables the Service Manager and the Email Service to
react to network failures and failures of the Email Service. The Email Service has the restart and failover high
availability feature. If a Email Service becomes unavailable, the Service Manager can restart the service on
the same node or on a back-up node.

Before You Enable the Email Service

Before you enable the Email Service, complete the prerequisite tasks for the service.
Perform the following tasks before you enable the Email Service:

If the domain uses Kerberos authentication and you set the service principal level at the process level,
create a keytab file for the service. For more information about creating the service principal names and
keytab files, see the Informatica Security Guide.

Configure the Model repository options for the service.

Configure the email server properties.

Email Service Properties

You can configure general properties, Model Repository Service options, and email server properties for the
Email Service. To configure the Email Service properties, select the service in the Domain Navigator and

Email Service

365

click Edit in the Properties view. You can change the properties while the service is running, but you must
recycle the service for the changed properties to take effect.

General Properties
The following table describes the general properties for the service:
Property

Description

Name

Name of the service. You cannot change the name of the Email Service.

Description

Description of the service. The description cannot exceed 765 characters.

Node

Node on which the service runs.

Backup Nodes

Nodes on which the service can run if the primary node is unavailable.

Model Repository Service Options

Configure a Model repository to store metadata for the email notifications that users configure. The Model
Repository Service must be available for the Email Service to send email notifications.
If the Model repository is integrated with a version control system, then you must synchronize the repository
before you associate it with the Email Service.
The following table describes the Model Repository options for the service:
Property

Description

Model Repository
Service

Model Repository Service associated with the Email Service.

Username

User name of an administrator user in the Informatica domain. Not available for a domain
with Kerberos authentication.

Password

Password of the administrator user in the Informatica domain. Not available for a domain
with Kerberos authentication.

Email Server Properties

Configure the email server properties so Business Glossary and Data Quality users can configure email
notifications.
The Email Service uses the email server configuration to send the following notifications:

366

Business glossary notifications.

Workflow notifications. Workflow notifications include emails sent from Human tasks and Notification tasks
in workflows that the Data Integration Service runs.

Chapter 21: System Services

The following table describes the email server properties for the service:
Property

Description

SMTP Server Host

Name

The SMTP outbound mail server host name. For example, enter the Microsoft
Exchange Server for Microsoft Outlook.
Default is localhost.

SMTP Server Port

Port number used by the outbound SMTP mail server. Valid values are from 1 to
65535. Default is 25.

SMTP Server User

Name

User name for authentication upon sending, if required by the outbound SMTP mail
server.

SMTP Server Password

Password for authentication upon sending, if required by the outbound SMTP mail
server.

SMTP Authentication
Enabled

Indicates that the SMTP server is enabled for authentication. If true, the outbound mail
server requires a user name and password.
Default is false.

Use TLS Security

Indicates that the SMTP server uses the TLS protocol. If true, enter the TLS port
number for the SMTP server port property.
Default is false.

Use SSL Security

Indicates that the SMTP server uses the SLL protocol. If true, enter the SSL port
number for the SMTP server port property.
Default is false.

Sender Email Address

Email address that the Email Service uses in the From field when sending notification
emails from a workflow. Default is [email protected].

Email Service Process Properties

When the Email Service is configured to run on primary and back-up nodes, a service process is enabled on
each node. Only a single process runs at any given time, and the other processes maintain standby status.
You can view the state of the service process on each node on the Processes view.
You can view the following information about the Email Service process:

Process Configuration. The state of the process configured to run on the node. The state can be Enabled
or Disabled.

Process State. The state of the service process running on the node. The state can be Enabled or
Disabled.

Node. The node that the service process runs on.

Node Role. Indicates whether the node has the service role, the compute role, or both roles.

Node Status. The state of the node that the process is running on. The state can be Enabled or Disabled.

Enabling, Disabling, and Recycling the Email Service

You can enable, disable, and recycle the Email Service from the Administrator tool.
By default, the Email Service is disabled. Enable the Email Service when you need to allow users to generate
emails based on Human tasks in a workflow or changes to the Business Glossary. When you enable the

Email Service

367

Email Service, a service process starts on the node designated to run the service. The service is available to
send emails based on the notification properties that users configure.
You might disable the Email Service if you need to perform maintenance. You might recycle the Email
Service if you connect to a different Model Repository Service.
When you recycle or disable an Email Service, you must choose a mode to recycle or disable it in. You can
choose one of the following options:

Complete. Wait for all subtasks to complete.

Stop. Wait up to 30 seconds for all subtasks to complete.

Abort. Stop all processes immediately.

Optionally, you can choose to specify whether the action was planned or unplanned, and enter comments
about the action. If you complete these options, the information appears in the Events and History panels in
the Domain view on the Manage tab.
To enable the service, select the service in the Domain Navigator and click Enable the Service.
To disable the service, select the service in the Domain Navigator and click Disable the Service.
To recycle the service, select the service in the Domain Navigator and click Recycle the Service. When you
recycle the service, the Service Manager restarts the service. You must recycle the Email Service whenever
you change a property for the service.

Resource Manager Service

The Resource Manager Service manages computing resources in the domain and dispatches jobs to achieve
optimal performance and scalability. The Resource Manager Service collects information about nodes with
the compute role. The service matches job requirements with resource availability to identify the best
compute node to run the job.
The Resource Manager Service communicates with compute nodes in a Data Integration Service grid. Enable
the Resource Manager Service when you configure a Data Integration Service grid to run jobs in separate
remote processes. The Resource Manager Service does not require a license object before you enable the
service.
The Resource Manager Service is highly available. High availability enables the Service Manager and the
Resource Manager Service to react to network failures and failures of the Resource Manager Service. The
Resource Manager Service has the restart and failover high availability feature. If a Resource Manager
Service becomes unavailable, the Service Manager can restart the service on the same node or on a back-up
node.

Resource Manager Service Architecture

The Resource Manager Service connects to nodes with the compute role in a Data Integration Service grid
that is configured to run jobs in separate remote processes.
When the Service Manager on a node with the compute role starts, the Service Manager registers the node
with the Resource Manager Service. Compute nodes use a heartbeat protocol to send periodic signals to the
Resource Manager Service. The Resource Manager Service stores compute node details in memory. If the
node stops sending heartbeat signals, the Resource Manager Service marks the node as unavailable and
does not dispatch jobs to the node.

368

Chapter 21: System Services

When you enable a Data Integration Service that runs on the grid, the Data Integration Service designates
one node with the compute role as the master compute node. The Service Manager on the master compute
node communicates with the Resource Manager Service to find an available worker compute node to run job
requests.

Before You Enable the Resource Manager Service

Before you enable the Resource Manager Service, complete the prerequisite tasks for the service.
Before you enable the Resource Manager Service, configure a Data Integration Service grid to run jobs in
separate remote processes. The designated master compute node in the grid communicates with the
Resource Manager Service to find an available compute node to run jobs remotely.

Resource Manager Service Properties

To configure the Resource Manager Service properties, select the service in the Domain Navigator and click
the Properties view. You can change the properties while the service is running, but you must recycle the
service for the changed properties to take effect.

General Properties
In the general properties, configure the primary and back-up nodes for the Resource Manager Service.
The following table describes the general properties for the service:
Property

Description

Name

Name of the service. You cannot change the name of the Resource Manager Service.

Description

Description of the service. The description cannot exceed 765 characters.

Node

Node on which the service runs.

Backup Nodes

Nodes on which the service can run if the primary node is unavailable.

Logging Options
The following table describes the log level property for the Resource Manager Service:
Property

Description

Log Level

Determines the default severity level for the service logs. Choose one of the following options:
- Fatal. Writes FATAL messages to the log. FATAL messages include nonrecoverable system failures that
cause the service to shut down or become unavailable.
- Error. Writes FATAL and ERROR code messages to the log. ERROR messages include connection
failures, failures to save or retrieve metadata, service errors.
- Warning. Writes FATAL, WARNING, and ERROR messages to the log. WARNING errors include
recoverable system failures or warnings.
- Info. Writes FATAL, INFO, WARNING, and ERROR messages to the log. INFO messages include
system and service change messages.
- Trace. Write FATAL, TRACE, INFO, WARNING, and ERROR code messages to the log. TRACE
messages log user request failures.
- Debug. Write FATAL, DEBUG, TRACE, INFO, WARNING, and ERROR messages to the log. DEBUG
messages are user request logs.

Resource Manager Service

369

Resource Manager Service Process Properties

When the Resource Manager Service is configured to run on primary and back-up nodes, a service process
is enabled on each node. Only a single process runs at any given time, and the other processes maintain
standby status. You can configure the service process properties differently for each node.
To configure the Resource Manager Service process properties, select the service in the Domain Navigator
and click the Processes view. You can change the properties while the service is running, but you must
restart the service process for the changed properties to take effect.

Environment Variables
You can configure environment variables for the Resource Manager Service process.
The following table describes the environment variables:
Property

Description

Environment Variable

Enter a name and a value for the environment variable.

Advanced Options
The following table describes the advanced options:
Property

Description

Maximum Heap Size

Amount of RAM allocated to the Java Virtual Machine (JVM) that runs the service
process. Use this property to increase the performance. Append one of the
following letters to the value to specify the units:
-

JVM Command Line

Options

b for bytes.
k for kilobytes.
m for megabytes.
g for gigabytes.

Java Virtual Machine (JVM) command line options to run Java-based programs.
When you configure the JVM options, you must set the Java SDK classpath, Java
SDK minimum memory, and Java SDK maximum memory properties.
You must set the following JVM command line options:
- Xms. Minimum heap size. Default value is 256 m.
- MaxPermSize. Maximum permanent generation size. Default is 128 m.
- Dfile.encoding. File encoding. Default is UTF-8.

Enabling, Disabling, and Recycling the Resource Manager Service

You can enable, disable, and recycle the Resource Manager Service from the Administrator tool.
By default, the Resource Manager Service is disabled. Enable the Resource Manager Service when you
configure a Data Integration Service grid to run jobs on remote nodes with the compute role. When you
enable the Resource Manager Service, a service process starts on the node designated to run the service.
The service is available to manage computing resources in the domain.
You might disable the Resource Manager Service if you need to perform maintenance or you need to
temporarily prevent Data Integration Service jobs from remotely running on nodes with the compute role. You
might recycle the Resource Manager Service if you changed a property. When you recycle the service, the
Service Manager restarts the service.

370

Chapter 21: System Services

When you disable a Resource Manager Service, you must choose the mode to disable it in. You can choose
one of the following options:

Complete. Wait for all processes to complete.

Abort. Stop all processes immediately.

Optionally, you can choose to specify whether the action was planned or unplanned, and enter comments
about the action. If you complete these options, the information appears in the Events and Command
History panels in the Domain view on the Manage tab.
To enable the service, select the service in the Domain Navigator and click Enable the Service.
To disable the service, select the service in the Domain Navigator and click Disable the Service.
To recycle the service, select the service in the Domain Navigator and click Recycle the Service.
Note: If the Resource Manager Service is configured to run on primary and back-up nodes, you can enable or
disable a Resource Manager Service process on the Processes view. Disabling a service process does not
disable the service. Disabling a service process that is running causes the service to fail over to another
node.

Scheduler Service
The Scheduler Service manages schedules for deployed mappings and workflows that the Data Integration
Service runs.
Use schedules to run deployed mappings and workflows at a specified time. You can schedule the objects to
run one time, or on an interval. Enable the Scheduler Service to create, manage, and run schedules.
The Scheduler Service is associated with a Model Repository Service. The Model repository stores metadata
for the schedules that users configure. Both the Model Repository Service and the Scheduler Service must
be available for scheduled objects to run.
The Scheduler Service is highly available. High availability enables the Service Manager and the Scheduler
Service to react to network failures and failures of the Scheduler Service. The Scheduler Service has the
restart and failover high availability feature. If a Scheduler Service becomes unavailable, the Service
Manager can restart the service on the same node or on a back-up node.

Before You Enable the Scheduler Service

Before you enable the Scheduler Service, complete the prerequisite tasks for the service.
Before you enable the Scheduler Service, complete the following tasks:

If the domain uses Kerberos authentication and you set the service principal level at the process level,
create a keytab file for the service. For more information about creating the service principal names and
keytab files, see the Informatica Security Guide.

Configure a Model repository for the service.

Scheduler Service Properties

You can configure general properties, logging options, and a Model Repository Service for the Scheduler
Service. To configure the Scheduler Service properties, select the service in the Domain Navigator and click

Scheduler Service

371

Edit in the Properties view. You can change the properties while the service is running, but you must recycle
the service for the modifications to take effect.

General Properties
The following table describes the general properties for the service:
Property

Description

Name

Name of the service. You cannot change the name of the Scheduler Service.

Description

Description of the service. The description cannot exceed 765 characters.

Node

Node on which the service runs.

Backup Nodes

Nodes on which the service can run if the primary node is unavailable.

Logging Options
Configure the Logging Level property to determine the level of error messages that are written to the
Scheduler Service log.
The following table describes the logging level properties for the service:
Property

Description

Logging
Level

Determines the default severity level for the service logs. Choose one of the following options:
- Fatal. Writes FATAL messages to the log. FATAL messages include nonrecoverable system failures
that cause the service to shut down or become unavailable.
- Error. Writes FATAL and ERROR code messages to the log. ERROR messages include connection
failures, failures to save or retrieve metadata, service errors.
- Warning. Writes FATAL, WARNING, and ERROR messages to the log. WARNING errors include
recoverable system failures or warnings.
- Info. Writes FATAL, INFO, WARNING, and ERROR messages to the log. INFO messages include
system and service change messages.
- Trace. Write FATAL, TRACE, INFO, WARNING, and ERROR code messages to the log. TRACE
messages log user request failures.
- Debug. Write FATAL, DEBUG, TRACE, INFO, WARNING, and ERROR messages to the log. DEBUG
messages are user request logs.

Model Repository Service Options

Configure a Model repository to store information about the schedules. The Model Repository Service must
be available for the Scheduler Service to run scheduled objects.
If the Model repository is integrated with a version control system, synchronize the Model repository before
you associate it with the Scheduler Service.

372

Chapter 21: System Services

The following table describes the Model repository options for the service:
Property

Description

Model Repository
Service

Model Repository Service associated with the Scheduler Service.

Username

User name of an administrator user in the Informatica domain. Not available for a domain
with Kerberos authentication.

Password

Password of the administrator user in the Informatica domain. Not available for a domain
with Kerberos authentication.

Security Domain

LDAP security domain for the user who manages the Scheduler Service. The security
domain field does not appear for users with Native or Kerberos authentication.

Storage Properties
Configure a temporary file location when you configure the Scheduler Service to run on multiple nodes. Use
the temporary file location to store parameter files for deployed mappings and workflows. The file location
must be a directory that all of the nodes can access.
The following table describes the Temporary File Location property:
Property

Description

Temporary File Location

Path to the directory where parameter files are read from and written to.

Scheduler Service Process Properties

When the Scheduler Service is configured to run on primary and back-up nodes, a service process is enabled
on each node. Only a single process runs at any given time, and the other processes maintain standby
status. You can configure the service process properties differently for each node.
To configure the Scheduler Service process properties, select the service in the Domain Navigator and click
the Processes view. You can change the properties while the service is running, but you must restart the
service process for the changed properties to take effect.

Security Properties
When you set the HTTP protocol type for the Scheduler Service to HTTPS or both, you enable the Transport
Layer Security (TLS) protocol for the service. Depending on the HTTP protocol type of the service, you define
the HTTP port, the HTTPS port, or both ports for the service process.

Scheduler Service

373

The following table describes the Scheduler Service security properties:

Property

Description

HTTP Port

Unique HTTP port number for the Scheduler Service process when the service uses the HTTP
protocol.
Default is 6211.

HTTPS Port

Unique HTTPS port number for the Scheduler Service process when the service uses the HTTPS
protocol.
When you set an HTTPS port number, you must also define the keystore file that contains the
required keys and certificates.

HTTP Configuration Options

Configure the HTTP options when the Scheduler Service uses the HTTPS protocol.
The following table describes the HTTP configuration options:

374

Property

Description

Keystore File

Path and file name of the keystore file that contains the keys and certificates. Required if
you use HTTPS connections for the service. You can create a keystore file with a keytool.
Keytool is a utility that generates and stores private or public key pairs and associated
certificates in a keystore file. You can use the self-signed certificate or use a certificate
signed by a certificate authority.

Keystore
Password

Password for the keystore file.

Truststore File

Path and file name of the truststore file that contains authentication certificates trusted by
the service.

Truststore
Password

Password for the keystore file.

SSL Protocol

Secure Sockets Layer protocol to use. Default is TLS.

Chapter 21: System Services

Advanced Options
You can configure maximum heap size and JVM command line options for the Scheduler Service.
The following table describes the advanced options:
Property

Description

Maximum Heap Size

Amount of RAM allocated to the Java Virtual Machine (JVM) that runs the service
process. Use this property to increase the performance. Append one of the
following letters to the value to specify the units:
-

JVM Command Line

Options

b for bytes.
k for kilobytes.
m for megabytes.
g for gigabytes.

Java Virtual Machine (JVM) command line options to run Java-based programs.
When you configure the JVM options, you must set the Java SDK classpath, Java
SDK minimum memory, and Java SDK maximum memory properties.
You must set the following JVM command line options:
-

Xmx. Maximum heap size. Default value is 640 m.

Xms. Minimum heap size. Default value is 256 m.
MaxPermSize. Maximum permanent generation size. Default is 192 m.
Dfile.encoding. File encoding. Default is UTF-8.

Environment Variables
You can configure environment variables for the Scheduler Service process.
The following table describes the environment variables:
Property

Description

Environment Variable

Enter a name and a value for the environment variable.

Enabling, Disabling, and Recycling the Scheduler Service

You can enable, disable, and recycle the Scheduler Service from the Administrator tool.
By default, the Scheduler Service is disabled. Enable the Scheduler Service when you want to manage
schedules or run scheduled objects. When you enable the Scheduler Service, a service process starts on the
node designated to run the service. The service is available to schedule and run objects.
You might disable the Scheduler Service for maintenance, or recycle the service if you change a property.
When you recycle or disable a Scheduler Service, you must choose a mode to recycle or disable it in. You
can choose one of the following modes:

Complete. Wait for all subtasks to complete.

Stop. Wait up to 30 seconds for all subtasks to complete.

Abort. Stop all processes immediately.

Optionally, you can choose to specify whether the action is planned or unplanned, and enter comments about
the action. If you complete these options, then the information appears in the service Events and Command
History panels in the Domain view on the Manage tab.
To enable the service, select the service in the Domain Navigator and click Enable the Service.

Scheduler Service

375

To disable the service, select the service in the Domain Navigator and click Disable the Service.
To recycle the service, select the service in the Domain Navigator and click Recycle the Service. When you
recycle the service, the Service Manager restarts the service. You must recycle the Scheduler Service
whenever you change a property for the service.

376

Chapter 21: System Services

CHAPTER 22

Test Data Manager Service

This chapter includes the following topics:

Test Data Manager Service Overview , 377

Test Data Manager Service Properties, 377

Database Connection Strings, 381

Configuring the Test Data Manager Service, 381

Creating the Test Data Manager Service, 382

Enabling and Disabling the Test Data Manager Service, 382

Editing the Test Data Manager Service, 383

Deleting the Test Data Manager Service, 384

Test Data Manager Service Overview

The Test Data Manager Service (TDM Service) is an application service in the Informatica domain. The TDM
Service is used by Test Data Manager (TDM) to perform data masking, data discovery, data subset, and test
data generation tasks through the TDM Workbench. The TDM Workbench accesses the TDM Service and
uses the database contents from the TDM repository associated with the service. The TDM repository is a
relational database that contains tables that the TDM requires to run and the tables that store metadata about
data sources.
Create a TDM Service in the Informatica domain to use the Test Data Manager application. Use the
Administrator tool or the infacmd command line program to administer the Test Data Manager Service.

Test Data Manager Service Properties

To view the Test Data Manager Service properties, select the service in the Domain Navigator and click the
Properties view. You can configure the following Test Data Manager Service properties:

General properties

Service properties

TDM repository configuration properties

TDM server configuration properties

Advanced properties

377

If you update a property, restart the Test Data Manager Service to apply the update.

General Properties
The following table describes the general properties for the service:
Property

Description

Name

Name of the service. The name is not case sensitive and must be unique within the domain. It
cannot exceed 128 characters or begin with @. It also cannot contain spaces or the following
special characters:
`~%^*+={}\;:'"/?.,<>|!()][
You cannot change the name of the service after you create it.

Description

Description of the service. The description cannot exceed 765 characters.

Location

Domain and folder where the service is created. Click Browse to choose a different folder. You can
move the service after you create it.

License

License object that allows use of the service.

Node

Node on which the service runs.

Service Properties
The following table describes the service properties that you configure for the Test Data Manager service:

378

Property

Description

PowerCenter
Repository Service

PowerCenter Repository Service that the Test Data Manager service uses to load
metadata into the Test Data Manager repository.

PowerCenter
Integration Service

PowerCenter Integration service that runs the workflows that you generate in Test Data
Manager for data subset and data masking operations.

Model Repository
Service

Name of the Model Repository Service that you want to associate with the Test Data
Manager service.

User Name

The user name to access the Model Repository Service.

Password

The password of the user name to access the Model Repository Service.

Security Domain

Name of the security domain that the user belongs to. Select the security domain from
the list.

Data Integration
Service

Name of the Data Integration Service that performs data discovery operations. If you
have enabled profiling, or if you use Hadoop connections, you must select the Data
Integration Service in the domain.

Analyst Service

Name of the Analyst Service that TDM uses for asset linking. Required if you want to
link TDM global objects to the Business Glossary assets.

Chapter 22: Test Data Manager Service

Property

Description

Enable Data Profiling

Required if you use the TDM setup for data discovery or profiling. Select True to enable
data profiling or False to disable data profiling.

Enable Test Data

Warehouse

Required if you want to configure a test data warehouse. Select this option to allow you
to configure the test data repository and test data mart from Test Data Manager.

TDM Repository Configuration Properties

The following table describes the TDM repository configuration properties that you configure for the Test Data
Manager Service:
Property

Description

Database Type

Type of database for the TDM repository.

-

Oracle
Microsoft SQL Server
DB2
Custom. Select this option to use custom database drivers instead of the Informatica database
drivers.

If you select Custom, you must save the JDBC driver JAR to the following locations:
- <INFA_HOME>/tomcat/endorsed. If the endorsed folder does not exist, create the
folder. Restart the domain after you copy the JAR.
- <INFA_HOME>/TDM/lib.
- <INFA_HOME>/TDM/offline/lib.
- <INFA_HOME>/services/TDMService.

Use Trusted
Connection

Available for Microsoft SQL Server. Select this if you want to log in using Windows login
credentials.

Custom Driver
Class

Custom JDBC parameters. Required if you select Custom database type. Enter the custom
JDBC driver parameters.

Username

User account for the TDM repository database. Set up this account using the appropriate
database client tools. To apply changes, restart the Test Data Manager Service.

Password

Password for the TDM repository database user. Must be in 7-bit ASCII. To apply changes,
restart the Test Data Manager Service.

JDBC URL

JDBC connection URL used to access the TDM repository database.

Enter the JDBC URL in one of the following formats:
- Oracle: jdbc:informatica:oracle://<host name>:<port>;ServiceName=<service name>
- IBM DB2: jdbc:informatica:db2://<host name>:<port>;DatabaseName=<database name>
- Microsoft SQL Server: jdbc:informatica:sqlserver://<host name>:<port>;DatabaseName=<database
name>

Connection
String

Native connect string to the TDM repository database. The Test Data Manager Service uses
the connect string to create a connection object to the TDM repository and the PowerCenter
repository. To apply changes, restart the Test Data Manager Service.

Schema Name

Available for Microsoft SQL Server. Name of the schema for the domain configuration tables. If
not selected, the service creates the tables in the default schema.

Test Data Manager Service Properties

379

Property

Description

Tablespace
Name

Available for DB2. Name of the tablespace in which to create the tables. You must define the
tablespace on a single node and the page size must be 32 KB. In a multipartition database, you
must select this option. In a single-partition database, if you do not select this option, the
installer creates the tables in the default tablespace.

Creation
options for the
New Test Data
Manager
Service

Options to create content, or use existing content, and upgrade existing content.
- Do not create new content. Creates the repository without creating content. Select this option if the
database content exists. If the content is of a previous version, the service prompts you to upgrade
the content to the current version.
- Previous Test Data Manager Service Name: Enter the name of the previous Test Data Manager
Service. Required if you create the service with a different name.
Note: If you create the Test Data Manager Service with a different name, the source and target
connections do not appear in Test Data Manager. Import the connections again if the
connections do not appear in Test Data Manager.
- Upgrade TDM Repository Contents. Upgrades the content to the current version.
- Create new content. Creates repository content.

TDM Server Configuration Properties

The following table describes the TDM Server configuration properties that you configure for the Test Data
Manager Service:

380

Property

Description

HTTP Port

Port number that the TDM application runs on. The default is 6605.

Enable Transport
Layer Security (TLS)

Secures communication between the Test Data Manager Service and the domain.

HTTPS Port

Port number for the HTTPS connection. The default is 6643.

Keystore File

Path and file name of the keystore file. The keystore file contains the keys and
certificates required if you use the SSL security protocol with the Test Data Manager
application. Required if you select Enable Secured Socket Layer.

Keystore Password

Password for the keystore file. Required if you select Enable Secured Socket Layer.

SSL Protocol

Secure Sockets Layer protocol to use. Default is TLS.

Chapter 22: Test Data Manager Service

Advanced Properties
The following table describes the advanced properties that you can configure for the Test Data Manager
Service:
Property

Description

JVM Params

The heap size allocated for Test Data Manager.

- Xms512m - Xmx1024m -XX:MaxPermSize=512m
The time after which database connections are renewed if the Test Data Manager remains
idle. Required if you modified the database configuration settings to values less than the TDM
defaults. Configure the following values in TDM to be less than the database values.
- IDLE_TIME. -DIDLE_TIME=<seconds>. Default is 300 seconds.
- CONNECT_TIME. -DCONNECT_TIME=<seconds>. Default is 5000 seconds.

Connection Pool
Size

The JDBC connection pool size.

JMX Port

Port number for the JMX/RMI connections to TDM. Default is 6675.

Shutdown Port

Port number that controls the server shutdown for TDM. The TDM Server listens for shutdown
commands on this port. Default is 6607.

Database Connection Strings

When you create a database connection, specify a connection string for that connection. The Test Data
Manager Service uses the connection string to create a connection object to the Test Data Manager
repository.
The following table lists the native connect string syntax for each supported database:
Database

Connection String Syntax

Example

IBM DB2

dbname

mydatabase

Microsoft SQL Server

servername@dbname

sqlserver@mydatabase

Oracle

dbname.world (same as TNSNAMES entry)

oracle.world

Configuring the Test Data Manager Service

You can create and configure a Test Data Manager Service in the Administrator tool.
1.

Set up the TDM repository database. You enter the database information when you create the Test Data
Manager Service.

2.

Create a PowerCenter Repository Service, PowerCenter Integration Service, and Model Repository
Service.

Database Connection Strings

381

3.

Optional. Create a Data Integration Service. Required if you use the data profiling feature or if you use
Hadoop connections in TDM.

4.

Optional. Create an Analyst Service. Required if you use the asset linking feature. The Analyst Service
license must support Business Glossary.

5.

Create the Test Data Manager Service and configure the service properties.

6.

Enable the Test Data Manager Service in the Informatica domain.

Creating the Test Data Manager Service

Log in to the Administrator tool to create the Test Data Manager Service. You can also create the Test Data
Manager Service using the TDM command line program.
1.

In the Administrator tool, click the Domain tab.

2.

Click the Services and Nodes view.

3.

Click Actions > New > Test Data Manager Service.

The New Test Data Manager Service dialog box appears.

4.

Enter values for the general properties, and click Next.

5.

Enter values for the service properties, and click Next.

6.

Enter the repository configuration properties and test the connection. The repository connection
information must be valid for the service to work.
a.

If no content exists, select Create new content. You cannot select this option if the database has
content.

b.

If the database content exists, select Do not create new content. If you entered a different name
for the Test Data Manager Service, you are prompted to enter the name of the previous Test Data
Manager Service. The application checks the version of the content. If the content is of a previous
version, an option to upgrade the repository content appears. Upgrade the repository content.
Creating the service without upgrading the content to the current version generates a warning.

7.

Choose to enable the Test Data Manager Service, and click Next.

8.

Enter values for the server configuration properties, and click Next.

9.

Enter values for the advanced properties, and click Finish.

Enabling and Disabling the Test Data Manager

Service
You can use the Administrator tool or the tdm command line program to enable, disable, or recycle the Test
Data Manager Service. Disable a Test Data Manager Service to perform maintenance or to temporarily
restrict users from accessing Test Data Manager. When you disable the Test Data Manager Service, you also
stop Test Data Manager. You might recycle the service if you modified a property. When you recycle the
service, the Test Data Manager Service is disabled and enabled.
When you enable the Test Data Manager Service, the Service Manager starts TDM on the node where the
service runs. You access the TDM application through Test Data Manager.

382

Chapter 22: Test Data Manager Service

You can enable, disable, and recycle the Test Data Manager Service from the service Actions menu in the
Administrator tool. You can also use the tdm command line program to enable and disable the service.

Editing the Test Data Manager Service

You can edit the Test Data Manager Service from the Administrator tool or using the tdm command line
program.
Edit the Test Data Manager Service to create or upgrade content and to edit or update the service properties.

Create or Upgrade TDM Repository Content

You can edit the TDM Service to create repository content after saving the service. If the TDM repository
content is of an older version, you can edit the TDM Service to upgrade the content.
1.

Log in to the Informatica Administrator as an Administrator.

2.

Select the TDM Service in the Domain Navigator to open the service properties.
Warning messages appear if the repository content is of an older version or if the content does not exist.

3.

Click Actions > Create Contents to create content, or click Actions > Upgrade Contents to upgrade
repository content.

Assigning the Test Data Manager Service to a Different Node

You can assign the Test Data Manager Service to a different node in the domain. The new node that uses
the Test Data Manager Service must have TDM installed.
1.

Disable the Test Data Manager Service.

2.

Click Edit in the General Properties section.

3.

Select a different node for the Node property, and then click OK.

4.

If the Test Data Manager Service is running in HTTPS security mode, change the Keystore File Location
to the path on the new node. Click Edit in the Server Configuration Properties section and update the
Keystore File location, and click OK.

5.

Enable the Test Data Manager Service.

Assigning a New License to the Test Data Manager Service

If you buy additional licenses, you can assign a different license to the Test Data Manager Service. Unassign
the Test Data Manager Service from the existing license and then assign the service to the new license. You
must add the license to the domain before you can assign it to the Test Data Manager Service.
Add the new license to the domain from the Domain Actions > New > License option.
To assign a new license to the Test Data Manager Service, perform the following steps:
1.

Disable the Test Data Manager Service.

2.

Select the assigned license in the Domain Navigator.

3.

Click Assigned Services.

4.

Click Edit Assigned Services.

Editing the Test Data Manager Service

383

5.

Select the Test Data Manager Service from the Assigned Services list and click Remove to unassign it.

6.

Select the new license in the Domain Navigator.

7.

Click Assigned Services.

8.

Click Edit Assigned Services.

9.

Select the Test Data Manager Service from the Unassigned Services list and click Add to assign it.

10.

Click OK.

11.

Enable the Test Data Manager Service.

Deleting the Test Data Manager Service

1.

Select the Test Data Manager from the Domain navigator in the Administrator tool.

2.

Disable the Test Data Manager Service by clicking Actions > Disable Service.

3.

Click Actions > Delete.

You cannot access the TDM Workbench associated with the Test Data Manager Service, if you delete
the service.

384

Chapter 22: Test Data Manager Service

CHAPTER 23

Web Services Hub

This chapter includes the following topics:

Web Services Hub Overview, 385

Creating a Web Services Hub, 386

Enabling and Disabling the Web Services Hub, 387

Web Services Hub Properties, 388

Configuring the Associated Repository, 392

Web Services Hub Overview

The Web Services Hub Service is an application service in the Informatica domain that exposes PowerCenter
functionality to external clients through web services. It receives requests from web service clients and
passes them to the PowerCenter Integration Service or PowerCenter Repository Service. The PowerCenter
Integration Service or PowerCenter Repository Service processes the requests and sends a response to the
Web Services Hub. The Web Services Hub sends the response back to the web service client.
The Web Services Hub Console does not require authentication. You do not need to log in when you start the
Web Services Hub Console. On the Web Services Hub Console, you can view the properties and the WSDL
of any web service. You can test any web service running on the Web Services Hub. However, when you test
a protected service you must run the login operation before you run the web service.
You can use the Administrator tool to complete the following tasks related to the Web Services Hub:

Create a Web Services Hub. You can create multiple Web Services Hub Services in a domain.

Enable or disable the Web Services Hub. You must enable the Web Services Hub to run web service
workflows. You can disable the Web Services Hub to prevent external clients from accessing the web
services while performing maintenance on the machine or modifying the repository.

Configure the Web Services Hub properties. You can configure Web Services Hub properties such as the
length of time a session can remain idle before time out and the character encoding to use for the service.

Configure the associated repository. You must associate a repository with a Web Services Hub. The Web
Services Hub exposes the web-enabled workflows in the associated repository.

View the logs for the Web Services Hub. You can view the event logs for the Web Services Hub in the Log
Viewer.

Remove a Web Services Hub. You can remove a Web Services Hub if it becomes obsolete.

385

Creating a Web Services Hub

Create a Web Services Hub to run web service workflows so that external clients can access PowerCenter
functionality as web services.
You must associate a PowerCenter repository with the Web Services Hub before you run it. The
PowerCenter repository that you assign to the Web Services Hub is called the associated repository. The
Web Services Hub runs web service workflows that are in the associated repository.
By default, the Web Services Hub has the same code page as the node on which it runs. When you associate
a PowerCenter repository with the Web Services Hub, the code page of the Web Services Hub must be a
subset of the code page of the associated repository.
If the domain contains multiple nodes and you create a secure Web Services Hub, you must generate the
SSL certificate for the Web Services Hub on a gateway node and import the certificate into the certificate file
of the same gateway node.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

On the Domain Navigator Actions menu, click New > Web Services Hub.
The New Web Services Hub Service window appears.

3.

Configure the properties of the Web Services Hub.

The following table describes the properties for a Web Services Hub:
Property

Description

Name

Name of the Web Services Hub. The characters must be compatible with the code
page of the associated repository. The name is not case sensitive and must be
unique within the domain. It cannot exceed 128 characters or begin with @. It also
cannot contain spaces or the following special characters:
`~%^*+={}\;:'"/?.,<>|!()][

386

Description

Description of the Web Services Hub. The description cannot exceed 765
characters.

Location

Domain folder in which the Web Services Hub is created. Click Browse to select
the folder in the domain where you want to create the Web Services Hub.

License

License to assign to the Web Services Hub. If you do not select a license now,
you can assign a license to the service later. Required before you can enable the
Web Services Hub.

Node

Node on which the Web Services Hub runs. A Web Services Hub runs on a single
node. A node can run more than one Web Services Hub.

Associated Repository
Service

PowerCenter Repository Service to which the Web Services Hub connects. The
repository must be enabled before you can associate it with a Web Services Hub.

Repository User Name

User name to access the repository.

Repository Password

Password for the user.

Security Domain

Security domain for the user. Appears when the Informatica domain contains an
LDAP security domain.

Chapter 23: Web Services Hub

Property

Description

URLScheme

Indicates the security protocol that you configure for the Web Services Hub:
- HTTP. Run the Web Services Hub on HTTP only.
- HTTPS. Run the Web Services Hub on HTTPS only.
- HTTP and HTTPS. Run the Web Services Hub in HTTP and HTTPS modes.

HubHostName

Name of the machine hosting the Web Services Hub.

HubPortNumber (http)

Optional. Port number for the Web Services Hub on HTTP. Default is 7333.

HubPortNumber
(https)

Port number for the Web Services Hub on HTTPS. Appears when the URL
scheme selected includes HTTPS. Required if you choose to run the Web
Services Hub on HTTPS. Default is 7343.

KeystoreFile

Path and file name of the keystore file that contains the keys and certificates
required if you use the SSL security protocol with the Web Services Hub.
Required if you run the Web Services Hub on HTTPS.

Keystore Password

Password for the keystore file. The value of this property must match the
password you set for the keystore file. If this property is empty, the Web Services
Hub assumes that the password for the keystore file is the default password
changeit.

InternalHostName

Host name on which the Web Services Hub listens for connections from the
PowerCenter Integration Service. If not specified, the default is the Web Services
Hub host name.
Note: If the host machine has more than one network card that results in multiple
IP addresses for the host machine, set the value of InternalHostName to the
internal IP address.

InternalPortNumber

4.

Port number on which the Web Services Hub listens for connections from the
PowerCenter Integration Service. Default is 15555.

Click Create.

After you create the Web Services Hub, the Administrator tool displays the URL for the Web Services Hub
Console. If you run the Web Services Hub on HTTP and HTTPS, the Administrator tool displays the URL for
both.
If you configure a logical URL for an external load balancer to route requests to the Web Services Hub, the
Administrator tool also displays the URL.
Click the service URL to start the Web Services Hub Console from the Administrator tool. If the Web Services
Hub is not enabled, you cannot connect to the Web Services Hub Console.

Enabling and Disabling the Web Services Hub

Use the Administrator tool to enable or disable a Web Services Hub. You can disable a Web Services Hub to
perform maintenance or to temporarily restrict users from accessing web services. Enable a disabled Web
Services Hub to make it available again.
The PowerCenter Repository Service associated with the Web Services Hub must be running before you
enable the Web Services Hub. If a Web Services Hub is associated with multiple PowerCenter Repository

Enabling and Disabling the Web Services Hub

387

Services, at least one of the PowerCenter Repository Services must be running before you enable the Web
Services Hub.
If you enable the service but it fails to start, review the logs for the Web Services Hub to determine the
reason for the failure. After you resolve the problem, you must disable and then enable the Web Services
Hub to start it again.
When you disable a Web Services Hub, you must choose the mode to disable it in. You can choose one of
the following modes:

Stop. Stops all web enabled workflows and disables the Web Services Hub.

Abort. Aborts all web-enabled workflows immediately and disables the Web Services Hub.

To disable or enable a Web Services Hub:

1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the Web Services Hub.

When a Web Services Hub is running, the Disable button is available.

3.

To disable the service, click the Disable the Service button.

The Disable Web Services Hub window appears.

4.

Choose the disable mode and click OK.

The Service Manager disables the Web Services Hub. When a service is disabled, the Enable button is
available.

5.

To enable the service, click the Enable the Service button.

6.

To disable the Web Services Hub with the default disable mode and then immediately enable the
service, click the Restart the Service button.
By default, when you restart a Web Services Hub, the disable mode is Stop.

Web Services Hub Properties

You can configure general, service, advanced, and custom properties for the Web Services Hub.
Use the Administrator tool to view or edit the following Web Services Hub properties:

General properties. Configure general properties such as license and node.

Service properties. Configure service properties such as host name and port number.

Advanced properties. Configure advanced properties such as the level of errors written to the Web
Services Hub logs.

Custom properties. Configure custom properties that are unique to specific environments.

1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select a Web Services Hub.

3.

To view the properties of the service, click the Properties view.

4.

To edit the properties of the service, click Edit for the category of properties you want to update.
The Edit Web Services Hub Service window displays the properties in the category.

5.

388

Update the values of the properties.

Chapter 23: Web Services Hub

General Properties
Select the node on which to run the Web Services Hub. You can run multiple Web Services Hub on the same
node.
Disable the Web Services Hub before you assign it to another node. To edit the node assignment, select the
Web Services Hub in the Navigator, click the Properties tab, and then click Edit in the Node Assignments
section. Select a new node.
When you change the node assignment for a Web Services Hub, the host name for the web services running
on the Web Services Hub changes. You must update the host name and port number of the Web Services
Hub to match the new node. Update the following properties of the Web Services Hub:

HubHostName

InternalHostName

To access the Web Services Hub on a new node, you must update the client application to use the new host
name. For example, you must regenerate the WSDL for the web service to update the host name in the
endpoint URL. You must also regenerate the client proxy classes to update the host name.
The following table describes the general properties for the service:
Property

Description

Name

Name of the service. The name is not case sensitive and must be unique within the
domain. It cannot exceed 128 characters or begin with @. It also cannot contain
spaces or the following special characters:
`~%^*+={}\;:'"/?.,<>|!()][
You cannot change the name of the service after you create it.

Description

Description of the service. The description cannot exceed 765 characters.

License

License object that allows use of the service.

Node

Node on which the service runs.

Service Properties
You must restart the Web Services Hub before changes to the service properties can take effect.
The following table describes the service properties for a Web Services Hub:
Property

Description

HubHostName

Name of the machine hosting the Web Services Hub. Default is the name of the
machine where the Web Services Hub is running. If you change the node on which the
Web Services Hub runs, update this property to match the host name of the new node.
To apply changes, restart the Web Services Hub.

HubPortNumber (http)

Port number for the Web Services Hub running on HTTP. Required if you run the Web
Services Hub on HTTP. Default is 7333. To apply changes, restart the Web Services
Hub.

HubPortNumber (https)

Port number for the Web Services Hub running on HTTPS. Required if you run the
Web Services Hub on HTTPS. Default is 7343. To apply changes, restart the Web
Services Hub.

Web Services Hub Properties

389

Property

Description

CharacterEncoding

Character encoding for the Web Services Hub. Default is UTF-8. To apply changes,
restart the Web Services Hub.

URLScheme

Indicates the security protocol that you configure for the Web Services Hub:
- HTTP. Run the Web Services Hub on HTTP only.
- HTTPS. Run the Web Services Hub on HTTPS only.
- HTTP and HTTPS. Run the Web Services Hub in HTTP and HTTPS modes.

If you run the Web Services Hub on HTTPS, you must provide information on the
keystore file. To apply changes, restart the Web Services Hub.
InternalHostName

Host name on which the Web Services Hub listens for connections from the Integration
Service. If you change the node assignment of the Web Services Hub, update the
internal host name to match the host name of the new node. To apply changes, restart
the Web Services Hub.

InternalPortNumber

Port number on which the Web Services Hub listens for connections from the
Integration Service. Default is 15555. To apply changes, restart the Web Services Hub.

KeystoreFile

Path and file name of the keystore file that contains the keys and certificates required if
you use the SSL security protocol with the Web Services Hub. Required if you run the
Web Services Hub on HTTPS.

KeystorePass

Password for the keystore file. The value of this property must match the password you
set for the keystore file.

Advanced Properties
The following table describes the advanced properties for a Web Services Hub:
Property

Description

HubLogicalAddress

URL for the third party load balancer that manages the Web Services Hub. This
URL is published in the WSDL for all web services that run on a Web Services Hub
managed by the load balancer.

DTMTimeout

Length of time, in seconds, that the Web Services Hub tries to connect or reconnect
to the DTM to run a session. Default is 60 seconds.

SessionExpiryPeriod

Number of seconds that a session can remain idle before the session times out and
the session ID becomes invalid. The Web Services Hub resets the start of the
timeout period every time a client application sends a request with a valid session
ID. If a request takes longer to complete than the amount of time set in the
SessionExpiryPeriod property, the session can time out during the operation. To
avoid timing out, set the SessionExpiryPeriod property to a higher value. The Web
Services Hub returns a fault response to any request with an invalid session ID.
Default is 3600 seconds. You can set the SessionExpiryPeriod between 1 and
2,592,000 seconds.

MaxISConnections

Maximum number of connections to the PowerCenter Integration Service that can

be open at one time for the Web Services Hub.
Default is 20.

390

Chapter 23: Web Services Hub

Property

Description

Log Level

Configure the Log Level property to set the logging level. The following values are
valid:
- Fatal. Writes FATAL messages to the log. FATAL messages include nonrecoverable
system failures that cause the service to shut down or become unavailable.
- Error. Writes FATAL and ERROR code messages to the log. ERROR messages
include connection failures, failures to save or retrieve metadata, service errors.
- Warning. Writes FATAL, WARNING, and ERROR messages to the log. WARNING
errors include recoverable system failures or warnings.
- Info. Writes FATAL, INFO, WARNING, and ERROR messages to the log. INFO
messages include system and service change messages.
- Trace. Write FATAL, TRACE, INFO, WARNING, and ERROR code messages to the
log. TRACE messages log user request failures.
- Debug. Write FATAL, DEBUG, TRACE, INFO, WARNING, and ERROR messages to
the log. DEBUG messages are user request logs.

The default value is Info.

MaxConcurrentRequests

Maximum number of request processing threads allowed, which determines the

maximum number of simultaneous requests that can be handled. Default is 100.

MaxQueueLength

Maximum queue length for incoming connection requests when all possible request
processing threads are in use. Any request received when the queue is full is
rejected. Default is 5000.

MaxStatsHistory

Number of days that Informatica keeps statistical information in the history file.
Informatica keeps a history file that contains information regarding the Web
Services Hub activities. The number of days you set in this property determines the
number of days available for which you can display historical statistics in the Web
Services Report page of the Administrator tool.

Maximum Heap Size

Amount of RAM allocated to the Java Virtual Machine (JVM) that runs the Web
Services Hub. Use this property to increase the performance. Append one of the
following letters to the value to specify the units:
-

b for bytes.
k for kilobytes.
m for megabytes.
g for gigabytes.

Default is 512 megabytes.

JVM Command Line
Options

Java Virtual Machine (JVM) command line options to run Java-based programs.
When you configure the JVM options, you must set the Java SDK classpath, Java
SDK minimum memory, and Java SDK maximum memory properties.
You must set the following JVM command line option:
- Dfile.encoding. File encoding. Default is UTF-8.

Use the MaxConcurrentRequests property to set the number of clients that can connect to the Web Services
Hub and the MaxQueueLength property to set the number of client requests the Web Services Hub can
process at one time.
You can change the parameter values based on the number of clients you expect to connect to the Web
Services Hub. In a test environment, set the parameters to smaller values. In a production environment, set
the parameters to larger values. If you increase the values, more clients can connect to the Web Services
Hub, but the connections use more system resources.

Web Services Hub Properties

391

Custom Properties for the Web Services Hub

Configure custom properties that are unique to specific environments.
You might need to apply custom properties in special cases. When you define a custom property, enter the
property name and an initial value. Define custom properties only at the request of Informatica Global
Customer Support.

Configuring the Associated Repository

To expose web services through the Web Services Hub, you must associate the Web Services Hub with a
repository. The code page of the Web Services Hub must be a subset of the code page of the associated
repository.
When you associate a repository with a Web Services Hub, you specify the PowerCenter Repository Service
and the user name and password used to connect to the repository. The PowerCenter Repository Service
that you associate with a Web Services Hub must be in the same domain as the Web Services Hub.
You can associate more than one repository with a Web Services Hub. When you associate more than one
repository with a Web Services Hub, the Web Services Hub can run web services located in any of the
associated repositories.
You can associate more than one Web Services Hub with a PowerCenter repository. When you associate
more than one Web Services Hub with a PowerCenter repository, multiple Web Services Hub Services can
provide the same web services. Different Web Services Hub Services can run separate instances of a web
service. You can use an external load balancer to manage the Web Services Hub Services.
When you associate a Web Services Hub with a PowerCenter Repository Service, the Repository Service
does not have to be running. After you start the Web Services Hub, it periodically checks whether the
PowerCenter Repository Services have started. The PowerCenter Repository Service must be running before
the Web Services Hub can run a web service workflow.

Adding an Associated Repository

If you associate multiple PowerCenter repositories with a Web Services Hub, external clients can access web
services from different repositories through the same Web Services Hub.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

On the Domain Navigator of the Administrator tool, select the Web Services Hub.

3.

Click the Associated Repository tab.

4.

Click Add.
The Select Repository section appears.

392

Chapter 23: Web Services Hub

5.

6.

Enter the properties for the associated repository.

Property

Description

Associated Repository
Service

Name of the PowerCenter Repository Service to which the Web Services Hub
connects. To apply changes, restart the Web Services Hub.

Repository User Name

User name to access the repository. Not available for a domain with Kerberos
authentication.

Repository Password

Password for the user. Not available for a domain with Kerberos authentication.

Security Domain

Security domain for the user. Appears when the Informatica domain contains an
LDAP security domain.

Click OK to save the associated repository properties.

Editing an Associated Repository

If you want to change the repository that associated with the Web Services Hub, edit the properties of the
associated repository.
1.

In the Administrator tool, click the Manage tab > Services and Nodes view.

2.

In the Domain Navigator, select the Web Services Hub for which you want to change an associated
repository.

3.

Click the Associated Repository view.

4.

In the section for the repository you want to edit, click Edit.
The Edit associated repository window appears.

5.

6.

Edit the properties for the associated repository.

Property

Description

Associated Repository
Service

Name of the PowerCenter Repository Service to which the Web Services Hub
connects. To apply changes, restart the Web Services Hub.

Repository User
Name

User name to access the repository. Not available for a domain with Kerberos
authentication.

Repository Password

Password for the user. Not available for a domain with Kerberos authentication.

Security Domain

Security domain for the user. Appears when the Informatica domain contains an
LDAP security domain.

Click OK to save the changes to the associated repository properties.

Configuring the Associated Repository

393

CHAPTER 24

Application Service Upgrade

This chapter includes the following topics:

Application Service Upgrade Overview, 394

Running the Service Upgrade Wizard, 395

Verify the Model Repository Service Upgrade, 396

Application Service Upgrade Overview

The Informatica services version that you upgrade from determines the application service upgrade process.
Some Informatica services versions require that you upgrade the application services. When you upgrade an
application service, you must also upgrade the dependent services. When you upgrade an application
service, the upgrade process upgrades the database contents of the databases associated with the service.
Use the service upgrade wizard, the actions menu of each service, or the command line to upgrade
application services. The service upgrade wizard upgrades multiple services in the appropriate order and
checks for dependencies. If you use the actions menu of each service or the command line to upgrade
application services, you must upgrade the application services in the correct order and verify that you
upgrade dependent services.
The privileges required to upgrade application services depend on the service.
After you upgrade the Model Repository Service, check the log to verify that the upgrade completed
successfully.

Privileges to Upgrade Services

The privileges required to upgrade application services depend on the application service.
A user with the Administrator role on the domain can access the service upgrade wizard.
A user must have these roles, privileges, and permissions to upgrade the following application services:
Model Repository Service
To upgrade the Model Repository Service using the service upgrade wizard, a user must have the
following credentials:

394

Administrator role on the domain.

Create, Edit, and Delete Projects privilege for the Model Repository Service and write permission on
projects.

To upgrade the Model Repository Service from the Actions menu or from the command line, a user must
have the following credentials:

Manage Services privilege for the domain and permission on the Model Repository Service.

Create, Edit, and Delete Projects privilege for the Model Repository Service and write permission on
projects.

Data Integration Service

To upgrade the Data Integration Service, a user must have the Administrator role on the Data Integration
Service.
Content Management Service
To upgrade the Content Management Service, a user must have the Administrator role on the Content
Management Service.
PowerCenter Repository Service
To upgrade the PowerCenter Repository Service, a user must have the Manage Services privilege for
the domain and permission on the PowerCenter Repository Service.
Metadata Manager Service
To upgrade the Metadata Manager Service, a user must have the Manage Services privilege for the
domain and permission on the Metadata Manager Service.

Service Upgrade from Previous Versions

When you upgrade from a previous version, some application services require an upgrade. Upgrade the
application services that you used in the previous version.
Before you upgrade, verify that the Metadata Manager Service is disabled. Verify that all other application
services are enabled.
To upgrade application services, upgrade the following services and associated databases in this order:
1.

Model Repository Service

2.

Data Integration Service

3.

Profiling warehouse for the Data Integration Service

4.

Metadata Manager Service

5.

PowerCenter Repository Service

Note: When you upgrade all other application services, the upgrade process upgrades the database contents
of the databases associated with the service.

Running the Service Upgrade Wizard

Use the service upgrade wizard to upgrade application services and the database contents of the databases
associated with the services. The service upgrade wizard displays upgraded services in a list along with

Running the Service Upgrade Wizard

395

services and associated databases that require an upgrade. You can also save the current or previous
upgrade report.
Note: The Metadata Manager Service must be disabled before the upgrade. All other services must be
enabled before the upgrade.
1.

In the Informatica Administrator header area click Manage > Upgrade.

2.

Select the application services and associated databases to upgrade.

3.

Optionally, specify if you want to Automatically recycle services after upgrade.

If you choose to automatically recycle application services after the upgrade, the upgrade wizard restarts
the services after they have been upgraded.

4.

Click Next.

5.

If dependency errors exist, the Dependency Errors dialog box appears. Review the dependency errors
and click OK. Then, resolve dependency errors and click Next.

6.

Enter the repository login information.

7.

Click Next.
The service upgrade wizard upgrades each application service and associated database and displays
the status and processing details.

8.

When the upgrade completes, the Summary section displays the list of application services and their
upgrade status. Click each service to view the upgrade details in the Service Details section.

9.

Optionally, click Save Report to save the upgrade details to a file.

If you choose not to save the report, you can click Save Previous Report the next time you launch the
service upgrade wizard.

10.

Click Close.

11.

If you did not choose to automatically recycle application services after the upgrade, restart the
upgraded services.

You can view the upgrade report and save the upgrade report. The second time you run the service upgrade
wizard, the Save Previous Report option appears in the service upgrade wizard. If you did not save the
upgrade report after upgrading services, you can select this option to view or save the previous upgrade
report.

Verify the Model Repository Service Upgrade

After you upgrade the Model Repository Service, check the Model Repository Service log to verify that the
upgrade completed successfully.

Object Dependency Graph

When you upgrade a Model Repository Service, the upgrade process upgrades the contents of the Model
repository and rebuilds the object dependency graph.
If the upgrade process encounters a fatal error while upgrading the Model repository contents, then the
service upgrade fails. The Administrator tool or the command line program informs you that you must perform
the upgrade again.

396

Chapter 24: Application Service Upgrade

If the upgrade process encounters a fatal error while rebuilding the object dependency graph, then the
upgrade of the service succeeds. You cannot view object dependencies in the Developer tool until you
rebuild the object dependency graph.
After you upgrade the Model Repository Service, verify that the Model Repository Service log includes the
following message:
MRS_50431 "Finished rebuilding the object dependency graph for project group '<project
group>'."
If the message does not exist in the log, run the infacmd mrs rebuildDependencyGraph command to rebuild
the object dependency graph. Users must not access Model repository objects until the rebuild process
completes, or the object dependency graph might not be accurate. Ask the users to log out of the Model
Repository Service before service upgrade.
The infacmd mrs rebuildDependencyGraph command uses the following syntax:
rebuildDependencyGraph
<-DomainName|-dn> domain_name
[<-SecurityDomain|-sdn> security_domain]
<-UserName|-un> user_name
<-Password|-pd> password
<-ServiceName|-sn> service_name
[<-ResilienceTimeout|-re> timeout_period_in_seconds]

Maximum Heap Size

After you upgrade the Model repository, reset the maximum heap size to the recommended 1 GB setting.
The upgrade process resets the Model Repository Service maximum heap size to 4 GB. After the upgrade,
reset the maximum heap size property to the value to which it was set prior to the upgrade, or to the setting
that Global Customer Support recommended for your environment.
To reset the maximum heap size, select the service in the Domain Navigator, click the Properties view, and
expand Advanced Properties. Set the Maximum Heap Size property to the pre-upgrade value. Set the
permGen property to the minimum of 512 MB.

Verify the Model Repository Service Upgrade

397

APPENDIX A

Application Service Databases

This appendix includes the following topics:

Application Service Databases Overview, 398

Set Up Database User Accounts, 399

Data Analyzer Repository Database Requirements, 399

Data Object Cache Database Requirements, 401

Jaspersoft Repository Database Requirements, 402

Metadata Manager Repository Database Requirements, 402

Model Repository Database Requirements, 406

PowerCenter Repository Database Requirements, 407

Profiling Warehouse Requirements, 409

Reference Data Warehouse Requirements, 410

Workflow Database Requirements, 411

Configure Native Connectivity on Service Machines, 413

Application Service Databases Overview

Informatica stores data and metadata in repositories in the domain. Before you create the application
services, set up the databases and database user accounts for the repositories associated with the
application services.
Set up a database and user account for the following repositories:

398

Data Analyzer repository

Data object cache repository

Workflow repository

Jaspersoft repository

Metadata Manager repository

Model repository

PowerCenter repository

Profiling warehouse

Reference data warehouse

To prepare the databases, verify the database requirements and set up the database. The database
requirements depend on the application services that you create in the domain and the number of data
integration objects that you build and store in the repositories.

Set Up Database User Accounts

Set up a database and user account for the domain configuration repository and for the repository databases
associated with the applications services.
Use the following rules and guidelines when you set up the user accounts:

The database user account must have permissions to create and drop tables, indexes, and views, and to
select, insert, update, and delete data from tables.

Use 7-bit ASCII to create the password for the account.

To prevent database errors in one repository from affecting any other repository, create each repository in
a separate database schema with a different database user account. Do not create a repository in the
same database schema as the domain configuration repository or any other repository in the domain.

If you create more than one domain, each domain configuration repository must have a separate user
account.

Data Analyzer Repository Database Requirements

The Data Analyzer repository stores metadata for schemas, metrics and attributes, queries, reports, user
profiles, and other objects for the Reporting Service.
You must specify the Data Analyzer repository details when you create a Reporting Service. The Reporting
Service provides the Data Analyzer repository with the metadata corresponding to the selected data source.
The Data Analyzer repository supports the following database types:

IBM DB2 UDB

Microsoft SQL Server

Oracle

Sybase ASE

Allow 60 MB of disk space for the database.

IBM DB2 Database Requirements

Use the following guidelines when you set up the repository on IBM DB2:

Informatica does not support IBM DB2 table aliases for repository tables. Verify that table aliases have not
been created for any tables in the database.

Set Up Database User Accounts

399

Microsoft SQL Server Database Requirements

Use the following guidelines when you set up the repository on Microsoft SQL Server:

If you create the repository in Microsoft SQL Server 2005, Microsoft SQL Server must be installed with
case-insensitive collation.

If you create the repository in Microsoft SQL Server 2005, the repository database must have a database
compatibility level of 80 or earlier. Data Analyzer uses non-ANSI SQL statements that Microsoft SQL
Server supports only on a database with a compatibility level of 80 or earlier.
To set the database compatibility level to 80, run the following query against the database:
sp_dbcmptlevel <DatabaseName>, 80
Or open the Microsoft SQL Server Enterprise Manager, right-click the database, and select Properties >
Options. Set the compatibility level to 80 and click OK.

Oracle Database Requirements

Use the following guidelines when you set up the repository on Oracle:

Set the storage size for the tablespace to a small number to prevent the repository from using an
excessive amount of space. Also verify that the default tablespace for the user that owns the repository
tables is set to a small size.
The following example shows how to set the recommended storage parameter for a tablespace named
REPOSITORY:
ALTER TABLESPACE "REPOSITORY" DEFAULT STORAGE ( INITIAL 10K NEXT 10K MAXEXTENTS
UNLIMITED PCTINCREASE 50 );
Verify or change the storage parameter for a tablespace before you create the repository.

Verify that the database user has the CONNECT, RESOURCE, and CREATE VIEW privileges.

Informatica does not support Oracle public synonyms for repository tables. Verify that public synonyms
have not been created for any tables in the database.

Sybase ASE Database Requirements

Use the following guidelines when you set up the repository on Sybase ASE:

Set the database server page size to 8K or higher. This is a one-time configuration and cannot be
changed afterwards.
The database for the Data Analyzer repository requires a page size of at least 8 KB. If you set up a Data
Analyzer database on a Sybase ASE instance with a page size smaller than 8 KB, Data Analyzer can
generate errors when you run reports. Sybase ASE relaxes the row size restriction when you increase the
page size.
Data Analyzer includes a GROUP BY clause in the SQL query for the report. When you run the report,
Sybase ASE stores all GROUP BY and aggregate columns in a temporary worktable. The maximum index
row size of the worktable is limited by the database page size. For example, if Sybase ASE is installed
with the default page size of 2 KB, the index row size cannot exceed 600 bytes. However, the GROUP BY
clause in the SQL query for most Data Analyzer reports generates an index row size larger than 600
bytes.

400

Verify the database user has CREATE TABLE and CREATE VIEW privileges.

Set "allow nulls by default" to TRUE.

Enable the Distributed Transaction Management (DTM) option on the database server.

Appendix A: Application Service Databases

Create a DTM user account and grant the dtm_tm_role to the user.
The following table lists the DTM configuration setting for the dtm_tm_role value:
DTM Configuration

Sybase System Procedure

Value

Distributed Transaction
Management privilege

sp_role "grant"

dtm_tm_role, username

Data Object Cache Database Requirements

The data object cache database stores cached logical data objects and virtual tables for the Data Integration
Service. You specify the data object cache database connection when you create the Data Integration
Service.
The data object cache database supports the following database types:

IBM DB2 UDB

Microsoft SQL Server

Oracle

Allow 200 MB of disk space for the database.

Note: Ensure that you install the database client on the machine on which you want to run the Data
Integration Service.

IBM DB2 Database Requirements

Use the following guidelines when you set up the repository on IBM DB2:

Verify that the database user account has CREATETAB and CONNECT privileges.

Informatica does not support IBM DB2 table aliases for repository tables. Verify that table aliases have not
been created for any tables in the database.

Set the tablespace pageSize parameter to 32768 bytes.

Set the NPAGES parameter to at least 5000. The NPAGES parameter determines the number of pages in
the tablespace.

Microsoft SQL Server Database Requirements

Use the following guidelines when you set up the repository on Microsoft SQL Server:

Verify that the database user account has CONNECT and CREATE TABLE privileges.

Oracle Database Requirements

Use the following guidelines when you set up the repository on Oracle:

Verify that the database user has the CONNECT, RESOURCE, and CREATE VIEW privileges.

Informatica does not support Oracle public synonyms for repository tables. Verify that public synonyms
have not been created for any tables in the database.

Data Object Cache Database Requirements

401

Jaspersoft Repository Database Requirements

The Jaspersoft repository stores reports, data sources, and metadata corresponding to the data source.
You must specify the Jaspersoft repository details when you create the Reporting and Dashboards Service.
The Jaspersoft repository supports the following database types:

IBM DB2 UDB

Microsoft SQL Server

Oracle

Allow 10 MB of disk space for the database.

IBM DB2 Database Requirements

Use the following guidelines when you set up the repository on IBM DB2:

Verify that the database user account has CREATETAB and CONNECT privileges.

Informatica does not support IBM DB2 table aliases for repository tables. Verify that table aliases have not
been created for any tables in the database.

Microsoft SQL Server Database Requirements

Use the following guidelines when you set up the repository on Microsoft SQL Server:

Verify that the database user account has CONNECT and CREATE TABLE privileges.

Oracle Database Requirements

Use the following guidelines when you set up the repository on Oracle:

Verify that the database user account has CONNECT and RESOURCE privileges.

Informatica does not support Oracle public synonyms for repository tables. Verify that public synonyms
have not been created for any tables in the database.

Metadata Manager Repository Database

Requirements
Metadata Manager repository contains the Metadata Manager warehouse and models. The Metadata
Manager warehouse is a centralized metadata warehouse that stores the metadata from metadata sources.
Specify the repository details when you create a Metadata Manager Service.
The Metadata Manager repository supports the following database types:

IBM DB2 UDB

Microsoft SQL Server

Oracle

Allow 1 GB of disk space for the database.

402

Appendix A: Application Service Databases

For more information about configuring the database, see the documentation for your database system.

IBM DB2 Database Requirements

Use the following guidelines when you set up the repository on IBM DB2:

The database user account that creates the repository must have privileges to perform the following
operations:
ALTER TABLE
CREATE FUNCTION
CREATE INDEX
CREATE PROCEDURE
CREATE TABLE
CREATE VIEW
DROP PROCEDURE
DROP TABLE
INSERT INTO

The database user that creates the repository must be able to create tablespaces with page sizes of 32
KB.

Set up system temporary tablespaces larger than the default page size of 4 KB and update the heap
sizes.
Queries running against tables in tablespaces defined with a page size larger than 4 KB require system
temporary tablespaces with a page size larger than 4 KB. If there are no system temporary table spaces
defined with a larger page size, the queries can fail. The server displays the following error:
SQL 1585N A system temporary table space with sufficient page size does not exist.
SQLSTATE=54048
Create system temporary tablespaces with page sizes of 8 KB, 16 KB, and 32 KB. Run the following SQL
statements on each database to configure the system temporary tablespaces and update the heap sizes:
CREATE Bufferpool RBF IMMEDIATE SIZE 1000 PAGESIZE 32 K EXTENDED STORAGE ;
CREATE Bufferpool STBF IMMEDIATE SIZE 2000 PAGESIZE 32 K EXTENDED STORAGE ;
CREATE REGULAR TABLESPACE REGTS32 PAGESIZE 32 K MANAGED BY SYSTEM USING ('C:
\DB2\NODE0000\reg32' ) EXTENTSIZE 16 OVERHEAD 10.5 PREFETCHSIZE 16 TRANSFERRATE 0.33
BUFFERPOOL RBF;
CREATE SYSTEM TEMPORARY TABLESPACE TEMP32 PAGESIZE 32 K MANAGED BY SYSTEM USING
('C:\DB2\NODE0000\temp32' ) EXTENTSIZE 16 OVERHEAD 10.5 PREFETCHSIZE 16 TRANSFERRATE
0.33 BUFFERPOOL STBF;
GRANT USE OF TABLESPACE REGTS32 TO USER <USERNAME>;
UPDATE DB CFG FOR <DB NAME> USING APP_CTL_HEAP_SZ 16384
UPDATE DB CFG FOR <DB NAME> USING APPLHEAPSZ 16384
UPDATE DBM CFG USING QUERY_HEAP_SZ 8000
UPDATE DB CFG FOR <DB NAME> USING LOGPRIMARY 100
UPDATE DB CFG FOR <DB NAME> USING LOGFILSIZ 2000
UPDATE DB CFG FOR <DB NAME> USING LOCKLIST 1000
UPDATE DB CFG FOR <DB NAME> USING DBHEAP 2400
"FORCE APPLICATIONS ALL"
DB2STOP
DB2START

Set the locking parameters to avoid deadlocks when you load metadata into a Metadata Manager
repository on IBM DB2.

Metadata Manager Repository Database Requirements

403

The following table lists the locking parameters you can configure:
Parameter Name

Value

IBM DB2 Description

LOCKLIST

8192

Max storage for lock list (4KB)

MAXLOCKS

10

Percent of lock lists per application

LOCKTIMEOUT

300

Lock timeout (sec)

DLCHKTIME

10000

Interval for checking deadlock (ms)

Also, for IBM DB2 9.7 and earlier, set the DB2_RR_TO_RS parameter to YES to change the read policy
from Repeatable Read to Read Stability.

Informatica does not support IBM DB2 table aliases for repository tables. Verify that table aliases have not
been created for any tables in the database.

Note: If you use IBM DB2 as a metadata source, the source database has the same configuration
requirements.

Microsoft SQL Server Database Requirements

Use the following guidelines when you set up the repository on Microsoft SQL Server:

The database user account that creates the repository must have privileges to perform the following
operations:
ALTER TABLE
CREATE CLUSTERED INDEX
CREATE INDEX
CREATE PROCEDURE
CREATE TABLE
CREATE VIEW
DROP PROCEDURE
DROP TABLE
INSERT INTO

404

If the repository must store metadata in a multibyte language, set the database collation to that multibyte
language when you install Microsoft SQL Server. For example, if the repository must store metadata in
Japanese, set the database collation to a Japanese collation when you install Microsoft SQL Server. This
is a one-time configuration and cannot be changed.

Appendix A: Application Service Databases

Oracle Database Requirements

Use the following guidelines when you set up the repository on Oracle:

The database user account that creates the repository must have privileges to perform the following
operations:
ALTER TABLE
CREATE CLUSTER
CREATE INDEX
CREATE OR REPLACE FORCE VIEW
CREATE OR REPLACE PROCEDURE
CREATE OR REPLACE VIEW
CREATE TABLE
DROP TABLE
INSERT INTO TABLE

Set the following parameters for the tablespace on Oracle:

<Temporary tablespace>
Resize to at least 2 GB.
CURSOR_SHARING
Set to FORCE.
MEMORY_TARGET
Set to at least 4 GB.
Run SELECT * FROM v$memory_target_advice ORDER BY memory_size; to determine the optimal
MEMORY_SIZE.
MEMORY_MAX_TARGET
Set to greater than the MEMORY_TARGET size.
If MEMORY_MAX_TARGET is not specified, MEMORY_MAX_TARGET defaults to the
MEMORY_TARGET setting.
OPEN_CURSORS
Set to 500 shared.
Monitor and tune open cursors. Query v$sesstat to determine the number of currently-opened
cursors. If the sessions are running close to the limit, increase the value of OPEN_CURSORS.
UNDO_MANAGEMENT
Set to AUTO.

If the repository must store metadata in a multibyte language, set the NLS_LENGTH_SEMANTICS
parameter to CHAR on the database instance. Default is BYTE.

Informatica does not support Oracle public synonyms for repository tables. Verify that public synonyms
have not been created for any tables in the database.

Metadata Manager Repository Database Requirements

405

Model Repository Database Requirements

Informatica services and clients store data and metadata in the Model repository. Before you create the
Model Repository Service, set up a database and database user account for the Model repository.
The Model repository supports the following database types:

IBM DB2 UDB

Microsoft SQL Server

Oracle

Allow 3 GB of disk space for DB2. Allow 200 MB of disk space for all other database types.
For more information about configuring the database, see the documentation for your database system.

IBM DB2 Database Requirements

Use the following guidelines when you set up the repository on IBM DB2:

If the repository is in an IBM DB2 9.7 database, verify that IBM DB2 Version 9.7 Fix Pack 7 or a later fix
pack is installed.

On the IBM DB2 instance where you create the database, set the following parameters to ON:
- DB2_SKIPINSERTED
- DB2_EVALUNCOMMITTED
- DB2_SKIPDELETED
- AUTO_RUNSTATS

On the database, set the configuration parameters.

The following table lists the configuration parameters that you must set:
Parameter

Value

applheapsz

8192

appl_ctl_heap_sz

8192
For IBM DB2 9.5 only.

logfilsiz

8000

maxlocks

98

locklist

50000

auto_stmt_stats

ON

Set the tablespace pageSize parameter to 32768 bytes.

In a single-partition database, specify a tablespace that meets the pageSize requirements. If you do not
specify a tablespace, the default tablespace must meet the pageSize requirements.
In a multi-partition database, specify a tablespace that meets the pageSize requirements. Define the
tablespace in the catalog partition of the database.

406

Set the NPAGES parameter to at least 5000. The NPAGES parameter determines the number of pages in
the tablespace.

Appendix A: Application Service Databases

Verify that the database user has CREATETAB, CONNECT, and BINDADD privileges.

Informatica does not support IBM DB2 table aliases for repository tables. Verify that table aliases have not
been created for any tables in the database.

In the DataDirect Connect for JDBC utility, update the DynamicSections parameter to 3000.
The default value for DynamicSections is too low for the Informatica repositories. Informatica requires a
larger DB2 package than the default. When you set up the DB2 database for the domain configuration
repository or a Model repository, you must set the DynamicSections parameter to at least 3000. If the
DynamicSections parameter is set to a lower number, you can encounter problems when you install or run
Informatica services.
For more information about updating the DynamicSections parameter, see Appendix D, Updating the
DynamicSections Parameter of a DB2 Database on page 447.

Microsoft SQL Server Database Requirements

Use the following guidelines when you set up the repository on Microsoft SQL Server:

Set the read committed isolation level to READ_COMMITTED_SNAPSHOT to minimize locking

contention.
To set the isolation level for the database, run the following command:
ALTER DATABASE DatabaseName SET READ_COMMITTED_SNAPSHOT ON
To verify that the isolation level for the database is correct, run the following command:
SELECT is_read_committed_snapshot_on FROM sys.databases WHERE name = DatabaseName

The database user account must have the CONNECT, CREATE TABLE, and CREATE VIEW privileges.

Oracle Database Requirements

Use the following guidelines when you set up the repository on Oracle:

Verify that the database user has the CONNECT, RESOURCE, and CREATE VIEW privileges.

Informatica does not support Oracle public synonyms for repository tables. Verify that public synonyms
have not been created for any tables in the database.

PowerCenter Repository Database Requirements

A PowerCenter repository is a collection of database tables containing metadata. A PowerCenter Repository
Service manages the repository and performs all metadata transactions between the repository database and
repository clients.
The PowerCenter repository supports the following database types:

IBM DB2 UDB

Microsoft SQL Server

Oracle

Sybase ASE

Allow 35 MB of disk space for the database.

PowerCenter Repository Database Requirements

407

Note: Ensure that you install the database client on the machine on which you want to run the PowerCenter
Repository Service.
For more information about configuring the database, see the documentation for your database system.

IBM DB2 Database Requirements

Use the following guidelines when you set up the repository on IBM DB2:

To optimize repository performance, set up the database with the tablespace on a single node. When the
tablespace is on one node, PowerCenter Client and PowerCenter Integration Service access the
repository faster than if the repository tables exist on different database nodes.
Specify the single-node tablespace name when you create, copy, or restore a repository. If you do not
specify the tablespace name, DB2 uses the default tablespace.

Informatica does not support IBM DB2 table aliases for repository tables. Verify that table aliases have not
been created for any tables in the database.

Microsoft SQL Server Database Requirements

Use the following guidelines when you set up the repository on Microsoft SQL Server:

Set the database server page size to 8K or higher. This is a one-time configuration and cannot be
changed afterwards.

Verify that the database user account has the CONNECT, CREATE TABLE, and CREATE VIEW
privileges.

Oracle Database Requirements

Use the following guidelines when you set up the repository on Oracle:

Set the storage size for the tablespace to a small number to prevent the repository from using an
excessive amount of space. Also verify that the default tablespace for the user that owns the repository
tables is set to a small size.
The following example shows how to set the recommended storage parameter for a tablespace named
REPOSITORY:
ALTER TABLESPACE "REPOSITORY" DEFAULT STORAGE ( INITIAL 10K NEXT 10K MAXEXTENTS
UNLIMITED PCTINCREASE 50 );
Verify or change the storage parameter for a tablespace before you create the repository.

Verify that the database user has the CONNECT, RESOURCE, and CREATE VIEW privileges.

Informatica does not support Oracle public synonyms for repository tables. Verify that public synonyms
have not been created for any tables in the database.

Sybase ASE Database Requirements

Use the following guidelines when you set up the repository on Sybase ASE:

408

Set the database server page size to 8K or higher. This is a one-time configuration and cannot be
changed afterwards.

Set the Sybase database option "ddl in tran" to TRUE.

Set "allow nulls by default" to TRUE.

Verify the database user has CREATE TABLE and CREATE VIEW privileges.

Appendix A: Application Service Databases

Set the database memory configuration requirements.

The following table lists the memory configuration requirements and the recommended baseline values:
Database Configuration

Sybase System Procedure

Value

Number of open objects

sp_configure "number of open objects"

5000

Number of open indexes

sp_configure "number of open indexes"

5000

Number of open partitions

sp_configure "number of open partitions"

8000

Number of locks

sp_configure "number of locks"

100000

Profiling Warehouse Requirements

The profiling warehouse database stores profiling and scorecard results. You specify the profiling warehouse
connection when you create the Data Integration Service.
The profiling warehouse supports the following database types:

IBM DB2 UDB

Microsoft SQL Server

Oracle

Allow 10 GB of disk space for the database.

Note: Ensure that you install the database client on the machine on which you want to run the Data
Integration Service.
For more information about configuring the database, see the documentation for your database system.

IBM DB2 Database Requirements

Use the following guidelines when you set up the repository on IBM DB2:

The database user account must have the CREATETAB, CONNECT, CREATE VIEW, and CREATE
FUNCTION privileges.

Informatica does not support IBM DB2 table aliases for repository tables. Verify that table aliases have not
been created for any tables in the database.

Set the tablespace pageSize parameter to 32768 bytes.

Set the NPAGES parameter to at least 5000. The NPAGES parameter determines the number of pages in
the tablespace.

Microsoft SQL Server Database Requirements

Use the following guidelines when you set up the repository on Microsoft SQL Server:

The database user account must have the CONNECT, CREATE TABLE, CREATE VIEW, and CREATE
FUNCTION privileges.

Profiling Warehouse Requirements

409

Oracle Database Requirements

Use the following guidelines when you set up the repository on Oracle:

Verify that the database user has CONNECT, RESOURCE, CREATE VIEW, CREATE PROCEDURE, and
CREATE FUNCTION privileges.

Informatica does not support Oracle public synonyms for repository tables. Verify that public synonyms
have not been created for any tables in the database.

Reference Data Warehouse Requirements

The reference data warehouse stores the data values for reference table objects that you define in a Model
repository. You configure a Content Management Service to identify the reference data warehouse and the
Model repository.
You associate a reference data warehouse with a single Model repository. You can select a common
reference data warehouse on multiple Content Management Services if the Content Management Services
identify a common Model repository. The reference data warehouse must support mixed-case column names.
The reference data warehouse supports the following database types:

IBM DB2 UDB

Microsoft SQL Server

Oracle

Allow 200 MB of disk space for the database.

Note: Ensure that you install the database client on the machine on which you want to run the Content
Management Service.

IBM DB2 Database Requirements

Use the following guidelines when you set up the repository on IBM DB2:

Verify that the database user account has CREATETAB and CONNECT privileges.

Verify that the database user has SELECT privileges on the SYSCAT.DBAUTH and
SYSCAT.DBTABAUTH tables.

Informatica does not support IBM DB2 table aliases for repository tables. Verify that table aliases have not
been created for any tables in the database.

Set the tablespace pageSize parameter to 32768 bytes.

Set the NPAGES parameter to at least 5000. The NPAGES parameter determines the number of pages in
the tablespace.

Microsoft SQL Server Database Requirements

Use the following guidelines when you set up the repository on Microsoft SQL Server:

410

Verify that the database user account has CONNECT and CREATE TABLE privileges.

Appendix A: Application Service Databases

Oracle Database Requirements

Use the following guidelines when you set up the repository on Oracle:

Verify that the database user account has CONNECT and RESOURCE privileges.

Informatica does not support Oracle public synonyms for repository tables. Verify that public synonyms
have not been created for any tables in the database.

Workflow Database Requirements

The Data Integration Service stores run-time metadata for workflows in the workflow database. Before you
create the workflow database, set up a database and database user account for the workflow database.
You specify the workflow database connection when you create the Data Integration Service.
The workflow database supports the following database types:

IBM DB2 UDB

Microsoft SQL Server

Oracle

Allow 200 MB of disk space for the database.

Note: Ensure that you install the database client on the machine on which you want to run the Data
Integration Service.

IBM DB2 Database Requirements

Use the following guidelines when you set up the repository on IBM DB2:

Verify that the database user account has CREATETAB and CONNECT privileges.

Informatica does not support IBM DB2 table aliases for repository tables. Verify that table aliases have not
been created for any tables in the database.

Set the tablespace pageSize parameter to 32768 bytes.

Set the NPAGES parameter to at least 5000. The NPAGES parameter determines the number of pages in
the tablespace.

Set the connection pooling parameters.

The following table lists the connection pooling parameters that you must set:
Parameter

Value

Maximum Connection Pool Size

128

Minimum Connection Pool Size

Maximum Idle Time

120 seconds

Workflow Database Requirements

411

Microsoft SQL Server Database Requirements

Use the following guidelines when you set up the repository on Microsoft SQL Server:

Verify that the database user account has CONNECT and CREATE TABLE privileges.

Enable JTA and XA datasource functionality on the database.

Set the connection pooling parameters.

The following table lists the connection pooling parameters that you must set:
Parameter

Value

Maximum Connection Pool Size

128

Minimum Connection Pool Size

Maximum Idle Time

120 seconds

Oracle Database Requirements

Use the following guidelines when you set up the repository on Oracle:

Verify that the database user has the CONNECT, RESOURCE, and CREATE VIEW privileges.

Informatica does not support Oracle public synonyms for repository tables. Verify that public synonyms
have not been created for any tables in the database.

Set the connection pooling parameters.

The following table lists the connection pooling parameters that you must set:

Parameter

Value

Maximum Connection Pool Size

128

Minimum Connection Pool Size

Maximum Idle Time

120 seconds

Optionally, configure the database for Oracle Advanced Security Option (ASO). You can activate Oracle
ASO for the database if the Informatica installation supports Oracle ASO.
For information about preparing the Informatica installation for Oracle ASO, consult the following
Informatica Knowledge Base article:
Can Oracle Advanced Security Option (ASO) be used with Informatica Data Quality Services? (KB
152376)

412

Appendix A: Application Service Databases

Configure Native Connectivity on Service Machines

To establish native connectivity between an application service and a database, install the database client
software for the database that you want to access.
Native drivers are packaged with the database server and client software. Configure connectivity on the
machines that need to access the databases. To ensure compatibility between the application service and
the database, install a client software that is compatible with the database version and use the appropriate
database client libraries.
The following services use native connectivity to connect to different databases:
Data Integration Service
The Data Integration Service uses native database drivers to connect to the following databases:

Source and target databases. Reads data from source databases and writes data to target
databases.

Data object cache database. Stores the data object cache.

Profiling source databases. Reads from relational source databases to run profiles against the
sources.

Profiling warehouse. Writes the profiling results to the profiling warehouse.

Reference tables. Runs mappings to transfer data between the reference tables and the external data
sources.

When the Data Integration Service runs on a single node or on primary and back-up nodes, install
database client software and configure connectivity on the machines where the Data Integration Service
runs.
When the Data Integration Service runs on a grid, install database client software and configure
connectivity on each machine that represents a node with the compute role or a node with both the
service and compute roles.
PowerCenter Repository Service
The PowerCenter Repository Service uses native database drivers to connect to the PowerCenter
repository database.
Install database client software and configure connectivity on the machines where the PowerCenter
Repository Service and the PowerCenter Repository Service processes run.
PowerCenter Integration Service
The PowerCenter Integration Service uses native database drivers to connect to the following
databases:

Source and target databases. Reads from the source databases and writes to the target databases.

Metadata Manager source databases. Loads the relational data sources in Metadata Manager.

Install database client software associated with the relational data sources and the repository databases
on the machines where the PowerCenter Integration Service runs.

Install Database Client Software

You must install the database clients on the required machines based on the types of databases that the
application services access.
To ensure compatibility between the application service and the database, use the appropriate database
client libraries and install a client software that is compatible with the database version.

Configure Native Connectivity on Service Machines

413

Install the following database client software based on the type of database that the application service
accesses:
IBM DB2 Client Application Enabler (CAE)
Configure connectivity on the required machines by logging in to the machine as the user who starts
Informatica services.
Microsoft SQL Server 2012 Native Client
Download the client from the following Microsoft website:
http://www.microsoft.com/en-in/download/details.aspx?id=29065.
Oracle client
Install compatible versions of the Oracle client and Oracle database server. You must also install the
same version of the Oracle client on all machines that require it. To verify compatibility, contact Oracle.
Sybase Open Client (OCS)
Install an Open Client version that is compatible with the Sybase ASE database server. You must also
install the same version of Open Client on the machines hosting the Sybase ASE database and
Informatica. To verify compatibility, contact Sybase.

Configure Database Client Environment Variables on UNIX

Configure database client environment variables on the machines that run the Data Integration Service,
PowerCenter Integration Service, and PowerCenter Repository Service processes.
The database client path variable name and requirements depend on the UNIX platform and the database.
After you configure the database environment variables, you can test the connection to the database from the
database client.
The following table lists the database environment variables you need to set in UNIX:
Database

Environment Variable
Name

Database
Utility

Oracle

ORACLE_HOME

sqlplus

PATH
IBM DB2

Sybase
ASE

414

DB2DIR

Value

Set to: <DatabasePath>

Add: <DatabasePath>/bin

db2connect

Set to: <DatabasePath>

DB2INSTANCE

Set to: <DB2InstanceName>

PATH

Add: <DatabasePath>/bin

SYBASE15

isql

Set to: <DatabasePath>/sybase<version>

SYBASE_ASE

Set to: ${SYBASE15}/ASE-<version>

SYBASE_OCS

Set to: ${SYBASE15}/OCS-<version>

PATH

Add: ${SYBASE_ASE}/bin:${SYBASE_OCS}/bin:
$PATH

Appendix A: Application Service Databases

APPENDIX B

Connecting to Databases from

Windows
This appendix includes the following topics:

Connecting to Databases from Windows Overview, 415

Connecting to an IBM DB2 Universal Database from Windows, 416

Connecting to an Informix Database from Windows, 416

Connecting to Microsoft Access and Microsoft Excel from Windows, 417

Connecting to a Microsoft SQL Server Database from Windows, 417

Connecting to a Netezza Database from Windows, 419

Connecting to an Oracle Database from Windows, 419

Connecting to a Sybase ASE Database from Windows, 421

Connecting to a Teradata Database from Windows, 422

Connecting to Databases from Windows Overview

Configure connectivity to enable communication between clients, services, and other components in the
domain.
To use native connectivity, you must install and configure the database client software for the database that
you want to access. To ensure compatibility between the application service and the database, install a client
software that is compatible with the database version and use the appropriate database client libraries. To
increase performance, use native connectivity.
The Informatica installation includes DataDirect ODBC drivers. If you have existing ODBC data sources
created with an earlier version of the drivers, you must create new ODBC data sources using the new drivers.
Configure ODBC connections using the DataDirect ODBC drivers provided by Informatica or third party
ODBC drivers that are Level 2 compliant or higher.
The Informatica installation includes DataDirect JDBC drivers. You can use these drivers without performing
additional steps. You can also download JDBC Type 4 drivers from third-party vendors to connect to sources
and targets. You can use any third-party JDBC driver that is JDBC 3.0 or later.
You must configure a database connection for the following services in the Informatica domain:

PowerCenter Repository Service

Model Repository Service

415

Reporting Service

Data Integration Service

Analyst Service

Connecting to an IBM DB2 Universal Database from

Windows
For native connectivity, install the version of IBM DB2 Client Application Enabler (CAE) appropriate for the
IBM DB2 database server version. To ensure compatibility between Informatica and databases, use the
appropriate database client libraries.

Configuring Native Connectivity

You can configure native connectivity to an IBM DB2 database to increase performance.
The following steps provide a guideline for configuring native connectivity. For specific instructions, see the
database documentation.
1.

Verify that the following environment variable settings have been established by IBM DB2 Client
Application Enabler (CAE):
DB2HOME=C:\IBM\SQLLIB
DB2INSTANCE=DB2
DB2CODEPAGE=1208 (Sometimes required. Use only if you encounter problems. Depends on
the locale, you may use other values.)

2.

Verify that the PATH environment variable includes the IBM DB2 bin directory. For example:
PATH=C:\WINNT\SYSTEM32;C:\SQLLIB\BIN;...

3.

4.

Configure the IBM DB2 client to connect to the database that you want to access. To configure the IBM
DB2 client:
a.

Launch the IBM DB2 Configuration Assistant.

b.

Add the database connection.

c.

Bind the connection.

Run the following command in the IBM DB2 Command Line Processor to verify that you can connect to
the IBM DB2 database:
CONNECT TO <dbalias> USER <username> USING <password>

5.

If the connection is successful, run the TERMINATE command to disconnect from the database. If the
connection fails, see the database documentation.

Connecting to an Informix Database from Windows

Use ODBC to connect to an Informix database on Windows. Create an ODBC data source by using the
DataDirect ODBC drivers installed with Informatica. To ensure compatibility between Informatica and
databases, use the appropriate database client libraries.
Note: If you use the DataDirect ODBC driver provided by Informatica, you do not need the database client.
The ODBC wire protocols do not require the database client software to connect to the database.

416

Appendix B: Connecting to Databases from Windows

Configuring ODBC Connectivity

You can configure ODBC connectivity to an Informix database.
The following steps provide a guideline for configuring ODBC connectivity. For specific instructions, see the
database documentation.
1.

Create an ODBC data source using the DataDirect ODBC Wire Protocol driver for Informix provided by
Informatica.

2.

Verify that you can connect to the Informix database using the ODBC data source.

Connecting to Microsoft Access and Microsoft Excel

from Windows
Configure connectivity to the Informatica components on Windows.
Install Microsoft Access or Excel on the machine where the Data Integration Service and PowerCenter
Integration Service processes run. Create an ODBC data source for the Microsoft Access or Excel data you
want to access.

Configuring ODBC Connectivity

You can configure ODBC connectivity to a Microsoft Access or Excel database.
The following steps provide a guideline for configuring ODBC connectivity. For specific instructions, see the
database documentation.
1.

Create an ODBC data source using the driver provided by Microsoft.

2.

To avoid using empty string or nulls, use the reserved words PmNullUser for the user name and
PmNullPasswd for the password when you create a database connection.

Connecting to a Microsoft SQL Server Database from

Windows
On Informatica 10.0, you can connect to Microsoft SQL Server database through the ODBC provider type by
default.
You can also connect to Microsoft SQL Server database using the OLEDB provider type, but the OLEDB
provider type is deprecated. Support for the OLEDB provider type will be dropped in a future release.

Configuring Native Connectivity

On Informatica 10.0, you can configure native connectivity to the Microsoft SQL Server database by using the
ODBC (default) or OLEDB (deprecated) provider types.
If you choose the ODBC provider type, you can enable the Use DSN option to use the DSN configured in the
Microsoft ODBC Administrator as the connect string. If you do not enable the Use DSN option, you must
specify the server name and database name in the connection properties.

Connecting to Microsoft Access and Microsoft Excel from Windows

417

If you choose the OLEDB provider type, you must install the Microsoft SQL Server 2012 Native Client to
configure native connectivity to the Microsoft SQL Server database. If you cannot to connect to the database,
verify that you correctly entered all of the connectivity information.
You can download the Microsoft SQL Server 2012 Native Client from the following Microsoft website:
http://www.microsoft.com/en-in/download/details.aspx?id=29065.
After you upgrade, the Microsoft SQL Server connection is set to the OLEDB provider type by default. It is
recommended that you upgrade all your Microsoft SQL Server connections to use the ODBC provider type.
You can upgrade all your Microsoft SQL Server connections to the ODBC provider type by using the following
commands:

If you are using PowerCenter, run the following command: pmrep upgradeSqlServerConnection

If you are using the Informatica platform, run the following command: infacmd.sh isp
upgradeSQLSConnection

For specific connectivity instructions, see the database documentation.

Rules and Guidelines for Microsoft SQL Server

Consider the following rules and guidelines when you configure ODBC connectivity to a Microsoft SQL Server
database:

If you want to use a Microsoft SQL Server connection without using a Data Source Name (DSN less
connection), you must configure the odbcinst.ini environment variable.

If you are using a DSN connection, you must add the entry "EnableQuotedIdentifiers=1" to the ODBC
DSN. If you do not add the entry, data preview and mapping run fail.

You can use the Microsoft SQL Server NTLM authentication on a DSN less Microsoft SQL Server
connection on the Microsoft Windows platform.

If the Microsoft SQL Server table contains a UUID data type and if you are reading data from an SQL
table and writing data to a flat file, the data format might not be consistent between the OLE DB and
ODBC connection types.

You cannot use SSL connection on a DSN less connection. If you want to use SSL, you must use the
DSN connection. Enable the Use DSN option and configure the SSL options in the odbc.ini file.

If the Microsoft SQL Server uses Kerberos authentication, you must set the GSSClient property to point to
the Informatica Kerberos libraries. Use the following path and filename: <Informatica installation
directory>/server/bin/libgssapi_krb5.so.2.Create an entry for the GSSClient property in the DSN
entries section in odbc.ini for a DSN connection or in the SQL Server wire protocol section in
odbcinst.ini for a connection that does not use DSN.

Configuring Custom Properties for Microsoft SQL Server

You can configure custom properties for Microsoft SQL Server to improve bulk load performance.
1.

Launch the PowerCenter client and connect to Workflow Manager.

2.

Open a workflow and select a session that you want to configure.

3.

Click the Config Object tab.

4.

Change the value of the Default Buffer Block size to 5 MB. You can also use the following command:
$INFA_HOME/server/bin/./pmrep massupdate -t session_config_property -n "Default buffer
block size" -v "5MB" -f $<folderName>
To get optimum throughput for a row size of 1 KB, you must set the Buffer Block size to 5 MB.

5.

418

Click the Properties tab.

Appendix B: Connecting to Databases from Windows

6.

Change the Commit Interval to 100000 if the session contains a relational target.

7.

Set the DTM Buffer Size. The optimum DTM Buffer Size is ((10 x Block Buffer size) x number of
partitions).

Connecting to a Netezza Database from Windows

Install and configure ODBC on the machines where the PowerCenter Integration Service process runs and
where you install the PowerCenter Client. You must configure connectivity to the following Informatica
components on Windows:

PowerCenter Integration Service. Install the Netezza ODBC driver on the machine where the
PowerCenter Integration Service process runs. Use the Microsoft ODBC Data Source Administrator to
configure ODBC connectivity.

PowerCenter Client. Install the Netezza ODBC driver on each PowerCenter Client machine that
accesses the Netezza database. Use the Microsoft ODBC Data Source Administrator to configure ODBC
connectivity. Use the Workflow Manager to create a database connection object for the Netezza database.

Configuring ODBC Connectivity

You can configure ODBC connectivity to a Netezza database.
The following steps provide a guideline for configuring ODBC connectivity. For specific instructions, see the
database documentation.
1.

Create an ODBC data source for each Netezza database that you want to access.
To create the ODBC data source, use the driver provided by Netezza.
Create a System DSN if you start the Informatica service with a Local System account logon. Create a
User DSN if you select the This account log in option to start the Informatica service.
After you create the data source, configure the properties of the data source.

2.

Enter a name for the new ODBC data source.

3.

Enter the IP address/host name and port number for the Netezza server.

4.

Enter the name of the Netezza schema where you plan to create database objects.

5.

Configure the path and file name for the ODBC log file.

6.

Verify that you can connect to the Netezza database.

You can use the Microsoft ODBC Data Source Administrator to test the connection to the database. To
test the connection, select the Netezza data source and click Configure. On the Testing tab, click Test
Connection and enter the connection information for the Netezza schema.

Connecting to an Oracle Database from Windows

For native connectivity, install the version of Oracle client appropriate for the Oracle database server version.
To ensure compatibility between Informatica and databases, use the appropriate database client libraries.
You must install compatible versions of the Oracle client and Oracle database server. You must also install
the same version of the Oracle client on all machines that require it. To verify compatibility, contact Oracle.

Connecting to a Netezza Database from Windows

419

Configuring Native Connectivity

You can configure native connectivity to an Oracle database to increase performance.
The following steps provide a guideline for configuring native connectivity using Oracle Net Services or Net8.
For specific connectivity instructions, see the database documentation.
1.

Verify that the Oracle home directory is set.

For example:
ORACLE_HOME=C:\Oracle

2.

Verify that the PATH environment variable includes the Oracle bin directory.
For example, if you install Net8, the path might include the following entry:
PATH=C:\ORANT\BIN;

3.

Configure the Oracle client to connect to the database that you want to access.
Launch SQL*Net Easy Configuration Utility or edit an existing tnsnames.ora file to the home directory
and modify it.
Note: By default, the tnsnames.ora file is stored in the following directory: <OracleInstallationDir>
\network\admin.
Enter the correct syntax for the Oracle connect string, typically databasename.world. Make sure the SID
entered here matches the database server instance ID defined on the Oracle server.
Here is a sample tnsnames.ora file. Enter the information for the database.
mydatabase.world =
(DESCRIPTION
(ADDRESS_LIST =
(ADDRESS =
(COMMUNITY = mycompany.world
(PROTOCOL = TCP)
(Host = mymachine)
(Port = 1521)
)
)
(CONNECT_DATA =
(SID = MYORA7)
(GLOBAL_NAMES = mydatabase.world)

4.

Set the NLS_LANG environment variable to the locale, including language, territory, and character set,
you want the database client and server to use with the login.
The value of this variable depends on the configuration. For example, if the value is
american_america.UTF8, you must set the variable as follows:
NLS_LANG=american_america.UTF8;
To determine the value of this variable, contact the database administrator.

5.

To set the default session time zone when the Data Integration Service reads or writes the Timestamp
with Local Time Zone data, specify the ORA_SDTZ environment variable.
You can set the ORA_SDTZ environment variable to any of the following values:

Operating system local time zone ('OS_TZ')

Database time zone ('DB_TZ')

Absolute offset from UTC (for example, '-05:00')

Time zone region name (for example, 'America/Los_Angeles')

You can set the environment variable at the machine where Informatica server runs.
6.

420

If the tnsnames.ora file is not in the same location as the Oracle client installation location, set the
TNS_ADMIN environment variable to the directory where the tnsnames.ora file resides.

Appendix B: Connecting to Databases from Windows

For example, if the tnsnames.ora file is in the C:\oracle\files directory, set the variable as follows:
TNS_ADMIN= C:\oracle\files
7.

Verify that you can connect to the Oracle database.

To connect to the database, launch SQL*Plus and enter the connectivity information. If you fail to
connect to the database, verify that you correctly entered all of the connectivity information.
Use the connect string as defined in the tnsnames.ora file.

Connecting to a Sybase ASE Database from

Windows
For native connectivity, install the version of Open Client appropriate for your database version. To ensure
compatibility between Informatica and databases, use the appropriate database client libraries.
Install an Open Client version that is compatible with the Sybase ASE database server. You must also install
the same version of Open Client on the machines hosting the Sybase ASE database and Informatica. To
verify compatibility, contact Sybase.
If you want to create, restore, or upgrade a Sybase ASE repository, set allow nulls by default to TRUE at the
database level. Setting this option changes the default null type of the column to null in compliance with the
SQL standard.

Configuring Native Connectivity

You can configure native connectivity to a Sybase ASE database to increase performance.
The following steps provide a guideline for configuring native connectivity. For specific instructions, see the
database documentation.
1.

Verify that the SYBASE environment variable refers to the Sybase ASE directory.
For example:
SYBASE=C:\SYBASE

2.

Verify that the PATH environment variable includes the Sybase OCS directory.
For example:
PATH=C:\SYBASE\OCS-15_0\BIN;C:\SYBASE\OCS-15_0\DLL

3.

Configure Sybase Open Client to connect to the database that you want to access.
Use SQLEDIT to configure the Sybase client, or copy an existing SQL.INI file (located in the %SYBASE
%\INI directory) and make any necessary changes.
Select NLWNSCK as the Net-Library driver and include the Sybase ASE server name.
Enter the host name and port number for the Sybase ASE server. If you do not know the host name and
port number, check with the system administrator.

4.

Verify that you can connect to the Sybase ASE database.

To connect to the database, launch ISQL and enter the connectivity information. If you fail to connect to
the database, verify that you correctly entered all of the connectivity information.
User names and database names are case sensitive.

Connecting to a Sybase ASE Database from Windows

421

Connecting to a Teradata Database from Windows

Install and configure native client software on the machines where the Data Integration Service and
PowerCenter Integration Service process runs and where you install Informatica Developer and the
PowerCenter Client. To ensure compatibility between Informatica and databases, use the appropriate
database client libraries. You must configure connectivity to the following Informatica components on
Windows:

Integration Service. Install the Teradata client, the Teradata ODBC driver, and any other Teradata client
software that you might need on the machine where the Data Integration Service and PowerCenter
Integration Service run. You must also configure ODBC connectivity.

Informatica Developer. Install the Teradata client, the Teradata ODBC driver, and any other Teradata
client software that you might need on each machine that hosts a Developer tool that accesses Teradata.
You must also configure ODBC connectivity.

PowerCenter Client. Install the Teradata client, the Teradata ODBC driver, and any other Teradata client
software that you might need on each PowerCenter Client machine that accesses Teradata. Use the
Workflow Manager to create a database connection object for the Teradata database.

Note: Based on a recommendation from Teradata, Informatica uses ODBC to connect to Teradata. ODBC is
a native interface for Teradata.

Configuring ODBC Connectivity

You can configure ODBC connectivity to a Teradata database.
The following steps provide a guideline for configuring ODBC connectivity. For specific instructions, see the
database documentation.
1.

Create an ODBC data source for each Teradata database that you want to access.
To create the ODBC data source, use the driver provided by Teradata.
Create a System DSN if you start the Informatica service with a Local System account logon. Create a
User DSN if you select the This account log in option to start the Informatica service.

2.

Enter the name for the new ODBC data source and the name of the Teradata server or its IP address.
To configure a connection to a single Teradata database, enter the DefaultDatabase name. To create a
single connection to the default database, enter the user name and password. To connect to multiple
databases, using the same ODBC data source, leave the DefaultDatabase field and the user name and
password fields empty.

3.

Configure Date Options in the Options dialog box.

In the Teradata Options dialog box, specify AAA for DateTime Format.

4.

Configure Session Mode in the Options dialog box.

When you create a target data source, choose ANSI session mode. If you choose ANSI session mode,
Teradata does not roll back the transaction when it encounters a row error. If you choose Teradata
session mode, Teradata rolls back the transaction when it encounters a row error. In Teradata mode, the
Integration Service cannot detect the rollback and does not report this in the session log.

5.

Verify that you can connect to the Teradata database.

To test the connection, use a Teradata client program, such as WinDDI, BTEQ, Teradata Administrator,
or Teradata SQL Assistant.

422

Appendix B: Connecting to Databases from Windows

APPENDIX C

Connecting to Databases from

UNIX
This appendix includes the following topics:

Connecting to Databases from UNIX Overview, 423

Connecting to an IBM DB2 Universal Database from UNIX, 424

Connecting to an Informix Database from UNIX, 426

Connecting to Microsoft SQL Server from UNIX, 427

Connecting to a Netezza Database from UNIX, 429

Connecting to an Oracle Database from UNIX, 431

Connecting to a Sybase ASE Database from UNIX, 433

Connecting to a Teradata Database from UNIX, 435

Connecting to an ODBC Data Source, 438

Sample odbc.ini File, 440

Connecting to Databases from UNIX Overview

To use native connectivity, you must install and configure the database client software for the database that
you want to access. To ensure compatibility between the application service and the database, install a client
software that is compatible with the database version and use the appropriate database client libraries. To
increase performance, use native connectivity.
The Informatica installation includes DataDirect ODBC drivers. If you have existing ODBC data sources
created with an earlier version of the drivers, you must create new ODBC data sources using the new drivers.
Configure ODBC connections using the DataDirect ODBC drivers provided by Informatica or third party
ODBC drivers that are Level 2 compliant or higher.
Use the following guidelines when you connect to databases from Linux or UNIX:

Use native drivers to connect to IBM DB2, Oracle, or Sybase ASE databases.

You can use ODBC to connect to other sources and targets.

423

Connecting to an IBM DB2 Universal Database from

UNIX
For native connectivity, install the version of IBM DB2 Client Application Enabler (CAE) appropriate for the
IBM DB2 database server version. To ensure compatibility between Informatica and databases, use the
appropriate database client libraries.

Configuring Native Connectivity

You can configure native connectivity to an IBM DB2 database to increase performance.
The following steps provide a guideline for configuring native connectivity. For specific instructions, see the
database documentation.
1.

To configure connectivity on the machine where the Data Integration Service, PowerCenter Integration
Service, or PowerCenter Repository Service process runs, log in to the machine as a user who can start
a service process.

2.

Set the DB2INSTANCE, INSTHOME, DB2DIR, and PATH environment variables.

The UNIX IBM DB2 software always has an associated user login, often db2admin, which serves as a
holder for database configurations. This user holds the instance for DB2.
DB2INSTANCE. The name of the instance holder.
Using a Bourne shell:
$ DB2INSTANCE=db2admin; export DB2INSTANCE
Using a C shell:
$ setenv DB2INSTANCE db2admin
INSTHOME. This is db2admin home directory path.
Using a Bourne shell:
$ INSTHOME=~db2admin
Using a C shell:
$ setenv INSTHOME ~db2admin>
DB2DIR. Set the variable to point to the IBM DB2 CAE installation directory. For example, if the client is
installed in the /opt/IBM/db2/V9.7 directory:
Using a Bourne shell:
$ DB2DIR=/opt/IBM/db2/V9.7; export DB2DIR
Using a C shell:
$ setenv DB2DIR /opt/IBM/db2/V9.7
PATH. To run the IBM DB2 command line programs, set the variable to include the DB2 bin directory.
Using a Bourne shell:
$ PATH=${PATH}:$DB2DIR/bin; export PATH
Using a C shell:
$ setenv PATH ${PATH}:$DB2DIR/bin

3.

Set the shared library variable to include the DB2 lib directory.
The IBM DB2 client software contains a number of shared library components that the Data Integration
Service, PowerCenter Integration Service, and PowerCenter Repository Service processes load

424

Appendix C: Connecting to Databases from UNIX

dynamically. Set the shared library environment variable so that the services can find the shared libraries
at run time.
The shared library path must also include the Informatica installation directory (server_dir).
Set the shared library environment variable based on the operating system.
The following table describes the shared library variables for each operating system:
Operating System

Variable

Solaris

LD_LIBRARY_PATH

Linux

LD_LIBRARY_PATH

AIX

LIBPATH

HP-UX

SHLIB_PATH

For example, use the following syntax for Solaris and Linux:

Using a Bourne shell:

$ LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:$HOME/server_dir:$DB2DIR/lib; export
LD_LIBRARY_PATH

Using a C shell:
$ setenv LD_LIBRARY_PATH ${LD_LIBRARY_PATH}:$HOME/server_dir:$DB2DIR/lib

For AIX:

Using a Bourne shell:

Using a C shell:

$ LIBPATH=${LIBPATH}:$HOME/server_dir:$DB2DIR/lib; export LIBPATH

$ setenv LIBPATH ${LIBPATH}:$HOME/server_dir:$DB2DIR/lib
For HP-UX:

Using a Bourne shell:

$ SHLIB_PATH=${SHLIB_PATH}:$HOME/server_dir:$DB2DIR/lib; export SHLIB_PATH

Using a C shell:
$ setenv SHLIB_PATH ${SHLIB_PATH}:$HOME/server_dir:$DB2DIR/lib

4.

Edit the .cshrc or .profile to include the complete set of shell commands. Save the file and either log out
and log in again or run the source command.
Using a Bourne shell:
$ source .profile
Using a C shell:
$ source .cshrc

5.

If the DB2 database resides on the same machine on which the Data Integration Service, PowerCenter
Integration Service, or PowerCenter Repository Service process runs, configure the DB2 instance as a
remote instance.
Run the following command to verify if there is a remote entry for the database:
DB2 LIST DATABASE DIRECTORY
The command lists all the databases that the DB2 client can access and their configuration properties. If
this command lists an entry for Directory entry type of Remote, skip to step 6.

Connecting to an IBM DB2 Universal Database from UNIX

425

If the database is not configured as remote, run the following command to verify whether a TCP/IP node
is cataloged for the host:
DB2 LIST NODE DIRECTORY
If the node name is empty, you can create one when you set up a remote database. Use the following
command to set up a remote database and, if needed, create a node:
db2 CATALOG TCPIP NODE <nodename> REMOTE <hostname_or_address> SERVER <port number>
Run the following command to catalog the database:
db2 CATALOG DATABASE <dbname> as <dbalias> at NODE <nodename>
For more information about these commands, see the database documentation.
6.

Verify that you can connect to the DB2 database. Run the DB2 Command Line Processor and run the
command:
CONNECT TO <dbalias> USER <username> USING <password>
If the connection is successful, clean up with the CONNECT RESET or TERMINATE command.

Connecting to an Informix Database from UNIX

Use ODBC to connect to an Informix database on UNIX.

Configuring ODBC Connectivity

You can configure ODBC connectivity to an Informix database.
The following steps provide a guideline for configuring ODBC connectivity. For specific instructions, see the
database documentation.
1.

Set the ODBCHOME environment variable to the ODBC installation directory. For example:
Using a Bourne shell:
$ ODBCHOME=<Informatica server home>/ODBC7.1; export ODBCHOME
Using a C shell:
$ setenv ODBCHOME <Informatica server home>/ODBC7.1

2.

Set the ODBCINI environment variable to the location of the odbc.ini file. For example, if the odbc.ini file
is in the $ODBCHOME directory:
Using a Bourne shell:
ODBCINI=$ODBCHOME/odbc.ini; export ODBCINI
Using a C shell:
$ setenv ODBCINI $ODBCHOME/odbc.ini

3.

Edit the existing odbc.ini file in the $ODBCHOME directory or copy this odbc.ini file to the UNIX home
directory and edit it.
$ cp $ODBCHOME/odbc.ini $HOME/.odbc.ini

4.

Add an entry for the Informix data source under the section [ODBC Data Sources] and configure the data
source. For example:
[Informix Wire Protocol]
Driver=/export/home/Informatica/10.0.0/ODBC7.1/lib/DWifcl27.so
Description=DataDirect 7.1 Informix Wire Protocol
AlternateServers=
ApplicationUsingThreads=1

426

Appendix C: Connecting to Databases from UNIX

CancelDetectInterval=0
ConnectionRetryCount=0
ConnectionRetryDelay=3
Database=<database_name>
HostName=<Informix_host>
LoadBalancing=0
LogonID=
Password=
PortNumber=<Informix_server_port>
ReportCodePageConversionErrors=0
ServerName=<Informix_server>
TrimBlankFromIndexName=1
5.

Set the PATH and shared library environment variables by executing the script odbc.sh or odbc.csh in
the $ODBCHOME directory.
Using a Bourne shell:
sh odbc.sh
Using a C shell:
source odbc.csh

6.

Verify that you can connect to the Informix database using the ODBC data source. If the connection fails,
see the database documentation.

Connecting to Microsoft SQL Server from UNIX

Use the Microsoft SQL Server connection to connect to a Microsoft SQL Server database from a UNIX
machine.

Configuring Native Connectivity

You must choose ODBC as the provider type while configuring a Microsoft SQL Server connection. The
OLEDB provider type is deprecated. Support for the OLEDB provider type will be dropped in a future release.
The server name and database name are retrieved from the connect string if you enable the Use DSN option.
The connect string is the DSN configured in the odbc.ini file. If you do not enable the Use DSN option, you
must specify the server name and database name in the connection properties. If you cannot to connect to
the database, verify that you correctly entered all of the connectivity information.
After you upgrade, the Microsoft SQL Server connection is set to the OLEDB provider type by default. It is
recommended that you upgrade all your Microsoft SQL Server connections to use the ODBC provider type.
You can upgrade all your Microsoft SQL Server connections to the ODBC provider type by using the following
commands:

If you are using PowerCenter, run the following command: pmrep upgradeSqlServerConnection

If you are using the Informatica platform, run the following command: infacmd.sh isp
upgradeSQLSConnection

After you run the upgrade command, you must set the environment variable on each machine that hosts the
Developer tool and on the machine that hosts Informatica services in the following format:
ODBCINST=<INFA_HOME>/ODBC7.1/odbcinst.ini
After you set the environment variable, you must restart the node that hosts the Informatica services.
For specific connectivity instructions, see the database documentation.

Connecting to Microsoft SQL Server from UNIX

427

Rules and Guidelines for Microsoft SQL Server

Consider the following rules and guidelines when you configure ODBC connectivity to a Microsoft SQL Server
database:

If you want to use a Microsoft SQL Server connection without using a Data Source Name (DSN less
connection), you must configure the odbcinst.ini environment variable.

If you are using a DSN connection, you must add the entry "EnableQuotedIdentifiers=1" to the ODBC
DSN. If you do not add the entry, data preview and mapping run fail.

You can use the Microsoft SQL Server NTLM authentication on a DSN less Microsoft SQL Server
connection on the Microsoft Windows platform.

If the Microsoft SQL Server table contains a UUID data type and if you are reading data from an SQL
table and writing data to a flat file, the data format might not be consistent between the OLE DB and
ODBC connection types.

You cannot use SSL connection on a DSN less connection. If you want to use SSL, you must use the
DSN connection. Enable the Use DSN option and configure the SSL options in the odbc.ini file.

If the Microsoft SQL Server uses Kerberos authentication, you must set the GSSClient property to point to
the Informatica Kerberos libraries. Use the following path and filename: <Informatica installation
directory>/server/bin/libgssapi_krb5.so.2.Create an entry for the GSSClient property in the DSN
entries section in odbc.ini for a DSN connection or in the SQL Server wire protocol section in
odbcinst.ini for a connection that does not use DSN.

Configuring SSL Authentication through ODBC

You can configure SSL authentication for Microsoft SQL Server through ODBC using the DataDirect New
SQL Server Wire Protocol driver.
1.

Open the odbc.ini file and add an entry for the ODBC data source and DataDirect New SQL Server Wire
Protocol driver under the section [ODBC Data Sources].

2.

Add the attributes in the odbc.ini file for configuring SSL.

The following table lists the attributes that you must add to the odbc.ini file when you configure SSL
authentication:

428

Attribute

Description

EncryptionMethod

The method that the driver uses to encrypt the data sent between the driver and
the database server. Set the value to 1 to encrypt data using SSL.

ValidateServerCertificate

Determines whether the driver validates the certificate sent by the database
server when SSL encryption is enabled. Set the value to 1 for the driver to
validate the server certificate.

TrustStore

The location and name of the trust store file. The trust store file contains a list of
Certificate Authorities (CAs) that the driver uses for SSL server authentication.

TrustStorePassword

The password to access the contents of the trust store file.

HostNameInCertificate

Optional. The host name that is established by the SSL administrator for the
driver to validate the host name contained in the certificate.

Appendix C: Connecting to Databases from UNIX

Configuring Custom Properties for Microsoft SQL Server

You can configure custom properties for Microsoft SQL Server to improve bulk load performance.
1.

Launch the PowerCenter client and connect to Workflow Manager.

2.

Open a workflow and select a session that you want to configure.

3.

Click the Config Object tab.

4.

Change the value of the Default Buffer Block size to 5 MB. You can also use the following command:
$INFA_HOME/server/bin/./pmrep massupdate -t session_config_property -n "Default buffer
block size" -v "5MB" -f $<folderName>
To get optimum throughput for a row size of 1 KB, you must set the Buffer Block size to 5 MB.

5.

Click the Properties tab.

6.

Change the Commit Interval to 100000 if the session contains a relational target.

7.

Set the DTM Buffer Size. The optimum DTM Buffer Size is ((10 x Block Buffer size) x number of
partitions).

Connecting to a Netezza Database from UNIX

Install and configure Netezza ODBC driver on the machine where the PowerCenter Integration Service
process runs. Use the DataDirect Driver Manager in the DataDirect driver package shipped with the
Informatica product to configure the Netezza data source details in the odbc.ini file.

Configuring ODBC Connectivity

You can configure ODBC connectivity to a Netezza database.
The following steps provide a guideline for configuring ODBC connectivity. For specific instructions, see the
database documentation.
1.

To configure connectivity for the integration service process, log in to the machine as a user who can
start a service process.

2.

Set the ODBCHOME, NZ_ODBC_INI_PATH, and PATH environment variables.

ODBCHOME. Set the variable to the ODBC installation directory. For example:
Using a Bourne shell:
$ ODBCHOME=<Informatica server home>/ODBC7.1; export ODBCHOME
Using a C shell:
$ setenv ODBCHOME =<Informatica server home>/ODBC7.1
PATH. Set the variable to the ODBCHOME/bin directory. For example:
Using a Bourne shell:
PATH="${PATH}:$ODBCHOME/bin"
Using a C shell:
$ setenv PATH ${PATH}:$ODBCHOME/bin
NZ_ODBC_INI_PATH. Set the variable to point to the directory that contains the odbc.ini file. For
example, if the odbc.ini file is in the $ODBCHOME directory:

Connecting to a Netezza Database from UNIX

429

Using a Bourne shell:

NZ_ODBC_INI_PATH=$ODBCHOME; export NZ_ODBC_INI_PATH
Using a C shell:
$ setenv NZ_ODBC_INI_PATH $ODBCHOME
3.

Set the shared library environment variable.

The shared library path must contain the ODBC libraries. It must also include the Informatica services
installation directory (server_dir).
Set the shared library environment variable based on the operating system. Set the Netezza library
folder to <NetezzaInstallationDir>/lib64.
The following table describes the shared library variables for each operating system:
Operating System

Variable

Solaris

LD_LIBRARY_PATH

Linux

LD_LIBRARY_PATH

AIX

LIBPATH

HP-UX

SHLIB_PATH

For example, use the following syntax for Solaris and Linux:

Using a Bourne shell:

$ LD_LIBRARY_PATH="${LD_LIBRARY_PATH}:$HOME/server_dir:$ODBCHOME/
lib:<NetezzaInstallationDir>/lib64
export LD_LIBRARY_PATH

Using a C shell:
$ setenv LD_LIBRARY_PATH "${LD_LIBRARY_PATH}:$HOME/server_dir:$ODBCHOME/
lib:<NetezzaInstallationDir>/lib64"

For AIX

Using a Bourne shell:

$ LIBPATH=${LIBPATH}:$HOME/server_dir:$ODBCHOME/lib:<NetezzaInstallationDir>/
lib64; export LIBPATH

Using a C shell:
$ setenv LIBPATH ${LIBPATH}:$HOME/server_dir:$ODBCHOME/
lib:<NetezzaInstallationDir>/lib64

For HP-UX

Using a Bourne shell:

$ SHLIB_PATH=${SHLIB_PATH}:$HOME/server_dir:$ODBCHOME/
lib:<NetezzaInstallationDir>/lib64; export SHLIB_PATH

Using a C shell:
$ setenv SHLIB_PATH ${SHLIB_PATH}:$HOME/server_dir:$ODBCHOME/
lib:<NetezzaInstallationDir>/lib64

4.

Edit the existing odbc.ini file or copy the odbc.ini file to the home directory and edit it.
This file exists in $ODBCHOME directory.
$ cp $ODBCHOME/odbc.ini $HOME/.odbc.ini

430

Appendix C: Connecting to Databases from UNIX

Add an entry for the Netezza data source under the section [ODBC Data Sources] and configure the
data source.
For example:
[NZSQL]
Driver = /export/home/appsqa/thirdparty/netezza/lib64/libnzodbc.so
Description = NetezzaSQL ODBC
Servername = netezza1.informatica.com
Port = 5480
Database = infa
Username = admin
Password = password
Debuglogging = true
StripCRLF = false
PreFetch = 256
Protocol = 7.0
ReadOnly = false
ShowSystemTables = false
Socket = 16384
DateFormat = 1
TranslationDLL =
TranslationName =
TranslationOption =
NumericAsChar = false
For more information about Netezza connectivity, see the Netezza ODBC driver documentation.
5.

Verify that the last entry in the odbc.ini file is InstallDir and set it to the ODBC installation directory.
For example:
InstallDir=<Informatica install directory>/<ODBCHOME directory>

6.

Edit the .cshrc or .profile file to include the complete set of shell commands.

7.

Restart the Informatica services.

Connecting to an Oracle Database from UNIX

For native connectivity, install the version of Oracle client appropriate for the Oracle database server version.
To ensure compatibility between Informatica and databases, use the appropriate database client libraries.
You must install compatible versions of the Oracle client and Oracle database server. You must also install
the same version of the Oracle client on all machines that require it. To verify compatibility, contact Oracle.

Configuring Native Connectivity

You can configure native connectivity to an Oracle database to increase performance.
The following steps provide a guideline for configuring native connectivity through Oracle Net Services or
Net8. For specific instructions, see the database documentation.
1.

To configure connectivity for the Data Integration Service, PowerCenter Integration Service, or
PowerCenter Repository Service process, log in to the machine as a user who can start the server
process.

2.

Set the ORACLE_HOME, NLS_LANG, TNS_ADMIN, and PATH environment variables.

ORACLE_HOME. Set the variable to the Oracle client installation directory. For example, if the client is
installed in the /HOME2/oracle directory. set the variable as follows:

Connecting to an Oracle Database from UNIX

431

Using a Bourne shell:

$ ORACLE_HOME=/HOME2/oracle; export ORACLE_HOME
Using a C shell:
$ setenv ORACLE_HOME /HOME2/oracle
NLS_LANG. Set the variable to the locale (language, territory, and character set) you want the database
client and server to use with the login. The value of this variable depends on the configuration. For
example, if the value is american_america.UTF8, set the variable as follows:
Using a Bourne shell:
$ NLS_LANG=american_america.UTF8; export NLS_LANG
Using a C shell:
$ NLS_LANG american_america.UTF8
To determine the value of this variable, contact the administrator.
ORA_SDTZ. To set the default session time zone when the Data Integration Service reads or writes the
Timestamp with Local Time Zone data, specify the ORA_SDTZ environment variable.
You can set the ORA_SDTZ environment variable to any of the following values:

Operating system local time zone ('OS_TZ')

Database time zone ('DB_TZ')

Absolute offset from UTC (for example, '-05:00')

Time zone region name (for example, 'America/Los_Angeles')

You can set the environment variable at the machine where Informatica server runs.
TNS_ADMIN. If the tnsnames.ora file is not in the same location as the Oracle client installation location,
set the TNS_ADMIN environment variable to the directory where the tnsnames.ora file resides. For
example, if the file is in the /HOME2/oracle/files directory, set the variable as follows:
Using a Bourne shell:
$ TNS_ADMIN=$HOME2/oracle/files; export TNS_ADMIN
Using a C shell:
$ setenv TNS_ADMIN=$HOME2/oracle/files
Note: By default, the tnsnames.ora file is stored in the following directory: $ORACLE_HOME/network/
admin.
PATH. To run the Oracle command line programs, set the variable to include the Oracle bin directory.
Using a Bourne shell:
$ PATH=${PATH}:$ORACLE_HOME/bin; export PATH
Using a C shell:
$ setenv PATH ${PATH}:ORACLE_HOME/bin
3.

Set the shared library environment variable.

The Oracle client software contains a number of shared library components that the Data Integration
Service, PowerCenter Integration Service, and PowerCenter Repository Service processes load
dynamically. To locate the shared libraries during run time, set the shared library environment variable.
The shared library path must also include the Informatica installation directory (server_dir).
Set the shared library environment variable to LD_LIBRARY_PATH.

432

Appendix C: Connecting to Databases from UNIX

For example, use the following syntax:

Using a Bourne shell:

$ LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:$HOME/server_dir:$ORACLE_HOME/lib; export
LD_LIBRARY_PATH

Using a C shell:
$ setenv LD_LIBRARY_PATH ${LD_LIBRARY_PATH}:$HOME/server_dir:$ORACLE_HOME/lib

4.

Edit the .cshrc or .profile to include the complete set of shell commands. Save the file and either log out
and log in again, or run the source command.
Using a Bourne shell:
$ source .profile
Using a C shell:
$ source .cshrc

5.

Verify that the Oracle client is configured to access the database.

Use the SQL*Net Easy Configuration Utility or copy an existing tnsnames.ora file to the home directory
and modify it.
The tnsnames.ora file is stored in the following directory: $ORACLE_HOME/network/admin.
Enter the correct syntax for the Oracle connect string, typically databasename.world.
Here is a sample tnsnames.ora file. Enter the information for the database.
mydatabase.world =
(DESCRIPTION
(ADDRESS_LIST =
(ADDRESS =
(COMMUNITY = mycompany.world
(PROTOCOL = TCP)
(Host = mymachine)
(Port = 1521)
)
)
(CONNECT_DATA =
(SID = MYORA7)
(GLOBAL_NAMES = mydatabase.world)

6.

Verify that you can connect to the Oracle database.

To connect to the Oracle database, launch SQL*Plus and enter the connectivity information. If you fail to
connect to the database, verify that you correctly entered all of the connectivity information.
Enter the user name and connect string as defined in the tnsnames.ora file.

Connecting to a Sybase ASE Database from UNIX

For native connectivity, install the version of Open Client appropriate for your database version. To ensure
compatibility between Informatica and databases, use the appropriate database client libraries.
Install an Open Client version that is compatible with the Sybase ASE database server. You must also install
the same version of Open Client on the machines hosting the Sybase ASE database and Informatica. To
verify compatibility, contact Sybase.
If you want to create, restore, or upgrade a Sybase ASE repository, set allow nulls by default to TRUE at the
database level. Setting this option changes the default null type of the column to null in compliance with the
SQL standard.

Connecting to a Sybase ASE Database from UNIX

433

Configuring Native Connectivity

You can configure native connectivity to a Sybase ASE database to increase performance.
The following steps provide a guideline for configuring native connectivity. For specific instructions, see the
database documentation.
1.

To configure connectivity to the Data Integration Service, PowerCenter Integration Service, or

PowerCenter Repository Service process, log in to the machine as a user who can start the server
process.

2.

Set the SYBASE and PATH environment variables.

SYBASE. Set the variable to the Sybase Open Client installation directory. For example if the client is
installed in the /usr/sybase directory:
Using a Bourne shell:
$ SYBASE=/usr/sybase; export SYBASE
Using a C shell:
$ setenv SYBASE /usr/sybase
PATH. To run the Sybase command line programs, set the variable to include the Sybase OCS bin
directory.
Using a Bourne shell:
$ PATH=${PATH}:/usr/sybase/OCS-15_0/bin; export PATH
Using a C shell:
$ setenv PATH ${PATH}:/usr/sybase/OCS-15_0/bin

3.

Set the shared library environment variable.

The Sybase Open Client software contains a number of shared library components that the Data
Integration Service, PowerCenter Integration Service, and PowerCenter Repository Service processes
load dynamically. Set the shared library environment variable so that the services can find the shared
libraries at run time.
The shared library path must also include the installation directory of the Informatica services
(server_dir).
Set the shared library environment variable based on the operating system.
The following table describes the shared library variables for each operating system.
Operating System

Variable

Solaris

LD_LIBRARY_PATH

Linux

LD_LIBRARY_PATH

AIX

LIBPATH

HP-UX

SHLIB_PATH

For example, use the following syntax for Solaris and Linux:

Using a Bourne shell:

$ LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:$HOME/server_dir:$SYBASE/OCS-15_0/lib;
$SYBASE/OCS-15_0/lib3p;$SYBASE/OCS-15_0/lib3p64; export LD_LIBRARY_PATH

434

Appendix C: Connecting to Databases from UNIX

Using a C shell:
$ setenv LD_LIBRARY_PATH ${LD_LIBRARY_PATH}:$HOME/server_dir:$SYBASE/OCS-15_0/lib;
$SYBASE/OCS-15_0/lib3p;$SYBASE/OCS-15_0/lib3p64;

For AIX

Using a Bourne shell:

$ LIBPATH=${LIBPATH}:$HOME/server_dir:$SYBASE/OCS-15_0/lib;$SYBASE/OCS-15_0/lib3p;
$SYBASE/OCS-15_0/lib3p64; export LIBPATH

Using a C shell:
$ setenv LIBPATH ${LIBPATH}:$HOME/server_dir:$SYBASE/OCS-15_0/lib;$SYBASE/
OCS-15_0/lib3p;$SYBASE/OCS-15_0/lib3p64;

For HP-UX

Using a Bourne shell:

$ SHLIB_PATH=${SHLIB_PATH}:$HOME/server_dir:$SYBASE/OCS-15_0/lib;$SYBASE/
OCS-15_0/lib3p;$SYBASE/OCS-15_0/lib3p64; export SHLIB_PATH

Using a C shell:
$ setenv SHLIB_PATH ${SHLIB_PATH}:$HOME/server_dir:$SYBASE/OCS-15_0/lib;$SYBASE/
OCS-15_0/lib3p;$SYBASE/OCS-15_0/lib3p64;

4.

Edit the .cshrc or .profile to include the complete set of shell commands. Save the file and either log out
and log in again, or run the source command.
Using a Bourne shell:
$ source .profile
Using a C shell:
$ source .cshrc

5.

Verify the Sybase ASE server name in the Sybase interfaces file stored in the $SYBASE directory.

6.

Verify that you can connect to the Sybase ASE database.

To connect to the Sybase ASE database, launch ISQL and enter the connectivity information. If you fail
to connect to the database, verify that you correctly entered all of the connectivity information.
User names and database names are case sensitive.

Connecting to a Teradata Database from UNIX

Install and configure native client software on the machines where the Data Integration Service or
PowerCenter Integration Service process runs. To ensure compatibility between Informatica and databases,
use the appropriate database client libraries.
Install the Teradata client, the Teradata ODBC driver, and any other Teradata client software that you might
need on the machine where the Data Integration Service or PowerCenter Integration Service runs. You must
also configure ODBC connectivity.
Note: Based on a recommendation from Teradata, Informatica uses ODBC to connect to Teradata. ODBC is
a native interface for Teradata.

Connecting to a Teradata Database from UNIX

435

Configuring ODBC Connectivity

You can configure ODBC connectivity to a Teradata database.
The following steps provide a guideline for configuring ODBC connectivity. For specific instructions, see the
database documentation.
1.

To configure connectivity for the integration service process, log in to the machine as a user who can
start a service process.

2.

Set the TERADATA_HOME, ODBCHOME, and PATH environment variables.

TERADATA_HOME. Set the variable to the Teradata driver installation directory. The defaults are as
follows:
Using a Bourne shell:
$ TERADATA_HOME=/opt/teradata/client/<version>; export TERADATA_HOME
Using a C shell:
$ setenv TERADATA_HOME /opt/teradata/client/<version>
ODBCHOME. Set the variable to the ODBC installation directory. For example:
Using a Bourne shell:
$ ODBCHOME=$INFA_HOME/ODBC<version>; export ODBCHOME
Using a C shell:
$ setenv ODBCHOME $INFA_HOME/ODBC<version>
PATH. To run the ddtestlib utility, to verify that the DataDirect ODBC driver manager can load the driver
files, set the variable as follows:
Using a Bourne shell:
PATH="${PATH}:$ODBCHOME/bin:$TERADATA_HOME/bin"
Using a C shell:
$ setenv PATH ${PATH}:$ODBCHOME/bin:$TERADATA_HOME/bin

3.

Set the shared library environment variable.

The Teradata software contains multiple shared library components that the integration service process
loads dynamically. Set the shared library environment variable so that the services can find the shared
libraries at run time.
The shared library path must also include installation directory of the Informatica service (server_dir).
Set the shared library environment variable based on the operating system.
The following table describes the shared library variables for each operating system:

436

Operating System

Variable

Solaris

LD_LIBRARY_PATH

Linux

LD_LIBRARY_PATH

AIX

LIBPATH

HP-UX

SHLIB_PATH

Appendix C: Connecting to Databases from UNIX

For example, use the following syntax for Solaris and Linux:

Using a Bourne shell:

$ LD_LIBRARY_PATH="${LD_LIBRARY_PATH}:$HOME/server_dir:$ODBCHOME/lib:
$TERADATA_HOME/lib64:$TERADATA_HOME/odbc_64/lib";
export LD_LIBRARY_PATH

Using a C shell:
$ setenv LD_LIBRARY_PATH "${LD_LIBRARY_PATH}:$HOME/server_dir:$ODBCHOME/lib:
$TERADATA_HOME/lib64:
$TERADATA_HOME/odbc_64/lib"

For AIX

Using a Bourne shell:

$ LIBPATH=${LIBPATH}:$HOME/server_dir:$ODBCHOME/lib:$TERADATA_HOME/
lib64:$TERADATA_HOME/odbc_64/lib; export LIBPATH

Using a C shell:
$ setenv LIBPATH ${LIBPATH}:$HOME/server_dir:$ODBCHOME/lib:$TERADATA_HOME/lib64:
$TERADATA_HOME/odbc_64/lib

For HP-UX

Using a Bourne shell:

$ SHLIB_PATH=${SHLIB_PATH}:$HOME/server_dir:$ODBCHOME/lib:$TERADATA_HOME/
lib64:$TERADATA_HOME/odbc_64/lib; export SHLIB_PATH

Using a C shell:
$ setenv SHLIB_PATH ${SHLIB_PATH}:$HOME/server_dir:$ODBCHOME/lib:$TERADATA_HOME/
lib64:
$TERADATA_HOME/odbc_64/lib

4.

Edit the existing odbc.ini file or copy the odbc.ini file to the home directory and edit it.
This file exists in $ODBCHOME directory.
$ cp $ODBCHOME/odbc.ini $HOME/.odbc.ini
Add an entry for the Teradata data source under the section [ODBC Data Sources] and configure the
data source.
For example:
MY_TERADATA_SOURCE=Teradata Driver
[MY_TERADATA_SOURCE]
Driver=/u01/app/teradata/td-tuf611/odbc/drivers/tdata.so
Description=NCR 3600 running Teradata V1R5.2
DBCName=208.199.59.208
DateTimeFormat=AAA
SessionMode=ANSI
DefaultDatabase=
Username=
Password=

5.

Set the DateTimeFormat to AAA in the Teradata data ODBC configuration.

6.

Optionally, set the SessionMode to ANSI. When you use ANSI session mode, Teradata does not roll
back the transaction when it encounters a row error.
If you choose Teradata session mode, Teradata rolls back the transaction when it encounters a row
error. In Teradata mode, the integration service process cannot detect the rollback, and does not report
this in the session log.

Connecting to a Teradata Database from UNIX

437

7.

To configure connection to a single Teradata database, enter the DefaultDatabase name. To create a
single connection to the default database, enter the user name and password. To connect to multiple
databases, using the same ODBC DSN, leave the DefaultDatabase field empty.
For more information about Teradata connectivity, see the Teradata ODBC driver documentation.

8.

Verify that the last entry in the odbc.ini is InstallDir and set it to the odbc installation directory.
For example:
InstallDir=<Informatica installation directory>/ODBC<version>

9.
10.

Edit the .cshrc or .profile to include the complete set of shell commands.
Save the file and either log out and log in again, or run the source command.
Using a Bourne shell:
$ source .profile
Using a C shell:
$ source .cshrc

11.

For each data source you use, make a note of the file name under the Driver=<parameter> in the data
source entry in odbc.ini. Use the ddtestlib utility to verify that the DataDirect ODBC driver manager can
load the driver file.
For example, if you have the driver entry:
Driver=/u01/app/teradata/td-tuf611/odbc/drivers/tdata.so
run the following command:
ddtestlib /u01/app/teradata/td-tuf611/odbc/drivers/tdata.so

12.

Test the connection using BTEQ or another Teradata client tool.

Connecting to an ODBC Data Source

Install and configure native client software on the machine where the Data Integration Service, PowerCenter
Integration Service, and PowerCenter Repository Service run. Also install and configure any underlying client
access software required by the ODBC driver. To ensure compatibility between Informatica and the
databases, use the appropriate database client libraries.
The Informatica installation includes DataDirect ODBC drivers. If the odbc.ini file contains connections that
use earlier versions of the ODBC driver, update the connection information to use the new drivers. Use the
System DSN to specify an ODBC data source on Windows.
1.

On the machine where the application service runs, log in as a user who can start a service process.

2.

Set the ODBCHOME and PATH environment variables.

ODBCHOME. Set to the DataDirect ODBC installation directory. For example, if the install directory is /
export/home/Informatica/10.0.0/ODBC7.1.
Using a Bourne shell:
$ ODBCHOME=/export/home/Informatica/10.0.0/ODBC7.1; export ODBCHOME
Using a C shell:
$ setenv ODBCHOME /export/home/Informatica/10.0.0/ODBC7.1
PATH. To run the ODBC command line programs, like ddtestlib, set the variable to include the odbc bin
directory.

438

Appendix C: Connecting to Databases from UNIX

Using a Bourne shell:

$ PATH=${PATH}:$ODBCHOME/bin; export PATH
Using a C shell:
$ setenv PATH ${PATH}:$ODBCHOME/bin
Run the ddtestlib utility to verify that the DataDirect ODBC driver manager can load the driver files.
3.

Set the shared library environment variable.

The ODBC software contains a number of shared library components that the service processes load
dynamically. Set the shared library environment variable so that the services can find the shared libraries
at run time.
The shared library path must also include the Informatica installation directory (server_dir).
Set the shared library environment variable based on the operating system.
The following table describes the shared library variables for each operating system:
Operating System

Variable

Solaris

LD_LIBRARY_PATH

Linux

LD_LIBRARY_PATH

AIX

LIBPATH

HP-UX

SHLIB_PATH

For example, use the following syntax for Solaris and Linux:

Using a Bourne shell:

$ LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:$HOME/server_dir:$ODBCHOME/lib; export
LD_LIBRARY_PATH

Using a C shell:
$ setenv LD_LIBRARY_PATH $HOME/server_dir:$ODBCHOME:${LD_LIBRARY_PATH}

For AIX

Using a Bourne shell:

$ LIBPATH=${LIBPATH}:$HOME/server_dir:$ODBCHOME/lib; export LIBPATH

Using a C shell:
$ setenv LIBPATH ${LIBPATH}:$HOME/server_dir:$ODBCHOME/lib

For HP-UX

Using a Bourne shell:

Using a C shell:

$ SHLIB_PATH=${SHLIB_PATH}:$HOME/server_dir:$ODBCHOME/lib; export SHLIB_PATH

$ setenv SHLIB_PATH ${SHLIB_PATH}:$HOME/server_dir:$ODBCHOME/lib
4.

Edit the existing odbc.ini file or copy the odbc.ini file to the home directory and edit it.
This file exists in $ODBCHOME directory.
$ cp $ODBCHOME/odbc.ini $HOME/.odbc.ini
Add an entry for the ODBC data source under the section [ODBC Data Sources] and configure the data
source.

Connecting to an ODBC Data Source

439

For example:
MY_MSSQLSERVER_ODBC_SOURCE=<Driver name or data source description>
[MY_SQLSERVER_ODBC_SOURCE]
Driver=<path to ODBC drivers>
Description=DataDirect 7.1 SQL Server Wire Protocol
Database=<SQLServer_database_name>
LogonID=<username>
Password=<password>
Address=<TCP/IP address>,<port number>
QuoteId=No
AnsiNPW=No
ApplicationsUsingThreads=1
This file might already exist if you have configured one or more ODBC data sources.
5.

Verify that the last entry in the odbc.ini is InstallDir and set it to the odbc installation directory.
For example:
InstallDir=/export/home/Informatica/10.0.0/ODBC7.1

6.

If you use the odbc.ini file in the home directory, set the ODBCINI environment variable.
Using a Bourne shell:
$ ODBCINI=/$HOME/.odbc.ini; export ODBCINI
Using a C shell:
$ setenv ODBCINI $HOME/.odbc.ini

7.

Edit the .cshrc or .profile to include the complete set of shell commands. Save the file and either log out
and log in again, or run the source command.
Using a Bourne shell:
$ source .profile
Using a C shell:
$ source .cshrc

8.

Use the ddtestlib utility to verify that the DataDirect ODBC driver manager can load the driver file you
specified for the data source in the odbc.ini file.
For example, if you have the driver entry:
Driver = /export/home/Informatica/10.0.0/ODBC7.1/lib/DWxxxxnn.so
run the following command:
ddtestlib /export/home/Informatica/10.0.0/ODBC7.1/lib/DWxxxxnn.so

9.

Install and configure any underlying client access software needed by the ODBC driver.
Note: While some ODBC drivers are self-contained and have all information inside the .odbc.ini file,
most are not. For example, if you want to use an ODBC driver to access Sybase IQ, you must install the
Sybase IQ network client software and set the appropriate environment variables.
To use the Informatica ODBC drivers (DWxxxxnn.so), manually set the PATH and shared library path
environment variables. Alternatively, run the odbc.sh or odbc.csh script in the $ODBCHOME folder. This
script will set the required PATH and shared library path environment variables for the ODBC drivers
provided by Informatica.

Sample odbc.ini File

The following sample shows the entries for the ODBC drivers in the ODBC.ini file:
[ODBC Data Sources]
SQL Server Legacy Wire Protocol=DataDirect 7.1 SQL Server Legacy Wire Protocol

440

Appendix C: Connecting to Databases from UNIX

DB2 Wire Protocol=DataDirect 7.1 DB2 Wire Protocol

Informix Wire Protocol=DataDirect 7.1 Informix Wire Protocol
Oracle Wire Protocol=DataDirect 7.1 Oracle Wire Protocol
Sybase Wire Protocol=DataDirect 7.1 Sybase Wire Protocol
SQL Server Wire Protocol=DataDirect 7.1 SQL Server Wire Protocol
MySQL Wire Protocol=DataDirect 7.1 MySQL Wire Protocol
PostgreSQL Wire Protocol=DataDirect 7.1 PostgreSQL Wire Protocol
Greenplum Wire Protocol=DataDirect 7.1 Greenplum Wire Protocol
[ODBC]
IANAAppCodePage=4
InstallDir=/<Informatica installation directory>/ODBC7.1
Trace=0
TraceFile=odbctrace.out
TraceDll=/<Informatica installation directory>/ODBC7.1/lib/DWtrc27.so
[DB2 Wire Protocol]
Driver=/<Informatica installation directory>/ODBC7.1/lib/DWdb227.so
Description=DataDirect 7.1 DB2 Wire Protocol
AccountingInfo=
AddStringToCreateTable=
AlternateID=
AlternateServers=
ApplicationName=
ApplicationUsingThreads=1
AuthenticationMethod=0
BulkBinaryThreshold=32
BulkCharacterThreshold=-1
BulkLoadBatchSize=1024
BulkLoadFieldDelimiter=
BulkLoadRecordDelimiter=
CatalogSchema=
CharsetFor65535=0
ClientHostName=
ClientUser=
#Collection applies to z/OS and iSeries only
Collection=
ConcurrentAccessResolution=0
ConnectionReset=0
ConnectionRetryCount=0
ConnectionRetryDelay=3
CurrentFuncPath=
#Database applies to DB2 UDB only
Database=<database_name>
DefaultIsolationLevel=1
DynamicSections=1000
EnableBulkLoad=0
EncryptionMethod=0
FailoverGranularity=0
FailoverMode=0
FailoverPreconnect=0
GrantAuthid=PUBLIC
GrantExecute=1
GSSClient=native
HostNameInCertificate=
IpAddress=<DB2_server_host>
KeyPassword=
KeyStore=
KeyStorePassword=
LoadBalanceTimeout=0
LoadBalancing=0
#Location applies to z/OS and iSeries only
Location=<location_name>
LogonID=
MaxPoolSize=100
MinPoolSize=0
Password=
PackageCollection=NULLID
PackageNamePrefix=DD
PackageOwner=
Pooling=0

Sample odbc.ini File

441

ProgramID=
QueryTimeout=0
ReportCodePageConversionErrors=0
TcpPort=50000
TrustStore=
TrustStorePassword=
UseCurrentSchema=0
ValidateServerCertificate=1
WithHold=1
XMLDescribeType=-10
[Informix Wire Protocol]
Driver=/<Informatica installation directory>/ODBC7.1/lib/DWifcl27.so
Description=DataDirect 7.1 Informix Wire Protocol
AlternateServers=
ApplicationUsingThreads=1
CancelDetectInterval=0
ConnectionRetryCount=0
ConnectionRetryDelay=3
Database=<database_name>
HostName=<Informix_host>
LoadBalancing=0
LogonID=
Password=
PortNumber=<Informix_server_port>
ServerName=<Informix_server>
TrimBlankFromIndexName=1
UseDelimitedIdentifiers=0
[Oracle Wire Protocol]
Driver=/<Informatica installation directory>/ODBC7.1/lib/DWora27.so
Description=DataDirect 7.1 Oracle Wire Protocol
AlternateServers=
ApplicationUsingThreads=1
AccountingInfo=
Action=
ApplicationName=
ArraySize=60000
AuthenticationMethod=1
BulkBinaryThreshold=32
BulkCharacterThreshold=-1
BulkLoadBatchSize=1024
BulkLoadFieldDelimiter=
BulkLoadRecordDelimiter=
CachedCursorLimit=32
CachedDescLimit=0
CatalogIncludesSynonyms=1
CatalogOptions=0
ClientHostName=
ClientID=
ClientUser=
ConnectionReset=0
ConnectionRetryCount=0
ConnectionRetryDelay=3
DataIntegrityLevel=0
DataIntegrityTypes=MD5,SHA1
DefaultLongDataBuffLen=1024
DescribeAtPrepare=0
EditionName=
EnableBulkLoad=0
EnableDescribeParam=0
EnableNcharSupport=0
EnableScrollableCursors=1
EnableStaticCursorsForLongData=0
EnableTimestampWithTimeZone=0
EncryptionLevel=0
EncryptionMethod=0
EncryptionTypes=AES128,AES192,AES256,DES,3DES112,3DES168,RC4_40,RC4_56,RC4_128,
RC4_256
FailoverGranularity=0
FailoverMode=0

442

Appendix C: Connecting to Databases from UNIX

FailoverPreconnect=0
FetchTSWTZasTimestamp=0
GSSClient=native
HostName=<Oracle_server>
HostNameInCertificate=
InitializationString=
KeyPassword=
KeyStore=
KeyStorePassword=
LoadBalanceTimeout=0
LoadBalancing=0
LocalTimeZoneOffset=
LockTimeOut=-1
LoginTimeout=15
LogonID=
MaxPoolSize=100
MinPoolSize=0
Module=
Password=
Pooling=0
PortNumber=<Oracle_server_port>
ProcedureRetResults=0
ProgramID=
QueryTimeout=0
ReportCodePageConversionErrors=0
ReportRecycleBin=0
ServerName=<server_name in tnsnames.ora>
ServerType=0
ServiceName=
SID=<Oracle_System_Identifier>
TimestampeEscapeMapping=0
TNSNamesFile=<tnsnames.ora_filename>
TrustStore=
TrustStorePassword=
UseCurrentSchema=1
ValidateServerCertificate=1
WireProtocolMode=2
[Sybase Wire Protocol]
Driver=/<Informatica installation directory>/ODBC7.1/lib/DWase27.so
Description=DataDirect 7.1 Sybase Wire Protocol
AlternateServers=
ApplicationName=
ApplicationUsingThreads=1
ArraySize=50
AuthenticationMethod=0
BulkBinaryThreshold=32
BulkCharacterThreshold=-1
BulkLoadBatchSize=1024
BulkLoadFieldDelimiter=
BulkLoadRecordDelimiter=
Charset=
ConnectionReset=0
ConnectionRetryCount=0
ConnectionRetryDelay=3
CursorCacheSize=1
Database=<database_name>
DefaultLongDataBuffLen=1024
EnableBulkLoad=0
EnableDescribeParam=0
EnableQuotedIdentifiers=0
EncryptionMethod=0
FailoverGranularity=0
FailoverMode=0
FailoverPreconnect=0
GSSClient=native
HostNameInCertificate=
InitializationString=
Language=
LoadBalancing=0
LoadBalanceTimeout=0

Sample odbc.ini File

443

LoginTimeout=15
LogonID=
MaxPoolSize=100
MinPoolSize=0
NetworkAddress=<Sybase_host,Sybase_server_port>
OptimizePrepare=1
PacketSize=0
Password=
Pooling=0
QueryTimeout=0
RaiseErrorPositionBehavior=0
ReportCodePageConversionErrors=0
SelectMethod=0
ServicePrincipalName=
TruncateTimeTypeFractions=0
TrustStore=
TrustStorePassword=
ValidateServerCertificate=1
WorkStationID=
[SQL Server Wire Protocol]
Driver=/<Informatica installation directory>/ODBC7.1/lib/DWsqls27.so
Description=DataDirect 7.1 SQL Server Wire Protocol
AlternateServers=
AlwaysReportTriggerResults=0
AnsiNPW=1
ApplicationName=
ApplicationUsingThreads=1
AuthenticationMethod=1
BulkBinaryThreshold=32
BulkCharacterThreshold=-1
BulkLoadBatchSize=1024
BulkLoadOptions=2
ConnectionReset=0
ConnectionRetryCount=0
ConnectionRetryDelay=3
Database=<database_name>
EnableBulkLoad=0
EnableQuotedIdentifiers=0
EncryptionMethod=0
FailoverGranularity=0
FailoverMode=0
FailoverPreconnect=0
FetchTSWTZasTimestamp=0
FetchTWFSasTime=1
GSSClient=native
HostName=<SQL_Server_host>
HostNameInCertificate=
InitializationString=
Language=
LoadBalanceTimeout=0
LoadBalancing=0
LoginTimeout=15
LogonID=
MaxPoolSize=100
MinPoolSize=0
PacketSize=-1
Password=
Pooling=0
PortNumber=<SQL_Server_server_port>
QueryTimeout=0
ReportCodePageConversionErrors=0
SnapshotSerializable=0
TrustStore=
TrustStorePassword=
ValidateServerCertificate=1
WorkStationID=
XML Describe Type=-10
[MySQL Wire Protocol]
Driver=/<Informatica installation directory>/ODBC7.1/lib/DWmysql27.so

444

Appendix C: Connecting to Databases from UNIX

Description=DataDirect 7.1 MySQL Wire Protocol

AlternateServers=
ApplicationUsingThreads=1
ConnectionReset=0
ConnectionRetryCount=0
ConnectionRetryDelay=3
Database=<database_name>
DefaultLongDataBuffLen=1024
EnableDescribeParam=0
EncryptionMethod=0
FailoverGranularity=0
FailoverMode=0
FailoverPreconnect=0
HostName=<MySQL_host>
HostNameInCertificate=
InteractiveClient=0
LicenseNotice=You must purchase commercially licensed MySQL database software or
a MySQL Enterprise subscription in order to use the DataDirect Connect for ODBC
for MySQL Enterprise driver with MySQL software.
KeyStore=
KeyStorePassword=
LoadBalanceTimeout=0
LoadBalancing=0
LogonID=
LoginTimeout=15
MaxPoolSize=100
MinPoolSize=0
Password=
Pooling=0
PortNumber=<MySQL_server_port>
QueryTimeout=0
ReportCodepageConversionErrors=0
TreatBinaryAsChar=0
TrustStore=
TrustStorePassword=
ValidateServerCertificate=1
[PostgreSQL Wire Protocol]
Driver=/<Informatica installation directory>/ODBC7.1/lib/DWpsql27.so
Description=DataDirect 7.1 PostgreSQL Wire Protocol
AlternateServers=
ApplicationUsingThreads=1
ConnectionReset=0
ConnectionRetryCount=0
ConnectionRetryDelay=3
Database=<database_name>
DefaultLongDataBuffLen=2048
EnableDescribeParam=1
EncryptionMethod=0
ExtendedColumnMetadata=0
FailoverGranularity=0
FailoverMode=0
FailoverPreconnect=0
FetchTSWTZasTimestamp=0
FetchTWFSasTime=0
HostName=<PostgreSQL_host>
HostNameInCertificate=
InitializationString=
KeyPassword=
KeyStore=
KeyStorePassword=
LoadBalanceTimeout=0
LoadBalancing=0
LoginTimeout=15
LogonID=
MaxPoolSize=100
MinPoolSize=0
Password=
Pooling=0
PortNumber=<PostgreSQL_server_port>
QueryTimeout=0

Sample odbc.ini File

445

ReportCodepageConversionErrors=0
TransactionErrorBehavior=1
TrustStore=
TrustStorePassword=
ValidateServerCertificate=1
XMLDescribeType=-10
[Greenplum Wire Protocol]
Driver=/<Informatica installation directory>/ODBC7.1/lib/DWgplm27.so
Description=DataDirect 7.1 Greenplum Wire Protocol
AlternateServers=
ApplicationUsingThreads=1
ConnectionReset=0
ConnectionRetryCount=0
ConnectionRetryDelay=3
Database=<database_name>
DefaultLongDataBuffLen=2048
EnableDescribeParam=0
EnableKeysetCursors=0
EncryptionMethod=0
ExtendedColumnMetadata=0
FailoverGranularity=0
FailoverMode=0
FailoverPreconnect=0
FetchTSWTZasTimestamp=0
FetchTWFSasTime=0
HostName=<Greenplum_host>
InitializationString=
KeyPassword=
KeysetCursorOptions=0
KeyStore=
KeyStorePassword=
LoadBalanceTimeout=0
LoadBalancing=0
LoginTimeout=15
LogonID=
MaxPoolSize=100
MinPoolSize=0
Password=
Pooling=0
PortNumber=<Greenplum_server_port>
QueryTimeout=0
ReportCodepageConversionErrors=0
TransactionErrorBehavior=1
XMLDescribeType=-10
[SQL Server Legacy Wire Protocol]
Driver=/<Informatica installation directory>/ODBC7.1/lib/DWmsss27.so
Description=DataDirect 7.1 SQL Server Legacy Wire Protocol
Address=<SQLServer_host, SQLServer_server_port>
AlternateServers=
AnsiNPW=Yes
ConnectionRetryCount=0
ConnectionRetryDelay=3
Database=<database_name>
FetchTSWTZasTimestamp=0
FetchTWFSasTime=0
LoadBalancing=0
LogonID=
Password=
QuotedId=No
ReportCodepageConversionErrors=0
SnapshotSerializable=0

446

Appendix C: Connecting to Databases from UNIX

APPENDIX D

Updating the DynamicSections

Parameter of a DB2 Database
This appendix includes the following topics:

DynamicSections Parameter Overview, 447

Updating the DynamicSections Parameter, 447

DynamicSections Parameter Overview

IBM DB2 packages contain the SQL statements to be executed on the database server. The
DynamicSections parameter of a DB2 database determines the maximum number of executable statements
that the database driver can have in a package. You can raise the value of the DynamicSections parameter
to allow a larger number of executable statements in a DB2 package. To modify the DynamicSections
parameter, connect to the database using a system administrator user account with BINDADD authority.

Updating the DynamicSections Parameter

Use the DataDirect Connect for JDBC utility to raise the value of the DynamicSections parameter in the DB2
database.
To use the DataDirect Connect for JDBC utility to update the DynamicSections parameter, complete the
following tasks:

Download and install the DataDirect Connect for JDBC utility.

Run the Test for JDBC tool.

Downloading and Installing the DataDirect Connect for JDBC Utility

Download the DataDirect Connect for JDBC utility from the DataDirect download web site to a machine that
has access to the DB2 database server. Extract the contents of the utility file and run the installer.
1.

Go to the DataDirect download site:

http://www.datadirect.com/support/product-documentation/downloads

2.

Choose the Connect for JDBC driver for an IBM DB2 data source.

447

3.

Register to download the DataDirect Connect for JDBC Utility.

4.

Download the utility to a machine that has access to the DB2 database server.

5.

Extract the contents of the utility file to a temporary directory.

6.

In the directory where you extracted the file, run the installer.

The installation program creates a folder named testforjdbc in the installation directory.

Running the Test for JDBC Tool

After you install the DataDirect Connect for JDBC Utility, run the Test for JDBC tool to connect to the DB2
database. You must use a system administrator user account with the BINDADD authority to connect to the
database.
1.

In the DB2 database, set up a system adminstrator user account with the BINDADD authority.

2.

In the directory where you installed the DataDirect Connect for JDBC Utility, run the Test for JDBC tool.
On Windows, run testforjdbc.bat. On UNIX, run testforjdbc.sh.

3.

On the Test for JDBC Tool window, click Press Here to Continue.

4.

Click Connection > Connect to DB.

5.

In the Database field, enter the following text:

jdbc:datadirect:db2://
HostName:PortNumber;databaseName=DatabaseName;CreateDefaultPackage=TRUE;ReplacePackag
e=TRUE;DynamicSections=3000
HostName is the name of the machine hosting the DB2 database server.
PortNumber is the port number of the database.
DatabaseName is the name of the DB2 database.

448

6.

In the User Name and Password fields, enter the system administrator user name and password you use
to connect to the DB2 database.

7.

Click Connect, and then close the window.

Appendix D: Updating the DynamicSections Parameter of a DB2 Database

Index

A
Abort
option to disable PowerCenter Integration Service 220
option to disable PowerCenter Integration Service process 220
option to disable the Web Services Hub 387
adaptive dispatch mode
description 248
overview 258
Additional JDBC Parameters
description 181
address validation properties
configuring 44
Administrator tool
SAP BW Service, configuring 348
advanced profiling properties
configuring 64
advanced properties
Metadata Manager Service 185
PowerCenter Integration Service 228
PowerCenter Repository Service 287
Web Services Hub 388, 390
Agent Cache Capacity (property)
description 287
agent port
description 180
AggregateTreatNullsAsZero
option 230
option override 230
AggregateTreatRowsAsInsert
option 230
option override 230
Aggregator transformation
caches 267, 272
treating nulls as zero 230
treating rows as insert 230
Allow Writes With Agent Caching (property)
description 287
Analyst Service
Analyst Service security process properties 32
creating 34
custom service process properties 33
environment variables 33
Maximum Heap Size 32
node process properties 32
process properties 31
properties 29
application
backing up 156
changing the name 155
deploying 152
enabling 155
properties 153
refreshing 157
application service upgrade
privileges 394

application services
system 364
architecture
Data Integration Service 76
ASCII mode
ASCII data movement mode, setting 226
Data Integration Service 79
overview 268
associated PowerCenter Repository Service
PowerCenter Integration Service 218
associated repository
Web Services Hub, adding to 392
Web Services Hub, editing for 393
associated Repository Service
Web Services Hub 386, 392, 393
audit trails
creating 310
Authenticate MS-SQL User (property)
description 287

B
backing up
list of backup files 307
performance 311
repositories 306
backup directory
Model Repository Service 205
backup node
license requirement 225
node assignment, configuring 225
PowerCenter Integration Service 218
baseline system
CPU profile 251
basic dispatch mode
overview 258
blocking
description 264
blocking source data
PowerCenter Integration Service handling 264
buffer memory
buffer blocks 267
DTM process 267

C
Cache Connection
property 59
cache files
directory 239
overview 272
permissions 269
Cache Removal Time
property 59

449

caches
default directory 272
memory 267
memory usage 267
multiple directories 106
overview 269
transformation 272
certificate
keystore file 386, 389
character data sets
handling options for Microsoft SQL Server and PeopleSoft on
Oracle 230
character encoding
Web Services Hub 389
classpaths
Java SDK 239
ClientStore
option 228
Code Page (property)
PowerCenter Integration Service process 239
PowerCenter Repository Service 282
code pages
data movement modes 268
for PowerCenter Integration Service process 237
global repository 300
PowerCenter repository 282
repository 299
repository, Web Services Hub 386
validation for sources and targets 232
command line programs
team-based development, administering 215
compatibility properties
PowerCenter Integration Service 230
Complete
option to disable PowerCenter Integration Service 220
option to disable PowerCenter Integration Service process 220
compute node
overriding attributes 146
compute role
Data Integration Service node 80
Compute view
Data Integration Service 70
environment variables 71
execution options 70
concurrent jobs
Data Integration Service grid 148
configuration properties
Listener Service 316
Logger Service 321
PowerCenter Integration Service 232
configure and synchronize with version control system
how to 211
connect string
examples 176, 284
PowerCenter repository database 286
syntax 176, 284
connecting
Integration Service to IBM DB2 (Windows) 416, 424
Integration Service to Informix (UNIX) 426
Integration Service to Informix (Windows) 416
Integration Service to Microsoft Access 417
Integration Service to Microsoft SQL Server 417
Integration Service to ODBC data sources (UNIX) 438
Integration Service to Oracle (UNIX) 431
Integration Service to Oracle (Windows) 419
Integration Service to Sybase ASE (UNIX) 433
Integration Service to Sybase ASE (Windows) 421
Microsoft Excel to Integration Service 417

450

Index

connecting (continued)
SQL data service 121
UNIX databases 423
Windows databases 415
Windows using JDBC 415
connection performance
optimizing 98
connection pooling
description 96
example 98
management 96
PowerExchange 98
properties 97
connection resources
assigning 245
connections
adding pass-through security 123
pass-through security 121
connectivity
connect string examples 176, 284
overview 254
Content Management Service
architecture 36
classifier model file path 48
creating 49
Data Integration Service grid 147
file transfer option 42
identity data properties 47
log events 42
Multi-Service Options 41
orphaned reference data 38
overview 35
probabilistic model file path 48
purge orphaned reference data 39
reference data storage location 38, 41
rule specifications 35, 36
staging directory for reference data 42
control file
overview 271
permissions 269
control files
Data Integration Service 93
CPU profile
computing 251
description 251
CPU usage
Integration Service 267
CreateIndicatorFiles
option 232
custom properties
configuring for Data Integration Service 66, 69
configuring for Metadata Manager 186
configuring for Web Services Hub 392
PowerCenter Integration Service process 241
PowerCenter Repository Service 290
PowerCenter Repository Service process 290
Web Services Hub 388
custom resources
defining 246
naming conventions 246
Custom transformation
directory for Java components 239

D
Data Analyzer
Data Profiling reports 327

Data Analyzer (continued)

Metadata Manager Repository Reports 327
repository 328
Data Analyzer repository
database requirements 399
IBM DB2 database requirements 399
Microsoft SQL Server database requirements 400
Oracle database requirements 400, 408
Sybase ASE database requirements 400
data cache
memory usage 267
data handling
setting up prior version compatibility 230
Data Integration Service
architecture 76
ASCII mode 79
assign to grid 52
assign to node 52
compute component 76, 80
compute properties 70
configuring Data Integration Service security 67
connectivity 75
control file directories 93
creating 52
custom properties 66, 69
data movement mode 79
data object cache database 108
disabling 89
DTM instance 80
DTM instances 95
DTM process pool 95
DTM processes 95
enabling 89
failover 72
file directories 70, 91
file permissions 94
grid 124
grid and node assignment properties 55
high availability 72
HTTP Configuration Properties 62
HTTP proxy server properties 61
LDTM 79
log directory 93
logs 86
Maximum Heap Size 69
maximum parallelism 102, 104
optimization 98
output files 81, 91
output files on grid 92
prerequisites 51
processes 94
properties 55
recycling 89
required databases 51
restart 72
result set cache properties 63, 68
service components 76, 77
source files on grid 92
system parameters 91
threads 102
Unicode mode 79
Workflow Orchestration Service properties 65
Data Integration Service grid
compute nodes 146
concurrent jobs 148
Content Management Service 147
deleting 149
editing 149

Data Integration Service grid (continued)

local mode 132
logs for remote mode 145
mappings in local mode 132, 134
mappings in remote mode 137, 141
prerequisites 126
profiles in local mode 132, 134
profiles in remote mode 137, 141
recycling 141
remote mode 137
SQL data services 126, 128
troubleshooting 149
web services 126, 128
workflows in local mode 132, 134
workflows in remote mode 137, 141
Data Integration Service process
disabling 91
enabling 91
HTTP configuration properties 68
properties 67
Data Integration Service process nodes
license requirement 55
data lineage
PowerCenter Repository Service, configuring 289
data lineage graph database
location 180
Metadata Manager Lineage Graph Location property
description 180
data movement mode
Data Integration Service 79
for PowerCenter Integration Service 218
option 226
setting 226
data movement modes
overview 268
data object cache
configuring 107
Data Object Cache Manager 79
database requirements 401
database tables 108
description 107
enabling 108
IBM DB2 database requirements 401
index cache 107
Microsoft SQL Server database requirements 401
Oracle database requirements 401
properties 59
user-managed tables 107, 111
data object cache database
configuring for the Data Integration Service 108
Data Object Cache Manager
cache tables 108
description 79
data object caching
with pass-through security 122
data service security
configuring Data Integration Service 67
Data Transformation Manager
optimizing job stability 94
optimizing performance 98
database
Reporting Service 328
repositories, creating for 282
database array operation size
description 286
database client
environment variables 241, 290

Index

451

database clients
configuring 414
environment variables 414
IBM DB2 client application enabler 413
Microsoft SQL Server native clients 413
Oracle clients 413
Sybase open clients 413
database connection timeout
description 286
database connections
PowerCenter Integration Service resilience 275
Database Hostname
description 181
Database Name
description 181
Database Pool Expiration Threshold (property)
description 287
Database Pool Expiration Timeout (property)
description 287
Database Pool Size (property)
description 286
Database Port
description 181
database preparation
repositories 398
database requirements
Data Analyzer 399
data object cache 401
Jaspersoft repository 402
Metadata Manager repository 402
Model repository 406
PowerCenter repository 407
profiling warehouse 409
reference data warehouse 410
workflow database 411
database resilience
repository 291
database statistics
IBM DB2 120
Microsoft SQL Server 120
Oracle 120
database user accounts
guidelines for setup 399
databases
connecting to (UNIX) 423
connecting to (Windows) 415
connecting to IBM DB2 416, 424
connecting to Informix 416, 426
connecting to Microsoft Access 417
connecting to Microsoft SQL Server 417
connecting to Netezza (UNIX) 429
connecting to Netezza (Windows) 419
connecting to Oracle 419, 431
connecting to Sybase ASE 421, 433
connecting to Teradata (UNIX) 435
connecting to Teradata (Windows) 422
Data Analyzer repository 399
Metadata Manager repository 399
PowerCenter repository 399
testing connections 414
DateDisplayFormat
option 232
DateHandling40Compatibility
option 230
dates
default format for logs 232
dbs2 connect
testing database connections 414

452

Index

deadlock retries
setting number 230
DeadlockSleep
option 230
Debug
error severity level 228, 390
Debugger
running 228
dependency graph
rebuilding 396
deployment
applications 152
directories
cache files 239
external procedure files 239
for Java components 239
lookup files 239
recovery files 239
reject files 239
root directory 239
session log files 239
source files 239
target files 239
temporary files 239
workflow log files 239
disabling
Metadata Manager Service 178
PowerCenter Integration Service 220
PowerCenter Integration Service process 220
Reporting Service 330, 331
Web Services Hub 387
dispatch mode
adaptive 248
configuring 248
Load Balancer 258
metric-based 248
round-robin 248
dispatch priority
configuring 249
dispatch queue
overview 256
service levels, creating 249
dispatch wait time
configuring 249
domain
associated repository for Web Services Hub 386
metadata, sharing 299
domain configuration repository
IBM DB2 database requirements 192, 406
Microsoft SQL Server database requirements 193
DTM (Data Transformation Manager)
buffer memory 267
distribution on PowerCenter grids 266
instance 80
master DTM 266
output files 81
preparer DTM 266
process 83, 259
processing threads 81
resource allocation policy 81
worker DTM 266
DTM instances
Data Integration Service 80
description 95
DTM process
environment variables 71
DTM processes
description 95

DTM processes (continued)

pool 95
pool management 95
DTM timeout
Web Services Hub 390

E
Email Service
properties 366
Enable Nested LDO Cache
property 59
enabling
Metadata Manager Service 178
PowerCenter Integration Service 220
PowerCenter Integration Service process 220
Reporting Service 330, 331
Web Services Hub 387
encoding
Web Services Hub 389
environment variables
compute node 71
database client 241, 290
database clients 414
DTM process 71
Listener Service process 316
Logger Service process 324
PowerCenter Integration Service process 241
PowerCenter Repository Service process 290
UNIX database clients 414
Error
severity level 228, 390
error logs
messages 270
Error Severity Level (property)
Metadata Manager Service 185
PowerCenter Integration Service 228
execution Data Transformation Manager
Data Integration Service 80
execution options
configuring 57
override for compute node 70
ExportSessionLogLibName
option 232
external procedure files
directory 239

F
failover
PowerCenter Integration Service 276
PowerCenter Repository Service 292
PowerExchange Listener Service 318
PowerExchange Logger Service 325
safe mode 224
file permissions
Data Integration Service 94
file/directory resources
defining 246
naming conventions 246
filtering data
SAP BW, parameter file location 353
flat files
output files 272
folders
operating system profile, assigning 306

FTP connections
PowerCenter Integration Service resilience 275

G
general properties
Listener Service 315
Logger Service 321
Metadata Manager Service 179
PowerCenter Integration Service 226
PowerCenter Integration Service process 239
PowerCenter Repository Service 285
SAP BW Service 351
Web Services Hub 388, 389
global repositories
code page 299, 300
creating 300
creating from local repositories 300
moving to another Informatica domain 303
grid
Data Integration Service file directories 92
troubleshooting for PowerCenter Integration Service 247
grid assignment properties
Data Integration Service 55
PowerCenter Integration Service 225
grids
assigning to a PowerCenter Integration Service 243
configuring for PowerCenter Integration Service 242
creating 242
Data Integration Service 124
description for PowerCenter Integration Service 265
DTM processes for PowerCenter 266
for PowerCenter Integration Service 218
license requirement 55
license requirement for PowerCenter Integration Service 225
operating system profile 243
PowerCenter Integration Service processes, distributing 265
troubleshooting for Data Integration Service 149

H
heartbeat interval
description 287
high availability
licensed option 225
Listener Service 318
Logger Service 325
PowerCenter Integration Service 274
PowerCenter Repository Service 291
PowerCenter Repository Service failover 292
PowerCenter Repository Service recovery 292
PowerCenter Repository Service resilience 291
PowerCenter Repository Service restart 292
high availability option
service processes, configuring 295
high availability persistence tables
PowerCenter Integration Service 279
host names
Web Services Hub 386, 389
host port number
Web Services Hub 386, 389
how to
configure and synchronize a Model repository with a version control
system 211
HTTP
Data Integration Service 75

Index

453

HTTP configuration properties

Data Integration Service process 68
HTTP Configuration Properties
Data Integration Service 62
HTTP proxy
domain setting 234
password setting 234
port setting 234
server setting 234
user setting 234
HTTP proxy properties
PowerCenter Integration Service 234
HTTP proxy server
usage 234
HTTP proxy server properties
Data Integration Service 61
HttpProxyDomain
option 234
HttpProxyPassword
option 234
HttpProxyPort
option 234
HttpProxyServer
option 234
HttpProxyUser
option 234
HTTPS
Data Integration Service 75
keystore file 386, 389
keystore password 386, 389
Hub Logical Address (property)
Web Services Hub 390

I
IBM DB2
connect string example 176, 284
connecting to Integration Service (Windows) 416, 424
repository database schema, optimizing 286
setting DB2CODEPAGE 416
setting DB2INSTANCE 416
single-node tablespaces 408
IBM DB2 database requirements
Data Analyzer repository 399
data object cache 401
domain repository 192, 406
Jaspersoft repository 402
Metadata Manager repository 403
Model repository database 192, 406
PowerCenter repository 408
profiling warehouse 409
reference data warehouse 410
workflow repository 411
IgnoreResourceRequirements
option 228
incremental aggregation
files 272
index caches
memory usage 267
indicator files
description 272
session output 272
infacmd mrs
listing checked-out object 215
listing locked object 215
reassigning locked or checked-out object 215
undoing checked-out object 215

454

Index

infacmd mrs (continued)

unlocking locked object 215
infacmd ps
purging profile and scorecard results 116
Informatica Administrator
repositories, backing up 306
repositories, restoring 307
repository notifications, sending 306
tasks for Web Services Hub 385
Information error severity level
description 228, 390
Informix
connecting to Integration Service (UNIX) 426
connecting to Integration Service (Windows) 416
internal host name
Web Services Hub 386, 389
internal port number
Web Services Hub 386, 389
isql
testing database connections 414

J
JaspeReports
overview 338
Jaspersoft repository
database requirements 402
IBM DB2 database requirements 402
Microsoft SQL Server database requirements 402
Oracle database requirements 402
Java
configuring for JMS 239
configuring for PowerExchange for Web Services 239
configuring for webMethods 239
Java components
directories, managing 239
Java SDK
class path 239
maximum memory 239
minimum memory 239
Java SDK Class Path
option 239
Java SDK Maximum Memory
option 239
Java SDK Minimum Memory
option 239
Java transformation
directory for Java components 239
JCEProvider
option 228
JDBC
connecting to (Windows) 415
Data Integration Service 75
jobs
launch as separate processes 94
Joiner transformation
caches 267, 272
setting up for prior version compatibility 230
JoinerSourceOrder6xCompatibility
option 230
JVM Command Line Options
advanced Web Services Hub property 390

K
keystore file
Metadata Manager 183
Web Services Hub 386, 389
keystore password
Web Services Hub 386, 389

L
LDTM
Data Integration Service 79
license
for PowerCenter Integration Service 218
Web Services Hub 386, 389
licensed options
high availability 225
server grid 225
Limit on Resilience Timeouts (property)
description 287
linked domain
multiple domains 301
Linux
database client environment variables 414
listCheckedoutObjects (infacmd mrs) 215
Listener Service process
environment variables 316
listing
checked-out object 215
locked object 215
listLockedObjects (infacmd mrs) 215
Load Balancer
configuring to check resources 257
defining resource provision thresholds 251
dispatch mode 258
dispatching tasks in a grid 257
dispatching tasks on a single node 257
resource provision thresholds 258
resources 244, 257
Load Balancer for PowerCenter Integration Service
assigning priorities to tasks 249, 259
configuring to check resources 228, 250
CPU profile, computing 251
dispatch mode, configuring 248
dispatch queue 256
overview 256
service levels 259
service levels, creating 249
settings, configuring 247
load balancing
SAP BW Service 354
support for SAP BW system 354
LoadManagerAllowDebugging
option 228
local mode
Data Integration Service grid 132
local repositories
code page 299
moving to another Informatica domain 303
promoting 300
registering 301
locks
managing 303
viewing 303
log files
Data Integration Service 86, 93
Data Integration Service permissions 94

Log Level (property)

Web Services Hub 390
Logger Service process
environment variables 324
properties 324
logical data objects
caching in database 107
logical Data Transformation Manager
Data Integration Service 79
logs
error severity level 228
in UTF-8 228
session 270
workflow 270
LogsInUTF8
option 228
lookup caches
persistent 273
lookup files
directory 239
Lookup transformation
caches 267, 272

M
Manage List
linked domains, adding 301
mapping pipelines
description 102
mapping properties
configuring 158
mappings
Data Integration Service grid 132, 137
grids in local mode 134
grids in remote mode 141
maximum parallelism 102, 104
partition points 102
partitioned 104
pipelines 102
processing threads 102
master thread
description 260
Max Concurrent Resource Load
description, Metadata Manager Service 185
Max Heap Size
description, Metadata Manager Service 185
Max Lookup SP DB Connections
option 230
Max MSSQL Connections
option 230
Max Sybase Connections
option 230
MaxConcurrentRequests
advanced Web Services Hub property 390
description, Metadata Manager Service 183
Maximum Active Connections
description, Metadata Manager Service 184
SQL data service property 160
maximum active users
description 287
Maximum Catalog Child Objects
description 185
Maximum Concurrent Connections
configuring 69
Maximum Concurrent Refresh Requests
property 59

Index

455

Maximum CPU Run Queue Length

node property 251
maximum dispatch wait time
configuring 249
Maximum Heap Size
advanced Web Services Hub property 390
configuring Analyst Service 32
configuring Data Integration Service 69
configuring Model Repository Service 199
configuring Search Service 360
maximum locks
description 287
Maximum Memory Percent
node property 251
maximum parallelism
description 102, 104
guidelines 105
Maximum Processes
node property 251
Maximum Wait Time
description, Metadata Manager Service 184
MaxISConnections
Web Services Hub 390
MaxQueueLength
advanced Web Services Hub property 390
description, Metadata Manager Service 183
MaxStatsHistory
advanced Web Services Hub property 390
memory
DTM buffer 267
maximum for Java SDK 239
Metadata Manager 185
minimum for Java SDK 239
metadata
sharing between domains 299
Metadata Manager
components 169
configuring PowerCenter Integration Service 186
repository 170
starting 178
user for PowerCenter Integration Service 187
Metadata Manager File Location (property)
description 180
Metadata Manager lineage graph location
configuring 180
Metadata Manager repository
content, creating 177
content, deleting 178
creating 170
database requirements 402
heap sizes 403
IBM DB2 database requirements 403
Microsoft SQL Server database requirements 404
optimizing IBM DB2 databases 403
Oracle database requirements 405
system temporary tablespaces 403
Metadata Manager Service
advanced properties 185
components 169
creating 172
custom properties 186
description 169
disabling 178
general properties 179
properties 178, 180
recycling 178
steps to create 170

456

Index

Metadata Manager Service properties

PowerCenter Repository Service 289
metric-based dispatch mode
description 248
Microsoft Access
connecting to Integration Service 417
Microsoft Excel
connecting to Integration Service 417
using PmNullPasswd 417
using PmNullUser 417
Microsoft SQL Server
connect string syntax 176, 284
connecting from UNIX 427
connecting to Integration Service 417
repository database schema, optimizing 286
setting Char handling options 230
Microsoft SQL Server database requirements
Data Analyzer repository 400
data object cache 401
domain configuration repository 193
Jaspersoft repository 402
Metadata Manager repository 404
Model repository 407
PowerCenter repository 408
profiling warehouse 409
reference data warehouse 410
workflow repository 412
Minimum Severity for Log Entries (property)
PowerCenter Repository Service 287
model repository
backing up 205
creating 204
creating content 204
deleting 204
deleting content 204
restoring content 206
Model repository
database requirements 406
IBM DB2 database requirements 192, 406
listing checked-out object in 215
listing locked object in 215
Microsoft SQL Server database requirements 407
non-versioned 214
Oracle database requirements 193, 407
reassigning locked or checked-out object in 215
reverting checked-out object in 215
team-based development 214, 215
undoing checked-out object in 215
unlocking locked object in 215
versioned 214
Model Repository Service
cache management 209
backup directory 205
Creating 216
custom search analyzer 207
disabling 194
enabling 194
failover 204
high availability 203
logs 208
Maximum Heap Size 199
overview 189
properties 195
recycling 194
restart 204
search analyzer 207
search index 207
upgrade error 396

Model Repository Service (continued)

versioning 199
Model Repository Service process
disabling 195
enabling 195
modules
disabling 61
MSExchangeProfile
option 232

N
native drivers
Data Integration Service 75
Netezza
connecting from Informatica clients(Windows) 419
connecting from Integration Service (Windows) 419
connecting to Informatica clients (UNIX) 429
connecting to Integration Service (UNIX) 429
node assignment
Data Integration Service 55
PowerCenter Integration Service 225
Resource Manager Service 369
Web Services Hub 388, 389
node properties
maximum CPU run queue length 251
maximum memory percent 251
maximum processes 251
nodes
node assignment, configuring 225
Web Services Hub 386
normal mode
PowerCenter Integration Service 222
notifications
sending 306
null values
PowerCenter Integration Service, configuring 230
NumOfDeadlockRetries
option 230

O
object dependency graph
rebuilding 396
objects
filtering 214
ODBC
Data Integration Service 75
ODBC Connection Mode
description 185
ODBC data sources
connecting to (UNIX) 438
connecting to (Windows) 415
odbc.ini file
sample 440
operating mode
effect on resilience 296
normal mode for PowerCenter Integration Service 221
PowerCenter Integration Service 221
PowerCenter Repository Service 296
safe mode for PowerCenter Integration Service 221
operating system profile
configuration 235
folders, assigning to 306
overview 235
pmimpprocess 235

operating system profile (continued)

PowerCenter Integration Service grids 243
troubleshooting 236
optimization
Data Integration 98
PowerCenter repository 408
Oracle
connect string syntax 176, 284
connecting to Integration Service (UNIX) 431
connecting to Integration Service (Windows) 419
Oracle database requirements
Data Analyzer repository 400, 408
data object cache 401
Jaspersoft repository 402
Metadata Manager repository 405
Model repository 193, 407
profiling warehouse 410
reference data warehouse 411
workflow repository 412
Oracle Net Services
using to connect Integration Service to Oracle (UNIX) 431
using to connect Integration Service to Oracle (Windows) 419
output files
Data Integration Service 81, 91
Data Integration Service permissions 94
overview 269, 272
permissions 269
target files 272
OutputMetaDataForFF
option 232
overview
Content Management Service 35

P
page size
minimum for optimizing repository database schema 286
partition points
description 102
partitioning
enabling 106
mappings 104
maximum parallelism 102, 104
pass-through pipeline
overview 260
pass-through security
adding to connections 123
connecting to SQL data service 121
enabling caching 122
properties 61
web service operation mappings 121
PeopleSoft on Oracle
setting Char handling options 230
performance
details 270
PowerCenter Integration Service 287
PowerCenter Repository Service 287
repository copy, backup, and restore 311
repository database schema, optimizing 286
performance detail files
permissions 269
permissions
output and log files 269
recovery files 269
persistent lookup cache
session output 273

Index

457

pipeline partitioning
multiple CPUs 263
overview 263
symmetric processing platform 267
pipeline stages
description 102
plug-ins
registering 309
unregistering 309
$PMBadFileDir
option 239
$PMCacheDir
option 239
$PMExtProcDir
option 239
$PMFailureEmailUser
option 226
pmimpprocess
description 235
$PMLookupFileDir
option 239
$PMRootDir
description 238
option 239
required syntax 238
shared location 238
PMServer3XCompatibility
option 230
$PMSessionErrorThreshold
option 226
$PMSessionLogCount
option 226
$PMSessionLogDir
option 239
$PMSourceFileDir
option 239
$PMStorageDir
option 239
$PMSuccessEmailUser
option 226
$PMTargetFileDir
option 239
$PMTempDir
option 239
$PMWorkflowLogCount
option 226
$PMWorkflowLogDir
option 239
pooling
connection 96
DTM process 95
pools
connection 96
DTM process 95
port number
Metadata Manager Agent 180
Metadata Manager application 180
post-session email
Microsoft Exchange profile, configuring 232
overview 272
PowerCenter
repository reports 327
PowerCenter Integration Service
advanced properties 228
architecture 253
assign to grid 218, 243
assign to node 218
associated repository 236

458

Index

PowerCenter Integration Service (continued)

blocking data 264
compatibility and database properties 230
configuration properties 232
configuring for Metadata Manager 186
connectivity overview 254
creating 218
data movement mode 218, 226
data movement modes 268
data, processing 263
date display format 232
disable process with Abort option 220
disable process with Stop option 220
disable with Abort option 220
disable with Complete option 220
disable with Stop option 220
disabling 220
enabling 220
export session log lib name, configuring 232
external component resilience 275
fail over in safe mode 222
failover 276
failover configuration 279
failover, on grid 278
for Metadata Manager 169
for Test Data Manager 377
general properties 226
grid and node assignment properties 225
high availability 274
high availability persistence tables 279
HTTP proxy properties 234
logs in UTF-8 228
name 218
normal operating mode 222
operating mode 221
output files 272
overview 217
performance 287
performance details 270
PowerCenter Integration Service client resilience 275
PowerCenter Repository Service, associating 218
process 254
recovery 279
recovery configuration 279
resilience 274
resilience period 228
resilience timeout 228
resource requirements 228
restart 276
safe mode, running in 223
safe operating mode 222
session recovery 278
shared storage 238
sources, reading 263
state of operations 279
system resources 267
version 230
workflow recovery 279
PowerCenter Integration Service process
$PMBadFileDir 239
$PMCacheDir 239
$PMExtProcDir 239
$PMLookupFileDir 239
$PMRootDir 239
$PMSessionLogDir 239
$PMSourceFileDir 239
$PMStorageDir 239
$PMTargetFileDir 239

PowerCenter Integration Service process (continued)

$PMTempDir 239
$PMWorkflowLogDir 239
code page 237
code pages, specifying 239
custom properties 241
disable with Complete option 220
disabling 220
distribution on a grid 265
enabling 220
environment variables 241
general properties 239
Java component directories 239
PowerCenter Integration Service process nodes
license requirement 225
PowerCenter repository
associated with Web Services Hub 392
code pages 282
content, creating for Metadata Manager 176
data lineage, configuring 289
database requirements 407
IBM DB2 database requirements 408
Microsoft SQL Server database requirements 408
optimizing IBM DB2 databases 408
Sybase ASE database requirements 408
PowerCenter Repository Reports
installing 327
PowerCenter Repository Service
advanced properties 287
associating with a Web Services Hub 386
Code Page (property) 282
configuring 285
creating 282
data lineage, configuring 289
enabling and disabling 294
failover 292
for Metadata Manager 169
for Test Data Manager 377
general properties 285
high availability 291
Metadata Manager Service properties 289
operating mode 296
overview 281
performance 287
PowerCenter Integration Service, associating 218
properties 285
recovery 292
repository agent caching 287
repository properties 285
resilience 291
resilience to database 291
restart 292
service process 295
state of operations 292
PowerCenter Repository Service process
configuring 290
environment variables 290
properties 290
PowerCenter tasks
dispatch priorities, assigning 259
dispatching 256
PowerExchange
connection pooling 98
PowerExchange for JMS
directory for Java components 239
PowerExchange for Web Services
directory for Java components 239

PowerExchange for webMethods

directory for Java components 239
PowerExchange Listener Service
creating 314
disabling 317
enabling 317
failover 318
properties 314
restart 318
restarting 318
PowerExchange Logger Service
creating 320
disabling 324
enabling 324
failover 325
properties 321
restart 325
restarting 325
Preserve MX Data (property)
description 287
primary node
for PowerCenter Integration Service 218
node assignment, configuring 225
processing threads
mappings 102
profile warehouse management
database management 116
tablespace recovery 119
profiles
Data Integration Service grid 132, 137
grids in local mode 134
grids in remote mode 141
maximum parallelism 102
purging results for 116
profiling properties
configuring 64
profiling warehouse
creating 116
creating content 116
database requirements 409
deleting 116
deleting content 116
IBM DB2 database requirements 409
Microsoft SQL Server database requirements 409
Oracle database requirements 410
Profiling Warehouse Connection Name
configuring 63
profiling warehouse management
database statistics 120
properties
Metadata Manager Service 180
Purge (infacmd ps) 116

R
Rank transformation
caches 267, 272
reassignCheckedOutObject (infacmd mrs) 215
reassigning
checked-out object 215
locked object 215
recovery
files, permissions 269
PowerCenter Integration Service 279
PowerCenter Repository Service 292
safe mode 224

Index

459

recovery files
directory 239
reference data
purge orphaned data 39
reference data warehouse
database requirements 410
IBM DB2 database requirements 410
Microsoft SQL Server database requirements 410
Oracle database requirements 411
registering
local repositories 301
plug-ins 309
reject files
directory 239
overview 271
permissions 269
remote mode
Data Integration Service grid 137
logs 145
repagent caching
description 287
Reporting and Dashboards Service
advanced properties 342
creating 342
editing 345
environment variables 342
general properties 340
overview 338
security options 340
Reporting Service
configuring 334
creating 326, 328
data source properties 335
database 328
disabling 330, 331
enabling 330, 331
general properties 334
managing 330
options 328
properties 334
Reporting Service properties 335
repository properties 336
using with Metadata Manager 170
reporting source
adding 344
Reporting and Dashboards Service 344
reports
Data Profiling Reports 327
Metadata Manager Repository Reports 327
repositories
associated with PowerCenter Integration Service 236
backing up 306
code pages 299, 300
configuring native connectivity 413
content, creating 176, 297
content, deleting 176, 298
database preparation 398
database schema, optimizing 286
database, creating 282
installing database clients 413
Metadata Manager 169
moving 303
notifications 306
performance 311
persisting run-time statistics 228
restoring 307
security log file 310
Test Data Manager 377

460

Index

repositories (continued)
version control 299
repository
Data Analyzer 328
repository agent cache capacity
description 287
repository agent caching
PowerCenter Repository Service 287
Repository Agent Caching (property)
description 287
repository domains
description 299
managing 299
moving to another Informatica domain 303
prerequisites 299
registered repositories, viewing 302
user accounts 300
repository locks
managing 303
releasing 305
viewing 303
repository notifications
sending 306
repository password
associated repository for Web Services Hub 392, 393
option 236
repository properties
PowerCenter Repository Service 285
Repository Service process
description 295
repository user name
associated repository for Web Services Hub 386, 392, 393
option 236
repository user password
associated repository for Web Services Hub 386
request timeout
SQL data services requests 160
Required Comments for Checkin(property)
description 287
resilience
in exclusive mode 296
period for PowerCenter Integration Service 228
PowerCenter Integration Service 274
PowerCenter Repository Service 291
repository database 291
Resilience Timeout (property)
description 287
option 228
Resource Manager Service
architecture 368
compute node attributes 146
disabling 370
enabling 370
log level 369
node assignment 369
overview 368
properties 369
recycling 370
Resource Manager Service process
properties 370
resource provision thresholds
defining 251
description 251
overview 258
resources
configuring 244
configuring Load Balancer to check 228, 250, 257
connection, assigning 245

resources (continued)
defining custom 246
defining file/directory 246
defining for nodes 244
Load Balancer 257
naming conventions 246
node 257
predefined 244
user-defined 244
restart
PowerCenter Integration Service 276
PowerCenter Repository Service 292
PowerExchange Listener Service 318
PowerExchange Logger Service 325
restoring
PowerCenter repository for Metadata Manager 177
repositories 307
result set cache
configuring 107
Data Integration Service properties 63, 68
purging 107
SQL data service properties 160
Result Set Cache Manager
description 79
result set caching
Result Set Cache Manager 79
virtual stored procedure properties 163
web service operation properties 166
reverting
checked-out object 215
revertObject (infacmd mrs) 215
root directory
process variable 239
round-robin dispatch mode
description 248
row error log files
permissions 269
rule specifications
Content Management Service 35, 36
run-time statistics
persisting to the repository 228

S
safe mode
configuring for PowerCenter Integration Service 224
PowerCenter Integration Service 222
samples
odbc.ini file 440
SAP BW Service
associated PowerCenter Integration Service 353
creating 348
disabling 350
enabling 350
general properties 351
log events, viewing 354
managing 347
properties 352
SAP Destination R Type (property) 348, 351
SAP BW Service log
viewing 354
SAP Destination R Type (property)
SAP BW Service 348, 351
SAP NetWeaver BI Monitor
log messages 354
saprfc.ini
DEST entry for SAP NetWeaver BI 348, 351

Scheduler Service
disabling 375
enabling 375
overview 371
properties 372
recycling 375
scorecards
purging results for 116
search analyzer
changing 207
custom 207
Model Repository Service 207
search index
Model Repository Service 207
updating 208
Search Service
creating 361
custom service process properties 361
disable 362
enable 362
environment variables 361
Maximum Heap Size 360
recycle 362
service process properties 360
service properties 358
security
audit trail, creating 310
web service security 120
SecurityAuditTrail
logging activities 310
server grid
licensed option 225
service levels
creating and editing 249
description 249
overview 259
service name
Web Services Hub 386
service process variables
list of 239
service role
Data Integration Service node 77
service variables
list of 226
services
system 364
session caches
description 269
session logs
directory 239
overview 270
permissions 269
session details 270
session output
cache files 272
control file 271
incremental aggregation files 272
indicator file 272
performance details 270
persistent lookup cache 273
post-session email 272
reject files 271
session logs 270
target output file 272
SessionExpiryPeriod (property)
Web Services Hub 390
sessions
caches 269

Index

461

sessions (continued)
DTM buffer memory 267
output files 269
performance details 270
running on a grid 266
session details file 270
shared library
configuring the PowerCenter Integration Service 232
shared storage
PowerCenter Integration Service 238
state of operations 238
SID/Service Name
description 181
sort order
SQL data services 160
source data
blocking 264
source databases
connecting through ODBC (UNIX) 438
source files
Data Integration Service 91
directory 239
source pipeline
pass-through 260
reading 263
target load order groups 263
sources
reading 263
SQL data service
changing the service name 164
properties 160
SQL data services
Data Integration Service grid 126, 128
sqlplus
testing database connections 414
startup type
configuring applications 153
configuring SQL data services 160
state of operations
PowerCenter Integration Service 238, 279
PowerCenter Repository Service 292
shared location 238
Stop option
disable Integration Service process 220
disable PowerCenter Integration Service 220
disable the Web Services Hub 387
Sybase ASE
connecting to Integration Service (UNIX) 433
connecting to Integration Service (Windows) 421
Sybase ASE database requirements
Data Analyzer repository 400
PowerCenter repository 408
symmetric processing platform
pipeline partitioning 267
system parameters
Data Integration Service 91
defining values 91
system services
overview 364
Resource Manager Service 368
Scheduler Service 371

T
table owner name
description 286

462

Index

tablespace name
for repository database 286, 336
tablespace recovery
IBM DB2 119
Microsoft SQL Server 120
Oracle 119
tablespaces
single nodes 408
target databases
connecting through ODBC (UNIX) 438
target files
directory 239
multiple directories 106
output files 272
target load order groups
mappings 263
targets
output files 272
session details, viewing 270
tasks
dispatch priorities, assigning 249
TCP/IP network protocol
Data Integration Service 75
team-based development
administering 214, 215
command line program administration 215
Objects view 214, 215
troubleshooting 214, 216
temporary files
directory 239
temporary tables
description 113
operations 114
rules and guidelines 115
Teradata
connecting to Informatica clients (UNIX) 435
connecting to Informatica clients (Windows) 422
connecting to Integration Service (UNIX) 435
connecting to Integration Service (Windows) 422
Test Data Manager
repository 381
Test Data Manager repository
creating 381
Test Data Manager Service
advanced properties 381
assign a new license 383
components 377
creating 382
description 377
general properties 378
properties 377
service properties 378
steps to create 381
TDM repository configuration properties 379
TDM server configuration properties 380
thread pool size
configuring maximum 63
threads
creation 260
mapping 260
master 260
post-session 260
pre-session 260
processing mappings 102
reader 260
transformation 260
types 261
writer 260

timeout
SQL data service connections 160
writer wait timeout 232
Timeout Interval (property)
description 185
Tracing
error severity level 228, 390
TreatCHARAsCHAROnRead
option 230
TreatDBPartitionAsPassThrough
option 232
TreatNullInComparisonOperatorsAs
option 232
troubleshooting
grid for Data Integration Service 149
grid for PowerCenter Integration Service 247
versioning 214, 216
TrustStore
option 228

U
undoing
checked-out object 215
Unicode mode
code pages 268
Data Integration Service 79
Unicode data movement mode, setting 226
UNIX
connecting to ODBC data sources 438
database client environment variables 414
database client variables 414
unlocking
locked object 215
UnlockObject (infacmd mrs) 215
unregistering
local repositories 301
plug-ins 309
upgrade error
Model Repository Service 396
URL scheme
Metadata Manager 183
Web Services Hub 386, 389
user connections
closing 305
managing 303
viewing 304
user-managed cache tables
configuring 111
description 111
users
notifications, sending 306
UTF-8
repository code page, Web Services Hub 386
writing logs 228

V
ValidateDataCodePages
option 232
validating
source and target code pages 232
version control
enabling 299
repositories 299

version control system

synchronizing 213
versioning
troubleshooting 214, 216
virtual column properties
configuring 163
virtual stored procedure properties
configuring 163
virtual table properties
configuring 162
virtual tables
caching in database 107

W
Warning
error severity level 228, 390
web service
changing the service name 166
enabling 166
operation properties 166
properties 164
security 120
web service security
authentication 120
authorization 120
HTTP client filter 120
HTTPS 120
message layer security 120
pass-through security 120
permissions 120
transport layer security 120
web services
Data Integration Service grid 126, 128
Web Services Hub
advanced properties 388, 390
associated PowerCenter repository 392
associated Repository Service 386, 392, 393
associated repository, adding 392
associated repository, editing 393
associating a PowerCenter repository Service 386
character encoding 389
creating 386
custom properties 388
disable with Abort option 387
disable with Stop option 387
disabling 387
domain for associated repository 386
DTM timeout 390
enabling 387
general properties 388, 389
host names 386, 389
host port number 386, 389
Hub Logical Address (property) 390
internal host name 386, 389
internal port number 386, 389
keystore file 386, 389
keystore password 386, 389
license 386, 389
location 386
MaxISConnections 390
node 386
node assignment 388, 389
password for administrator of associated repository 392, 393
properties, configuring 388
security domain for administrator of associated repository 392
service name 386

Index

463

Web Services Hub (continued)

SessionExpiryPeriod (property) 390
tasks on Informatica Administrator 385
URL scheme 386, 389
user name for administrator of associated repository 392, 393
user name for associated repository 386
user password for associated repository 386
version 386
Web Services Hub Service
custom properties 392
workflow
enabling 167
IBM DB2 database requirements 411
Microsoft SQL Server database requirements 412
Oracle database requirements 412
properties 167
workflow log files
directory 239
workflow logs
overview 270
permissions 269
Workflow Orchestration Service properties
Data Integration Service 65
workflow output
email 272
workflow logs 270

464

Index

workflow schedules
safe mode 224
workflows
Data Integration Service grid 132, 137
database requirements 411
grids in local mode 134
grids in remote mode 141
running on a grid 265
Workflow Orchestration Service properties 65
writer wait timeout
configuring 232
WriterWaitTimeOut
option 232

X
XMLWarnDupRows
option 232

Z
ZPMSENDSTATUS
log messages 354