Pavan_Sr_ETL_IDQ_MDM_Developer (1)
Pavan_Sr_ETL_IDQ_MDM_Developer (1)
[email protected]
510-697-5311
Lead Informatica ETL ,IDQ/MDM Developer
Professional Summary:
Around 10 years of Software Life Cycle experience in System Analysis, Design, Development,
and Implementation, Maintenance, and Production support of Data Warehouse Applications.
Extensive experience with Informatica Power Center 10.x,9.x,8.x, 7.xIDQ
10.2.1/9.0.1/8.6,MDM 10.3,B2B,PCF,node js, Teradata, SQL server and oracle databases
Worked on various domains including Healthcare, Insurance, Finance domains
Expertise in working with Informatica Designer, Informatica developer , Informatica MDM
Work Flow Manager, Work Flow Monitor, Source Analyzer, Target Designer, Transformation
Developer, Mapplet Designer, Mapping Designer, Workflow Designer, Task Developer, Worklet
Designer, Gant Chart, Task View, Mappings, Workflows, Sessions, Re-usable Transformations,
Shortcuts, Import and Export utilities.
Experience in integration of various data sources with Multiple Relational Databases like Oracle,
Teradata, SQL Server and Worked on integrating data from flat files like fixed width, delimited,
CSV, HL7 (health level) and EPIC .EXT Files
Good knowledge of Data warehouse concepts and principles (Kimball/Inman) - Star Schema,
Snowflake, Data Vault, Oracle Designer and modeling tools like Erwin and Visio,SCD,Surrogate
keys, Normalization/De normalization.
Analysis, estimations, Design, Construction, Unit and System Testing and implementation.
Extensive Knowledge in designing functional and detailed design documents for data
warehouse development
Experience in ActiveVOS workflow design, creation of Human task Extensive experience in MDM
10. x with IDQ and ActiveVOS 9. 2.
Experience in managing ActiveVOS Central Setup Identify Service on ActiveVOS Console
Good Knowledge on ActiveVOS Error and Fault handing, Event Handling, Gateway, Control Flow
Understanding of Monitoring Services (Process, Task, Server) Schedule ActiveVOS Automatic
Processes
Worked on IDQ tools for data profiling, data enrichment and standardization.
Experience in development of mappings in IDQ to load the cleansed data into the target table
using various IDQ transformations. Experience in data profiling and analyzing the scorecards to
design the data model
Experience on creating Column Profiling, Rule Profiling, Mid-stream Profiling, Score Cards,
Decision Task, Reference Tables, DQ Tables, Notification task as a part of workflow and
deploying them.
Imported the IDQ address standardized mappings into Informatica Designer as a Mapplets
Expertise in designing and developing Informatica Data Quality transformations/rules like
Address validator, Parser, Labeler, Match, Exception, Association, Standardizer and other
significant transformations
Experience in Data Modeling, Star Schema, Snowflake Schema, Slowly Changing Dimensions,
Fact tables, Dimension tables, Normal forms, OLAP and OLTP systems.
Good explore in Informatica DVO for test the data validation by write SQL queries source and
Target database and schedule tasks and reporting test result.
Experience in the integration of various data sources such as Oracle, SQL Server, Sybase,
Teradata, DB2, XML Files and Flat files.
Two B2B Projects – DT/DX (Data Transformation Studio), Data Transformation Accelerator, Data
Format Transformation Library, Data Transformation Engine and full integration with Power
center
Design MDM architecture solutions, complex match rules, complex custom survivorship rules
which cannot be handled out-of-the box MDM tool to determine best version of truth (BVT) aka
Golden Record and reusable framework
Experience in making API , web service calls to third party vendors by integrating with node js
and PCF .
Developed E2E process for design and developing real time process to users to insert records
directly into MDM schema.
Configure Base objects, Match Rules, Merge Rules, Trust Settings, Stage, Landing tables, Queries,
Packages, Validation rules, mappings, Hierarchies using Informatica MDM Multi-Domain Hub.
Build Informatica Data Director (IDD) UI application for data steward to strategize stewardship
functionality and Entity 360 view by providing governance on role based specific operations
Vast experience in Designing and developing complex mappings from varied transformation
logic like Unconnected and Connected lookups, Source Qualifier, Router, Filter, Expression,
Aggregator, Joiner, Update Strategy, Data Transformation Services etc
Extracted Data from multiple operational sources of loading staging area, Data Warehouse and
data marts using CDC/ SCD (Type1/Type2) loads.
Experience in PL/SQL Programming (Stored procedures, Triggers, Packages) using Oracle and
have a good knowledge in Sybase.
Technical Summary:
Worked with DBA’s and Informatics admins for server size estimation and informatica tool
installation.
Worked with Informatica Data Quality (IDQ) toolkit, Analysis, data cleansing, data matching,
data conversion.
Worked extensively on Informatics mappings to load data from various sources to final target
tables based on the business logic.
Designed web services applications for name standardization and for inserting records through
real time
Create Realtime RESTFUL PUT, POST, GET method API calls called as Business Entity Services that
exposes a master entity out from MDM to enable realtime integration of application to MDM
using Provisioning Tool and also enable smart search using Solr Fuzzy Search.
Configured Informatica Data Director(IDD); design workflow customizations for Data Stewards
Configured administrative activities related to MDM platform including but not limited to MDM
hub, Process Server, Active VOS, Provisioning and IDD/C360 UI.
Configured C360 view to display the data of the root node of the composite objects
Configure near realtime capability, configure triggers and components against specific sources
and events to publish message queues to RabbitMQ to publish a Master record changed
message in json format
Used Metadata manager for validating, promoting, importing and exporting repositories from
development environment to testing environment.
Involved with Data Steward Team for designing, documenting and configuring Informatica Data
Director for supporting management of MDM data.
Identified Golden Record (BVT) for Customer Data by analyzing the data and duplicate records
coming from different source systems.
Helped the testing team for data integrity and consistency.
Defined and configured schema, staging tables, and landing tables, base objects foreign-key
Relationships, look up systems and tables, packages, query groups and queries/custom queries.
Defined the Trust and Validation rules and setting up the match/merge rule sets to get the right
master records
Used Hierarchies tool, for configuring entity base objects, entity types, relationship base objects,
relationship types, profiles, put and display packages and used the entity types as subject areas
in IDD.
Designed the Informatica master data C360 processes, C360 Model objects, Entities, etc
Implemented the C360 product functionality to support MDM application design within SFDC
Configured C360 application configuration for Customer objects
Worked with offshore teams to design and develop/configure C360 functionality
Created Jenkins and UCD process for automatic code deployment to higher environments
Successfully implemented IDD using hierarchy configuration and created subject area groups,
subject areas, subject area child, IDD display packages in hub and search queries.
Deployed new MDM Hub for portals in conjunction with user interface on IDD application.
Defined the Trust and Validation rules and setting up the match/merge rule sets to get the right
master records.
Worked on java script and node js to deploy applications in PCF to communicate to third party
vendors
Extensively worked on E2E flow of data from IDQ to MDM and generating BVT using validation
rules and survivorship
Created complex mappings for the retro activity requirements from client.
Designed automation process to handle production data issue using scripts and sqlqueries,and
come up with the best approach to increase the performance of process
Created webservice calls,restapi calls from Informatica developer to communicate with cloud
data and real time insert/update call to insert data into MDM directly
Design trust settings, design java user exits, Security and Privileges along with roles and groups,
design data model for MDM by interacting with solution and portfolio architects to establish
common framework based solutions using Informatica MDM Multi-Domain Hub.
Developed database triggers, functions, stored procedures, packages, Materialized Views and
Ref cursors using Oracle PLSQL
Used debugger in identifying bugs in existing mappings by analyzing data flow, evaluating
transformations.
Extensively worked on Labeler, Parser, Key Generator, Match, Merge, and Consolidation
transformations to identify the duplicate records.
Good Debugging skills and good at using Exceptions and Error Handling.
Worked with Shortcuts across Shared and Non Shared Folders
Involved in implementing the Land Process of loading the customer/product Data Set into
Informatica MDM from various source systems.
Performed land process to load data into landing tables of MDM Hub using external batch
processing for initial data load in hub store.
Involved in deployment of IDQ mappings to application and to different environments
Preparation of UTP (Unit Test Plan) with all required validations and test cases.
Responsible for testing and validating the Informatica mappings against the pre-defined ETL
design standards.
Created various tasks like sessions, decision, timer & control to design the workflows based on
dependencies
Involved in production support.
Environment: Informatica Data Quality 10.2,Informatica Power Center 10.2,Informatica MDM 10.3, IDD,
C360,oracle 12g, MS SQL Server 2012, SQL, PL/SQL,Scripts,nodejs , PCF, java script,Jenkins,UCD.