Lab: Qlik Replicate for SAP ERP

to Amazon Redshift
TABLE OF CONTENTS
Overview ..................................................................................................................................................... 3
Introduction ............................................................................................................................................... 3
Accessing Replicate Environment ............................................................................................................. 4
SAP Extractor Source Configuration ......................................................................................................... 5
Amazon Redshift Target Configuration ..................................................................................................... 7
Configure Replication Task ........................................................................................................................ 9
Run Task ................................................................................................................................................... 17
View Data in Amazon Redshift ................................................................................................................. 19
Overview
This Document covers the process involved in configuring Qlik Replicate to extract data out of an SAP ERP
System and store it into Amazon Redshift Cluster Environment. The areas covered include:

o Configuring Endpoints (Source and Target)

o Creating Replicate Task

o Execute Task

o Validate data

Introduction
Replicate Tasks are used to manage the extraction and loading from various Source Systems/Databases to
targeted Databases. Although a Replicate task can only manage one source and one target system, it does
not limit the development of multiple tasks within a project. Example: A client may have three different
Database/File Systems in their environment, (Oracle, SAP HANA, IBM VSAM files) and would like to extract all
these data into a centralized Database/Cloud Environment (ex. Amazon Redshift) for Analysis. In this
scenario, three Replicate Tasks would be required.
What will surprise those who worked with other data extraction tools, is the seamlessness with which Qlik
Replicate performs these processes.

In this Lab, you will define the steps needed to configure Qlik Replicate to extract data from SAP ERP via
Extractors to Amazon Redshift Cluster. Below are the steps required.

Lab: Qlik Replicate for SAP ERP to Amazon Redshift | Overview 3

Accessing Replicate Environment
Steps
1. Ensure that the URL for the Replicate Server is available, and access granted.
- This will be provided by your Systems Administrator.

2. Open browser** and enter the URL of the Replication Server.

The format is: https://ReplicateComputerName:3552/attunityreplicate/

Example: https://replicate.attunitydemo.com:3552/attunityreplicate

- This will prompt you to log into Replicate.

3. Enter your Username and Password.

- This will take you to the Replicate Console.

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| Accessing Replicate Environment 4
4
SAP Extractor Source Configuration

4. Select Manage Endpoint Connections.

The following window will appear.

We will now create an Oracle Endpoint.

5. Select + New Endpoint Connection.

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| SAP Extractor Source Configuration 5
5
 6. Enter a meaningful Endpoint Name and Description for the Endpoint Connector.

7. With Source button selected, select dropdown arrow to select SAP Extractor.

8. Enter SAP Source information and access credentials as provided.

By your Systems Administrator.

• Server:
• Instance:
• Client Identifier:
• Password:
• Number Format:

9. Select Test Connection to ensure definitions are correct.

Look for the “Test Connection succeeded” message. Any other message means something may be
incorrect with your Server/Database definitions, or the Server/Database is unavailable.

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| SAP Extractor Source Configuration 6
6
 The green checkmark is indicative of correct configuration.

10. Select Save.

11. Select Close.

Amazon Redshift Target Configuration

Next, we need to configure our Amazon Redshift target endpoint. This process contains more information about the
files being output but is similar to other endpoints. As before, the first step in the configuration process is to provide
the attributes of the endpoint to be created.

1. In the Replicate Console, Select Manage Endpoint Connections.

2. Select + New Endpoint Connection.

3. Enter a meaningful Endpoint Name and Description for the Endpoint Connector.

4. Select Target button selected in Role.

5. Select Type Amazon Redshift.

Note: Your System Administrator will provide Cluster information and other credentials. Also ensure that the
S3 Staging information is available. They work in concert with each other.
6. Enter Amazon Redshift Target Information.

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| Amazon Redshift Target Configuration 7
7
 i. Redshift cluster:
ii. Server port:
iii. Username:
iv. Password:
v. Database Name:

7. Enter parameters for the Amazon S3 Staging as indicated below.

Note: Your System Administrator will provide these credentials.

i. Bucket Name:
ii. Bucket Region
iii. Access Options
iv. Security Key
v. Target Folder (This will be created dynamically once name is entered)

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| Amazon Redshift Target Configuration 8
8
 8. Select Test Connection.
Again, look for the “Test Connection succeeded” message. Any other message means something may be
incorrect with your Server/Database definitions, or the Server/Database is unavailable.

9. Select Save.

Configure Replication Task

Now that we have configured our SAP S4HANA Extractor source and Amazon Redshift target endpoints, we need to tie
them together in what we call a Replicate task. In short, a task defines the following:

• A source endpoint

• A target endpoint

• The list of tables that we want to capture.

• Any transformations we want to make on the data.

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| Configure Replication Task 9
9
We start by doing the following:

1. In the Replication Console, Select +New Task to create a New Task.

The following window will appear:

2. Enter a meaningful Task Name.

3. Select Unidirectional radio button.

- This indicates data flows from Source to Target – with no writebacks to source system.

4. Ensure that Full Load and Apply Changes are shaded.

You should have the following filled in:

• Unidirectional
• Full Load: enabled (Blue highlight is enabled; Select to enable / disable.)
• Apply Changes: enabled (Blue highlight is enabled; Select to enable / disable.)
• Store Changes: disabled (Blue highlight is enabled; Select to enable / disable.)

5. Select OK.
- This closes the New Task dialog box.

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| Configure Replication Task 10
10
 Once completed, the following window will appear:

We will now assign the newly created endpoints - source endpoint (SAP) and target endpoint (Amazon Redshift).

At this point the Source and Target Endpoints created above will be assigned, in order for Replicate to extract and
load the data as defined.

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| Configure Replication Task 11
11
 1. On the left of the Replicate Console panel, Select Source.
2. Locate the Source Endpoint created above or one which meets your Source definitions.
3. Drag and drop to Source Endpoint on the right, as indicated in diagram.

4. On the left of the Replicate Console panel, Select Target.

5. Locate the Target Endpoint created above or one which meets your Target definitions.
6. Drag and drop to Target Endpoint on the right, as indicated in diagram.

7. Select Save.

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| Configure Replication Task 12
12
 Replicate is ready to extract the data from SAP into Amazon Redshift Cluster.

Steps
1. In the Qlik Replicate Console, Select Table Selection.

2. Enter % in Table:

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| Configure Replication Task 13
13
 3. Select Search.
A list of available [Extractor] files/tables will appear.

4. Select Files/tables to be transfer into Replicate the Qlik Replicate Console.

5. Select > icon to transfer data to the Selected Tables column.

6. Select OK.

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| Configure Replication Task 14
14
 7. Select Global Transformation.
You need to configure a Schema in the Redshift Cluster for storing the data.

8. Select New Global Transformation.

Enter meaningful Transformation description.

9. Select Rename Schema button.

10. Select Next.

11. Select Next.

12. Select Rename Schema to button.

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| Configure Replication Task 15
15
 13. Enter the name of the Schema.

14. Select Finish.

15. Select OK.

16. Select Task Settings.

17. Enter Table Target Schema.

18. Select OK.

19. Select Save.

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| Configure Replication Task 16
16
Run Task

1. Select down arrow beside Run.

2. Select Start Processing.

- If this is not the first time this Task is being used to extract data, Reload Target must be used – Reload
Target will not be an option.

3. Select Yes to reload Data Target.

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| Run Task 17
17
 Replicate switches to Monitor mode to allow for monitoring of Data Loads.

After Full Load is complete, select on the Completed bar to display the tables. There

is DML activity running in the background. Select on the Change Processing tab to

see it in action.

Note: Changes to the tables occur somewhat randomly in the background. You may

need to wait a few minutes before you will see changes appear in the tables that we

selected.

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| Run Task 18
18
View Data in Amazon Redshift
In this scenario, the data was extracted into Amazon Redshift. QMI® allows each user to provision a small Redshift
Cluster. We will now go to view the data.

The tool I will use to browse the data is DBeaver.

1. Locate the Redshift Database used in the Target Endpoint.

2. Drilldown to locate the database Schema defined as part of the Replicate Configuration.

3. Drill down into Schema.

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| View Data in Amazon Redshift 19
19
 4. Right-mouse click on Table and select view Table.

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| View Data in Amazon Redshift 20
20
About Qlik
Qlik’s vision is a data-literate world, where everyone can use data and analytics to improve decision-making and solve their most challenging problems. Qlik provides an
end-to-end, real-time data integration and analytics cloud platform to close the gaps between data, insights and action. By transforming data into active intelligence,
businesses can drive better decisions, improve revenue and profitability, and optimize customer relationships. Qlik does business in more than 100 countries and serves
over 50,000 customers around the world.

qlik.com
© 2021 QlikTech International AB. All rights reserved. All company and/or product names may be trade names, trademarks and/or registered trademarks of the respective owners with which they are
associated. CODE NEEDED FOR PUBLISHING

SAP
Lab:ERP
Qlikto Amazon
Replicate forRedshift in Amazon
SAP ERP to Qlik Replicate
Redshift Environment
| View Data in Amazon Redshift 21
21