Ab Initio Training

Basic Components
 Filter By Expression

 Filter by Expression
filters records
according to a DML
expression or
transform function,
which specifies the
selection criteria.

 Filter by Expression
is sometimes used to
create a subset, or
sample, of the data.

Confidential ©2012 Syntel, Inc.

 Filter By Expression

 Ports:
Parameters
– in
select_expr
– out
– use_package
– deselect
– package
– reject
– error_group
– error
– log_group
– log
– reject-threshold
– logging

Confidential ©2012 Syntel, Inc.

> The Sort Component

 Reads records from input port, sorts them by key, and writes
the result on the output port.

Confidential ©2012 Syntel, Inc.

> The Sort Component

Confidential ©2012 Syntel, Inc.

> The Sort Component

Input Data Outpu

t
Data
SOR
T

Confidential ©2012 Syntel, Inc.

> Keys

 A key identifies a single field or set of fields (a composite

key) used to organize a dataset in some way.
 Single field: {id}
 Multiple field: {last_name; first_name}
 Modifiers: {id descending}
 Used for sorting, grouping, partitioning.

Note: Keys are also called collators.

Confidential ©2012 Syntel, Inc.

 Dedup Sorted

 Dedup Sorted separates one

specified record in each
group of records from the
rest of the records in the
group.

 Dedup Sorted requires

grouped input.

 Dedup Sorted component

removes duplicate records
from a sorted flow of data.

 Perform a descending sort

or an ascending sort.

Confidential ©2012 Syntel, Inc.

 Dedup Sorted

 Ports:
Parameters
– in
key
– out
select
– dup
keep
– reject
package
– error
error_group
– log
log_group
– reject-threshold
– check-sort
– logging

Confidential ©2012 Syntel, Inc.

> The Reformat Component

 Reads records from input port, reformats each according to a

transform function (optional in the case of the Reformat Component),
and writes the result records to the output (out0) port.
 Additional output ports (out1, ...) can be created by adjusting the count
parameter.

 Purpose : The Reformat component changes the

record format of data records by dropping fields, or
by using DML expressions to add fields, combines
fields, or transforms the data in the records.
Confidential ©2012 Syntel, Inc.
> The Reformat Component
 Count : is an integer from 1 to 20 that is used to set the number

of the following ports

 out ports
 reject ports
 error ports
 transform parameters

 Transform : used for mapping purpose (From source to Target)

based on the business requirement.

 Select : is used to filter data records based on a select

expression. Same as Filter by Expression

Confidential ©2012 Syntel, Inc.

 > The Reformat Component

 Count : is an integer from 1 to 20

that is used to set the number of
the following ports
 out ports
 reject ports
 error ports
 transform parameters

Confidential ©2012 Syntel, Inc.

 > Built In Functions in Reformat or any Transform Component
 Inquiry and Error Functions :  Math Functions :
 String Functions :  Date Functions :
 fail_if_error  ceiling
 string_compare  date_add_months
 first_defined  decimal_round
 string_concat  date_day
 force_error  floor
 string_downcase  date_day_of_month
 is_defined  math_abs
 string_filter  date_day_of_year
 is_error  math_acos
 string_length  date_month
 is_failure  math_asin
 string_lpad  date_to_int
 is_null  math_atan
 string_replace  date_month_end
 is_valid  math_cos
 is_blank  date_year
 length_of  math_exp
 string_ltrim  datetime_add
 size_of  math_pow
 string_pad  now
 today  write_to_log  math_sin
 string_trim
 today1  math_sinh
 string_upcase
 math_sqrt
 math_tan
 math_tanh

Confidential ©2012 Syntel, Inc.

> The Reformat Component

Target Fields
Source Fields Transformation Rules

 Transform : used for mapping purpose (From source to

Target) based on the business requirement.

Confidential ©2012 Syntel, Inc.

> Text DML: Transform Function Syntax

 Transform Functions look like:

output-variables :: name ( input-variables ) =

begin
assignments;
end;

 Assignments look like:

output-variable.field :: expression;

Confidential ©2012 Syntel, Inc.

> The Transform Function in Text Format

out :: reformat (in) =

begin
out.id :: in.id + 1000000;
out.last_name :: string_concat(“Mac”, in.last_name);
end;

Confidential ©2012 Syntel, Inc.

> A Look Inside the Reformat Component

a b c

x y z

Confidential ©2012 Syntel, Inc.

> The Record is read into the component

9 45 AB

out :: reformat(in) =
begin
out.x :: in.b - 1;
out.y :: in.a;
out.z :: string_concat(in.c,”C”);
end;

Confidential ©2012 Syntel, Inc.

> The Transformation Function is evaluated

9 45 AB

out :: reformat(in) =
begin
out.x :: in.b - 1;
out.y :: in.a;
out.z :: string_concat(in.c,”C”);
end;

Confidential ©2012 Syntel, Inc.

> Since every rule within the Transform function, is successful, a result record is
issued

out :: reformat(in) =
begin
out.x :: in.b - 1;
out.y :: in.a;
out.z :: string_concat(in.c,”C”);
end;

44 9 ABC

Confidential ©2012 Syntel, Inc.

> The result record is written to the output port of the component

out :: reformat(in) =
begin
out.x :: in.b - 1;
out.y :: in.a;
out.z :: string_concat(in.c,”C”);
end;

44 9 ABC

Confidential ©2012 Syntel, Inc.

> Exercise: Write the transformation rules for the below given
scenario

Input record format:

0345,090263John,Smith;
0345,090263John,Smith;
record
decimal(”,”) id;
date(”MMDDYY”) bday;
string(”,”)first_name;
string(”;”) last_name;
Drop Reformat end

Reformat Reorder

id+1000000
Output record format:
record
decimal(7) id;
string(8) last_name;
date(”YYYY.MM.DD”) bday;
end

1000345Smith
1000345Smith 1963.09.02
1963.09.02

Confidential ©2012 Syntel, Inc.

> The Replicate Component

 Purpose : This component arbitrarily

combines all the data records it receives into
a single flow and writes a copy of that flow
to each of its output flows.

Confidential ©2012 Syntel, Inc.

> The Replicate Component

Copy data into 2 flows Output Sorted on Field ID

Output Sorted on
Field first_name

Confidential ©2012 Syntel, Inc.

Thank You!

Confidential ©2012 Syntel, Inc.