Unit Iii - Transaction Flow Testing and Data Flow Testing
Unit Iii - Transaction Flow Testing and Data Flow Testing
TRANSACTION FLOWS:
• INTRODUCTION:
• A transaction is a unit of work seen from a system user's point of view.
• A transaction consists of a sequence of operations, some of which are performed
by a system, persons or devices that are outside of the system.
• Transaction begin with Birth-that is they are created as a result of some external
act.
• At the conclusion of the transaction's processing, the transaction is no longer in
the system.
• Example of a transaction: A transaction for an online information retrieval
system might consist of the following steps or tasks:
• Accept input (tentative birth)
• Validate input (birth)
• Transmit acknowledgement to requester
• Do input processing
• Search file
• Request directions from user
• Accept input
• Validate input
• Process request
• Update file
• Transmit output
• Record transaction in log and clean up (death)
• TRANSACTION FLOW GRAPHS:
• Transaction flows are introduced as a representation of a system's processing.
• The methods that were applied to control flow graphs are then used for functional
testing.
• Transaction flows and transaction flow testing are to the independent system
tester what control flows are path testing are to the programmer.
• The transaction flow graph is to create a behavioral model of the program that
leads to functional testing.
• The transaction flowgraph is a model of the structure of the system's behavior
(functionality).
• An example of a Transaction Flow is as follows:
IMPLEMENTATION:
To be added
The point of showing you this alternative anomaly state graph is to demonstrate
that the specifics of an anomaly depends on such things as language, application,
context, or even your frame of mind. In principle, you must create a new
definition of data flow anomaly (e.g., a new state graph) in each situation. You
must at least verify that the anomaly definition behind the theory or imbedded in a
data flow anomaly test tool is appropriate to your situation.
• STATIC Vs DYNAMIC ANOMALY DETECTION:
• Static analysis is analysis done on source code without actually executing it. For
example: source code syntax error detection is the static analysis result.
• Dynamic analysis is done on the fly as the program is being executed and is based
on intermediate values that result from the program's execution. For example: a
division by zero warning is the dynamic result.
• If a problem, such as a data flow anomaly, can be detected by static analysis
methods, then it doesnot belongs in testing - it belongs in the language processor.
• There is actually a lot more static analysis for data flow analysis for data flow
anomalies going on in current language processors.
• For example, language processors which force variable declarations can detect (-
u) and (ku) anomalies.
• But still there are many things for which current notions of static analysis are
INADEQUATE.
• Why Static Analysis isn't enough? There are many things for which current
notions of static analysis are inadequate. They are:
• Dead Variables:Although it is often possible to prove that a variable is
dead or alive at a given point in the program, the general problem is
unsolvable.
• Arrays:Arrays are problematic in that the array is defined or killed as a
single object, but reference is to specific locations within the array. Array
pointers are usually dynamically calculated, so there's no way to do a
static analysis to validate the pointer value. In many languages,
dynamically allocated arrays contain garbage unless explicitly initialized
and therefore, -u anomalies are possible.
• Records and Pointers:The array problem and the difficulty with pointers
is a special case of multipart data structures. We have the same problem
with records and the pointers to them. Also, in many applications we
create files and their names dynamically and there's no way to determine,
without execution, whether such objects are in the proper state on a given
path or, for that matter, whether they exist at all.
• Dynamic Subroutine and Function Names in a Call:subroutine or
function name is a dynamic variable in a call. What is passed, or a
combination of subroutine names and data objects, is constructed on a
specific path. There's no way, without executing the path, to determine
whether the call is correct or not.
• False Anomalies:Anomalies are specific to paths. Even a "clear bug" such
as ku may not be a bug if the path along which the anomaly exist is
unachievable. Such "anomalies" are false anomalies. Unfortunately, the
problem of determining whether a path is or is not achievable is
unsolvable.
• Recoverable Anomalies and Alternate State Graphs:What constitutes
an anomaly depends on context, application, and semantics. How does the
compiler know which model I have in mind? It can't because the definition
of "anomaly" is not fundamental. The language processor must have a
built-in anomaly definition with which you may or may not (with good
reason) agree.
• Concurrency, Interrupts, System Issues:As soon as we get away from
the simple single-task uniprocessor environment and start thinking in
terms of systems, most anomaly issues become vastly more complicated.
How often do we define or create data objects at an interrupt level so that
they can be processed by a lower-priority routine? Interrupts can make the
"correct" anomalous and the "anomalous" correct. True concurrency (as in
an MIMD machine) and pseudoconcurrency (as in multiprocessing)
systems can do the same to us. Much of integration and system testing is
aimed at detecting data-flow anomalies that cannot be detected in the
context of a single routine.
• Although static analysis methods have limits, they are worth using and a
continuing trend in language processor design has been better static analysis
methods, especially for data flow anomaly detection. That's good because it
means there's less for us to do as testers and we have far too much to do as it is.
• DATA FLOW MODEL:
• The data flow model is based on the program's control flow graph - Don't confuse
that with the program's data flowgraph..
• Here we annotate each link with symbols (for example, d, k, u, c, p) or sequences
of symbols (for example, dd, du, ddd) that denote the sequence of data operations
on that link with respect to the variable of interest. Such annotations are called
link weights.
• The control flow graph structure is same for every variable: it is the weights that
change.
• Components of the model:
1. To every statement there is a node, whose name is unique. Every node has
at least one outlink and at least one inlink except for exit nodes and entry
nodes.
2. Exit nodes are dummy nodes placed at the outgoing arrowheads of exit
statements (e.g., END, RETURN), to complete the graph. Similarly, entry
nodes are dummy nodes placed at entry statements (e.g., BEGIN) for the
same reason.
3. The outlink of simple statements (statements with only one outlink) are
weighted by the proper sequence of data-flow actions for that statement.
Note that the sequence can consist of more than one letter. For example,
the assignment statement A:= A + B in most languages is weighted by cd
or possibly ckd for variable A. Languages that permit multiple
simultaneous assignments and/or compound statements can have
anomalies within the statement. The sequence must correspond to the
order in which the object code will be executed for that variable.
4. Predicate nodes (e.g., IF-THEN-ELSE, DO WHILE, CASE) are weighted
with the p - use(s) on every outlink, appropriate to that outlink.
5. Every sequence of simple statements (e.g., a sequence of nodes with one
inlink and one outlink) can be replaced by a pair of nodes that has, as
weights on the link between them, the concatenation of link weights.
6. If there are several data-flow actions on a given link for a given variable,
then the weight of the link is denoted by the sequence of actions on that
link for that variable.
7. Conversely, a link with several data-flow actions on it can be replaced by
a succession of equivalent links, each of which has at most one data-flow
action for any variable.
• Let us consider the example:
Figure 3.7: Program Example (PDL)
For variable X and Y:In Figure 3.9, because variables X and Y are used only on
link (1,3), any test that starts at the entry satisfies this criterion (for variables X
and Y, but not for all variables as required by the strategy).
For variable Z: The situation for variable Z (Figure 3.10) is more complicated
because the variable is redefined in many places. For the definition on link (1,3)
we must exercise paths that include subpaths (1,3,4) and (1,3,5). The definition on
link (4,5) is covered by any path that includes (5,6), such as subpath (1,3,4,5,6,
...). The (5,6) definition requires paths that include subpaths (5,6,7,4) and
(5,6,7,8).
For variable V: Variable V (Figure 3.11) is defined only once on link (1,3).
Because V has a predicate use at node 12 and the subsequent path to the end must
be forced for both directions at node 12, the all-du-paths strategy for this variable
requires that we exercise all loop-free entry/exit paths and at least one path that
includes the loop caused by (11,4). Note that we must test paths that include both
subpaths (3,4,5) and (3,5) even though neither of these has V definitions. They
must be included because they provide alternate du paths to the V use on link
(5,6). Although (7,4) is not used in the test set for variable V, it will be included
in the test set that covers the predicate uses of array variable V() and U.
The all-du-paths strategy is a strong criterion, but it does not take as many tests as
it might seem at first because any one test simultaneously satisfies the criterion
for several definitions and uses of several different variables.
2. All Uses Startegy (AU):The all uses strategy is that at least one definition clear
path from every definition of every variable to every use of that definition be
exercised under some test. Just as we reduced our ambitions by stepping down
from all paths (P) to branch coverage (C2), say, we can reduce the number of test
cases by asking that the test set should include at least one path segment from
every definition to every use that can be reached by that definition.
For variable V: In Figure 3.11, ADUP requires that we include subpaths (3,4,5)
and (3,5) in some test because subsequent uses of V, such as on link (5,6), can be
reached by either alternative. In AU either (3,4,5) or (3,5) can be used to start
paths, but we don't have to use both. Similarly, we can skip the (8,10) link if
we've included the (8,9,10) subpath. Note the hole. We must include (8,9,10) in
some test cases because that's the only way to reach the c use at link (9,10) - but
suppose our bug for variable V is on link (8,10) after all? Find a covering set of
paths under AU for Figure 3.11.
3. All p-uses/some c-uses strategy (APU+C) : For every variable and every
definition of that variable, include at least one definition free path from the
definition to every predicate use; if there are definitions of the variables that are
not covered by the above prescription, then add computational use test cases as
required to cover every definition.
For variable Z:In Figure 3.10, for APU+C we can select paths that all take the
upper link (12,13) and therefore we do not cover the c-use of Z: but that's okay
according to the strategy's definition because every definition is covered. Links
(1,3), (4,5), (5,6), and (7,8) must be included because they contain definitions for
variable Z. Links (3,4), (3,5), (8,9), (8,10), (9,6), and (9,10) must be included
because they contain predicate uses of Z. Find a covering set of test cases under
APU+C for all variables in this example - it only takes two tests.
4. All c-uses/some p-uses strategy (ACU+P) : The all c-uses/some p-uses strategy
(ACU+P) is to first ensure coverage by computational use cases and if any
definition is not covered by the previously selected paths, add such predicate use
cases as are needed to assure that every definition is included in some test.
The above examples imply that APU+C is stronger than branch coverage but
ACU+P may be weaker than, or incomparable to, branch coverage.
5. All Definitions Strategy (AD) : The all definitions strategy asks only every
definition of every variable be covered by atleast one use of that variable, be that
use a computational use or a predicate use.
From the definition of this strategy we would expect it to be weaker than both
ACU+P and APU+C.
6. All Predicate Uses (APU), All Computational Uses (ACU) Strategies : The all
predicate uses strategy is derived from APU+C strategy by dropping the
requirement that we include a c-use for the variable if there are no p-uses for the
variable. The all computational uses strategy is derived from ACU+P strategy by
dropping the requirement that we include a p-use for the variable if there are no c-
uses for the variable.
It is intuitively obvious that ACU should be weaker than ACU+P and that APU
should be weaker than APU+C.
• ORDERING THE STRATEGIES:
• Figure 3.12 compares path-flow and data-flow testing strategies. The arrows
denote that the strategy at the arrow's tail is stronger than the strategy at the
arrow's head.
SUMMARY:
• The methods discussed for path testing of units and programs can be applied with suitable
interpretation to functional testing based on transaction flows.
• The biggest problem and the biggest payoff may be getting the transaction flows in the
first place.
• Full coverage (C1 + C2) is required for all flows, but most bugs will be found on the
strange, meaningless, weird paths.
• Transaction-flow control may be implemented by means of an undeclared and
unrecognized internal language.
• The practice of attempting to design tests based on transaction-flow representation of
requirements and discussing those attempts with the designer can unearth more bugs than
any tests you run.
• Data are as important as code and will become more important.
• Data integrity is as important as code integrity. Just as common sense dictates that all
statements and branches be exercised on under test, all data definitions and subsequent
uses must similarly be tested.
• What constitutes a data flow anomaly is peculiar to the application. Be sure to have a
clear concept of data flow anomalies in your situation.
• Use all available tools to detect those anomalies that can be detected statically. Let the
extent and excellence of static data-flow anomaly detection be as important a criterion in
selecting a language processor as produced object code efficiency and compilation speed.
Use the slower compiler that gives you slower object code if it can detect more
anomalies. You can always recompile the unit after it has been debugged.
• The data-flow testing strategies span the gap between all paths and branch testing. Of the
various available strategies, AU probably has the best payoff for the money. It seems to
be no worse than twice the number of test cases required for branch testing, but the
resulting code is much more reliable. AU is not too difficult to do without supporting
tools, but use the tools as they become available.
• Don't restrict your notion of data-flow anomaly to the obvious. The symbols d, k, u, and
the associated anomalies, can be interpreted (with profit) in terms of file opening and
closing, resource management, and other applications.