Lecture 4 - Principles of Experimental Design
Lecture 4 - Principles of Experimental Design
FACTOR/TREATMENT:
training method 1, training method 2= 2 levels
-Randomization….
a)Takes place before the experiment begins
b)Is a process of assigning individuals to
groups not a result of such distribution
c)Forms groups that are equivalent and differ
only by chance.
1)Replication
Repetition of the experiment on many
experimental units
Functions:
To provide for an estimate of experimental
error which is used for test of significance
To improve the precision of an experiment
by reducing standard error of the mean
8
Precision: the degree to which repeated
measurements under unchanged condition show
the same results. (reliability)-
repeatability/reproducibility
Accuracy: closeness to the absolute or true value of
the quantity measured (validity)
Coefficient of variation: indicates the variation
within the data set
the results of a single experiment, applied to a small number of
objects or subjects, should not be accepted without question.
Randomly selecting two individuals from a group of four and
applying a treatment with "great success" generally will not impress
the public or convince anyone of the effectiveness of the treatment.
To improve the significance of an experimental result, replication,
the repetition of an experiment on a large group of subjects, is
required. If a treatment is truly effective, the long-term averaging
effect of replication will reflect its experimental worth. If it is not
effective, then the few members of the experimental population who
may have reacted to the treatment will be void/invalid by the large
numbers of subjects who were unaffected by it. Replication reduces
variability in experimental results, increasing their significance and
the confidence level with which a researcher can draw conclusions
about an experimental factor.
2) Randomization
A process of assigning the treatments among
the experimental units such that every
treatment has equal chance of being assigned
to any experimental unit
Functions:
To provide the random sample of observation
Techniques:
Use an appropriate experimental design
Compare several treatments
Blocking – technique used to increase the
precision of an experiment by breaking the
experiment into homogeneous segments
(blocks) in order to control any potential
block to block variability ( several training
methods, several drugs, several teaching
modules etc ). Any effects on the
experimental results as a result of the
blocking factor will be identified and
minimized.
Suppose that some Vo2max measurements
will be made in the morning and some in the
afternoon.
If you anticipate a difference between
15
• 20 males and 20 females.
• Half to be treated; the other half left
untreated.
• Can only work with 4 subjects per day.
16
17
18
19
If you can (and want to), fix a variable.
◦ e.g., use only male athletes from one category of
sport.
If you don’t fix a variable, stratify it.
◦ e.g., use both male and female athletes, and stratify
with respect to sports.
If you can neither fix nor stratify a variable,
randomize it.
20
Blinding
◦ Measurements made by people can be influenced
by unconscious biases.
◦ Ideally, dissections and measurements should be
made without knowledge of the treatment applied.
Internal controls
◦ It can be useful to use the subjects themselves as
their own controls (e.g., consider the response after
vs. before treatment).
◦ Why? Increased precision.
21
Representativeness
◦ Are the subjects/specimen you are studying really
representative of the population you want to study?
◦ Ideally, your study material is a random sample
from the population of interest.
22
Characteristics of good experiments:
Unbiased Able to estimate
◦ Randomization uncertainty
◦ Blinding
◦ Replication
High precision ◦ Randomization
◦ Uniform material
◦ Replication
◦ Stratification
Simple
◦ Protect against mistakes
23