Scribd
Upload
44 views

Producing Data: - : Design of Experiments

Beware of drawing conclusions from our own experience or hearsay. Government statistical offices are the primary source for demographic, economic, and social data. A response to a treatment is statistically significant if it is larger than you would expect by chance.

Uploaded by

crutili
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
44 views

Producing Data: - : Design of Experiments

Beware of drawing conclusions from our own experience or hearsay. Government statistical offices are the primary source for demographic, economic, and social data. A response to a treatment is statistically significant if it is larger than you would expect by chance.

Uploaded by

crutili
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 20

Producing data:

- Design of experiments

IPS chapters 3.1 and 3.2

© 2006 W.H. Freeman and Company


Objectives (IPS chapters 3.1
and 3.2)
Design of experiments
 Obtaining data
 Terminology
 Comparative experiments
 Caution about experimentation
 Randomization
 Completely randomized designs
 Block designs
 Matched pairs designs
Obtaining data
Available data are data that were produced in the past for some other
purpose but that may help answer a present question inexpensively.
The library and the Internet are sources of available data.
Government statistical offices are the primary source for demographic,
economic, and social data (visit the Fed-Stats site at www.fedstats.gov).

Beware of drawing conclusions from our own experience or hearsay.


Anecdotal evidence is based on haphazardly selected individual
cases, which we tend to remember because they are unusual in some
way. They also may not be representative of any larger group of cases.

Some questions require data produced specifically to answer them.


This leads to designing observational or experimental studies.
Observational study: Record data on individuals without attempting
to influence the responses. We typically cannot prove anything this
way.

Example: Based on observations you make in nature,


you suspect that female crickets choose their
mates on the basis of their health.  Observe
health of male crickets that mated.

Experimental study: Deliberately impose a treatment on individuals


and record their responses. Influential factors can be controlled.

Example: Deliberately infect some males with


intestinal parasites and see whether females
tend to choose healthy rather than ill males.
Terminology
 The individuals in an experiment are the experimental units. If they
are human, we call them subjects.

 In an experiment, we do something to the subject and measure the


response. The “something” we do is a called a treatment, or factor.

 The factor may be the administration of a drug.

 One group of people may be placed on a diet/exercise program for six


months (treatment), and their blood pressure (response variable) would
be compared with that of people who did not diet or exercise.
 If the experiment involves giving two different doses of a drug, we
say that we are testing two levels of the factor.

 A response to a treatment is statistically significant if it is larger


than you would expect by chance (due to random variation among
the subjects). We will learn how to determine this later.

In a study of sickle cell anemia, 150 patients were given the drug
hydroxyurea, and 150 were given a placebo (dummy pill). The researchers
counted the episodes of pain in each subject. Identify:

• The subjects • (patients, all 300)


• The factors / treatments • (hydroxyurea and placebo)
• And the response variable • (episodes of pain)
Comparative experiments
Experiments are comparative in nature: We compare the response to a
treatment to:
 Another treatment,
 No treatment (a control),
 A placebo
 Or any combination of the above

A control is a situation when no treatment is administered. It serves as


a reference mark for an actual treatment (e.g., a group of subject does
not receive any drug or pill of any kind).

A placebo is a fake treatment, such as a sugar pill. This is to test the


hypothesis that the response to the actual treatment is due to the
actual treatment and not to how the subject is being taken care of.
About the placebo effect
The “placebo effect” is an improvement in health due not to any
treatment but only to the patient’s belief that he or she will improve.
 The “placebo effect” is not understood, but it is believed to have
therapeutic results on up to a whopping 35% of patients.
 It can sometimes ease the symptoms of a variety of ills, from asthma to
pain to high blood pressure, and even to heart attacks.
 An opposite, or “negative placebo effect,” has been observed when
patients believe their health will get worse.

The most famous, and maybe most powerful, placebo


is the “kiss,” blow, or hug—whatever your technique.

Unfortunately, the effect gradually disappears


once children figure out that they sometimes
get better without help and vice versa.
Caution about
experimentati
on
The design of a study is
biased if it systematically
favors certain
outcomes.

The best way to exclude biases in an experiment is to randomize the


design. Both the individuals and treatments are assigned randomly.
Other ways to remove bias:

A double-blind experiment is one in which neither the subjects nor


the experimenter know which individuals got which treatment until the
experiment is completed. The goal is to avoid forms of placebo effects
and biases in interpretation.

The best way to make sure your conclusions are robust is to replicate
your experiment—do it over. Replication ensures that particular results
are not due to uncontrolled factors or errors of manipulation.
Lack of realism

Lack of realism is a serious weakness of experimentation. The


subjects or treatments or setting of an experiment may not realistically
duplicate the conditions we really want to study. In that case, we
cannot generalize the conclusions of the experiment.

Is the treatment appropriate for the response you want to study?

 Is studying the effects of eating red meat on cholesterol values in a group of


middle aged men a realistic way to study factors affecting heart disease
problem in humans?

 What about studying the effects of hair spray


on rats to determine what will happen
to women with big hair?
Designing “controlled” experiments
Sir Ronald Fisher—The “father of statistics”
He was sent to Rothamsted Agricultural Station in
the United Kingdom to evaluate the success of
various fertilizer treatments.

Fisher found the data from experiments going on for decades to be


basically worthless because of poor experimental design.
 Fertilizer had been applied to a field one year and not in another in order to
compare the yield of grain produced in the two years. BUT
 It may have rained more, or been sunnier, in different years.

 The seeds used may have differed between years as well.

 Or fertilizer was applied to one field and not to a nearby field in the same
year. BUT
 The fields might have different soil, water, drainage, and history of

previous use.

 Too many factors affecting the results were “uncontrolled.”


Fisher’s solution:

“Randomized comparative experiments”

 In the same field and same year, apply F F F F F F


fertilizer to randomly spaced plots
F F F F F F F F
within the field. Analyze plants from
F F F F F
similarly treated plots together.
F F F F F F F F
 This minimizes the effect of variation
F F F F F
within the field in drainage and soil
composition on yield, as well as F F F F

controlling for weather.


Randomization
One way to randomize an experiment is to rely on random digits to
make choices in a neutral way. We can use a table of random digits
(like Table B) or the random sampling function of a statistical software.

How to randomly choose n individuals from a group of N:


 We first label each of the N individuals with a number (typically from 1 to
N, or 0 to N − 1)
 A list of random digits is parsed into digits the same length as N (if N =
233, then its length is 3; if N = 18, its length is 2).
 The parsed list is read in sequence and the first n digits corresponding
to a label in our group of N are selected.
 The n individuals with these labels constitute our selection.
Using Table B

We need to randomly select five students from a class of 20.

• List and number all members of the population, which is the class of 20.
• The number 20 is two digits long.
• Parse the list of random digits into numbers that are two digits long. Here
we chose to start with line 103 for no particular reason.

45 46 71 17 09 77 55 80 00 95 32 86 32 94 85 82 22 69 00 56
45 46 71 17 09 77 55 80 00 95 32 86 32 94 85 82 22 69 00 56

52 71 13 88 89 93 07 46 02 … 1 Alison
2 Amy
• Randomly choose five students by reading through the list of 3 Brigitte
two-digit random numbers, starting with line 103 and on. 4 Darwin
5 Emily
• The first five random numbers matching numbers assigned
6 Fernando
to students make our selection. 7 George
8 Harry
9 Henry
The first individual selected is Ramon, number 17. Then
10 John
Henry (9, or 09). That’s all we can get from line 103. 11 Kate
12 Max
We then move on to line 104. The next three to be
13 Moe
selected are Moe, George, and Amy (13, 7, and 2). 14 Nancy
15 Ned
• Remember that 1 is 01, 2 is 02, etc. 16 Paul
17 Ramon
• If you were to hit 17 again before getting five people,
18 Rupert
don’t sample Ramon twice—just keep going. 19 Tom
20 Victoria
Completely randomized designs
Completely randomized experimental designs:
Individuals are randomly assigned to groups, then
the groups are randomly assigned to treatments.
Block designs
In a block, or stratified, design, subjects are divided into groups,
or blocks, prior to experiments to test hypotheses about
differences between the groups.

The blocking, or stratification, here is by gender.


Matched pairs designs
Matched pairs: Choose pairs of subjects that are closely matched—
e.g., same sex, height, weight, age, and race. Within each pair,
randomly assign who will receive which treatment.

It is also possible to just use a single person, and give the two
treatments to this person over time in random order. In this case, the
“matched pair” is just the same person at different points in time.

The most closely


matched pair
studies use
identical twins.
What experimental design?

A researcher wants to see if there is a significant difference in


resting pulse rates for men and women. Twenty-eight men
and 24 women had their pulse rate measured at rest in the
lab.

 One factor, two levels (male and female)


 Stratified random sample (by gender)

Many dairy cows now receive injections of BST, a hormone intended to spur
greater milk production. The milk production of 60 Ayrshire dairy cows was
recorded before and after they received a first injection of BST.

 SRS of 60 cows
 Match pair design (before and after)

You might also like