Alternative Designs
Alternative Designs
I. Quasi-Experiments
A. When true experiments cannot be conducted - naturally occurring events - limited pool of participants B. When possible use true experimental designs to prevent threats to validity: e.g., pre-test, post-test with a control group Solomon-four groups design
ts
nts
en
Tr
D. Quasi-Experimental Designs
(in increasing levels of internal validity)
1. Single Pretest-Posttest design: OXO O= Observation X= Experimental Manipulation Example: Quaker Oatmeal Worst possible design
Qu
asi
rim pe Ex ue
-E
xp
eri
me
D. Quasi-Experimental Designs
(in increasing levels of internal validity)
2. Interrupted Time Series: 00000X00000 00000X Use this when you dont have complete control don over when the manipulation occurs. Example: boxing and homicide rates
D. Quasi-Experimental Designs
(in increasing levels of internal validity)
3. Random time series
Time of manipulation randomly determined
Diet Example
250 230 210
Start Program
Week
D. Quasi-Experimental Designs
(in increasing levels of internal validity)
4. Nonequivalent Control Group (before-after)
Difference
Experimental: Control:
O1 O1
X O2 O2
O1-O2 O1-O2
Number of errors on the reading word list in each of the groups before and after the airport opened
Nomothetic research
drawbacks: drawbacks: 1) individual differences treated as error 2) grouped data may obscure psychological processes. Example: primary images in flashbulb memories Question: What is your most memorable image from the 9/11 attacks?
0.6
0.5
Percent Reported First
0.4
0.3
0.2
0.1
0
Planes Crashing Buildings Collapsing People Jumping Others
Image
These results suggests that people have remarkable stable memories for the events. But, what happens if we look at individual participants consistency in reporting over time?
Ideographic Research
Goal: to understand an individual Goal: Methods: case studies Methods: Emphasis on the uniqueness of the individual
Drawback: what can case studies tell us about Drawback: psychological processes in others? others? Shontz (1965, p. 236)
A chemist who wishes to study the properties of a compound or element need not concern himself with the number of samples of the substance on which his tests are run, as long as he is certain that he knows the identity of the particular material on which he is working and as long as his procedures are explicit and carefully followed . By the same token, a psychologist who wishes to study an important personality process, such as anxiety, need not concern himself greatly with the size of his sample, provided that his subject is appropriately selected and that he has procedures that enable him to recognize (that is, measure) anxiety when it occurs in the person he is investigating.
10
11
Example 2: Flashbulb memory hypothesis (cont) McCloskey, Wible, & Cohen (1988) Wible,
Flashbulb memory and the Challenger explosion Susan . . . Stated that she was eating lunch in the cafeteria with John, Beth, and Jennifer . . . However, Tim . . . Stated that he was eating with John when he learned of the explosion, but did not remember Susan, Beth, or Jennifer being there. Beth Beth recollected that she was elsewhere at lunch the day (p. 175). 175).
12
Conclusions
1 Alternative research designs can provide important information quasi-experimental, small n, case studies 2. But, they have clear limitations 3. Researchers should use the best designs possible, minimizing alternative explanations
13