From Clinical Observations To Research: Dr. Dick Menzies June 10, 2005
From Clinical Observations To Research: Dr. Dick Menzies June 10, 2005
to Research
Hierarchy of Study Designs
Advantages
Good for chronic diseases (prevalence)
Good for common diseases
Also good for fairly common exposures
Allows one to measure multiple disease or conditions
and multiple determinants or risk factors
Disadvantages
Measurement of exposure can be difficult
Recall problems if long latency
Accuracy if changes over time (Alcohol, smoking, blood
pressure)
Can not distinguish cause and effect (Tobacco Industry)
Step 6: Analytic Studies Case Control
General design
Identify a group of patients with disease, or
conditions = cases
Identify similar group but without disease or
conditions = controls
Measure risk factors or determinants in both
Assess if exposure more likely (odds > 1) in
cases than controls
6: Case Control Studies
Advantages
Relatively cheap and quick
Particularly useful for studying rare conditions
Or conditions with long latency
Disadvantages
Controls, Controls, Controls
Very difficult to select proper controls
This is the source of most problems in case control studies
And is why they are generally considered weak evidence.
Difficulties of retrospective exposure assessment
particularly if long latency
Step 7: Analytic Studies Cohorts
General design
Find a group of healthy people (without
condition/ disease)
Eg.: military, workforce, nurses
Measure their characteristics at baseline
Particularly exposures of interest
Follow them for a period of time
Measure occurrence of disease or condition
7: Cohort Studies
Advantages
Can measure many exposures or determinants
Can measure many diseases
Much better to know cause and effect
Disadvantages
Long and expensive (often very $$$)
Good for common diseases (some cancers,
cardiovascular)
Inefficient for rare diseases or with long latency
Also what if you fail to measure key determinants
(Solution = freezer)
Step 7a: Studies of Diagnostic Tests
General design
Usually prospective
Find group of patients with condition
Ideally when they are being investigated for it
Try new test & standard or reference tests
Establish a final accurate diagnosis in all
Need a GOLD standard.
Compare new test to old test(s)
agreement, sensitivity and specificity
7a: Diagnostic Test Studies
Advantages
Relatively cheap, and quick
If condition is reasonable common
Disadvantages
Must define final diagnosis correctly. Must have a gold
standard
Persons doing new test must be blinded
Population must be representative
eg. Patients with advanced disease vs. healthy volunteers
The final step: Experimental Studies
Randomized Trials
General Design
Pick an intervention usually a form of treatment
You can only pick one
Find a group of patients that agree to participate
Have to be representative of condition
Give the new treatment to some
Some get the old (or no) treatment
Do this randomly
Follow all to see outcomes
Experimental Studies Randomized Trials
Advantages
Best way to evaluate effect of an intervention
Best control of bias and confounding
Disadvantages
Not easy or feasible for all interventions
Not useful for studies or risk factors or natural history
Difficult to apply for most diagnostic tests
Substantial refusal or drop-out rates can restrict
generalizability
Population selected may not be representative
Young healthier adults
No pregnancy, no kids, no elderly PLEASE!
Experimental Community or Field Trials
General Design
Pick an intervention to be applied at a community
level
Fluoride in water, public education, vaccination
Find several communities or population groups
Apply intervention to some and not others
Randomly again
Measure outcomes at population or group level
Community or Field Trials
Advantages
Only way to study some interventions
May offer better assessment of likely impact of these
interventions
Disadvantages
All the same problems as ecologic studies
Also some important ethical issues (eg., fluoride)