Observational Overview and Case Control Studies 2022 Student Handout 3 Slides
Observational Overview and Case Control Studies 2022 Student Handout 3 Slides
OBSERVATIONAL STUDIES
Objectives
• Describe how observational studies differ from clinical trials and
descriptive literature
• Explain how observational studies are used in research
• Discuss the general limitations of observational studies including
types of bias
• Explain what confounding is and how it is controlled for in studies in
both the methods and statistical analysis
Meta-
analysis
Systematic Review
Randomized Controlled
Trials (RCTs)
Observational
Studies Cohort Studies
Case-Control Studies
Case Reports/Series
Expert Opinion
1
10/3/2022
• Analytical studies
- Test hypotheses, look for relationships
- Examples:
• Observational Studies- Cohort, Case-control
• Experimental- Randomized Controlled Trial (RCT)
Observational Studies
• Like RCTs, they attempt to answer a clinical question (such as identifying factors
associated with increased or decreased risk of a certain clinical outcome)
• They are not descriptive
2
10/3/2022
Treatment group: All those with diabetes who were admitted to a medicine inpatient unit at a
hospital over a 1-year period and were treated with Drug X
Control group: Nurses with diabetes who worked full time at the same hospital during the same
time period who did not receive Drug X during the same time period
How might this affect the outcome you are measuring? Would you expect those who received
the treatment with Drug X to be healthier or less healthy at baseline than the control group?
Does either group represent the general population of those with diabetes?
3
10/3/2022
• New Drug- providers used in more healthy patients due to their lack of experience
with the new drug
• Old drug- providers more comfortable using in sicker patients because they were more
familiar with the drug
How would this bias the outcome? More or less side effects with the new drug?
10
11
12
4
10/3/2022
Confounding
• A causal relationship between two variables is often described as the way in
which the independent variable affects the dependent variable. The independent
variable can take different values independently, and the dependent variable
varies according to the value of the independent variable.
• Confounding is the distortion of the association between the independent and
dependent variables because a third variable is Independently associated with
both.
• If the third variable is not present equally among the two groups, it could be
that variable, not the one being studied that is affecting the outcome/dependent
variable
https://s4be.cochrane.org/blog/2018/10/01/a-beginners-guide-to-confounding/
13
Confounding
• Let’s say you want to find out how alcohol consumption affects mortality
• You want to compare the mortality rates between two groups –
Group 1 = heavy users of alcohol
Group 2 = those who drink little or no alcohol
https://s4be.cochrane.org/blog/2018/10/01/a-beginners-guide-to-confounding/
14
Confounding
• If you find that Group 1 (heavy alcohol users) are more likely to die you may
conclude that alcohol use increases the risk of death.
• However, it is possible that alcohol use is not the only mortality-affecting
factor that differs between the two groups.
• People who consume less alcohol might be more likely to eat a healthier diet
or less likely to smoke, for example.
• Eating a healthy diet or smoking might affect mortality.
https://s4be.cochrane.org/blog/2018/10/01/a-beginners-guide-to-confounding/
15
5
10/3/2022
These other influencing factors are called confounding variables. If you ignore them and assume that any differences in
mortality must be caused by a difference in alcohol consumption, you could end up with results that don’t reflect reality.
You might find associations where in reality there are none or fail to find associations where they do in fact exist.
https://s4be.cochrane.org/blog/2018/10/01/a-beginners-guide-to-confounding/
16
• Examples: age, sex, weight, diet, medical history, social history (e.g., smoking, ETOH
use), other medications
• Cannot rule out possibility that it is some confounder, and not the exposure itself, that
resulted in an outcome. Confounding can distort the “truth!”
17
18
6
10/3/2022
Confounder
Exposure Outcome
19
Blood pressure
An observational study could give the false impression that taking statins is associated with increased
CHD (or have no reduction in CHD) due to the confounder BP if more subjects had high BP the statin
group compared to the non statin taking group.
20
Older Age
An observational study could give the false impression that moving to Florida is associated with short
term memory loss if those who moved to Florida included more who were older than those who did not
move to Florida.
21
7
10/3/2022
Alendronate Fractures
1. Color of a car one drives is not associated with taking alendronate or getting fractures
2. Color of car one drives would not be predicted to be more common in those prescribed alendronate
than those not prescribed alendronate.
3. Alendronate does not affect the color of car one drives, and the car color does not affect fracture rate
(not along the causal pathway)
22
Alendronate Fractures
Another question: In this study, could gender be a cofounder? Why or why not?
23
X Randomization
• Not possible in Observational studies- no intervention by investigators so
can’t randomly assign patients to treatment group; (will see this in
Interventional studies such as RCTs covered in later lectures)
✓Restriction
• Exclude subjects with a certain confounding characteristic from study (e.g.,
smokers, ETOH users, people with certain medical conditions)
• May limit generalizability of study (external validity)
• Can use in both observational and experimental studies (RCTs)
✓Matching- Next slide
24
8
10/3/2022
25
https://pubmed.ncbi.nlm.nih.gov/23613075/
26
London MJ, Her K, Schwartz GG, Henderson WG. Association of perioperative β- blockade with mortality and cardiovascular
morbidity following major noncardiac surgery. JAMA. 2013; 309(16:):1704-1713.
https://pubmed.ncbi.nlm.nih.gov/23613075/
27
9
10/3/2022
Question
What is the exposure being studied?
What is the outcome being studied?
Are there any potential confounding variables/confounders that could affect the
results of this study? (see Table 1)
https://pubmed.ncbi.nlm.nih.gov/23613075/
28
29
30
10
10/3/2022
Postoperative Outcomes
Full Cohort Matched Cohort
(% of patients) (% of patients)
Notice that in full cohort, the % of patients experiencing an event in exposed group is greater than
in unexposed group. However after PS matching, perioperative beta-blockade is shown to be protective
for most events. This suggests that the unmatched results may be due to confounding (e.g., subjects
exposed to beta-blockers had more risk factors than unexposed group).
31
• Stratification
• Regression analysis
32
33
11
10/3/2022
Yes 88 68
No 62 82
Data suggests that alcohol abuse is significantly associated with an increased risk of
lung cancer. What about smoking as a potential confounder? It is associated
with both alcohol use and lung cancer, and is not in causal pathway between exposure
and lung cancer (lung cancer doesn’t cause one to smoke).
34
Alcohol abuse
Yes 53 15 68 35 53 88
No 10 3 13 52 79 131
Total 63 18 81 87 132 219
Stratum specific OR =1.06 (95% CI: 0.26-4.35) OR= 1.01 (95% CI: 0.58-1.74)
35
36
12
10/3/2022
37
38
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8436093/pdf/ijmsv18p3565.pdf
https://pubmed.ncbi.nlm.nih.gov/34522183/
39
13
10/3/2022
STROBE Statement
• Developed by an international group of experts (epidemiologists, researchers,
statisticians who conduct observational research
• Aimed at strengthening the reporting of observational studies in epidemiology
• Includes a checklist of items that should be included in reports of observational
studies
• Available at: https://www.equator-network.org/reporting-guidelines/strobe/
40
• Were the subjects in the study treatment and control groups comparable at
baseline? (did selection bias exist?)
• Were confounding variables obviously present?
• Was the information on exposure and outcomes collected consistently in both
groups? (was there bias in recording exposure or outcomes?)
• How good is the quality/completeness of the collected data?
• Was study design modified (restriction or matching) or statistical analysis done
(stratification or regression analysis) to correct for potential confounders?
41
Summary
• Observational studies are useful in assessing real world
effectiveness and harm/risk of treatment
• Observational studies are often the best approach when long
periods of observation are needed, for rare exposures or
outcomes, or when clinical trials would be unethical
• Because they are not experimental (like RCTs), only associations
and not cause-effect relationships can be determined
• Understanding how to critically evaluate cohort and case-control
studies is important to utilizing them for making patient care
decisions- both types of studies will be outlined in detail in the
next few lectures
42
14
10/3/2022
Case-Control Studies
43
44
45
15
10/3/2022
Case-Control Study
• Begins AFTER individuals have developed the outcome of interest
• Therefore, these studies are retrospective
• Two groups: cases (with outcome of interest) and controls (without
outcome) who reflect exposure pattern from same source population from
which cases arose
• Cases and controls are matched for key characteristics (e.g., sex, age) to
reduce bias/confounding
• Longitudinal: goes back in time (retrospectively) to determine differences
between the groups in some exposure (e.g., drug) prior to event occurring
• Like cohort studies, used to define risk factors associated with the
development of particular disease
46
Exposed +
CASES- Those with the
outcome (ex. disease)
Not Exposed -
Exposed +
CONTROLS-
Those without the
Not Exposed - outcome (ex disease)
Past Present
47
Outcome +
EXPOSED
No Outcome -
COHORT
Outcome +
NOT EXPOSED
No Outcome -
48
16
10/3/2022
49
50
51
17
10/3/2022
In case control studies you don’t start with exposed, therefore don’t know
how many were exposed so can’t calculate RR
To estimate RR in case control studies- Use Odds Ratio (OR)
OR estimates RR if outcome not too common; (more on this in cohort lecture)
52
53
54
18
10/3/2022
95% Confidence Interval = 95% chance that the true value falls
within this range
55
56
Crude OR (Unadjusted) can also be adjusted (Adjusted OR) for variables that weren’t matched
such as presence of other diseases, smoking etc using Regression analysis- see next example
57
19
10/3/2022
Study Example:
Bruderer et al. Use of Diuretics and Risk of Incident Gout: A Population-
Based Case–Control Study; ARTHRITIS & RHEUMATOLOGY 2014;Vol.
66 (1):185–196
https://www.ncbi.nlm.nih.gov/pubmed/24449584 or
https://onlinelibrary.wiley.com/doi/epdf/10.1002/art.38203
58
Bruderer et al study-
Which of the following was done in this study to control for confounding?
59
Questions:
1. What matching was done with the controls to make them similar to cases?
2. What variables were adjusted for in the analysis?
3. Was thiazide diuretic current use overall associated with an increased risk of gout?
What was the OR and 95% CI? Corrected (adjusted) OR? (see Table 3)
4. Was Potassium sparing current use overall associated with an increased risk of
gout? What was the OR and 95% CI? Corrected (adjusted) OR? (see Table 3)
60
20
10/3/2022
• The cohort group is followed until a certain event occurs (e.g., MI,
stroke, death)
• “incident” or new cases are identified
61
Eurich et al. Inhaled corticosteroids and risk of recurrent pneumonia. Clin Infect Dis 2013;57:1138-44
62
Study Results
ICS Use Controls Cases Unadjusted Adjusted OR
(n=6244) (n=653) OR (95%) CI (95%) CI
1. What can you conclude about past use of ICS & pneumonia based on
these results?
2. What can you conclude about current use of ICS & pneumonia based on
these results?
3. Was there evidence of confounding?
63
21
10/3/2022
Another Example:
Daneman N et al. Metronidazole-associated neurologic events: A nested case control study
https://academic.oup.com/cid/article/72/12/2095/5821517
Which of the following was done in this study to control for confounding?
64
65
66
22
10/3/2022
Starts with exposure and goes forward to Starts with outcome and goes backward to
outcome exposure
Typically larger sample size Typically smaller sample size
Can provide information about multiple Provides information only about outcome
outcomes under study
Expensive Inexpensive
67
Starts with exposure and goes forward to Starts with outcome and goes backward to
outcome exposure
Typically larger sample size Typically smaller sample size
Can provide information about multiple Provides information only about outcome
outcomes under study
Expensive Inexpensive
68
69
23
10/3/2022
Questions?
70
24