Combining Qualitative and Quantitative Data Sampling and Analysis Mixed Methods
Combining Qualitative and Quantitative Data Sampling and Analysis Mixed Methods
*Professor.
246
COMBINING / SANDELOWSKI
use terms like positivist and positivism to quickly communicate complex and admittedly controversial ideas for the
purposes of this paper, not to stereotype researchers or viewing positions.
247
248
and quantitative approaches may be used sequentially, concurrently and iteratively, or in a sandwich pattern.
Combining Sampling Strategies
One of the most important features distinguishing
what is commonly referred to as qualitative from
quantitative inquiry is the kind of sampling used.
While qualitative research typically involves purposeful sampling to enhance understanding of the
information-rich case (Patton, 1990), quantitative
research ideally involves probability sampling to
permit statistical inferences to be made. Although
purposeful sampling is oriented toward the development of idiographic knowledgefrom generalizations from and about individual cases
probability sampling is oriented toward the development of nomothetic knowledge, from generalizations from samples to populations. Notwithstanding these key differences, purposeful and
probability sampling techniques can be combined
usefully.
Criterion sampling. For example, in design
template 2 shown in Figure 1, in which the use of
quantitative techniques precede the use of qualitative techniques, research participants scores on
the instruments used to collect data in the quantitative portion of the study can be used to initiate a
criterion sampling strategy. Criterion sampling is
a kind of purposeful sampling of cases on preconceived criteria, such as scores on an instrument.
Cases may be chosen because they typify the average score; this kind of sampling may also be referred to as typical case sampling. Cases may be
chosen because they exemplify extreme scores;
this kind of sampling may also be called extreme
or deviant case sampling. (The term deviant here
refers to any departure from a specified norm.)
Such cases are highly unusual. Or, cases may be
chosen because they show a variable intensely, but
not extremely; this kind of sampling may also be
referred to as intensity sampling (Patton, 1990, pp.
182183).
Researchers using scores on instruments as the
criterion for purposeful sampling may wish to collect more data (e.g., via interviews or observations) from the chosen participants for the purpose
of triangulation: that is, to discern whether a typical, extreme, or intense case of something on a
standardized test is also a typical, extreme, or intense case using other data collection techniques.
Or, researchers may use the criterion of scores
(typical, extreme, or intense scores) for the purpose of complementarity: that is, to find out more
about what makes a case typical, extreme, or in-
COMBINING / SANDELOWSKI
249
tense. In the process of sampling for complementarity, researchers will inevitably also obtain information on convergent validity and, thereby,
also achieve the purpose of triangulation. That is,
in the process of obtaining fuller information on
why persons scored as they did, they will also obtain information on whether persons look the same
on interview or observation as they did on the
quantitative measure of a target phenomenon. Researchers will sample participants in scoring categories until the point of informational redundancy; that is, until they have collected information
from enough cases in each scoring category to allow them to draw conclusions about the validity of
the result (if they are seeking convergent validity),
or to elaborate on and clarify the result. Sampling
on the basis of scores is an especially useful strategy in clinical trials of interventions to validate or
clarify their effects on different participants.
Random purposeful sampling. Another example of the combined use of probability and purposeful sampling is random purposeful sampling,
which may also be used in design template 2 or 3.
This sampling strategy is employed when there is
a very large pool of potentially information-rich
cases and no obvious reason to choose one case
over another. For example, in a clinical trial of an
intervention to reduce pain with 500 people, 300
of them scored as having less pain on a standardized measure of pain, 150 scored as having as
much pain as they had before the treatment, and 50
scored as having more pain. These numbers are
too large for any purposeful sampling strategy oriented toward the intensive study of the particulars
of each case. Accordingly, cases can initially be
chosen from each of these three scoring groups
(the criterion for sampling here is again the scores)
by assigning all the cases in each group a number
250
COMBINING / SANDELOWSKI
251
252
and what data they will collect in the second qualitative portion of a study.
Another use of instruments that fulfills the
purpose of development is to guide purposeful
sampling. The results of instruments can direct researchers more precisely to the kinds of participants they may wish to recruit and the nature of information they will want to obtain from them. As
described previously, instrument scores can be the
basis for sampling in a follow-up qualitative study.
Results from a survey can direct researchers toward the most fruitful variables and associations
to examine further both qualitatively, as shown in
design template 3 in Figure 1, or first qualitatively
and then again, quantitatively, as shown in design
template 7 in Figure 1. Ornstein and his colleagues
(1993) initiated focus groups after learning from
the results of a telephone survey that there were
three groups of nonresponders to a reminder
letter for cholesterol screening. The focus groups
were organized to elicit more information concerning the lack of response. This information could
then serve as the basis for revising the reminder
protocol and then qualitatively or quantitatively
evaluating its effectiveness in reducing the numbers of nonresponders. For example, the new reminder protocol could be tested in a clinical trial
and the scores on the instruments used to appraise
the protocol could then be used as the basis for criterion sampling to further explain those scores.
This combined example illustrates how a quan !
Qual study (survey>focus group) can lead to a
Quan ! qual (experiment ! criterion sampling "
interviews) study. Together, these studies can be
represented as quan!Qual! Quan!qual.
Instruments can also be used as elicitation devices in interviews concerning both the target phenomenon and the instrument itself. For example, a
researcher may use participants responses on a
depression inventory to trigger more thoughts and
feelings about depression in individual interview
sessions. Participants often require some assistance to articulate inchoate thoughts or to speak
the unspeakable. The use of an instrument as an
elicitation device can serve this purpose, just as
the use of projective techniques (e.g., Ornstein et
al., 1993) can help participants language, and focus on, a target experience.
Researchers may also ask participants to comment specifically on their view of each item on an
instrument in order to appraise its content and construct validity. In the infertility study mentioned
previously (Sandelowski et al., 1992), we used a
symptom inventory to appraise the type and intensity of symptoms women and men were experiencing as they awaited birth or adoption. One of
COMBINING / SANDELOWSKI
253
254
been using combinations of qualitative and quantitative techniques, but the qualitative techniques
have not been featured, have been inappropriately
or inadequately used or explained, or have been
explicitly minimized. Sutton (1997) lauded the
virtues of closet qualitative research whereby
researchers conceal or downplay (p. 97) the use
of qualitative techniques in order to have their research reports published!
The combined use of qualitative and quantitative techniques will inevitably be informed by the
researchers viewing position, which shapes what
techniques will be combined, and how and why
they are combined. Accordingly, if researchers
want to combine stories and numbers. . . without
compromise (Ford-Gilboe, Campbell, & Berman,
1995), use numbers and words in a shamelessly
eclectic manner (Rossman & Wilson, 1994), and
ease the uneasy alliance (Buchanan, 1992) between qualitative and quantitative methods, they
must have a clear view of their viewing positions
and what dynamic mixes they suggest or permit.
Researchers must also resist the mix and
match syndrome (Leininger, 1994, p. 103) that
can result in a qualitative quagmire (Barbour,
1998) and that mandates that all research be
mixed-method research. As Chen (1997) suggested, mixed-method research is in danger of becoming the new ideology. Mixed-method research
should never be used because of the misguided assumptions that more is better, that it is the fashionable thing to do, or, most importantly, that qualitative research is incomplete without quantitative
research (Morse, 1996). Indeed, qualitative techniques have been used to salvage quantitative
studies (Weinholtz, Kacer, & Rocklin, 1995). The
completeness of any individual study, no matter
what kind it is, must be judged without resorting
to methodological fads or fetishes.
REFERENCES
Annells, M. (1996). Grounded theory method: Philosophical perspectives, paradigm of inquiry, and postmodernism. Qualitative Health Research, 6, 379393.
Barbour, R.S. (1998). Mixing qualitative methods:
Quality assurance or qualitative quagmire? Qualitative Health Research, 8, 352361.
Berman, H., Ford-Gilboe, M., & Campbell, J.C. (1998).
Combining stories and numbers: A methodologic approach for a critical nursing science. ANS: Advances
in Nursing Science, 21(1), 115.
Borkan, J.M., Quirk, M., & Sullivan, M. (1991). Finding meaning after the fall: Injury narratives from elderly hip fracture patients. Social Science & Medicine, 33, 947957.
COMBINING / SANDELOWSKI
255
Morse, J.M. (1991). Approaches to qualitative-quantitative methodological triangulation. Nursing Research, 40, 120123.
Morse, J.M. (1996). Is qualitative research complete?
Qualitative Health Research, 6, 35.
Ornstein, S.M., Musham, C., Reid, A., Jenkins, R.G.,
Zemp, L.D., & Garr, D.R. (1993). Barriers to adherence to preventive services reminder letters: The patients perspective. Journal of Family Practice, 36,
195200.
Patton, M.Q. (1990). Qualitative evaluation and research methods (2nd ed.). Newbury Park, CA: Sage.
Pearce, J.C. (1971). The crack in the cosmic egg: Challenging constructs of mind and reality. New York:
Washington Square Press.
Rossman, G.B., & Wilson, B.L. (1994). Numbers and
words revisited: Being shamelessly eclectic. Quality & Quantity, 28, 315327.
Rothert, M., Rovner, D., Holmes, M., Schmitt, N., Talarczyk, G., Kroll, J., & Gogate, J. (1990). Womens
use of information regarding hormone replacement
therapy. Research in Nursing & Health, 13, 355366.
Sandelowski, M. (1995). Triangles and crystals: On the
geometry of qualitative research. Research in Nursing & Health, 18, 569574.
Sandelowski, M., Harris, B.G., & Holditch-Davis, D.
(1991). Amniocentesis in the context of infertility.
Health Care for Women International, 12, 167
178.
Sandelowski, M., Holditch-Davis, D., & Harris, B.G.
(1992). Using qualitative and quantitative methods:
The transition to parenthood of infertile couples. In
J.F. Gilgun, K. Daly, & G. Handel (Eds.), Qualitative
methods in family research (pp. 301322). Newbury
Park, CA: Sage.
Silverman, D. (1993). Interpreting qualitative data:
Methods for analyzing talk, text and interaction. London: Sage.
Sutton, R.I. (1997). The virtues of closet qualitative research. Organization Science, 8, 97106.
Swanson, S.C. (1992). A cross-disciplinary application
of Greene, Caracelli and Grahamss conceptual
framework for mixed method evaluation. Unpublished doctoral dissertation, Georgia State University, Atlanta, GA.
Tashakkori, A., & Teddlie, C. (1998). Mixed methodology: Combining qualitative and quantitative approaches. Thousand Oaks, CA: Sage.
Trost, J.E. (1986). Statistically non-representative stratified sampling: A sampling technique for qualitative
studies. Qualitative Sociology, 9, 5457.
Weinholtz, D., Kacer, B., & Rocklin, T. (1995). Salvaging quantitative research with qualitative data.
Qualitative Health Research, 5, 388397.
Wolfer, J. (1993). Aspects of reality and ways of
knowing in nursing: In search of an integrating paradigm. Image: Journal of Nursing Scholarship, 25,
141146.