Qualitative Data Collection

Lizamarie C. Olegario

Qualitative researchers typically rely on

four methods for gathering information:
1.
2.
3.
4.

participating in the setting

observing directly
interviewing in depth
analyzing documents and material culture

Primary Data vs. Secondary Data

Primary data
gathered by researcher
Secondary data
the data that have been already
collected and recorded by someone else
readily available from other sources
can be collected directly either form
published or unpublished sources

Classification of Secondary Data

Secondary
Data

Internal

Ready to Use

Requires
Further
Processing

Internal
Used
Published
Materials
Syndicated
Services

Computerize
d Databases

Published Sources
1. Official publications, i.e. the publication of the central
statistical office, Karachi , Ministry of Finance , Ministry of
Food, Agriculture, Lahore, Industry, etc the provincial
statistical Bureau, etc.
2. Semi-Official publications , etc., the publication issued by
the state Bank of Pakistan Railway Board , Board of
Economic Enquiry , District councils, Municipalities, Central
Cotton Committee, etc
3. Publication of trade-association, chambers of commerce,
co-operative societies, and unions.
4. Research publication, submitted by research workers,
economists, University bureaus, and other institutions.
5. Technical or trade journals.

Sources of Unpublished Data

can be obtained from the chamber of
commerce, trade associations, labor
bureaus and research workers

Scrutiny of Secondary Data

The secondary data should possess the
following qualities:
Reliability
Suitability
Adequacy

Reliability
In order to test the reliability of the data following points
should be considered:
Who collected the data?
The source of collection of the data
Is the reliability of the compiler dependable?
Is the source of the collection of the data dependable?
What was the scope and object of the investigation?
Were the data collected by the use of proper methods?
Were the statistical units defined in which the compiler
collected the data?
What was the period of the collection of data?
What was the type of inquiry? Was it census or sample?
What was the degree of accuracy desired and achieved?
Were the data in comparable form?

Suitability
If the data are reliable it does not mean
that they are suitable for every
investigation.
Data which are found suitable for one
inquiry might not be suitable for another
one.
These necessities that the suitability of the
data for the inquiry under investigation is
very essential.

Purposes of Secondary Data

Extracting the relevant information from other
sources, previous studies
Fact findings: Descriptive information to support
research
Model Building: specifying relationship between
two or more variables
Data mining : Exploring data through computer
Using computer technology to go through volumes
of data to discover trends
Identifying the relevant sources to avoid plagiarism

Advantages of Secondary Data

Faster
Less Expensive
Less activities (Field trip, Survey etc.)
Available locally
Grounded in setting and language in which
they occur
Useful for determining value, interest,
positions, political

Advantages of Secondary Data

climate, public attitudes
Provide information on historical trends or
sequences
Provide opportunity for study of trends
over time
Unobtrusive

Disadvantages of Secondary Data

Not easily available

Not adequate
May not meet the needs of researcher
Outdated information
Variation in definition
Inaccurate or bias
Locating suitable documents may pose
challenges

SECONDARY AND
SPECIALIZED METHODS

Life Histories and Narrative Inquiry

methods that gather, analyze, and interpret the stories people tell
about their lives
The researcher, working closely with the participant, explores a
story and records it.
seek to examine and analyze the subjective experience of
individuals and their constructions of the social world (Jones,
1983, p. 147)
can focus on critical or fateful moments. Indecision, confusion,
contradiction, and irony are captured as nuanced processes in a
life (Sparks, 1994)
help capture how cultural patterns evolve and how they are linked
to the life of an individual. Often, this point of view is missing
from standard ethnographies (Atkinson, 1998; Edgerton &
Langness, 1974).

Strength
Because it pictures a substantial portion of a
persons life, the reader can enter into those
experiences.
It provides a fertile source of testable hypotheses,
useful for focusing subsequent studies.
It depicts actions and perspectives across a social
group that may be analyzed for comparative study
Emphasizes the value of a persons story and
provides pieces for a mosaic depicting an era or
social group

Five Criteria for Life Histories (Jones, 1983)

The individual should be viewed as a member of a culture; the
life history describe[s] and interpret[s] the actors account of
his or her development in the common-sense world.
The method should capture the significant role that others play
in transmitting socially defined stocks of knowledge.
The assumptions of the cultural world under study should be
described and analyzed as they are revealed in rules and
codes for conduct as well as in myths and rituals.
Life histories should focus on the experience of an individual
over time so that the processual development of the person
can be captured (pp. 153154).
The cultural world under study should be continuously related
to the individuals unfolding life story.

Criticisms
It makes generalizing difficult, offers only
limited principles for selecting participants,
and is guided by few accepted concepts of
analysis.
Official records may provide corroborating
information or may illuminate aspects of a
culture absent from an individuals account
The researcher can substantiate meanings
presented in a history by interviewing
others in a participants life.

Narrative Inquiry
Closely related to life history
an interdisciplinary method that views lives holistically and
draws from traditions in literary theory, oral history, drama,
psychology, folklore, and film philosophy (Connelly &
Clandinin, 1990).
The method assumes that people construct their realities
through narrating their stories.
Narrative analysis can be applied to any spoken or written
account
Narrative inquiry may rely on journal records, photographs,
letters, autobiographical writing, e-mail messages, and other
data.

Criticisms
focus on the individual rather than on the social context
Like life histories, however, it seeks to understand
sociological questions about groups, communities, and
contexts through individuals lived experiences
may suffer from recalling selectively, focusing on subsets of
experience, filling in memory gaps through inference, and
reinterpreting the past (Ross & Conway, 1986)
Crites (1986) cautions against the illusion of causality (p.
168) the inference that the narrators sequencing of the
story uses cause and effect accurately.
Narrative inquiry is also time-consuming and laborious and
requires some specialized training (Viney & Bousefield,
1991).

Uses of Narrative Inquiry

It has been particularly useful in
developing feminist and critical theory
(Eisner, 1988; Grumet, 1988; Riessman,
1993).
Narrative inquiry is especially useful when
exploring issues of social change,
causality, and social identity (Elliott, 2005)

Historical Analysis
method of discovering what has happened using
records and accounts.
It is particularly useful in qualitative studies for
establishing a baseline or background prior to
participant observation or interviewing
Sources of historical data are classified as either
primary or secondary.
Oral testimony of eyewitnesses, documents, records,
and relics are primary.
Reports of persons who relate the accounts of
eyewitnesses and summaries, as in history books and
encyclopedias, are secondary.

Sources of Historical Data

contemporary records, including instructions, stenographic
records, business and legal papers, and personal notes and
memos;
confidential reports, including military records, journals and
diaries, and personal letters;
public reports, including newspaper reports and memoirs or
autobiographies;
questionnaires;
Government documents, including archives and regulations;
opinions, including editorials, speeches, pamphlets, letters to
the editor, and public opinion polls;
fiction, songs, and poetry;
folklore.

Uses of Historical Analysis

particularly useful in obtaining knowledge of
unexamined areas and in reexamining questions for
which
Historical analysis cannot use direct observation, and
there is no way to test a historical hypothesis.
Documents may be falsified deliberately or may have
been interpreted incorrectly by the recorder.
Words and phrases used in old records may now have
different meanings. Errors in recording, as well as
frauds, hoaxes, and forgeries, pose problems in dealing
with the past.

Films, Videos, and Photography

Visual Anthropology or Film Ethnography

The concept and method of the research film have emerged

and are now compatible with a variety of research methods
to describe how people navigate in public places (Ryave &
Schenkein, 1974) and how they use space (Whyte, 1980), to
present findings (Jackson, 1978), and to empower
participants (Ziller & Lewis, 1981).
The various forms of photography can be used for data
collection and for organizing, interpreting, and validating
qualitative inquiry (Szto, Furman, & Langer, 2005).
Research film methodology requires the documentation of
the time, place, and subject of the filming, as well as the
photographers intent and interests.

Three Kinds of Sampling in Films

Opportunity sampling documents unanticipated or poorly understood
phenomena as they occur.
Programmed sampling involves filming according to a predetermined
plandeciding in advance what, where, and when to film.
stipulates which events are likely to be significant.
guided by the research design rather than by intuition, as in
opportunity sampling.
Digressive sampling is deliberate searching beyond the obvious to
the novel, to the places and events beyond typical public
recognition.
Film documents life crises and ceremonies, transmits cultural events
to successive generations, and documents social conflicts (court
proceedings, public speakers, Senate sessions, and so on).

Value of Film
for discovery and validation
Documents nonverbal behavior and communication such as facial
expressions, gestures, and emotions. Film preserves activity and
change in its original form
can be used in the future to take advantage of new methods of seeing,
analyzing, and understanding the process of change
an aid to the researcher when the nature of what is sought is known
but the elements of it cannot be discovered because of the limitations
of the human eye
allows for the preservation and study of data from nonrecurring,
disappearing, or rare events.
Interpretation of information can be validated by another researcher or
by participants.
The researcher can obtain feedback on the authenticity of
interpretation, and the film can be reshot to be more authentic.

Weaknesses and Limitations of Film

There are always fundamental questions
What is the nature of truth?
Does the film manipulate reality?
and concerns about professional bias and the interests
of the filmmaker
Film is expensive, and most research budgets are minimal.
Production can be problematic.
Film cannot be included in a book, journal, or dissertation.
Serious consideration must be given to the ethics of
ethnographic
filming.

Interaction Analysis
researchers wanting finely focused data on verbal and
nonverbal communication can use forms of interaction analysis
to quantify patterns of interaction.
An observer uses a predetermined coding scheme, often called
a protocol, to produce a listing of the likely interactions.
Then she samples duration at predetermined intervals. For
example, the observer might sample blind-date eye contact for
5 seconds every 5 minutes or teachers responses to student
questions in a 30-minute lesson.
First used as a method for studying small groups in
organizations in the 1920s, interaction analysis gained
prominence as a method for observing classrooms and for
aiding teacher training (Flanders, 1970; Freiberg, 1981).

Strength of Interaction Analysis

systematic, quantified data are obtained
useful for verifying patterns that emerged
in early observations and interviews
Systems for assessing inter-rater reliability
can also be constructed
Large amounts of focused data can be
collected in a variety of settings, making
statistical analyses useful.

Well-developed Types of Interactional Analysis

Kinesics.
Learning about society can be enhanced if we
study what their body movements reveal.
study of body motion and its communicative
messages.
Motion is analyzed systematically so that
researchers can see and measure significant
patterns in the communication process
Nonverbal behavior is influenced by culture,
gender, age, and other factors associated with
psychological and social development.

Four Channels in the Communicative Process (Birdwhistell)

vocal
visual
olfactory,
tactile.
Body language can express unconscious
thoughts that may be essential for
observers to decode if they are to analyze
situations accurately.

Strengths of Kinesic Analysis

Provides a view into unconscious thoughts and
a means for the triangulation of verbal data
A researcher can be more confident about the
accuracy of information provided by a
participant if the speakers body language is
congruent with his words.
The researcher can monitor her own nonverbal
behavior to clarify messages sent to the
subject and to stay in touch with her own
feelings during data collection.

Limitations of Kinesic Analysis

Body language is not universal
researchers must be aware of cultural
differences
Many gestures signal different meanings
in different cultures
Body movements must be interpreted in
context, and only experts can make finetuned kinesic interpretations.

Well-developed Types of Interactional Analysis

Proxemics (coined by Hall, 1966)

the study of peoples use of space in
relation to culture
the researcher focuses on space, from
interpersonal distance to the arrangement
of furniture and architecture.
has been useful in the study of the
behavior of students in the classroom and
of marital partners undergoing counseling

Advantages of the Use of Proxemics

It is unobtrusive, and usually it is difficult for a subject to
mislead the observer deliberately.
Because it is concerned with nonverbal behavior, subjects
would have to be skillful to lie about their feelings.
Proxemics is useful for studying the way individuals react
to the invasion of their territory.
Proxemics can be used in cross-cultural studies because
peoples use of personal space varies greatly from one
culture to the next.
Proxemic analysis is useful for studies in areas suc as the
effect of seating arrangements on student behavior or the
effect of crowding on workplace productivity.

Disadvantage of Proxemics
The researcher must be skilled in the
interpretation of the observed behaviors.
Exclusive reliance on proxemics could be
misleading because relationships that do
not exist might be suggested.
Because proxemics is relatively new as a
data collection method, few instruments to
measure space in research are available,
further limiting its diverse use.

Unobtrusive Measures
ways of collecting data that do not require the
cooperation of the subjects and, in fact, may be
invisible to them
nonreactive research (Webb, Campbell,
Schwarz, and Sechrest, 1966)
the researcher is expected to observe or gather
data without interfering in the ongoing flow of
everyday events
Data collected in this manner are categorized as
documents, archival records, and physical
evidence.

Uses of Unobtrusive Measures

particularly useful for triangulation
As a supplement to interviews, nonreactive
research provides another perspective on a
phenomenon, elaborating its complexity
These methods can be used without arousing
subjects notice and data collection is
relatively easy because it often involves
using data already collected by someone else
(e.g., bills, archival records, sales records)

Limitations of Unobtrusive Measures

Unobtrusive measures may distort the picture.
Erosion and survival may be affected by activities
unknown to the researcher.
Some researchers consider the use of unobtrusive
methods (e.g., monitoring exchanges on
newsgroups or searching through garbage) to be
unethical
Unobtrusive data collection is often aided by
hardware, such as audiotapes, hidden cameras,
one-way mirrors, gauges, and infrared photos.
Ethical issues abound in surreptitious observation.

Projective Techniques and Psychological Testing

These strategies have been used fairly extensively in
comparative studies about culture and for analysis of
personality dynamics.
Based on an internal, perceptual frame of reference, the
techniques assume that one can get a valid picture of a person
by assessing the way the individual projects his personality onto
some standard, ambiguous stimuli.
Results are typically expressed in the form of a verbal report
assessing the subjects dominant needs and ambitions,
tolerance of frustrations, attitudes toward authority, major
internal conflicts, and so on
The reputation and qualifications of the tester sometimes play a
role in how the report is received and how much credibility is
attached to the interpretation.

Projective Techniques and Psychological Testing

A number of other psychological tests and measurements have been
developed for use in qualitative and anthropological research
(a) the perception of illusions, in which optical and auditory illusions are
examined for differences in perception related to differences in types of
environments;
(b) judgments of aesthetic qualities, in which pictures of art objects or
musical stimuli are used to elicit opinions concerning aesthetic excellence;
(c) psychomotor skills, in which physical activity measures indicate
personality qualities, such as introversion and extroversion;
(d) games people engage in, to provide significant information about
community and social behavior;
(e) games as a laboratory device, in which a specific game involving family
members is used to determine a relationship between communication
patterns and socioeconomic differences.
Attitude scales can be used in qualitative inquiry, as supplementary
measures, and for triangulation

Dilemma Analysis
brings into focus respondents reactions to situations
that have no right answers: that is, dilemmas
The approach can be used as a focused part of
interviewing, particularly to get at the core of the
respondents processes of thinking, assessing,
valuing, and judging.
It has been developed primarily in developmental
psychology.
However, it can be adapted wherever the research
probes at moral issues and practical decision-making
processes.

Two Common Types of Dilemma Analysis

The hypothetical, researcher-generated dilemma
Many respondents are given a standardized dilemma
and asked about what they would do and what would
guide their decision making.
Kohlbergs Heinz dilemma
The real-life, researcher-generated dilemma
uses a real crisisfrom history from typical workplace
or family life situationsand asks for
respondentschoices and the thoughts and feelings
surrounding those choices
Encourages respondents to describe the most difficult
or heart-wrenching choices they have made

Strengths
can be fun
Commonly focusing on one respondent at
a time, it produces a thematic coherence
that does not depend upon academic
theories or hunches of the researcher
(Winter, 1982).
It opens doors to innermost thoughts and
can be designed to collect standardized
data.

Weaknesses of Dilemma Analysis

can be dilemma-laden
people may not take the situation seriously
the choice of a dilemma and the interview
questions may be skewed to shape the choices,
producing interesting data
respondent-generated dilemmas may be difficult
to interpret and to compare with other data
directing people to recall all the agonies
associated with a dilemma that may still be
unresolved can be problematic ethically.

Using Computer and Internet Technologies

Searching the Internet for resources (now
called Googling), using software to
manage citations and some aspects of
data analysis, interviewing by means of email or in dedicated chat rooms, and using
dialogues and interactions online as sites
for study are all now part and parcel of
much scholarship in the social sciences
and applied fields

Internet Ethnography (Markham, 2005)

growing focus on the Internet itself as a site for identity
representation and construction.
The Internet provides a disembodied site where social
identities (gender, social class, sexual orientation, and so
on) are hidden. Thus emerges the possibility of studying
the construction of identity solely through text. As
Although we recognize that reality is socially negotiated
through discursive practice, the dialogic nature of
identity and culture is thrown into high relief in computermediated environments (Markham, 2005, p. 795).

Challenges and Questions

Are data collected from an internet
discussion board more or less authentic than
data from, for example, interviews or focus
groups?
How can you guard the anonymity of sources
if you collect data online?
How do you manage the fact that your data
come only from persons who are computersavvy, comfortable with computers, and have
computer access?

Advantages
Data gathering may offer an alternative to
face-to-face interviewing and be most
appropriate for certain research projects.
Sample can quite literally be a global one
Computers also provide access to
populations uncomfortable with or
unwilling to engage in face-to-face
interactions.

Rules for Collecting Data

Use multiple data collection methods
Use available data, but need to know
how the measures were defined
how the data were collected and
cleaned
the extent of missing data
how accuracy of the data was
ensured

References
Church, R.M. & Jurtzman, H.S. (2001). Data Archiving for
Animal Cognition Research. National Institute of Mental
health. http://www.Brown.edu/Research/Timelab
Marshall, C. & Rossman, G.B. (2006). Designing
Qualitative Research.Forum Qualitative Sozialforschung /
Forum: Qualitative Social Research,9(3), Art. 13,
http://nbn-resolving.de/urn:nbn:de:0114-fqs0803137
Westat, J.F. (2002) An Overview of Quantitative and
Qualitative Methods. The National Science Foundation
Directorate for Education & Human Resources Division of
Research, Evaluation, and Communication. Retrieved from
http://www.nsf.gov/pubs/2002/nsf02057/nsf02057_4.pdf