Survey Research Design: Classifying Surveys On The Basis of Scope
Survey Research Design: Classifying Surveys On The Basis of Scope
Survey research is the collection of data attained by asking individuals questions either in person,
on paper, by phone or online. Conducting surveys is one form of primary research, which is the
gathering data first-hand from its source. The information collected may also be accessed
subsequently by other parties in secondary research.
Survey research is used to gather the opinions, beliefs and feelings of selected groups of
individuals, often chosen for demographic sampling. These demographics include age, gender,
ethnicity or income levels. The most famous public survey focused on demographics is
the United States Census, which occurs every ten years.
1. A census of tangibles: one seeks information about a small population, such as a single
school, and when the variables are concrete, there is little challenge in finding the
required answers.
2. A census of intangibles: one seeks information about constructs that aren’t directly
observable but must be inferred from indirect measures. Such constructs may include
pupil achievement or aspirations, teacher morale, parents’ attitudes toward school, or the
achievement testing program carried out by most schools.
3. A sample survey of tangibles: one seeks information about large groups. Sampling
techniques are used and the information collected from the sample is used to make
inferences about the population as a whole. The variables must be concrete in nature.
4. A sample survey of intangibles: one seeks information about constructs that aren’t
directly observable but must be inferred from responses made by the subjects to
questionnaires or interviews. For example, how someone is going to vote is an intangible,
but what is marked on a ballot is tangible.
For a survey to succeed, it must minimize the risk of two types of error:
3. Nonresponse can distort the sample when individuals refuse to respond or cannot
be contacted. Nonresponse to specific questions can distort the generalizability of
the responses to those questions
A COMPARISON OF SURVEY DESIGNS
Which survey design should be used when? Group-administered surveys are similar,
in most respects, to mailed surveys, except that they require the unusual circumstance of
having access to the sample in a group setting. We therefore do not need to consider this
survey design by itself; what applies to mail surveys applies to group-administered
survey designs, with the exception of sampling issues. Thus, we can focus our
comparison on the three survey designs that involve the use of a questionnaires with
individuals sampled from a larger population: mail surveys, phone surveys, in-person
surveys, and electronic surveys.
The most important consideration is the likely response rate each method will
generate. Because of the low response rates of mailed surveys, they are the weakest from
a sampling standpoint. However, researchers with limited time, money, and staff
(including most student researchers) may still prefer a mailed survey. Mailed surveys can
be useful in asking sensitive questions because respondents won’t be embarrassed by
answering in front of an interviewer.
Contracting with an established survey research organization for a phone survey is
often the best alternative to a mailed survey. The persistent follow-up attempts that are
necessary to secure an adequate response rate are much easier over the phone than in
person. However, the declining rate of response to phone interview calls is reducing the
advantages of this method.
In-person surveys can be long and complex, and the interviewer can easily monitor
the conditions (the room, noise, and other distractions). Although interviewers may
themselves distort results, either by changing the wording of the questions or failing to
record answers properly, this problem can be lessened by careful training and monitoring
of interviewers and by audio-recording the answers.
So overall, in-person interviews are the strongest design and generally preferable when
sufficient resources and a trained interview staff are available; telephone surveys have many of
the advantages of in-person interviews at much less cost, but response rates are an increasing
problem.
SURVEY RESEARCH DESIGN TYPES
1. Longitudinal/penal study
A longitudinal study, like a cross-sectional one, is observational. So, once again, researchers do
not interfere with their subjects. However, in a longitudinal study, researchers conduct several
observations of the same subjects over a period of time, sometimes lasting many years.
The benefit of a longitudinal study is that researchers are able to detect developments or changes
in the characteristics of the target population at both the group and the individual level. The key
here is that longitudinal studies extend beyond a single moment in time. As a result, they can
establish sequences of events.
The defining feature of a cross-sectional study is that it can compare different population groups
at a single point in time. Think of it in terms of taking a snapshot. Findings are drawn from
whatever fits into the frame.
The benefit of a cross-sectional study design is that it allows researchers to compare many
different variables at the same time. However, cross-sectional studies may not provide definite
information about cause-and-effect relationships. This is because such studies offer a snapshot of
a single moment in time; they do not consider what happens before or after the snapshot is taken.
A successive independent samples design draws multiple random samples from a population at
one or more times. This design can study changes within a population, but not changes within
individuals because the same individuals are not surveyed more than once. Such studies cannot,
therefore, identify the causes of change over time necessarily. For successive independent
samples designs to be effective, the samples must be drawn from the same population, and must
be equally representative of it. If the samples are not comparable, the changes between samples
may be due to demographic characteristics rather than time. In addition, the questions must be
asked in the same way so that responses can be compared directly.
In the successive independent samples design, different samples of respondents from the
population complete the survey over a time period. The successive independent samples design
allows researchers to study changes in a population over time. The successive independent
samples design does not allow researchers to infer how individual respondents have changed
over time. A problem with the successive independent samples design occurs when the samples
drawn from the population are not comparable-that is, not equally representative of the
population.