Econ 656- Research Methods III
Econ 656- Research Methods III
Part III
Survey Designs and Sampling
Content of the lecture
Introduction – Survey Research
Research Designs
Types of Research Design
The Experimental Design
Survey Sampling
Probability samples
Non probability samples
Problems in Sampling
Survey research
Surveys are the most widely used method of collecting a wide
variety of information in research.
Why sampling?
Reasons for Sampling
Reduced cost: since data are secured from a small fraction
of the population, cost will be reduced.
Greater speed: for the same reasons as above, sample
surveys can be reported faster than that of census.
Greater scope and accuracy: since samples deal with fewer
units than complete census, it is possible to attain greater
accuracy.
highly trained personnel, careful supervision, specialized
equipment, etc.
Reasons for Sampling
Feasibility: some investigations could only be addressed by
sample surveys:
Example
when studying infinite populations,
laboratory testing of one’s blood,
when conducting quality assurance tests (especially when
the test involves the destruction of the product), etc.
Survey Sampling
In sampling we need to ensure Representativeness
There are two principles in representativeness:
The need to avoid bias and the need to gain maximum
precision.
Bias can arise for instance:
If the selection of the sample is done by some non-
random method
If the sampling frame (i.e. list, index, population
record) does not adequately cover the target
population.
Survey Sampling
Representativeness is important particularly if you want to make
generalization about the population.
So, for Quantitative Studies:
Sample should be drawn in such a way that it is representative of
the population.
For Qualitative Studies:
Representativeness of the sample is NOT a primary concern.
In qualitative studies we select study units which give you the
richest possible information.
You go for INFORMATION-RICH cases!
Steps in Sampling Design
a) Identifying the relevant population:
Determine the relevant population from which the sample is going to be
drawn.
Example: if the study concerns income, then the definition of the population
as individuals or households can make a difference.
The decision of the sample size hinges on how large an error one is
willing to tolerate in estimating population parameters.
The sample size will also depend on what you want to do with your
results.
Determining the sample size
The general rule in quantitative research is that the larger
the sample the better it is.
select at least 10% more than you hope to gain responses from.
In the process we have to consider
i) Degree of homogeneity: The size of the population variance is the
most important parameter.
The greater the dispersion in the population the larger the
sample must be to provide a given estimation precession.
ii) Degree of confidence required: you must determine how much
precision you need.
Precision is measured in terms of
An interval range.
The degree of confidence
i.e. the sample size is determined by the level accuracy required in
the study.
Determining the sample size
iii) Number of sub groups to be studied:
When the researcher is interested in making estimates
concerning various subgroups of the population then the sample
must be large enough for each of these subgroups to meet the
desired quality level.
iv) Cost: All studies have some budgetary constraint and hence cost
dictates the size of the sample.
The level of precision obviously increases with increase in the size of the
sample thus researchers are usually challenged by the interest of
balancing accuracy and cost.
Determining the sample size
v) Practicality: Of course the sample size you select must make sense.
Therefore the sample size is usually a compromise between what is
DESIRABLE and what is FEASIBLE.
FEASIBLE
For some researchers, the sample size may be influenced by the
resources available.
But, the limitations of a smaller sample need to be reported in
the research report or dissertation.
Determining the sample size
VI) Other Considerations:
(i)Prior information: If our process has been studied before, we can
use that prior information to determine our sample size.
This can be done by using prior mean and variance estimates.
Note: If you know the mean and variance statistical methods can be
used to determine the size of the sample required for a given level of
accuracy.
Determining the sample size
(VII) Rule of Thumb: is based on past experience.
For small populations (under 1000 a large sampling ratio
(about 30%). Hence, a sample size of about 300 is required.
For moderately large population (10,000), a smaller sampling
ratio (about 10%) is needed – a sample size around 1,000.
To sample from very large population (over 10 million), one can
achieve accuracy using tiny sampling ratios (.025%) or samples
of about 2,500.
Determining the sample size
(VIII) Using Cochran’s Formula: You need to determine a few things
about the sample you need.
The safe decision is to use 0.5 – this is the most commonly used number.
Determining the sample size
Cochran (1963) has developed the following formula to determined sample
size.
At one end of the spectrum are the sampling approaches that are based
on statistical theory.