Chapter 8 Methods of Study and Sources Of-1
Chapter 8 Methods of Study and Sources Of-1
Objectives:
Describes sampling procedure and the sample.
Constructs an instrument and establishes its validity and reliability.
Explain what quantitative research method is.
Describe the three types of descriptive research designs.
Differentiate the two types of survey.
RESEARCH DESIGN
the relationship between the principal and the teachers and anecdotal records
of incidences that occurred in the school. In this example, the researcher
arrived at spontaneous methodologies and questions aside from those
speculated before the actual research design.
Table 1
Differences Between Qualitative and Quantitative Research Design
QUANTITATIVE QUALITATIVE
1. Hypotheses are defined at the 1. Hypotheses emerge as the
beginning of the research activity research
progresses
2. Definitions are clearly defined 2. Definitions are captured during
prior to the research the
research activity
3. Data are transformed to 3. Narrative descriptions are
numerical preferred
scores
4. The reliability and validity of 4. Reliability of inference is
research instruments are assumed to be adequate.
represented by equivalent The validity is established by
statistical coefficients multi-level respondents by cross
checking responses
5. Randomization of samples 5. Purposive samples (Expert
informants)
6. Well defined procedures 6. Narrative literar descriptio of
procedur y n
es
7. Control of extraneous variables 7. Relies on logical analysis in
controlling extraneous variables
8. Statistical summary of results 8. Narrative summary of results
9. Breaks down complex 9. Holistic description of complex
phenomena into specified parts phenomena
Manipulates aspects, situations
MODULE: RESEARCH PROJECT CULMINATING ACTIVITY
Source: Fraenkel Jack and Norman Wallen. (1984). How to design and
Evaluate Research in Education. New York: McGraw-Hill Inc.
There are four basic research designs generally taught in research books.
These are: descriptive research design, correlational, Causal-comparative,
experimental design and the quasi-experimental design (Borg & Gall, 1992;
Kerlinger, F., 1986).
Table 2
Suggested Statistical Treatment for Correlating variables.
Scatterplot
By examining the scatterplot, we can identify or describe the homogeneity or
heterogeneity of the two variables. Secondly, we can describe the degree of
which the two variables are intercorrelated or using statistical approach known
as correlation coefficient. Finally, we can interpret these data and give them
meaning.
MODULE: RESEARCH PROJECT CULMINATING ACTIVITY
Survey Research
Kerlinger (1973) defined survey
research as a study on large and small
populations by selecting samples
chosen from the desired population and
to discover relative incidence,
distribution and interrelations.
The ultimate goal of survey
research is to learn about a large
population by surveying a sample of the
population; thus we may also call it
descriptive survey or normative survey. In this method, a researcher poses a
series of questions to the respondents, summarizes their responses in
percentages, frequency distribution and some other statistical approaches.
Survey research typically employs face-to-face interviews, telephone interviews
or the common approach using questionnaires (we will look into questionnaires
in the next section). Basically, information is acquired by asking respondents
questions by using interviews or questionnaires concerning the following:
There are two types of survey, normally, the type of survey method used
depends on the scope of the research work. If the research needs a pool of
opinions and practices, a cross-sectional survey would be appropriate. On the
other hand, if a researcher specifies the objective as to compare differences in
opinion and practices over time, a longitudinal survey would be the ideal
method.
Types of Survey
MODULE: RESEARCH PROJECT CULMINATING ACTIVITY
Cohort Studies
In Cohort Studies, a researcher specifies population (e.g. IT subordinates in an
organization dealing with security audit and penetration tests) and lists the
names of all members of this population. At each data collection point, a
researcher will select a sample of respondents from the population of IT
subordinates doing security audit and penetration testing and administer a
questionnaire. This is then repeated at another point of time. Although the
population remains the same, different respondents are sampled each time.
The researchers aim here is to see if there are changes in perceptions or trends
that occur in the study.
Panel Studies
In Panel Studies, a researcher can identify a sample from the beginning and
follow the respondents over a specified period of time to observe changes in
specific respondents and highlight the reasons why these respondents have
changed.
Mean
Mean is also known as average. A mean is the sum of all scores divided by the
number of scores. The mean is used to measure central tendency or center of
a score distribution generally. For example, the mean for the following set of
integers: 3, 4, 5, 7 and 6 = 5.
MODULE: RESEARCH PROJECT CULMINATING ACTIVITY
Standard Deviation
A standard deviation tells us how close the scores are centered on the
mean. By referring to the above Figure 8.7, when the scores are bunched
together around the mean, the standard deviation is small and the bell curve
is steep. When the scores are spread away from the mean, the standard
deviation is large and the bell curve is relatively flat.
One standard deviation (SD= 5) from the mean in either direction on the
horizontal axis accounts for around 68% of the organization in this group. In
other terms, 68% terminals obtained 15 and 25 optimal time.
Two standard deviation (5+5=10) away from the mean accounts roughly 95%
of terminals. In other words, 95% terminals obtained between 10 and 30
optimal time.
Three standard deviations (5+5+5=15) away from the mean accounts for
roughly 99% terminals. In other words, 99% terminals obtained 5 and 35
optimal time.
Testing for Significant Differences between Two Means Using the t-Test
(Independent Groups)
Let’s say you are conducting a study to compare the effectiveness of the use of
Service discovery protocol (independent variable) in enhancing network
MODULE: RESEARCH PROJECT CULMINATING ACTIVITY
appliances detection in home networks. The mean score and standard deviation
for the application test are shown in Table 8.2 and you want to test the null
hypothesis.
H0: There is no significant difference between the experimental group and the
control group in terms of enhancing network appliances detection.
To solve this, you may use the statistical approach called t-test to obtain the t-
value for independent means. In this case, independent means that two groups
consist of different subjects. The t-test gives the probability that the difference
between the two means is caused by chance. For testing the significance, you
will need to set a risk level called the alpha level. Set the alpha level at .05. This
means that the obtained result which is significant at .05 level could occur by
chance only 5 times in trial of 100.
If you are using statistical software like SPSS or SAS, the probability value is
given (i.e. <0.02). We could also refer to the table of critical values to find out
whether the t-value is large enough to say that the difference between the
groups is not likely to have been a chance finding.
We can also determine the degrees of freedom (df) for the test which is the sum
of the terminals in both groups minus 2 (i.e.n-2). By the given alpha level, the
df and the t-value, we can refer to the t-value in the table of critical values.
The obtained t-value (2.65) is bigger than the critical value (2.1009) for
18 degree of freedom (20-2=18). From this, we can conclude that the differences
between the means for two organizations is significantly different at the 0.05
level of significance.
df p = 0.05 p = 0.01
17 2.1098 2.8982
18 2.1009 2.8784
19 2.1009 2.8609
MODULE: RESEARCH PROJECT CULMINATING ACTIVITY
Please note the difference is NOT SIGNIFICANT at the 0.01 level of significance
because t-value (2.65) is smaller than the critical value (2.8784) for 18 degrees
of freedom.
Testing for Significant Differences between Two Means Using the t-test
(Dependent groups)
Let’s say you would like to conduct a study to compare the effectiveness of the
use of Service discovery protocol (independent variable) in enhancing network
appliances detection (dependent variable) in ONE home network (IEEE 802.11).
You gave a pretest and after testing the protocol with the IEEE 802.11 network,
you give a posttest. Here, the same group of subjects are tested 2 times. You
want to test the null hypothesis.
H0: There is no significant difference between the pretest mean and the posttest
mean in terms of network appliances detection enhancement.
Means and Standard Deviation Obtained for the Pretest and Posttest
Scores
Mean Standard Deviation
Pretest 9.90 1.66
Posttest 10.90 0.99
N=10; t value=1.94; degrees of freedom=9; p<0.09
By using the t-test for dependent groups, we can obtain value of 1.94. In this
case, dependent means that the two means are obtained from the same groups.
From Table 8.5, we can highlight that for 9 degree of freedom, the critical
value is 2.2622, which is larger than the t-value 1.94. We can conclude that
the means are NOT significantly different at the 0.05 level of significance.
N Mean Standard
Deviation
Buffer Method 1 10 14.6 1.83
Buffer Method 2 10 15.6 2.22
Buffer Method 3 10 18.0 2.10
From Table, we can conclude that there is no significant difference between the
performance using Buffer Method 1 and Buffer Method 2. Buffer Method 3
performed significantly better at significance level 0.05. Buffer Method 3 also
outperformed Buffer Method 1 at the 0.01 level of significance.
Correlation Coefficient
MODULE: RESEARCH PROJECT CULMINATING ACTIVITY
To find the relationship or correlation between two variables, the approach used
is called correlation coefficient.
Picture shows perfect positive correlation (r=+1) which means an increase in
variable y is also followed by an increase in variable x. The second diagram
shows a perfect negative correlation (r = -1) which means an increase in variable
y is followed by a decrease in variable x or vice-versa. The third diagram shows
a zero correlation(r=0.00) which means there is no relationship between
variable y and variable x.
SAMPLING
Sampling Plan
A detailed outline of which measurements will be taken at what times,
on which material, in what manner, and by whom that support the purpose of
an analysis. Sampling plans should be designed in such a way that the
resulting data will contain a representative sample of the parameters of interest
and allow for all questions, as stated in the research objectives to be answered.
Probability Sampling
It refers to a sampling technique in which samples are obtained using some
objective chance mechanism, thus involving randomization. They require the
use of a sampling frame. The probabilities of selection are known.
It is the only approach that makes possible representative sampling plans.
Non-Probability Sampling
This is a technique when there is no way of estimating the probability that each
element has of being included in the sample and no assurance that every
element has a chance of being included.
INSTRUMENTS
Are the data gathering devices that will be used in the study? It is a testing
device for measuring a given phenomenon, such as a paper and pencil test,
questionnaires, interviews, research tools, or set of guidelines for observation.
MODULE: RESEARCH PROJECT CULMINATING ACTIVITY
Validity
Refers to the extent to which the instrument measures what it intends to
measure and performs as it is designed to perform.
Types of Validity:
1. Content Validity – the extent to which a research instrument
accurately measures all aspects of a construct.
2. Construct Validity – the extent to which a research instrument or tool
measures the intended construct.
3. Criterion Validity – the extent to which a research instrument is
related to other instruments that measure the same variables.
Reliability
Relates to the extent to which the instrument is consistent. The instrument
should be able to obtain approximately the same response when applied to
respondents who are similarly situated.
Attributes of Reliability
1. Internal Consistency/Homogeneity – the extent to which all the items
on a scale measure one construct.
2. Stability or Test-Retest Correlation – the consistency of results using
an instrument with repeated testing.
3. Equivalence – consistency among responses of multiple users of an
instrument, or among alternate forms of an instrument.
SOURCE OF DATA
Explain the data you have collected, the statistical treatment and all
relevant results in relation to the research problem that you are
investigating.
Describe unexpected events that occurred during your data collection.
Explain how the actual analysis differs from the planned analysis.
Explain how you handled the missing data and why any missing data did
not undermine the validity of your analysis.
Explain the techniques you used to “clean” your data set.
Choose a statistical tool and discuss its use and reference a for it. Specify
any computer programs or software used in the study.
Describe well the assumptions for each procedure and the steps you took
to ensure that they were not violated.
Provide the descriptive statistics, confidence intervals and sample sizes
for each variable.
Avoid interfering causality, particularly in non-randomized designs or
without further experimentation.
Use tables to provide exact values and use figures to convey global effects.
Keep figures small in size ad include graphic presentations of confidence
intervals whenever possible.
Inform the reader what to look for in tables and figures.
MODULE: RESEARCH PROJECT CULMINATING ACTIVITY
WRITING METHODOLOGY
Design – describe the research design used in your research study. Specify the
variables as well as the levels and measurement of these variables. Explain
whether your research study uses a within- groups or between-groups design.
Discuss how the measurements were made and what calculations were
performed upon the raw data. Describe the statistical techniques used upon
the data.
Example: The experiment used a 3x2 between-subjects design. The
independent variables were age and understanding of second-order
beliefs.
Procedure – the detail of the research procedures used in your research study
should be properly explained. Explain what your participants/respondents do,
how you collected the data, the order in which steps occurred. Observe some
ethical standards in gathering your data.
Example: A researcher interviewed children individually in their school
in one session that lasted 20 minutes on average. The researcher
explained to each child that he or she would be told two short stories and
that some questions would be asked after each story. All sessions were
videotaped so the data could later be coded.
https://www.slideshare.net/CarlaKristinaCruz/chapter-4-understanding-data-and-
ways-to-systematically-collect-data
https://www.scribd.com/document/323972586/2011-0021-22-research-
methodology-pdf