Is The Research Investigation Providing Answers To The Research Questions For Which It Was Undertaken?
Is The Research Investigation Providing Answers To The Research Questions For Which It Was Undertaken?
2
Types of validity in quantitative research
Face and
content
validity Concurren
t and
Construct predictive
validity validity
3
Face and content validity
• The judgement that an instrument is measuring what it is
supposed to.
– primarily based upon the logical link between questions and
objectives of the study.
• Advantage: easy to apply
• Face validity – establishment of logical link between
questions and objectives of study
• Content validity – assessment if items and questions
covers the full range of the issue being measured.
– Judge which statements or questions represent the issue
they
are supposed to measure
4
Face and content validity (cont.)
• Problems;
– Judgement is based upon subjective logic
– The extent to which question reflect the objectives of a study
may differ.
5
Concurrent and predictive validity
6
Construct validity
• Construct validity – determined by ascertaining the
contribution of each construct to the total variance
observed in a phenomenon.
• Based upon statistical procedure.
• The greater the variance attributable to the construct,
the higher the validity of the instrument.
7
The concept of reliability
• Reliability is if a research tool is consistent and
stable hence predictable and accurate.
• The greater the degree of consistency and stability in a
research instrument, the greater the reliability.
• A scale or test is reliable to the extent that repeat
measurements made by it under constant conditions will
give the same result.
• Reliability is the degree of accuracy or precision in the
measurements made by a research instrument.
– The lower the degree of ‘error’ in an instrument, the higher the
reliability.
8
Reliability vs. Validity
9
Factors affecting reliability
The wording of questions
The respondent’s or
interviewer mode
The regression
effect
The nature of
interaction
10
Methods of determining the reliability
• Internal consistency procedures – items or questions
measuring the same phenomenon, should produce
similar results irrespective of their number in an
instrument
– The split-half technique
• External consistency procedures – compare findings
from two independent process of data collection with
each other as a means of verifying the reliability of the
measure
– Test/retest
– Parallel form of the same test
11
Split-half technique
• To correlate half of the items with the other half in a
research instruments
• Questions are divided in half in such way that any two
questions intended to measure the same aspect fall into
different halves.
• The scores obtained by administering the two halves are
correlated.
• Reliability is calculated using product moment correlation
between scores
12
Test/ retest (repeatability test)
• An instrument is administered once, and then again,
under the same or similar conditions.
• The ratio between test and retest score is an indication
of the reliability of the instrument
– The greater the value of the ratio, the higher the reliability of the
instrument
• Advantage - it permits the instrument to be
compared with itself.
• Disadvantage – a respondent may recall the
responses
that they gave in the first round
– Overcome by increasing the time span between two tests
13
Parallel forms of the same test
• Two instrument intended to measure the same
population is constructed and administered to two similar
population.
• The results obtained from one test is compared with
another
– If similar, the instrument is reliable.
• Advantage – does not suffer from the problem of recall
and time lapse between two test is not required.
• Disadvantage – need to construct two instrument instead
of one.
14
Validity & reliability in qualitative
research
Traditional criteria for judging Alternative criteria for judging
quantitative research qualitative research
Internal validity Credibility
External validity Transferability
Reliability Dependability
Objectivity Confirmability
15
Validity & reliability in qualitative
research
• Credibility
• Transferability
• Dependability
• Confirmability
16