Reliability Assignment
Reliability Assignment
Topic: Reliability.
TOPIC: RELIABILITY
The term reliability refers to a specific instrument’s capacity to consistently
evaluate qualities or the variables.
For example, an sphygmomanometer that provides the same reading for the same
patient at different times is deemed dependable.
DEFINITION :
When a tool assesses the quality for which it is intended to measure, its reliability
is determined by how consistently it does so.
ELEMENTS OF RELIABILITY
Stability
Equivalence
Internal consistency
STABILITY
CALCULATION OF STABILITY
INTERNAL CONSISTENCY
• Only when every component of a research instrument measures the same traits or
phenomena can the tool be said to be internally consistent.
• Segment a research instrument's items into equal halves by classifying them into
a number of first and second half items, even and odd number questions, or both.
• Use a formula to calculate the correlation coefficient between the two distinct
scores obtained from administering the tool's two subparts simultaneously and
scoring them independently.
EQUIVALENCE :
• This aspect of reliability is estimated when a researcher is evaluating the validity
AFFECTORS ON RELIABILITY
• Continuous hazard
• Operator learning
• Neutrality
Definitions:-
1- “In test theory, the standard error of measurement is the standard deviation of
observed test scores for a given true score.”
2- “The standard error of measurement (SEM) is a statistical phenomenon and is
unrelated to the accuracy of scoring.”
3- “The standard error (SE) is the standard deviation of the sampling distribution of
a statistic.”
4- “An estimate of how often a researcher can expect errors of a given size on an
instrument.”
Explanation:-
It is usually estimated with the following formula in which ‘s’ is the standard
deviation of the test scores and ‘r’ is the reliability of the test.
S measurement = S √ 1_r.
All test results, including scores on tests and quizzes designed by classroom
teachers, are subject to the standard error of measurement.
The term may also be used to refer to an estimate of that standard deviation,
derived from a particular sample used to compute the estimate.
For example, the sample mean is the usual estimator of a population mean.
The SEM is in standard deviation units and can be related to the normal curve.
SEM is a related to reliability.
As the reliability increases, the SEM decreases.
NATURE OF RELIABILITY.
1. Reliability refers to the results obtained with an evaluation instrument and not to
the instrument itself.
2. Reliability refers to a type of consistency.
3. Reliability is a necessary but not a sufficient condition for validity.
4. Reliability merely provides the consistency that makes validity possible.
5- Reliability is a property of the assessment results rather than the property of the
instrument.
6- It is more appropriate to speak of the reliability of assessment scores rather than
the reliability of an assessment.
7- Reliability refers to the results (scores) of a test; not the test itself.
8- An estimate of reliability refers to a particular type of consistency.
Consistency over time. or,
Consistency among raters. or,
Consistency of performance across tasks.
Must have reliability to have validity.
9- A test can measure the same attribute with perfect consistency and not be valid.
10- Reliability is primarily statistical.
When estimating reliability, we are trying to determine how much measurement
error is present; the less error, the more reliable the instrument.