Reliability refers to the consistency or repeatability of measurement. There are three main types of reliability: internal consistency, test-retest reliability, and interrater reliability. Internal consistency looks at consistency across items on the same test. Test-retest reliability examines consistency over time when the same test is given multiple times. Interrater reliability assesses consistency between ratings from different raters. Factors like question wording, physical setting, mood, and nature of interaction can impact a measure's reliability. Establishing reliability is important for demonstrating that psychological measures are stable and produce consistent results.
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
0 ratings0% found this document useful (0 votes)
20 views23 pages
Deepika RM Seminar
Reliability refers to the consistency or repeatability of measurement. There are three main types of reliability: internal consistency, test-retest reliability, and interrater reliability. Internal consistency looks at consistency across items on the same test. Test-retest reliability examines consistency over time when the same test is given multiple times. Interrater reliability assesses consistency between ratings from different raters. Factors like question wording, physical setting, mood, and nature of interaction can impact a measure's reliability. Establishing reliability is important for demonstrating that psychological measures are stable and produce consistent results.
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 23
RELIABILITY
Deepika S I Msc Applied Psychology Bharathiar University CONTENT
Measurement and Statistics
Reliability – Meaning Types of Reliability 1.Internal Consistency 2.Test Retest Reliability 3.Inter rater reliability Factors affecting reliability MEASUREMENT AND STATISTICS Measurement involves assigning scores to individuals so that they represent some characteristic of the individuals. Psychologists do not simply assume that their measures work. Instead, they collect data to demonstrate that they work. If their research does not demonstrate that a measure works, they stop using it.. RELIABILITY If a research is consistent and stable , hence predictable and accurate , it is said to be in reliable . Therefore , ‘ a scale or test is reliable to the extent that repeat measurements made by it under constant conditions will give the same result ’ ( Moser & Kalton 1989 : 353). TYPES OF RELIABILITY Reliability refers to the consistency of a measure. Psychologists consider three types of consistency: over time (test-retest reliability), across items (internal consistency), and across different researchers (inter rater reliability).
INTERNAL CONSISTENCY
TEST RETEST RELIABILITY
INTERRATER RELIABILITY 1.INTERNAL CONSISTENCY Consistency – Across the items
Scores correlated with each other
It can be measured by using methods like Cronbach’s Alpha or Split half correction. Internal consistency can only be assessed by collecting collecting and analyzing data.
1.Split half correction
One approach is to look at a split-half
correction.This involves even and odd numbered items . Then a score is computed for each set of items , and the relationship between the two sets of scores is examined. Cronbach’s Alpha : It measures the internal consistency or reliability of a set of survey items . Use this statistics to help determine whether a collection of items consistently measures the same characteristic. Cronbach’s alpha quantifies the level of agreement on a standardized 0 to 1 scale. 2.TEST RETEST RELIABILITY Cont... High test –retest correlation make sense when the construct being measured is assumed to be consistent over time , which is the case for intelligence , self-esteem, and the five big personality dimensions. But other constructs are not assumed to be stable over time . The very nature of mood , for example , is that it changes . So a measure of mood that produced a low test-retest correlation over a period of month would not be a cause for concern . 3. INTERRATER RELIABILITY It is the extent to which different observers are consistent in their judgement. It is often assessed using cronbach’s alpha when the judgements are quantitative or an analogous statistics called cohen’s kappa when they are categorical (Qualitative). FACTORS AFFECTING RELIABILITY The wording of questions – A slight ambiguity in the wording of questions or statements can affect the reliability of a research instrument as respondents may interpret the questions differently at different times , resulting in different responses. The physical setting – In the case of an instrument being used in an interview , any change in the physical setting at the time of the repeat interview may affect the responses given by a respondent ,which may affect reliability. The respondent’s mood – A change in a respondent’s mood when responding to questions or writing answers in a questionnaire can change and may affect the reliability of that instrument. The interviewer’s mood - As the mood of a respondent could change from one interview to another so could the mood , motivation and interaction of the interviewer , which could affect the responses given by respondents thereby affecting the reliability of the research instrument. The nature of interaction – In an interview situation , the interaction between the interviewer and interviewee can affect responses significantly . During the repeat interview the responses given may be different due to a change in interaction , which could affect reliability. The regression effect of an instrument - When a research instrument is used to measure attitudes towards an issue , some respondents , after having expressed their opinion , may feel that they have been either too negative or too positive towards the issue . The second time they may express their opinion differently , thereby affecting reliability. REFERENCES Howitt , D .,& D, Cramer ., (2014) . Introduction to research methods in Psychology .