Strategic Staffing: Chapter 8 - Measurement
Strategic Staffing: Chapter 8 - Measurement
8-2
Learning Objectives
After studying this chapter, you should be able to: Describe why measurement and assessment are important to staffing Define reliability and validity and explain how they affect the evaluation of a measure Explain why standardization and objectivity are important in measurement
8-3
There are many legal issues involved with candidate assessment and measurement
8-4
What Is Measurement?
Measurement is the process of assigning numbers according to some rule or convention to aspects of people, jobs, job success, or aspects of the staffing system
The measures relevant to staffing are those that assess:
The characteristics of the job, which enables the creation of job requirements and job rewards matrices Aspects of the staffing system such as the number of days a job posting is run, where it is run, and the recruiting message The characteristics of job candidates such as ability or personality Staffing outcomes, such as performance or turnover
8-5
What Is Data?
8-6
Types of Measurement
Nominal: numbers are assigned to discrete labels or categories (e.g., race, gender, college major) Ordinal: attributes are ranked in ascending or descending order (e.g., ranking from best to worst performance) Interval: zero point is arbitrary but distance between scores has meaning (e.g., intelligence or interview scores) Ratio: distance between scores has meaning and there is a true zero point (e.g., salary, typing speed)
What Is Reliability?
Reliability refers to how dependably or consistently a measure assesses a particular characteristic
8-7
Types of Reliability
Test-retest reliability reflects the repeatability of scores over time and the stability of the underlying construct being measured Alternate or parallel form reliability indicates how consistent scores are likely to be if a person completes two or more forms of the same measure Inter-rater reliability indicates how consistent scores are likely to be if the responses are scored by two or more raters using the same item, scale, or instrument
8-8
8-9
What Is Validity?
Validity refers to how well a measure assesses a given construct and the degree to which you can make specific conclusions or predictions based on observed scores. Validity can tell you what you may conclude or predict about someone based on his or her score on a measure, thus indicating the measures usefulness. Validity will tell you how useful a measure is for a particular situation; reliability will tell you how consistent scores from that measure will be.
8-10
What Is Validation?
Validation is the cumulative and ongoing process of establishing the job relatedness of a measure
There are three types of validation processes:
Content-related validation: Demonstrating that the content of a measure assesses important job-related behaviors Construct-related validation: Demonstrating that a measure assesses the construct, or characteristic, it claims to measure Criterion-related validation: Demonstrating that there is a statistical relationship between scores from a measure and the criterion, usually some aspect of job success
8-11
8-12
8-15
Objectivity
Objectivity refers to the amount of judgment or bias involved in scoring an assessment measure. The scoring of objective measures is free of personal judgment or bias. Multiple-choice exams and the number of words typed in a minute are objective measures.
Subjective measures contain items for which the score can be influenced by the attitudes, biases, and personal characteristics of the person doing the scoring (e.g., essay or interview questions). Whenever hiring decisions are subjective, it is also a good idea to involve multiple people in the hiring process, preferably of diverse gender and race, to generate a more defensible decision. Because they produce the most accurate measurements, it is best to
8-16
8-17