Psychological Assessment

Utility(7)
Source: Cohen & Swerdlik (2018), Kaplan & Saccuzzo (2018)

Utility ★ A psychometrically sound test

of practical value is worth
- Usefulness or practical value of paying for, even when the
testing to improve efficiency. dollar cost is high, if the
- Helps us make better decisions. potential benefits of its use are
★ Psychometric Soundness - also high, or if the potential
reliability and validity costs of not using it are high.
(understand—if derived in
interpretation—how it will Utility Analysis - family of techniques
benefit society). that entail a cost-benefit analysis
● Cost - disadvantages, losses, designed to yield information relevant
and expenses in both economic to a decision about the usefulness
and noneconomic terms. and/or practical value of a tool of
- Other costs in testing: assessment.
➔ Payment to
professionals and - Helps us decide if testing is
staff. needed or not.
➔ Facility rental, - Kailangan pa ng tool, another
mortgage, and test, kasi baka maging bias.
other charges
How Utility Analysis Conducted:
related to the
usage of the test Expectancy Data/Table - provide an
facility. indication that a test taker will score
➔ Insurance, legal, within some interval of scores on a
accounting, criterion measure – passing,
licensing, and acceptable, failing.
other routine
costs of doing ● Taylor-Russel Tables - provide
business. an estimate of the extent to
● Benefit - profits, gains, or which the inclusion of a
advantages. particular test in the selection
- Some non-economic system will improve selection.
benefits: - Sa lahat ng test, aalamin
➔ Increase in the niya, “who among will be
quality of workers’ successful?”.
performance. ● Selection Ratio - numerical
➔ Increase in the value that reflects the
quality of workers’ relationship between the
performance. number of people to be hired
➔ Decrease in the and the number of people
time needed to available to be hired.
train workers. ● Base Rate - percentage of
people hired under the existing
system for a particular position.
 Psychological Assessment

Utility(7)
Source: Cohen & Swerdlik (2018), Kaplan & Saccuzzo (2018)

● Naylor-Shine Tables - entails ● Compensatory Model of

obtaining the difference Selection - assumption that
between the means of the high scores on one attribute
selected and unselected groups can compensate for lower
to derive an index of what the scores.
test is adding to already
established procedures. Decision Theory - provides guidelines
- Group to know sino magsa- for setting optimal cut off scores.
suceed.
★ Both TRT and NST assist in
Brodgen-Cronbach-Geser Formula - to judging the utility of a
calculate the dollar amount of a utility particular test.
gain resulting from the use of a
Methods for Setting Cut Scores:
particular selection instrument.
Angoff Method - setting fixed cut
● Utility Gain - estimate of the
scores.
benefit of using a particular
test. - Low interrater reliability
● Productivity Gains - an (weakness).
estimated increase in work - Ask different experts for
output. opinions (sino makakapasa).
Some practical considerations: Known Groups Method - collection of
data on the predictor of interest from
Cut Score - reference point derived as
group known to possess and not
a result of a judgement and used to
posses a trait of interest.
divide a set of data into two or more
classifications. - The determination of where to
set cut off score is inherently
● Relative Cut Score - reference
affected by the composition of
point based on norm-related
contrasting groups.
considerations (norm-
referenced); e.g. NMAT. (Item Response Theory) IRT-Based
● Final Cut Scores - set with Methods - cut off scores are typically
reference to a judgement set based on test taker’s performance
concerning minimum level of across all the items on the test.
proficiency required; e.g. Board
Exams. ● Item-Mapping Method -
● Multiple Cut Scores - refers to arrangement of items in
the use of two or more cut histogram, with each column
scores with reference to one containing items with deemed
predictor for the purpose of to be equivalent value.
categorization. - Have check what’s or
● Multiple Hurdle - multi-stage how many is correct.
selectionprocess, a cut score is
in place for each predictor.
 Psychological Assessment

Utility(7)
Source: Cohen & Swerdlik (2018), Kaplan & Saccuzzo (2018)

● Bookmark Method - expert

places “bookmark” between the
two pages that are deemed to
separate test takers who have
acquired the minimal
knowledge, skills, and/or
abilities from those who are
not.
- “Bookmark” what is
difficult for the test
taker.
● Method of Predictive Yield -
took into account the number
of positions to be filled,
projections regarding the
likelihood of offer acceptance,
and the distribution of
applicant scores.
● Discriminant Analysis - shed
light on the relationship
between identified variables
and two naturally occuring
groups.