E-Journal GJMBR A Vol 18 Issue 1pdf - Io2
E-Journal GJMBR A Vol 18 Issue 1pdf - Io2
net/publication/336686258
CITATION READS
1 1,222
1 author:
SEE PROFILE
All content following this page was uploaded by Michael Mncedisi Willie on 21 October 2019.
OnNormalizationPerformanceScoresModelsAnIllustrativeCaseStudy
Strictly as per the compliance and regulations of:
© 2018. Mncedisi Michael Willie. This is a research/review paper, distributed under the terms of the Creative Commons
Attribution-Noncommercial 3.0 Unported License http://creativecommons.org/licenses/by-nc/3.0/), permitting all non-commercial
use, distribution, and reproduction in any medium, provided the original work is properly cited.
On Normalization Performance Scores Models:
An Illustrative Case Study
Mncedisi Michael Willie
Abstract- Problem Statement: Performance Management the overall performance of the organization. There is
System (PMS) applies to all companies. It is a system that has extensive literature that links performance management
been in existence for decades and, yet Human Resources to the overall strategy of the organization (Callaghan,
professionals and managers have the difficult task of ensuring
2005; Adler, 2011; Chau, 2008). According to Saravanja
that it produces results intended for. One of the limitations
2018
(2010), Performance Management has to be
currently is that models used to measure performance are
approached from an integrated perspective, where there
Year
subjective and methodologies such as normalization of
performance scores are not applied consistently nor have is synergy between the performance management
some limitations. system and strategic planning. PMS is an important part
of the performance management process as these 15
Methodology: This study design was a retrospective case
study on a one-year performance review data. The hypothesis systems consist of measuring and monitoring the
Global Journal of Management and Business Research ( A ) Volume XVIII Issue I Version I
in the current study was that the modified normalization achievement of the goals through clearly defined key
performance scores models reduces bias and performs better performance indicators.
than the normalization score models. Final year-end In recent years South African private companies
performance scores for individual employees were used to and most government entities have increasingly started
assess four models. to link reward to performance (Callghan, 2005; Bhengu,
Results: The results showed no significant differences between 2012). On the international front, large organizations are
the four models. Therefore, the modifying normalization achieving better results and employee engagement by
performance scores did not improve the model. These results
linking reward directly to performance (Shah et al., 2012;
also revealed precincts of forced distribution such as the size
of the business unit or organization and lastly, the employee-
Armstrong, 2010). A study by Lawler et al. (2012) found
supervisor consequence. that bonuses and salary increases tied to performance
appraisals are associated with better organizational
Recommendations/Value: Alternative approaches other than
normalization of performance scores need to be considered in performance.
measuring performance. These methods need to adjust for O’Callaghan (2005) listed factors that are often
factors such as the supervisor or manager influence, the not addressed in organizations and eventually upshot in
complexity of the job, the variations in the job functions and a destructive performance management processes. The
the business unit size. author further specified that performance management
Keywords: performance management, management should be a process that incorporates the following:
education, normalization, business management and • Planning Performance: setting Key Performance
research. Area’s (KPA’s), objectives and standards that
I. Introduction include corporate strategy and development plans
• Maintaining Performance: monitoring, feedback,
P
erformance Management is a process of defining coaching, mentoring and regular interactions
clear organizational objectives for employees and regarding goal achievement
regularly review their actual performance against • Reviewing Performance: formal feedback and
set targets. One of the vital stages in the process is to ratings to evaluate performance
eventually reward high performers and also identify non- • Rewarding of Performance: increases, bonuses,
performers with an objective of employing interventions incentives, etc.
to help them improve. High performers are generally
Another body of literature depicts performance
rewarded in monetary or non-monetary form. Rewarding
management process asanintricate process due to
of high performing employees is subject to policies and
some reasons, one of them being that the direct reward
performance standards that are defined at
(or the withholding thereof) for performance may impact
organizational level. Effectiveness of organizations is
on the employee’s motivation to perform better (or
achieved through improving the performance of staff by
worse). Furthermore, a performance reward
continuously developing their capabilities.
management system that lacks objectivity might
Performance management remains an
become unsustainable or controversial.
important aspect of connecting people management to
Leneburg (2012) discussed the methods and
Author: Multinum, Post Net Suite 427, Private Bag X 32, Lynwoodridge, factors that may adversely impact the objectivity of PMS.
0040, South Africa. e-mail: [email protected] The four rating errors described by the author include
© 2018 Global Journals
On Normalization Performance Scores Models: An Illustrative Case Study
strictness, leniency, central tendency, the halo effect both mid-year and final assessments and the average of
and, recent events. The rating scale method is the most the two scores was used in the analysis.
common method of recording and evaluating
b) Procedure
employees and for deciding promotions and annual
There is comprehensive literature on
increases. These methods continue to attract
performance rating methods, a study by Stewart et al
controversy due to bias as well as inconsistencies when
(2010) describes a plethora of performance terms.
implemented.
These include terms like forced distribution, forced
Normalization of scores commonly compares
ranking system, bell curve, group ordering and normal
and standardizes performance scores of individuals
distribution. These are often used in performance
belonging to different business functions in an
evaluation systems to rate and rank employees
organization. A recent study by Sarkar et al (2011)
performance. Many organizations make use of these
proposed a modified methodology of normalization of
rating systems where performance scores of various
scores. In an illustrative example the author found that
2018
© 2018
1 Global Journals
On Normalization Performance Scores Models: An Illustrative Case Study
distribution in the form of a bell curve with the majority of As per normal distribution, high performers are
performers clustered around the mean. This selected if they scored more than the average + ‘Z’
predisposed organizational practices for a while now. times the standard deviation. The ‘Z’ value depicts the
The normal distribution, sometimes denoted as a forced standardized normal variable or the Z score.
distribution would assume that there would be a small For example, to identify the top 10% of
number of non-performers and a small number of high employees, the Z score will be 1.28155 (Sakar et al,
performers. The majority of individuals would be the 2011). The normalization of scores was the
average performers clustered around the mean (Stewart methodology employed in the current research and,
et al., 2010; Harbring et al., 2010). scores were used to determine which employees
Box 1 below depicts an example of a forced qualified for performance incentives such as bonuses or
distribution schema. annual increases.
Box 1: Forced Distribution Scheme adapted from Normalization of performance scores was
denoted by Model 1 (M1). Model2, Model 3 and Model 4
2018
Grote (2005)
[M2-M4] are modifications of M1 and are subject to
Level Ranking Scheme Rank %
Year
different characteristics as depicted in Equation 1.
1 Does not meet minimum requirements 5 In Table 2 below, the Z-score in Equation 1 was
2 Not yet effective 20 derived for each business unit and, the final comparable 17
3 Effective 50 score for the respective Models were calculated for each
employee as follows:
Global Journal of Management and Business Research ( A ) Volume XVIII Issue I Version I
4 Very effective 20
5 Clearly outstanding 5
75
90
65
55
80
Total score
45
35
70
25
M1
15
60
5
-5
50
1 2 3 4 5
2018
M1 BellCurve
40
Year
Figure 1: Distribution of scores and Whisker Box Plot for the sample, n=95
18
The identified outliers were further removed in subsample analysis scores followed a normal
the sub-sample data and, scores were re-tested for distribution.
Global Journal of Management and Business Research ( A ) Volume XVIII Issue I Version I
normality.
Table 4 below depicts Skewness/Kurtosis tests
for normality which were not significant; therefore the
Table 4: Skewness/Kurtosis tests for Normality, n=94
Variable n Pr(Skewness) Pr(Kurtosis) Adjchi2(2) P-value
M1 94 0.057 0.3867 4.46 0.1074
Normalization of performance denoted as M1 This was done to test the size effect between the
were compared to incentive levels given in Table 1. different business units.
Model M2 was a modification of Model 1 as outlined by In M2, M3 and M4 the Z-score for each
Sarkar et al. (2011). Models M3 and M4 were a business unit were computed and the final comparable
modification of M1 and were based on the re- score for respective Model was calculated for each
classification of business units ‘classes’. employee as follows:
Models M3 and M4 were re-classified and the
desired sample for each business unit was obtained.
Comparable score = overall average +Z score × overall standard deviation (2)
Table 5 below depicts descriptive statistics other models, which were significantly higher. The
computed for each model. There were no significant average number of employees per business unit was
differences in the average scores between the four higher for M3 and M4, and the effect of reclassification
models: 70.6 95% CI (69.1-72.1) compared to 70.6 95% of the business seemed to have had an impact only on
CI (68.9-72.3), 70.6 95% CI (69.0-72.2), 70.6 95% CI M3. Normality tests for the four models are shown in
(68.9-72.3) of M1, M3 and, M4 respectively. Table 5 below.
A noteworthy feature of the data was that there
was less variation in M2 (SD=5.93) when compared to
Table 5: Descriptive Analysis of adjusting for different models
Model Class level Total score
Number of Business Average Number of Employees per Mean Std. Range
Range
functions Business function score Dev. (Min-Max)
M1 18 5 2-9 70.61 8.23 51-87
M2 18 5 2-9 70.64 5.93 57-82
M3 5 19 8-39 70.63 8.01 53-84
M4 4 24 14-36 70.61 8.07 51-87
We cannot reject the hypothesis that M1, M2 reject the hypothesis that M3 is normally distributed at
and, M4 are normally distributed but we also cannot 5% level.
© 2018
1 Global Journals
On Normalization Performance Scores Models: An Illustrative Case Study
The kurtosis for M3 was 0.0228 with a p-value of cannot reject the hypothesis that M3 is normally
0.0229, which indicated that it was significantly different distributed on the basis of skewness alone. Therefore,
from the kurtosis of a normal distribution. However, we all four models follow a normal distribution.
Table 6: Skewness/Kurtosis tests for Normality for M1-M4, n=94
Variable Pr(Skewness) Pr(Kurtosis) adj chi2(2) P-value
M1 0.057 0.3867 4.46 0.1074
M2 0.1202 0.3118 3.54 0.1703
M3 0.1122 0.0228 7.06 0.0293
M4 0.1428 0.3022 3.31 0.1914
2018
appeared to be normally distributed.
Year
90
80 19
70
Global Journal of Management and Business Research ( A ) Volume XVIII Issue I Version I
60
80
50
Count
40
30
70
20
10
0
60
0 1 2 3 4 5 6 7 8
Incentive level
50
M1 M2 M1 M2 M3
M3 M4 M4 BellCurve
The average number reward increased further performer: 11.25 95% CI (3.08-19.40) vs. 11.25 95% CI
between M1 and M4 with the average number of (3.31-19.19).
BU18 0 1
BU17 2 2
BU16 2 0
BU15 0 1
BU14 1 1
BU13 4 0
BU12 0 1
Business Unit
BU11 5 5
BU10 2 2
2018
BU9 4 6
BU8 2 1
Year
BU7 4 5
BU6 6 5
20 BU5 1 1
BU4 5 3
Global Journal of Management and Business Research ( A ) Volume XVIII Issue I Version I
BU3 5 5
BU2 2 2
BU1 0 2
0 2 4 6 8 10 12
Count
M1 M2
BBU5 15 16 BBBU4 4 6
Business Unit
Business Unit
BBU4 11 10
BBBU3 16 18
BBU3 7 6
BBBU2 13 11
BBU2 5 3
BBU1 7 7 BBBU1 12 10
0 10 20 30 40 0 10 20 30 40
Count Counts
M1 M3 M1 M4
reduced bias. Similarly, when adjusting for different some of these possible alternatives. We recommend
performance incentive levels as well as business units, that the use of forced distribution to assess performance
the data showed similar results between the models. be considered in concurrence with other relevant recent
This particular finding was consistent with a study by methodologies, in particular when issues of bias
Harbringet al.(2010). The author found that the may exist.
introduction of forced distribution led to short-term
V. Conclusion
performance increase. It is important to note though that
the sample size of the study conducted by Sarkar et al. The current study illustrated that despite the
(2011) was higher than in this research. Thus, a bigger controversies in methodological issues such as the use
sample size could potentially improve the findings of this of normalization of scores; most organizations still
research. implement this method. This research revealed that the
The results in this study revealed that there was modification of this model did not necessarily reduce
bias when comparison model M1 and M2, and M3 bias. Therefore, the modification of the bell-curve; such
2018
andM4. Size effect was noted when comparing model as the model employed in the current study needs to
take into account factors, such as supervisor’s/
Year
M1 to model M2, where the modified model M2 was
more biased towards 3 of the 18 business units. manager's effect which need to be accounted for when
Comparison analysis between M1 and M3 was more rewarding employees. 21
biased towards BB4 and BB5. The comparison between The complexity of the job and the size of the
M1 and M4 was biased towards business BBBU3 and organization, inter (intra)-differences between the
Global Journal of Management and Business Research ( A ) Volume XVIII Issue I Version I
BBBU4. businesses units remain a contributing factor. The size
It is stated in the literature that for the the business units were also noted as one of the critical
normalization of scores system to have statistical validity factors. Therefore, size effect of the business units need
there must be a large number of employees in the pool to be adjusted for in the performance reward incentive
(Stewart et al., 2010; Abelson, 2001). A sample size of scheme; whether the motive is a reward based or
30 or more is considered appropriate; however if fewer penalty based, this will ultimately fail in its intended
than that, then confidence in the predictive power of the purpose of improving employees' overall performance.
bell curve begins to diminish sharply according to the A reward system for performance remains an
central limit theorem. Therefore, smaller companies integrated performance management process. In the
avoid force-fitting employees to the bell curves. current study we did not conduct a comprehensive
The effect of size within the business units also assessment of employees who underperformed.
has an effect on the manager’s social preferences. A Therefore, interventions employed by companies to
study by Willie (2014) presented that business units with assist underperformers still need to be explored further.
a significantly small number of employees resulted in a Finally, alternative statistical methods can also
performance rate of 100%. This potentially indicate that be applied as an alternative to normalization of
there may be a positive association between actual performance scores. Advanced statistical methods such
performance of the team within the unit, job complexity as linear mixed modelling have been applied in annual
or to other factors such as the managers effect which performance evaluations. These methods have been
was not explored further in the current research. A study shown to reduce supervisor’s/managers based effects.
by Harbringet al.(2010) found out that the manager’s Acknowledgements
social preferences on ratings had a substantial impact
The author is grateful to the organization that
on the rating behaviors, these social preferences were
supplied the data to conduct this research work. The
not picked up by forced distribution. This finding
author is also grateful to Phakamile Nkomo for his
illustrates a need to consider other factors that
comments in concluding this piece of work.
introduced bias in the PMS.
Finally, the current study noted that the Competing Interests
normalization of scores was used across the The Author declares that there is no financial or
organization irrespective of the sample size of the personal relationship which may have influenced him
different business units. Stewartet al (2010) warned inappropriately in writing this article.
against the use of scores across all departments, in Authors' Contributions
particular, those that differ in size and job complexity. The Author was responsible for the data
He further narrates that such practice might be analysis and drafting of the article. The Author has
problematic and maybe an unfair comparison. In the proofread the final manuscript.
current research work, we illustrated that modification of
the normalization of performance scores did not
References Références Referencias
necessarily reduce bias. There is an existing literature on 1. Abelson R. (2001). Companies turn to grades and
alternative approaches to measuring performance other employees go to court, The new York Times, March,
than the forced distribution, Burger (2006) depicted 150 (51697).
© 2018 Global Journals
On Normalization Performance Scores Models: An Illustrative Case Study
2. Adler, R.W. (2011). ‘Performance management and Practice in Human Resource Management, 19(2),
organisational strategy: How to design systems that 92-100.
meet the needs of confrontation strategy firms’, The 16. Saxena, S. 2010. ‘Performance Management
British Accounting Review, 43(4), 251-263. [Online] System’, Global Journal of Management and
http://dx.doi.org/10.1016/j.bar.2011.08.004. Business Research, 10(5):27-30.
3. Armstrong, M. & Baron, A. (1998).Performance 17. Shah et al. (2012). ‘The Impact of HR Dimensions
management: the new realities. London: Institute of on Organisational Performance’, African Journal of
Personnel and Development. [Online] http://www. Business Management. Vol 6(4) 1306-1314.
cipd.co.uk/NR/rdonlyres/64B9C9FD-8168-4EDC- 18. Stewart SM, Gruys ML, Storm M. (2010). Forced
9B71-DD3D8B5C2B90/0/performance_ distribution performance evaluation systems:
management_discussion_paper.pdf. Advantages, disadvantages and keys to
4. Armstrong, M. (2010). Armstrong's Handbook of implementation. Journal of management and
Reward Management Practice: Improving Organisation. Vol 16 (1).
2018
Performance through Reward. 3rd ed. London: 19. Svaranja, M. (2010). Integrated Performance
Year
Kogan Page Limited. [online] http://www.ukessays. Management Systems’. PhD dissertation. [online]
com/essays/marketing/the-factors-behind- http://etd.uwc.ac.za/usrfiles/modules/etd/docs/etd_
22 performance-management-in-companies-business- gen8Srv25Nme4_1579_1298278773. pdf.
essay.php#ixzz2QutytlF3. 20. Willie, M. M. (2014). Analysis of performance reward
5. Armstrong. M. & Baron, A. (1998). ‘Out of the Tick models: A Multinum Investments case study,
Global Journal of Management and Business Research ( A ) Volume XVIII Issue I Version I
Box’ People Management, 4(15), 38-39. Journal of Strategy and Performance Management,
6. Bengu, B.N. 2009. The perceived effectiveness of 2(3), 111-121.
employee share options as a mechanism of talent 21. ZewotirT. (2012). ‘On employees' performance
management in South Africa. M.Com research appraisal: the impact and treatment of the rater’s
report. Johannesburg. University of Johannesburg. effect’, South African Journal of Economic and
7. Burger, Shannon M. (2006) An Alternative Method to Management Sciences, vol.15 no.1 Pretoria 2012.
Forced Distribution as a Means of Evaluating 22. Zhang Y. (2012). The impact of performance
Employee Performance. Engineering Management management system on the employee: Analysis
Field Projects. The University of Kansas Masters with WERS 2004. [Online] http://essay.utwente.nl/
thesis. United States. [Online] http://hdl.handle.net/ 62260/1/Daisy-master_thesis.pdf
1808/1046.
8. Chau, V.S. (2008). ‘The Relationship of Strategic
Performance Management to team strategy,
company performance and organisational
effectiveness’, Emerald 14.
9. Desimone, R. L. Werner, J. M.& Harris, D. M. (2002).
Human Resource Development (3rd Ed.) Orlando:
Harcourt College Publisher.
10. Harbring, C.Berger J, Sliwka D. (2010). Performance
Appraisals and the Impact of Forced Distribution:
An Experimental Investigation. IZA Discussion Paper
No 5020.
11. Lawler, E.E, Benson GS, & Mc Dermatt, M. (2012).
Performance Management and Reward System.
Centre for Effective Organisation. Los Angeles.
12. Lenenburg, F.C. (2012). ‘Performance Appraisal:
Methods and Rating Errors’, International Journal of
Scholarly Academic intellectual diversity. Vol4 (1).
13. Mujtaba, B.G, Shuaib S. (2010). ‘An Equitable Total
Rerwards Approach to Pay Form Performance
Management’, Journal of Management Policy and
Practice. Vol, 11(4).
14. O’Callaghan, A. (2005). Performance Management:
SDFs in the Fasset Sector. Unpublished paper
delivered at an IIL Conference, July.
15. Sarkar, A. Mukhopadhyay, A. R. & Ghosh, S. K.
(2011). Comparison of Performance Appraisal
Score: A Modified Methodology, Research and
© 2018
1 Global Journals