Predictor and Criterion Variables1
Predictor and Criterion Variables1
Frequency of
Performance
Importance
Employees
for Difficulty
task
level
of Easiness of task
Not performed at
all
Seldom
Somewhat important
Somewhat difficult
Extremely easy
Occasionally
Important
Difficult
Easy
Frequently
Very important
Very difficult
Difficult
Extremely important
Extremely difficult
Extremely
difficult
From the interview with incumbent, following task were identified. The tasks include both
the core and non-core tasks. The interview was verified by expert and ex-employee Mr.
Sanjay Pudasaini, Mr. Sudan Pudasaini and Mr. Animesh K.C.
S.N.
Tasks
Frequency of
Performance
Task 1
Server administration
Importance Difficulty
for
Level of
employees
task
5
5
Task 2
Network administration
Easiness
to learn
Mean
4.5
4.75
2
Task 3
and 5
4.25
1.75
Surveillance
system 5
administration
IT device maintenance
5
2.75
4.25
2.5
2.5
Task 11 Facilitate
SWC
(student 2
welfare council) election
Task 12 Help faculty regarding IT 3
problem
3.25
3.25
Task 4
Task 5
Task 6
Software maintenance
update
Exam invigilators
Task 7
Step 2: Among the listed tasks, critical task were identified whose mean was greater than 3.
5. They are as follows:
Critical Task SN
Critical Task 1:
Critical Task 2:
Critical Task 3:
Critical Task 4:
Critical Task
Server administration
Network administration
Software maintenance and update
IT device maintenance
3
4. Perform the maintenance of schools IT devices as well as assists in operation of all the IT
equipment to assure effective performance of devices.
Step 4: Knowledge Skills, and ability associated with critical task are as below:
A. Server Administration
Knowledge
Skills
and
experience
Abilities
B. Network administration:
Knowledge
Skills
and
experience
4
Abilities
Skills
and
experience
4.5, IIS
Knowledge about programming is an added advantage
Working experience on software maintenance and update
Skills to use open source software, visual studio, WAMP, dot net
Abilities
D. IT device maintenance
Knowledge
Skills
and
experience
software
Skills to troubleshoot and solve IT problem
5
Abilities
devices
Ability to work in a team
Analytical ability
Ability to solve problem creatively
Step 4: the identified KSA (Knowledge Skill Ability) were further processed with the help
Mr. Sharad Neupane.
Importance of task for the
employees
Relatedness to job
performance
1 - Not important
1 No
1 - Not at all
2 - Somewhat important
2 Somewhat
2 Somewhat related
3 Important
3 Yes
3 Moderately Related
4 - Very important
4 Considerably related
5 - Extremely important
Importance
of KSA
Necessity
at entry
level
5
5
3
3
Relatedness
to job
performanc
e
4
3
5
4
1
1
3
3
4
5
5
3
3
3
4
4
4
5
5
5
3
3
1
4
4
4
3
5
5
5
5
5
4
2
3
3
3
3
3
3
4
4
4
4
4
3
4
3
5
5
3
2
3
3
2
4
4
4
4
4
3
3
1
4
4
5
5
3
3
4
4
5
5
3
3
3
4
technicians
Ability to prepare and review network
documentation and diagrams
Ability to respond to all alerts generated by
the monitoring systems and resolve all issues
related to the data network
Ability to analyze importance and scope of
various software
Ability to identify and interact with local
vendors to provide regional IT requirement
such as network expansion
Ability to influence concerned person
regarding the implementation of IT devices
Knowledge about programming
Ability to research on different open source
5
5
2
2
3
3
Knowledge
Critical
Skills
Critical
Ability
8
Step 6: On the basis of the identified critical tasks and critical KSAs, the following matrix
was developed which traces the KSAs according to the critical tasks.
Critical Tasks
Server administration
Knowledge about the hardware of the server
Up-to date professional
information technology
K
S
A
knowledge
in
**
Network
administration
**
***
***
**
***
**
***
****
***
****
***
****
****
***
****
***
****
***
***
****
****
****
****
****
****
*** denotes critical KSA
critical tasks
From the above table, following skills are important for all the four critical tasks and can be
used for selection of new employees for the job.
Softw
and up
uirements
10
Background information
KSA
weight
Application
blank
(10%)
Reference
check
(5%)
Interview
Behavioral
Event
interview
(20%)
Test
Assessment
Instrument
(15%)
Work
Paper and penc
sample test
(25%)
MCQ
(10%)
about computer
35%
10
13
solve problem
15%
skills
15%
mmunicate and
ople
arn, understand
pret
English
10%
5%
to
analyze
and scope of
are
otal
20%
100%
10
20
15
25
10
11
A. Application blank: application blank would be required in order to get access to the
background information of the applicants. It would contain the information about current
address, educational background and work experience of the applicant. The application blank
would also serve as a tool to check the ability of applicants in English language.
a. Knowledge about computer system: Past work experience and educational background will
be considered. Collected information will be measured against different pre-established
categories. Ratio scale will be used for measurement of work experience and interval scale
will be used for educational background. The measurement shall be done as follows:
For work experience
0 No experience
1 Six months of internship or similar experience
2 Six months to one year of professional experience
3 one year to two years of professional experience
4 2 years to five years of professional experience
5 More than five years of professional experience
For educational background
1 Diploma in computer science
2 Bachelor in computer science/engineering
3 Bachelors in computer science/ engineering with distinction
4 Masters in computer science/engineering
5 Masters in computer science/engineering with distinction
B. Reference check: Reference check would provide the prospective employers with accurate
information about the applicants characteristics and background. These checks would be
used to verify information stated on the application blank as well as to receive additional data
about the applicant. Since, this method is costly, it will be used for limited KSAs.
12
a. Ability to solve problem creatively: Reference opinion will be considered using ordinal
scale measurement. The categories used shall be as follows:
1 Never solved problems creatively
2 Sometimes solved problems creatively
3 Frequently/always solved problems creatively
b. Self-learning skills: Reference opinion will be considered using ordinal scale
measurement. The categories used shall be as follows:
1 Never consults seniors or colleagues, neither initiates by self to learn something new
2 Sometimes consults and initiates to learn something new
3 Frequently/always initiates to learn something new
c. Ability to analyze importance and scope of various software:
C. Behavioral Event Interview (BEI): The behavioral event interview would be used to
collect information about the applicants regarding their ability to deal with tough situations.
The applicants would be required to describe the critical incidents they have faced and how
they dealt with it. These information would be evaluated by the interviewer to assess the
applicants suitability and fit for the job.
a. Knowledge about computer system: Questions related to basic computer skills will be
asked to the interviewee using ratio scale. The categories used shall be as follows:
0 Cannot answer any questions
1 Can answer at least 20% of the questions
2 Can answer at least 40% of the questions
3 Can answer at least 60% of the questions
4 - Can answer at least 80% of the questions
5 Can answer all the questions
13
b. Ability to solve problem creatively: Different situations will be asked verbally to the
interviewee to check the problem solving ability. The situations may be related directly or
indirectly with the computer programming. Puzzle will be designed to be solved for 5
minutes at maximum. Interval scale will be used to categorize according to the time taken to
solve the puzzle which are as follows:
1 Takes more than 5 minutes
2 Takes 3-5 minutes
3 Solves within 3 minutes
c. Ability to learn, understand and interpret English language: This wont be taken separately,
but the interviewees ability to communicate in English will be observed. Interval scale will
be used which are as follows:
1 Cannot understand the questions asked and also unable to reply in English
2 Can understand the questions asked but cannot reply in English
3 Can understand as well as reply fluently
D. Assessment instruments: assessment instruments like Big five personality test would be
used to evaluate the applicants personality. This would be required to assess how fit the
candidate is for the job of IT officer. For example: in order for the applicant to be a self
learner, it is important that he/she is a curious person aiming for achievement.
a. Self-learning skills:
b. Ability to communicate and work with people: Team will be formed randomly and tasks
given and output will be measured. Peers review will be collected and interval scale will be
used by using Likert scale.
c. Ability to analyze importance and scope of various software: Different software will be
provided to interviewees to put forward their analysis in context of the organization. Their
analysis will be evaluated by experts of the field by using Likert scale.
E. Work sample test: The work sample test would be used in order to assess the applicants
ability. The applicant would be put in a situation where he/she will have to deal with it as an
IT officer. He/she will then be evaluated on how well the person performs the job.
14
a. Ability to solve problem creatively: Simulation problem will be provided with limited
resources and time. Their solution will be evaluated based upon its effectiveness. Ordinal
scale will be used for measurement.
1 Can somehow understand the problem but cannot diagnose.
2 Can understand the problem and partially diagnose with provided resources and time.
3 Can understand and diagnose the problem with given resources and time.
b. Ability to communicate and work with people: Team based simulation project will be
assigned to group. Results will be evaluated based upon team participation and contribution.
Peer evaluation will be collected and Likert scale will be used for measurement.
c. Ability to analyze importance and scope of various software: Random problem will be
assigned and interviewees are asked to use it using any software as per their convenience.
Interval scale will be used to measure the findings.
1 Uses appropriate/advanced software but cant devise solutions.
2 Uses appropriate/advanced software and can partially devise solutions.
3 Devise solutions by use of default operating software.
F. Paper and pencil test: the paper and pencil test would contain two formats for evaluating
the applicant i.e. Multiple Choice Question and Case analysis. The applicant would be
presented series of MCQs to determine his/her level of understanding regarding the subject
matter. Similarly, case analysis would be used to determine the applicants ability to analyze
the situation along with what went wrong and what should be done.
For MCQ:
a. Knowledge about computer system: Questionnaire related to basic computer programming
like Java, C, C++, python, SQL etc will be administered. 20 questions will be designed and
results measured using interval scale.
1 Below 5 correct answers
2 6-10 correct answers
3 11-14 correct answers
4 15 and above correct answers
15
b. Ability to analyze importance and scope of various software: In basket exercises will be
provided and results measured using ordinal scale.
1 Cannot complete within stipulated time
2 Can somehow come to solution within stipulated time
3 Can devise effective solution within stipulated time
For Case Analysis:
a. Knowledge about computer system: Case related to computer system will be provided for
analysis. Nominal scale will be used to evaluate effectiveness, whether the interviewee
possesses knowledge about computer system or not.
b. Ability to solve problem creatively: Creative problem analysis and recommendation shall
be evaluated. Evaluation shall be done using Likert scale.
c. Ability to learn, understand and interpret English language: Evaluation shall be done on the
basis of number of grammatical mistakes made and comprehension level. Ordinal scale will
be used for measurement.
d. Ability to analyze importance and scope of various software: Evaluation shall be done
based on the specificity and appropriateness of prescribed solution to problems provided.
Likert scale will be used for measurement purpose.
16
Criterion Measure
Knowledge
about
computer system
Ability
to
solve
problem creatively
Self-learning skills
Ability to communicate
and work with people
Ability
to
learn,
understand
and
interpret
English
language
Ability to analyze
importance and scope
of various software
Supervisor Feedback
Supervisor
Performance
Feedback on
Appraisal
Customer Satisfaction
Faculty
Student
feedback
feedback
30
30
20
10
30
20
10
20
20
20
20
15
15
10
10
20
20
15
15
30
20
20
Supervisor feedback regarding the performance of the employee can be used as a criterion
measures. Supervisor is directly linked with the employee and he/she is also the best person
to assess the performance of candidates.
Performance Appraisal
In KUSOM, performance appraisal is done twice a year, it can be used as a criterion measure
of the applicants. Performance appraisal track all the task associated with the job as well as it
will track the KSA demonstrated by the person during his job.
Faculty feedback
Student feedback
No of errors
17
No of complaints
18
A. Application blank
a. Knowledge about computer system:
b. Ability to learn, understand and interpret English language:
B. Reference check:
a. Ability to solve problem creatively
b. Self-learning skills
c. Ability to analyze importance and scope of various software
C. Behavioral Event Interview (BEI):
a. Knowledge about computer system
b. Ability to solve problem creatively
c. Self-learning skills
d. Ability to communicate and work with people
e. Ability to learn, understand and interpret English language
f. Ability to analyze importance and scope of various software
D. Assessment instruments:
a. Self-learning skills
b. Ability to communicate and work with people
c. Ability to analyze importance and scope of various software
E. Work sample test:
a. Knowledge about computer system
b. Ability to solve problem creatively
c. Self-learning skills
d. Ability to communicate and work with people
19
e. Ability to analyze importance and scope of various software
F. Paper and pencil test:
For MCQ:
a. Knowledge about computer system
b. Ability to analyze importance and scope of various software
For Case Analysis:
a. Knowledge about computer system
b. Ability to solve problem creatively
c. Ability to learn, understand and interpret English language
d. Ability to analyze importance and scope of various software