The Impact of Computer Based Test On Senior Secondary School Students
The Impact of Computer Based Test On Senior Secondary School Students
INTRODUCTION
1.1
BACKGROUND OF STUDY
The use of CBT for entrance examination in education, military training, and
certification examination by professional groups and promotional examination
in various stages and categories of life cannot be overemphasized. Erle, at el.
(2006) cited by Olumorin et al. (2013) noted that CBT has gained popularity
as a means of testing with large-scale professional examination such as
United State Medical Licensing Examination (USME) in 1999. However, the
popularity emerged through the post UME and university main examination in
Nigeria. Other institution such as University of Ilorin, Federal University of
Technology, Akure and Federal University of Technology, Mina are
maximizing the use of CBT as tool for undergraduate and postgraduate
assessments.
Recently, the Joint Admission and Matriculation Board (JAMB) conducted the
2013 edition of the Unified Tertiary Matriculation Examination (UTME) with
three test options the traditional Paper Pencil Testing (PPT), Dual Based
Testing (DBT) and Computer Based Testing (CBT). The DBT and CBT which
are a novel introduction were largely successful in spite of some challenges
especially in the area of infrastructure. However, the JAMB Executive
Register, Professor Dibu Ojerinde, announced that from 2015; CBT will be
used to conduct all UTME. He noted that the objective of the e-testing was to
Computer and related technologies provide powerful tools to meet the new
challenges of designing and implementing assessments methods that go
beyond the conventional practices of cognitive skill and knowledge
(Mubashrah et al., 2012). In the past, various methods was employed in
examining the ability of an individual, starting from oral to written, practical to
theoretical, and paper and pencil to electronic. The present ICT means of
examining students in Nigeria is the use of electronic system in place of
manual or paper method which was characterized by massive examination
leakages, impersonations, demand for grafication by teachers, bribe taking
by supervisors and invigilators of examinations (Olawole and Shafil 2010).
1.2
Currently, examination inn Nigeria are a disaster to both parents, students, the
government and teachers. It is generally not a true reflection of students
knowledge and capabilities to a great extent and in many cases a show of
shame going by the manner of ceased and cancelled results released by the
examination conducting bodies.
This study aim to achieve two major objective, to look into the impact of using
Computer-Based Test (CBT) in Nigeria Secondary Schools and its challenges
and strategic plan to adopt for implementation.
1.3
PURPOSE OF STUDY
iii.
iv.
1.4
SIGNIFICANCE OF STUDY
The findings of this study will help the educational policy makers and as well
as the curriculum planners to tackle the problems of examination malpractices
in Nigeria. This will enable them to strategies the best method of writing
examination in Nigeria.
The result will assist the various examination bodies like WAEC, NECO,
JAMB, and NABTEB amongst others in making decision on how to ensure
hitch-free examination in Nigeria.
Finally, the findings will provide the basis for further investigation into the effect
of CBT in secondary school examination in Nigeria
1.5
i.
RESEARCH QUESTIONS
What are the impact of CBT on secondary school students in Lagos
State?
ii.
What are the difference between paper pencil test (PPT) and Computer
based test (CBT)
iii.
iv.
1.6
RESEARCH HYPOTHESEIS
ii.
iii.
1.7
1.8
DEFINITION OF TERMS
CHAPTER TWO
LITERATURE REVIEW
2.0
INTRODUCTION
2.1
2.1.1
Assessing test quality generally involves both item and test analysis. Classical
statistics used to summarize item quality are based on difficulty and
discrimination indices; these are calculated more easily and quickly with the
use of the computer than by traditional hand methods. Items which have been
inadvertently miss-keyed, have intrinsic ambiguity, or have structural flaws
such as grammatical or contextual clues that make it easy to pick out the
correct answer, can be identified and culled out. These items are characterized
by being either too easy or too difficult, and tend to have low or negative
discrimination. Test analysis can also provide an overall index of reliability or
internal consistency, that is, a measure of how consistently the examinees
performed across items or subtests of items. Christine (2011)
In the use of item which are an alternative to item banks, algorithms are used
for randomly generating test items from a well-defined set of item
characteristics; each item is similar in structure. For instance, items might have
a multiple-choice format, a similar stem, the same number of answer choices,
and a common pool of distractors. The most important advantage gained from
storing item forms is that many more items can be produced by the
microcomputer that would be reasonable to store on the microcomputer
(Millman & Outlaw, 2008). With the availability of item forms, unique sets of
test items can be developed and drawn for each examinee. Such a feature
makes it feasible to administer different tests of the same content and domain
to students at different times.
10
2.2
11
12
graphic can be used to depict more clearly the motion in question. This should
represent a purer measure of the examinee's understanding of the motion
concept because it is less confounded with other skills such as reading level.
This implies a higher degree of validity for the computerized test item.
Computer-animated tests such as this, may have special applications with
students who have reading comprehension problems or difficulty translating
words into images. Printed tests may therefore not provide an accurate
measure of the true ability of the student. Christine (2011)
The administration of tests by computer also allows the collection of data about
examinee response styles. These include information such as which items are
skipped, how many answers are changed, and response latencies. The latter
may refer to the time it takes an examinee to answer an item; analysis time for
any complex drawing, graph, or table; reading time for each option; response
selection time, or response speed. Precise measurement of any of these
latencies is virtually impossible with paper-and-pencil tests. Christine (2011)
13
2.3
14
There are also measurement problems associated with the use of computeradministered tests. These are related to item types, item contamination that
arises from certain test design strategies, and the non-equivalence of
comparison groups in item analyses (Sarvela & Noonan, 2008). With regard
to item type, difficulties arise when constructed-response items (such as fillins and short answers) as compared to selected-response items (for example
multiple-choice, matching and true/false) are developed for the computer. It
becomes almost impossible to program all the possible correct answers, when
considering alternative correct answers, wording, spacing and spelling errors.
A tremendous amount of programming is involved for even a partial subset of
all possible correct answers. There are psychometric implications as well.
Students could supply correct answers that simply are not recognized by the
computer; the result could be lower reliability and poorer discrimination
indices. Because of these reasons, computer-administered tests are mainly
restricted to multiple-choice items. Christine (2011)
15
the student to use the result from item 3 to compute item 4) would be
contaminated if a student receives feedback after each item. Or, the correct
answer for one item could provide subtle clues to the correct answer on
another item. There are motivational concerns as well. If a student is
consistently answering items incorrectly, the negative feedback might be
detrimental to motivation on future items. Christine (2011)
Furthermore, when test items are drawn randomly from an item pool, for a
given test different students may see different items or items presented in a
different order. Consequently, there is non-equivalence of comparison groups.
Unless the items administered to one student are equal in difficulty to items
that are presented to another student, it becomes extremely difficult to
compute item and test statistics (for example, total score, point bi-serial
coefficient, estimate of reliability). The problem is that there is no sensible total
score. With random item selection, a total test score is defensible for item
analysis only if every item is of equal difficulty and equal discrimination.
Christine (2011)
16
2.4
17
obtained by the paper-and-pencil test, then the two test versions can be
evaluated against the criteria for parallel tests.
18
19
Although test situations are stressful and evoke state anxiety (A-State)
reactions in most students, the magnitude of the A-State response will depend
on the student's perception of a particular test as personally threatening.
Individuals with high test anxiety generally perceive tests as more threatening
than low test-anxious individuals and respond with greater elevations in state
anxiety to the evaluative threat that is inherent in most test situations.
Spielberger (2002)
20
Sex differences in test anxiety have also been consistently obtained, with
females having higher levels of anxiety. Given the fact that research has
provided evidence of a negative relationship between test anxiety and test
performance, an important issue related to the use of computers in testing is
whether computer-administered testing will increase test anxiety and depress
test performance, particularly in examinees who are relatively unfamiliar with
computers. The results of this study also showed no evidence of interactions
between sex and state anxiety. Christine (2010)
A study by Ward era (2009), fifty college students were randomly assigned to
take an Education class exam either on computer or in the traditional paper-
21
Given the results reported in the preceding section, it appears that the added
test anxiety associated with computer-administered tests is an important
consideration in the evaluation of computerized testing. There is a need to
familiarize examinees with the technology used in testing prior to test
administration so that anxiety about computers does not increase examinee's
level of test anxiety. Ward era (2009),
22
Simonson,
Maurer,
Factors such as gender and prior computer experience have been identified
as being related to computer anxiety. A review of previous research reveals
several studies designed to determine sex-related differences in computer
anxiety and attitudes. While Loyd and Gressard (2004) found no difference in
computer anxiety levels for males and females in a sample of high school and
college students, Chen (2006) on the other hand, found significant sex-related
differences, with high school males being less anxious and holding more
positive attitudes of interest in and confidence with computers than did
females. Differences in computer attitudes such as interest, liking and
confidence were also obtained in investigations by Levin and Gordan (2009),
and Popovich et al (2007) with males holding more positive attitudes.
23
were significantly more anxious about computers than those with more
experience.
This finding is supported by Loyd and Gressard (2004) who found that
although students' attitudes towards computers were not dependent on sex,
they were affected by the amount of computer experience, with more
experience related to decreased anxiety and increased positive attitudes.
Manifestations of computer experience could be having access to a computer
at home, participating in computer-related courses, playing computer games
or knowing how to work with computers. Students who have a computer at
home tend to have lower computer anxiety than those who do not. Boys are
also more likely to have used computers more frequently at both home and
school, as well as in informal settings (Chen, 2006). Perhaps because of this,
they are often found to be less anxious about using computers and more selfconfident about their abilities with computers.
24
Previous research has shown that the amount of computer experience can
influence test performance on computer-based tests, with less experience
being associated with lower test scores. Johnson and White used a between
subjects design to compare computerized test scores of a sample of elderly
subjects who had prior training on the computer with the scores of those who
did not have prior training Christine (2010). They found that increased training
on the computer prior to testing significantly enhanced the test scores of their
examinees. The authors attributed the improvement in scores to the
amelioration of anxiety by the training. Lee's study investigated the
performance on a computerized arithmetic reasoning test with a sample of
college undergraduates. While past computer experience was a significant
factor affecting test performance, the findings showed that there was not a
significant difference between "low experience" and "high experience"
persons, indicating that minimal work with computers may be sufficient to
prepare a person for computerized testing. Furthermore, it was also found that
those whose computer experience involved computerized games only,
25
performed significantly worse than the other two groups, indicating that
computerized games did not provide the same training with computers as work
tasks. Christine (2010)
Contrary to the above findings, the results of three other studies showed that
lack of experience with using computers did not have an adverse effect on
examinee performance on a computer-based test. The subjects in the sample
pool in these three separate studies by Eaves & Smith (2006), Plumly & Ray
(2009), and Wise et al (2009) were all college students. There are some
plausible reasons why contradictory findings were obtained.
First, age may play a part in the ability of examinees to respond equally to the
two media used in the studies, namely computerized and traditional paperand-pencil tests. It would seem reasonable to assume that college students
would be more likely than elderly examinees to adapt to the novelty of using
computers in testing. Second, the response demands placed on the subjects
for the tests in the latter three studies might have been simple enough that an
examinee with little or no prior computer experience would not be
disadvantaged by the computerized test-taking procedures. Wise et al (2009)
testing.
The
research
literature
on
attitudes
toward
26
In the study by Gwinn & Beal (2008), 70% of the university students who took
an anatomy and physiology test had a decided preference for computer testing
over paper-and-pencil tests, about 7% disliked it, and the remainder found it
made little difference. This sample of students had very little prior experience
with the use of computers. A greater preference for online computer testing
was also found by Moe and Johnson (2008) who investigated the reactions of
Grade 8 to 12 students on a standardized aptitude test battery. Gwinn & Beal
(2008)
27
28
CHAPTER THREE
RESEARCH DESIGN AND METHODOLOGY
3.0
INTRODUCTION
This chapter is concerned with the various procedures and methods involved
in the collection and analysis of data, therefore information is supplied on the
research design, population, sample and sampling techniques, instruments,
validity and reliability of the instruments and procedures for data collection and
analysis.
3.1
RESEARCH DESIGN
3.2
RESEARCH POPULATION
29
3.3
3.4
RESEARCH INSTRUMENT
The questionnaire was developed after due consultation with the project
supervisor, it consist of two main section A and Section B, A comprises of
personal information about the respondents such as; Name, Sex, Age, Marital
Status, Educational qualification and Year of experience, while section B is
subdivided into parts according to the problems, (The impact of computer
based text on senior secondary school students in Lagos State). The
questionnaire was structured on a four (4) Liker scale structure, expressed as;
30
A = Agreed
SA = Strongly Agreed
D = Disagreed
SD = Strongly Disagreed
3.5
The instrument was validated by the project supervisor and other experts in
the department for proper corrections and modifications, so determine the face
validity of the instrument and also to remove absurdity. The comment and
observations were incorporated to fashion out a new draft.
3.6
3.7
31
3.8
In analyzing the data for this study, simple percentage was used to analyze
the personal information of the respondents, whereas Chi-square(X2)
statistical analysis was used to test the entire hypothesis.
Due to the fact that the questionnaire was divided into two sections, the Chisquare was used because it enables the researcher to know the relationship
between the variables tested in the study. The simple percentage enabled
researcher to know the variables tested in the study. The simple percentage
enabled researcher to know the relative importance of various items used for
the analysis, the responses from the data collected and the hypothesis that
were tested at 0.05 level of significance.
X2c =
( )
Where,
O = Observed frequency
E = Expected frequency
= Summation
X2c = Chi-square calculated
32
CHAPTER FOUR
PRESENTATION OF RESULT DATA ANALYSIS AND INTERPRETATION
4.0
INTRODUCTION
This chapter embodies the results of the finding. It reveals the analysis of the
data collected through the questionnaire. A total one hundred (100) copies of
questionnaire were distributed to the teachers of the five (5) randomly selected
secondary school in Agege Local Government Educational District in Lagos
State. Simple percentage was used in analyzing the personal data, while Chisquare(X2) was being employed in analyzed the data collected based on the
questionnaire. All data analysis was done and the entire hypotheses were
tested at 0.05 level of significance.
4.1
SCHOOLS
NO OF RESPONDENTS
20
20
20
20
100
From the above table, 20 teachers were sampled from Lagooz College, 20
teachers were sampled from A&T College, 20 teachers were sampled from
Fitjoy Secondary School, 20 teachers were sampled from Cleverland Schools,
33
and 20 teachers were sampled from Lagos Baptist Secondary School. Making
a total of 100 teachers sampled in all schools during the survey of the study.
NO OF RESPONDENTS
PERCENTAGE (%)
MALE
47
47%
FEMALE
53
53%
TOTAL
100
100%
The table above represents the distribution based on gender, it implies that
47% of the respondents were male, while 53% of the respondents were
female.
NO OF RESPONDENTS
PERCENTAGE (%)
Below 25 years
30
30%
25 35 years
50
50%
20
20%
TOTAL
100
100%
FREQUENCY
PERCENTAGE (%)
SINGLE
49
49%
MARRIED
51
51%
TOTAL
100
100%
34
The above table show that 49 respondents were single, and 51 respondents
were married. This implies that 49% of the respondents were single, while 51%
of the respondents were married.
FREQUENCY
PERCENTAGE (%)
WASSCE/GCE
0%
NCE
38
38%
NHD
7%
B.SC ED./B.ED
52
52%
M.ED/SC.
3%
TOTAL
100
100%
QUALIFICATION
From the above table, 38% of the respondents have NCE qualification, 7%
have qualification in HND, and 52% of the respondents has certificate in B.Sc.
/B.Ed. while 3% of the respondents were certified with M.Ed. /Sc.
4.1.6 DISTRIBUTION
OF
RESPONDENTS
BASED
ON
YEAR
OF
EXPERIENCE
YEAR OF
FREQUENCY
PERCENTAGE (%)
0 5 years
33
33%
6 10 years
32
32%
11 15 years
21
21%
14
14%
TOTAL
100
100%
EXPERIENCE
35
between 0 -5 years, 32 % of the respondents have been teaching for the period
of 6 11 years, 21% of the respondents had taught for 11 15 years, while
14% of the respondents have been I teaching line for over 16 years and above.
4.2
DATA ANALYSIS
HYPOTHESIS ONE
In order to validate the hypothesis which says there is no significant difference
among the secondary school students that uses CBT and students that does
not.
Table 4.2.1 Showing summary of the chisquare(x2) based on the
computation.
ITEM
FAVOURABLE
UNFAVOURABLE
TOTAL
S/N
SA
SD
SD
50
20
15
15
100
20
35
25
20
100
20
40
15
25
100
45
15
25
15
100
30
20
25
25
100
TOTAL
165
130
105
100
500
SL
DF
X2CAL
X2TAB
DECISION
0.05
10.46
9.488
Rejected
From the above computation, it is observed that the X2 tabulated value (x2 t),
which is 9.488 with df of 4 at 0.05 level of significance is lesser than X 2
calculated value (X2c) 10.46. Therefore, the null hypothesis is rejected. Thus,
the alternative hypothesis which says there is significant difference between
among the secondary school students that uses CBT and students that does
not will be upheld.
36
HYPOTHESIS TWO
There will be no significant difference among paper pencil test (PPT) and
computer based test (CBT)
Table 4.2.2 Showing summary of the chisquare(x2) based on the
computation.
ITEM
FAVOURABLE
UNFAVOURABLE
TOTAL
S/N
SA
SD
SD
20
15
35
30
100
15
25
40
20
100
10
15
45
30
100
15
50
30
100
10
25
20
35
20
100
TOTAL
75
90
205
130
500
SL
DF
X2CAL
X2TAB
DECISION
0.05
19.44
9.488
Rejected
The computation above shows that the chi-square calculated value (x2c) of
19.44, is greater than the chi-square critical value (X2t) 9.488 at (0.05, 4) level
of significance. Therefore, the null hypothesis is rejected and the alternative
hypothesis is accepted. Thus, there will be significant difference between
paper pencil test (PPT) and computer based test (CBT).
HYPOTHESIS THREE
There will be no significant challenges on the use of computer - based test
(CBT) in Nigeria.
37
FAVOURABLE
UNFAVOURABLE
TOTAL
S/N
SA
SD
SD
11
60
14
16
10
100
12
25
31
29
15
100
13
25
10
50
15
100
14
45
20
15
20
100
15
50
25
10
15
100
TOTAL
205
100
120
75
500
SL
DF
X2CAL
X2TAB
DECISION
0.05
45.47
9.488
Rejected
The computation above shows that the chi-square calculated value (X2c) is
45.47, which is greater than the chi-square tabulated value (0.05, 4), which is
9.488. Therefore, the null hypothesis is rejected and the alternative hypothesis
is accepted. Thus, there will be significant challenges on the use of computer
based test in Nigeria.
4.3
DISCUSSION OF FINDINGS
This study revealed that ICT facilities such as computer, projectors, electronic
notice boards, internet filmstrips were not available in secondary schools. This
could be as a result of inadequate funding of the schools by the government.
This finding has grave consequences on the resourcefulness of the teachers.
Even if these teachers are willing to learn and use ICT in their, the nonavailable of the facilities will hinder them.
The study also revealed that teachers and students were to a little extent
exposed to the use of ICT. This is a pointer to the low level of application in
the teaching-learning in secondary schools. The implication is that most of the
teachers are still fond of the old method of chalk and talk, the practice which
will make them lag behind in the world of ICT.
38
It was also revealed that the perceived benefits of using ICT in schools include
making
teaching-learning
interesting;
helping
the
distance
learning
This finding corroborates Kwache (2007) who submitted that the application of
ICT makes institutions more efficient and productive, enhance and facilitate
pedagogical activities. Similarly, Ayeni (2007) posited that the fact that ICT is
accurate, fact and reliable and has the capacity to store and disseminate large
information within the shortest periods, makes it a veritable and indispensable
instrument for distance education programme.
The study revealed that irregular power supply is major challenge facing the
application of ICT in secondary schools in the country. The epileptic power
supply is a national phenomenon that has a detrimental effect on all sectors of
the economy. This can also be attributed to low level of funding in the school
system. If schools are well funded, the management of the school can always
make provision for alternative power supply in the schools. This finding support
Yusuf (2005) and Ofodu (2007) who submitted that irregular power supply in
the country is a major obstacle to the usage of ICT in all spheres of the
economy.
The study showed that most schools in the sampled areas lack computer
literate teachers. The lack of computer literate might not be unconnected with
the non-inclusion of ICT in teacher training programmes in school curriculum
at all levels of education in Nigeria. This finding is in support of Kwache (2007),
39
Dabesaki (2005) and Oyebanji (2003) who submitted that lack of skilled
manpower to manager available system and facilities for ICT hinders its use
in schools. Kwache (2007) remarked the most institutions lack computer
literate teachers and ICT experts that would support and manage the internet
connectively and / or application of computing in the teaching learning
process.
40
CHAPTER FIVE
SUMMARY, CONCLUSION AND RECOMMENDATION
5.1
During the course of the research, adequate and relevant data were collected
through the use of questionnaire with the assistance of the supervisor in order
to carry out the investigation. The copies of the questionnaire were distributed
to teachers in five randomly selected secondary schools in Agege Local
Government Area of Lagos state, to measure students attitude towards the
adoption of computer based test in senior secondary schools. The
respondents however, supplied the information to the best of their knowledge;
this made it possible for the researcher to analyze the data as supplied in
chapter four of this project.
The research was successfully carried out through the formulated and tested
of three hypotheses. It shows that computer based test has the potential of
eradicating examination malpractice in Nigeria and also help to boost their
learning outcomes. However, computer based test offers chances to redefine
how examination is design and conducted in the classroom, bringing teachers
and students closed and making use of various technologies that manifest the
society.
In the hypothesis it shows that computer based test cannot be rejected in this
modern age i.e. both teachers and students are to be involved in the use of
computer for their educational purposes as well as academic pursuit.
Resistance in the use of computer in teaching and learning process may take
shape in different forms but it is important to envision computer based exam
as a way to enhance, not substitute the traditional paper to pencil method of
examining the students.
41
5.2
CONCLUSION
The finding of this study has shown that Nigeria secondary schools are lagging
behind in the level of application of ICT in the teaching- learning process. The
ICT facilities are lacking in schools, the capacity for using ICT by both teachers
and students is also very low.
Despite the perceived benefits in the use of ICT in school, there are a lot of
factors inhibiting the successful application of ICT in secondary schools. In
order to fit into the new scientific order, it is necessary for Nigerian institutions
and individuals alike to develop a society and culture that places a high value
on
information
and
communication
technology.
The
following
Experience has shown that examination malpractices have been the bane of
Nigerias education system as both parents and teachers assists students in
the task of this crime. This ugly state of affairs has continually robbed-off on
both the standard and out-come of education in the country leading to a
widespread call for a total overhaul and sanitization of the entire educational
system. As a result, the call for the adoption of the electronic/computer-based
tests is a right step in the right direction. However, the process requires an
appreciable level of strategies to enable students/candidates meet the
challenges posed by CBT.
42
students take their studies seriously and discard the idea of planning for
malpractices.
5.3
RECOMMENDATIONS
Based on the findings of the study, the following recommendations are made:
I.
II.
III.
IV.
V.
This will help provide them with practical and functional knowledge of the
computer, the internet and associated areas of ICT with the hope of integrating
it with instructional methods of teaching and learning.
43
REFERENCE
Akpa GO, Ayeni AO, Adedeji SO (eds) Access, equity and quality in higher
education. National Association for Educational Administration and
Planning (NAEAP) Publications. Ibadan: Awemark Printers pp. 487-496.
Bodmann, S. M. and Robinson, D. H. (2004), Speed and Performance
Differences among Computer Based and Paper-Pencil Tests. Journal of
Educational Computing Research, 31(1), 51 60.
Bunderson, C.V., Inouye, D.K. & Olsen, J.B. (2009). The four generations of
computerized educational measurement. In R.L. Linn (Ed.), Educational
measurement. (3rd ed., pp. 367- 408). New York, NY: Macmillan
Dusek, J.B. (2000). The development of test anxiety in children. In I.G. S
arason (Ed.), Test anxiety: Theory, research and applications (pp. 87
119). Hillsdale, NJ: Lawrence Erlbaum Associates
Duthie, B. (2004).
psychological test.
NY: The
Haworth Press.
Fletcher, P. & Collins, M.A.J. (2006). Computer administered versus written
tests advantages and disadvantages.
Journal of Computers in
44
Lee, J.A., Moreno, K.E. & Sympson, J.B. (2006). The effects of mode of
test administration on test performance. Educational and Psychological
Measurement. 46. 46 - 474.
Mazzeo, J. & Harvey, A.L (2008). The equivalence of scores from automa
ted and conventional educational and psychological tests: A review of the
literature (College Board Rep. No. 88-88, ETS RR No. 88 21).
McArthur, D.L. and Choppin, B.H. (2004).
J.R. (2005).
Computerized adaptive
testing. Educational
45
instruction:
Psychometric implications,
Technology. 2
46