Design and Implementation of A Fault Tol 24791561
Design and Implementation of A Fault Tol 24791561
UDC 621
This paper presents the development of a web-based DOI: 10.15587/1729-4061.2022.253146
examination system that focuses on automated resolution
of faults such as power, network, or component failure that
may occur when an e-learning system is used to conduct an
examination. This system can withstand various challenges DESIGN AND
that hinder the adoption of e-learning technologies in
developing countries. This is important because it will
reduce the time and cost involved in conducting large scale
IMPLEMENTATION OF
examinations by tertiary institutions without the need to
upgrade existing infrastructures. These institutions will A FAULT TOLERANT
not necessarily require uninterrupted power or network
connection to conduct web-based examinations as the
system can easily resume if such an incident occurs.
WEB-BASED
The architecture of the proposed web-based online
examination system provides for integrated management EXAMINATION SYSTEM
of functions such as question pool creation and update,
examination monitoring, failure toleration and recovery,
automated grading, and randomization. The system also
FOR DEVELOPING
eliminates the need for manual scheduling of examinations
which requires much planning and is error-prone. Different COUNTRIES
examinations can be scheduled to run simultaneously.
The design technology adopted for the implementation
is a client/server technology. The incremental software Ceasar E. Eko
development model in conjunction with prototyping Corresponding Author
technique was adopted in the development of the web- Master of Science in Computer Science, Lecturer*
based examination system due to the iterative nature of the
developed software. The system was developed using PHP,
E-mail: [email protected]
JavaScript, Ajax and MySQL. The system has been applied Idongesit E. Eteng
to conduct an examination involving more than 20,000 PhD, Senior Lecturer*
students per semester at University of Calabar. It has been
proved to save efforts of teachers and students
Eyo E. Essien
Keywords: Web-based, examination, Randomization, PhD, Senior Lecturer*
Auto-grading, E-learning, MYSQL, Client/Server, *Department of Computer Science
Resumption, Scheduling, Recovery University of Calabar
Etagbor, PMB 1115, Calabar, Cross River State, Nigeria
Received date 03.01.2022 How to Cite: Eko, C. E., Eteng, I. E., Essien, E. E. (2022). Design and implementation of a fault tolerant web-based
Accepted date 04.02.2022 examination system for developing countries. Eastern-European Journal of Enterprise Technologies, 1 (2 (115)), 58–67.
Published date 25.02.2022 doi: https://doi.org/10.15587/1729-4061.2022.253146
58
Copyright © 2022, Authors. This is an open access article under the Creative Commons CC BY license
Information technology
2. Literature review and problem statement tries such as scores, exam questions and login passwords. The
system could generate random questions as well as encrypt the
The main aim of a software system is so that human effort sensitive records in the database; however, it could not resume
can be significantly reduced by introducing proficient com- the exam if a fault were to occur during an examination. To
puting technologies. Several researches have been carried out promote the development of basic computer education, an on-
using existing technologies to improve conducting examina- line examination system based on the Browser/Server frame-
tions using a web-based examination system. The study in [8] work for the evaluation of computer basic operational skills
developed An Examination System Automation Using Natu- is designed in [15]. The system is a distributed collaborative
ral Language Processing that allows descriptive questions to system with components such as: the examination preparation
be graded. They designed and analyzed a model that assigns system, the examination system, the examination monitor
accurate marks to the answers for a given question. The mod- system and the auto-grading system. The system is capable
el enabled an examinee to write descriptive answers which of examining basic computer operating skills such as Visual
will get evaluated using Natural Language Processing. The Basic programming, Microsoft Windows operating, Word,
system evaluated student’s answers during the exams and stu- Excel and PowerPoint editing, Internet and Email etc. The
dents could see the correct solutions. However, features such system requires students not to leave the computer during a
as random question selection and random questions distribu- test hence, it will not be ideal for examination settings where
tion were missing from the system and as a result, students are a computer system might break down during an examination.
presented with the same set of questions whose solutions are A computer skill assessment system to assess practical com-
already known. Similarly, a creative software solution are de- puter skills is similarly designed in [16]. The authors utilize
veloped in [9] that automates manual assessment and helps or- various techniques involving Distributed Component Object
ganizations to limit the cost, time, exertion and human errors Model (DCOM), mark-method and fuzzy-match to enable
involved in conducting an examination. The authors designed auto-grading in the system. The system can auto-grade de-
a centralized system that can effectively manage the tasks and scriptive questions but could not auto-resume after a failure
activities related with examination. The system permitted in the exam process. The study in [17] proposed an online
descriptive answers to be scanned and manually evaluated by examination system with an integrated and flexible structure.
evaluators. This will reduce the amount of hard copy records The system manages functions such as collection of feedback
an institution will need to maintain. However, this evaluation from students, generating reports and submitting them for
process will require lots of human resource and time as much decision making purposes. The system could solve most of the
as in paper-based examinations. To reduce the rate of exam- challenges encountered during an exam but each challenge
ination malpractice and cheating in online examinations, a generated feedback that is sent to an instructor who is saddled
random number generator is used to develop an online exam- with the responsibility of restarting the exams for the affected
ination system that auto generates random questions; howev- students.
er, features such as resumption capability were missing [10]. A Most of the reviewed literature assumes an ideal examina-
set of electronic examinations in Nigeria aimed at preventing tion setting where an examination runs from start to finish
students from bad behaviors to some extent is implemented without any interruptions. A good number of reviewed liter-
in [11]. The authors highlighted economic factors, security, atures that have exam monitoring features also assume that
Software, Poor ICT culture, policy and implementation, and interruptions during the course of an examination are a flag for
power failure as the critical challenges facing the conduct of potential malpractice. Students are expected to maintain unin-
online examination in Nigeria. These challenges are common terrupted connection to the web server [18]. This is not always
among developing countries and addressing them has been a the case especially, in developing countries where power can be
major concern for these countries. An examination system is lost during an examination hence, a student may be required
also designed in [12] to monitor the status of students during to restart the entire exams or forfeit the exams in the case of
examinations. They developed a system where a camera at the remote examinations where an instructor may not be available
client computer is used to capture the student’s face and pos- to resolve such problems. Other issues such as prolonged net-
ture at random intervals during a test. The captured footage work downtime and system component failure can also affect
could be reviewed at a later date if the need arises. Reviewing the seamless conduct of an examination. This paper is focused
this footage to discover irregularities during an examination on developing an examination system with features such as:
will require lots of manpower. Such a system may not be ideal resumption capability, random question selection, random ques-
for developing countries due to the need for an uninterrupted tions distribution, random choices distribution, and concurrent
network connection. An online examination system using examination to help ameliorate these challenges while curbing
Java web technologies that runs on a campus network and in- examination malpractice.
cluded functions such as question management and test paper
generation is developed in [13]. The paper generation module
randomly extracted questions from the question database in 3. The aim and objectives of the study
accordance with three restrictions, including question type,
difficulty and chapter to generate an exam paper. The system The aim of the study is to develop a secure fault tolerant
developed by the authors could generate random questions examination system that can recover from several technical
based on the specified question combination; however, it did faults such as power failure, network failure, and system
not have any resumption feature. In order to meet the special component failure.
requirements in impartiality, confidentiality and authoriza- To achieve this aim, the following objectives were ac-
tion forms used in the field of industry certification, an en- complished:
cryption scheme to provide safety in web-based examination – to design a system that restores the remaining time,
systems is proposed and implemented in [14]. This encryption question set, and selected choices during the occurrence of a
scheme prevented users from directly modifying database en- fault in an examination;
59
Eastern-European Journal of Enterprise Technologies ISSN 1729-3774 1/2 ( 115 ) 2022
60
Information technology
The system randomizes the question set given to each in the temporary session storage. The server agent keeps
student to reduce cheating and malpractice during an exam- track of the IP address used by a client computer during
ination. The system interface is user friendly as novice com- an examination. When there is power failure, the user will
puter users can navigate through the system with the use of be temporarily disconnected pending when the power is
custom keys on a computer keyboard. The proposed system restored. Once power is restored, and the client computer
is failure tolerant as the student’s progress in the exams is rebooted, the student will be allowed to re-login and con-
easily restored in case there are instances of network failure, tinue the examination from the same computer system if
component failure or power failure during an examination. the IP address of the client computer remains unchanged.
The client agent also resumes the countdown timer from
4. 2. Failure Toleration the remaining time saved in the database prior to when the
The GSOLES has the ability to recover from failure and power failure occurred. The server agent fetches the previ-
resume the examination prior to the point of failure. Such ously assigned questions from the database and reassigns
failure includes power failure, network failure, and system the same set of questions, options and selected answers.
component failure [7]. The system is designed to recover
from these failures if they occur during an examination. As 4. 2. 2. Network Failure
a result, students will not be required to restart the entire Network failure may occur if the examination is con-
examination when these failures occur. The system allows the ducted over the Internet or a Local Area Network (LAN).
student to resume the examination prior to the point of failure If a client computer is disconnected during an examination,
by keeping track of the entire examination process. In the next the client agent will not be able to transmit newly selected
subsection, let’s discuss the recovery procedures in each case. answers by the student to the server agent. The system
operations on the client side will discontinue until the net-
4. 2. 1. Power Failure work is restored. The server agent keeps track of the idle
During an examination, each of the selected choices by time during an exam. If the idle time exceeds a threshold of
a student is stored in the database and a copy is also stored 500 seconds, the server agent will reallocate the idle time
61
Eastern-European Journal of Enterprise Technologies ISSN 1729-3774 1/2 ( 115 ) 2022
to the student. When the network is restored, the student The server agent enables the administrator or the instruc-
can resume the examination from the point prior to the tor to upload any given number of questions (N ) for each
network failure. of the courses to be written and then specify the number
of questions (Q) that will be randomly fetched to each
4. 2. 3. Computer’s Components Failure student (where Q<=N ). The random selection of questions
There are instances where machine failure or hard disk is a feature performed for a more secure and time saving
failure may occur during the examination phase. The server examination.
agent enables students to easily resume the examination
from another computer system with the authorization of the 4. 3. 2. Random Questions Distribution
system administrator. The system does not permit simul- In the examination phase, each student can login to the
taneous logins on two different machines. When a student system and request for exam’s questions in a course. As an
starts the exam, the server agent adds the client system’s added security measure and to prevent cheating, random
IP address and hostname to the student’s profile to prevent question distribution is required [20]. Therefore, each stu-
simultaneous login from another computer system. Hence, in dent gets a random set of questions that differ from any other
a scenario where there is component failure and the student set of questions received by other students.
can no longer continue on the same computer system, the ad-
ministrator can reset the IP address and hostname that was 4. 3. 3. Random Choices Distribution
added to the student’s profile to enable the student login and To ensure security and robustness against cheat attempts
continue the exams from another computer system. during an examination, random choice distribution within
each question is performed. In other words, the order of
4. 3. Combination of Randomization choices within the same question received by each student is
The three forms of randomization in [7] were used to randomized. Thus, if two students get the same question, the
minimize the level of cheating among students during the choices of this question are randomly sorted and differ from
examination. The sequence of questions and choices distrib- each other in the order of choices [20].
uted among the students are random. The set of questions
assigned to a student will be stored in the database to facil- 4. 4. Actors in GSOLES
itate easy resumption of the examination in case of a failure. There are three categories of users in the GSOLES as
shown in Fig. 3.
4. 3. 1. Random Question Selection These include the administrators, instructors and stu-
During an examination, question sets are randomly dents. The different roles played by these actors are as de-
selected from the entire pool of questions in a given course. picted in Fig. 3.
62
Information technology
4. 4. 1. Administrator write. Students can also see their results at the end of the
The administrator has control to manage the entire sys- examination.
tem. The functions of the administrator include:
– upload and manage eligible student list for the exam-
ination; 5. Results of research on the design and implementation
– upload and manage question bank for each of the of a fault tolerant web-based examination system
courses to be written;
– add list of courses for the examination; 5. 1. Examination time, question set and selected
– add Departments, Faculties and Programmes; choices restore
– export student results at the end of the examination; The implementation of the examination system permits
– enable students to swap computer systems in case of the time spent by a student during a fault to be restored once
component failure; the fault is resolved. The system keeps track of the last ac-
– specify duration for each examination. tivity performed by a student and restores the time a student
spent during a loss of connectivity. The time is restored only
4. 4. 2. Instructor if the loss of connectivity persists beyond a threshold time;
The instructor is responsible for developing the questions 500 seconds is used in this study. The automated retrieval of
for each of the courses. Other responsibilities of the examin- the remaining time, question set, and selected choices are the
er include: attributes that facilitate the resumption capabilities of the
– specify the number of questions to be answered during system. The examination start-up and resumption process
an exam; is shown in Fig. 4. In addition to the PHP session variables
– upload the set of questions for an examination. which may be lost if a client computer loses power, the IP
address and hostname of a client computer is assigned to the
4. 4. 3. Students user’s registration number during the examination which is
A student should be able to login with his/her registra- used to resume a student’s session from the same device.
tion number and then choose a course he/she is eligible to The system interfaces are shown in Fig. 5.
63
Eastern-European Journal of Enterprise Technologies ISSN 1729-3774 1/2 ( 115 ) 2022
Fig. 5. System interfaces: a – Login interface; b – Course selection interface; c – Examination interface; d – Admin interface
Source: Developed by authors
64
Information technology
Table 1
Comparison of GSOLES features
Test Test Coner- Sky
Features GSOLES
Invite Gorilla stone LMS prep
Automatic
Yes Yes No No Yes
Grading
Candidate
Yes Yes No No Yes
Management
Question
Yes Yes No Yes Yes
Library
Randomiza-
Yes Yes No Yes Yes
tion
Test Sched-
Yes No No Yes Yes
uling
Weighted
Yes No No Yes Yes
Questions
Automatic
Test Resump- No No No No Yes
tion
Source: [21]
65
Eastern-European Journal of Enterprise Technologies ISSN 1729-3774 1/2 ( 115 ) 2022
6. Discussion of the results of the development of a web- – keeping track of all the assigned questions and selected
based fault-tolerant examination system choices may result to the database size becoming too large
for large examinations.
After analyzing existing web-based examination systems The study can be further enhanced by incorporating
and the challenges faced by developing countries in adopting live image capture to check impersonations when the
these systems to conduct examinations, the need to create exams are written online. A major drawback to this en-
a system that addresses these challenges was identified. hancement is the need to manually review the captured
Studies [8–18] on the development of online examination footage to detect impersonation. Face detection tech-
systems included the research to justify the need to conduct nologies will reduce the need to manually review such
a seamless web-based examination. footage but this technology is yet to be fully harnessed in
To solve this problem, a fault tolerant web-based examina- developing countries.
tion with resumption capabilities was developed to reduce the
effect of the occurrence of faults. The occurrence of a fault can
result in abrupt termination of an exam as the timer may time 7. Conclusions
out before such fault is resolved. To solve this problem, the sys-
tem was designed to restore the lost time by keeping track of 1. A web-based examination system with resumption
the client computer’s connectivity with the server. Once con- capabilities was developed. The system keeps track of the
nectivity is lost beyond a threshold period, the system restores current state of an examination by storing the examination
the timer to when the student last interacted with the server. time, questions, IP address, and hostname in a database.
In addition to restoring the remaining time, the question set These details are used to resume an examination if there is
and selected choices by a stent is restored when the exam is re- an interruption during the exams. Here, uninterrupted pow-
sumed. The process involved in resuming an exam is shown in er supply and network connection will not be a necessity in
Fig. 4. If power failure occurs, the system uses the IP address conducting an online examination.
and host name to restore a student’s session. 2. A pseudo random algorithm was used to reduce exam-
An algorithm was constructed for random question selec- ination malpractice. This algorithm generates random ques-
tion, random questions distribution, and random choices dis- tions and random choices. Hence, as the number of questions
tribution. This algorithm as shown in Fig. 5 is used to reduce in the question pool increases, the probability that the same
examination malpractice. The randomized question sets and sequence of questions and choices is assigned to students is
selected choices are stored in a database and are reassigned greatly reduced.
to a student during resumption of the exams. The random al- 3. The system permits examinations in different courses
gorithm uses PHP inbuilt shuffle function which ensures that to be written concurrently by keeping track of all registered
the generated random question sets are normally distributed. courses. Students are eligible to sit for any scheduled course
The features of the designed system were compared with that was registered for.
some popular online examination systems. The result of the 4. A simulation of different fault scenarios showed that
comparison is shown in Table 1. In comparing these fea- the web-based fault-tolerant examination system permits
tures, automated test resumption, which is a novel feature, is the resumption of an examination from the same device
enabled in GSOLES in addition to other common features. when there is loss of power or network connection without
Automated test resumption will ensure that institutions can the intervention of a system administrator. The examination
adopt web-based examinations without the need for uninter- time, questions and choices are preserved. Hence, the integ-
rupted power or Internet connection. rity of the final grade is guaranteed.
The limitation of this study is that the proposed method
is applied only to online examinations with multiple choice
questions. There is a need to apply the proposed method in Acknowledgments
this study to online examinations with descriptive questions.
The disadvantages of this study include the following: The authors wish to express their gratitude and thanks
– the proposed method does not involve live image cap- to the Center for General Studies at University of Cala-
ture and as a result will not detect impersonation when the bar for their support and contributions to this research
exam is written over the Internet; work.
References
1. Trivedi, A. (2010). A relevant online examination system. 2010 International Conference on Technology for Education. doi: https://
doi.org/10.1109/t4e.2010.5550114
2. Wen, J., Zhang, Y., Yan, Y., Xia, S. (2005). A Web-based Examination System Based on PHP+MySQL. 2005 IEEE Engineering in
Medicine and Biology 27th Annual Conference. doi: https://doi.org/10.1109/iembs.2005.1617076
3. Bobdem S., Chaudharim S., Golguri, J., Shahane, R. (2017). Web Based Online Examination System. GRD Journals, 2 (5), 58–61.
Available at: https://www.grdjournals.com/uploads/article/GRDJE/V02/I05/0057/GRDJEV02I050057.pdf
4. Nnabuko, U. C., Iroegbu, I. O., Ugwuoke, C. I., Eteng, I. E., Okoronkwo, M. C. (2013). An object based result processing system.
International Journal of Natural and Applied Sciences (IJNAS), 8 (12), 27–34. Available at: https://www.researchgate.net/profile/
Idongesit_Eteng2/publication/309891371_An_object_based_result_processing_system/links/58358fd208ae102f073d2904/
An-object-based-result-processing-system.pdf
66
Information technology
5. Stergiopoulos, C., Tsiakas, P., Triantis, D., Kaitsa, M. (2006). Evaluating Electronic Examination Methods Applied to Students of
Electronics. Effectiveness and Comparison to the Paper-and-Pencil Method. IEEE International Conference on Sensor Networks,
Ubiquitous, and Trustworthy Computing - Vol 2 - Workshops. doi: https://doi.org/10.1109/sutc.2006.65
6. Biswas, S., Roy, R., Chowdhury, M. R., Bhattacharya, A. B. (2016). On the Advanced Strategies of Next Generation Online
Examination System Implementing Cloud Based Standardization: Next Generation Online Examination System. 2016 IEEE 6th
International Conference on Advanced Computing (IACC). doi: https://doi.org/10.1109/iacc.2016.159
7. Younis, M. I., Hussein, M. S. (2015). Construction of an Online Examination System with Resumption and Randomization Capabilities.
International Journal of Computing Academic Research (IJCAR), 4 (2), 62–82. Available at: https://www.researchgate.net/
publication/275770816_Construction_of_an_Online_Examination_System_with_Resumption_and_Randomization_
Capabilities
8. Das, I., Sharma, B., Rautaray, S. S., Pandey, M. (2019). An Examination System Automation Using Natural Language
Processing. 2019 International Conference on Communication and Electronics Systems (ICCES). doi: https://doi.org/10.1109/
icces45898.2019.9002048
9. Rathor, S., Nikhil, J U., Srinivasa, H. P. (2019). Campus Examination System Automation. Journal of Web Development and Web
Designing, 4 (3). Available at: https://zenodo.org/record/3363044#.Yg-VAjhByUk
10. Kotwal, D. V., Bhadke, S. R., Gunjal, A. S., Biswas, P. (2016). Online examination system. International Research Journal of
Engineering and Technology (IRJET), 03 (01), 115–117.
11. Abubakar, A. S., Adebayo, F. O. (2014). Using Computer Based Test Method for the Conduct of Examination in Nigeria: Prospects,
Challenges and Strategies. Mediterranean Journal of Social Sciences. doi: https://doi.org/10.5901/mjss.2014.v5n2p47
12. Ko, C. C., Cheng, C. D. (2004). Secure Internet examination system based on video monitoring. Internet Research, 14 (1), 48–61.
doi: https://doi.org/10.1108/10662240410516318
13. Zhao, Q. F., Li, Y. F. (2013). Research and Development of Online Examination System. Advanced Materials Research, 756-759,
1110–1113. doi: https://doi.org/10.4028/www.scientific.net/amr.756-759.1110
14. Li, Y. F. (2013). Design and Implementation of Encryption Scheme in Web-Based Examination System. Advanced Materials
Research, 756-759, 1106–1109. doi: https://doi.org/10.4028/www.scientific.net/amr.756-759.1106
15. Zhenming, Y., Liang, Z., Guohua, Z. (2003). A novel web-based online examination system for computer science education. 33rd
Annual Frontiers in Education, 2003. FIE 2003. doi: https://doi.org/10.1109/fie.2003.1265999
16. Zhang, L., Zhuang, Y., Yuan, Z., Zhan, G. (2006). A Web-Based Examination and Evaluation System for Computer Education. Sixth
IEEE International Conference on Advanced Learning Technologies (ICALT’06). doi: https://doi.org/10.1109/icalt.2006.1652383
17. Taşci, T., Parlak, Z., Kibar, A., Taşbaşi, N., Cebeci, H. I. (2013). A novel agent-supported academic online examination system. Educational
Technology & Society, 17 (1), 154–168. Available at: https://www.researchgate.net/profile/Tugrul-Tasci/publication/260045388_A_
Novel_Agent-Supported_Academic_Online_Examination_System/links/0deec52f351afc9184000000/A-Novel-Agent-Supported-
Academic-Online-Examination-System.pdf
18. Khanam, Z., Ahsan, M. N. (2018). Implementation of the pHash algorithm for face recognition in a secured remote online
examination system. International Journal of Advances in Scientific Research and Engineering, 4 (11), 01–05. doi: https://
doi.org/10.31695/ijasre.2018.32917
19. Sears, R., van Ingen, C., Gray, J. (2006). To BLOB or Not To BLOB: Large Object Storage in a Database or a Filesystem? Technical
Report MSR-TR-2006-45. Available at: https://arxiv.org/ftp/cs/papers/0701/0701168.pdf
20. Vas, S., Kamolphiwong, T., Kamolphiwong, S., Sae-Wong, S. (2010). Interactive examination management system. 2010 2nd
International Conference on Education Technology and Computer. doi: https://doi.org/10.1109/icetc.2010.5529435
21. Capterra. Available at: https://www.capterra.com/
67