2022_Feasibility of Using QR Code for Registration & Evaluation of Training and Its Ability to Increase Response Rate – the Learners' Perception
2022_Feasibility of Using QR Code for Registration & Evaluation of Training and Its Ability to Increase Response Rate – the Learners' Perception
Feasibility of using QR code for registration & evaluation of training and its
ability to increase response rate – The learners' perception
Elwin Ajeet Masih *
Professional Education and Training Nurse Trainer, Sherwood Forest Hospitals NHS Foundation Trust, United Kingdom
A R T I C L E I N F O A B S T R A C T
Keywords: Taking learners' attendance and obtaining an evaluation of teaching is a routine activity performed by teachers.
QR code The traditional method of taking attendance using pen and paper posed a huge challenge during the COVID-19
Registration pandemic. This has been time-consuming as compared to pre-COVID as well as frustrating for learners waiting in
Evaluations
a queue for their turn to sign the register. Quick Response (QR) Codes were used to complete registration to buy
Perception
back the time consumed using traditional methods of registration. Learners' evaluations are used as an instru
ment to evaluate teaching quality. At the researcher's workplace, a traditional paper-based evaluation method
has been used for decades. However, over time a significant decrease in the response rate of evaluations was
noticed. The pandemic provided an opportunity of using QR Codes to obtain learners' evaluation of teaching
quality. This study assessed the learners' perception of using QR Codes for registration and evaluation, and the
likelihood of learners completing the evaluation surveys, thus increasing the response rate. Participants of the
study were asked to complete an electronic survey to help assess their perception of using QR Codes and a
comparison was made between the responses gathered using paper-based evaluations over 5 months and QR
Code evaluations over the same 5 months in the following year. The results of this study demonstrate that using
QR Codes for registration and evaluation is easy and straightforward, thus increasing the likelihood of learners
completing the evaluation. The comparison between paper-based and QR Code evaluations confirms that a
substantial increase in response rate can be achieved by using QR Code evaluations.
* Corresponding author.
E-mail address: [email protected].
https://doi.org/10.1016/j.nedt.2022.105305
Received 14 August 2021; Received in revised form 31 January 2022; Accepted 15 February 2022
Available online 18 February 2022
0260-6917/© 2022 Elsevier Ltd. All rights reserved.
E.A. Masih Nurse Education Today 111 (2022) 105305
learning courses. All staff members of the Trust have access to MOODLE infusions calculations workshop and manual measurement of blood
and are familiar with using the platform. Therefore, MOODLE was used pressure and catheterisation. The study participants were from different
to create QR Code registers. MOODLE was given preference over other professional backgrounds including registered nurses, midwives, oper
electronic registration platforms, such as Jot form and Google forms, to ation department practitioners, allied health professionals, and health
minimise the confidentiality breach of learners' personal data. MOODLE care support workers. Participants were made aware of the study and
is purchased and used by the Trust, thus is trusted for maintaining that their responses to the questions would be anonymised and used to
confidentiality. investigate the hypotheses.
Teaching quality is paramount to delivering high-standard education The COVID-19 pandemic has brought most of the conventional re
that can be measured in different ways and sources (Feistauer and searches to a standstill, due to the need to socially distance and wide
Richter, 2017) including electronic or paper-based evaluation forms. At spread lockdown, hence this promoted survey-based researches (Gaur
the workplace of the researcher, the traditional method of paper-based et al., 2020). Surveys are considered a well-established tool to collect
evaluations has been used for decades and was the only trusted quantitative and qualitative data. Since 1986, there has been a shift from
method for teachers to evaluate their performance and the course con traditional survey methods of using in-person or telephone interviews
tents. The COVID-19 pandemic provided an opportunity for a different and paper-based surveys to web-based surveys. Web-based surveys are
approach that reduces the risk of cross-infection, is cost-effective, and becoming increasingly common in research, because they allow rapid
improves the learners' response rate compared to the traditional paper- development and administration, fast data collection and analysis, low
based evaluations. A comparative study by Snyder et al. (2018) cost, and fewer errors in data entry as compared to paper-based surveys
concluded that QR Code based evaluations were significantly associated (Maymone et al., 2018). Surveys are valued methods to collect data
with usability, cost-effectiveness, and time efficiency. The system also pertaining to individual self-report about their opinions and satisfaction
minimises the risk of cross-infection by eliminating the use of paper and (Gaur et al., 2020). Considering the benefits, a web-based survey was
pens that go into different hands and touch different places, increasing used to collect data. The survey was developed and administered using
the risk of infection. Using the QR Code has dramatically increased the MOODLE with the opportunity for the learners to scan the QR Code and
number of evaluations (Ramalingam et al., 2020). According to a study complete the survey using a smartphone or tablet. To make it equitable
done by Bellot et al. (2015), creating and scanning a QR Code is easy; for staff to use QR codes, iPads were provided if they did not own a
83% of participants of the study agreed to the benefits of QR Code in smartphone. Questionnaires, being the most common survey modality
healthcare education and were likely to use QR Code technology in the for data collection, were used to collect quantitative and qualitative
future. Considering the challenges to using traditional paper-based data.
evaluations and the highly recommended usability of QR Code linked For hypotheses 1 (H1) and hypothesis 2 (H2), rated multiple-choice
evaluations for being easy and quick, allowing faster completion of questions were asked to obtain quantitative data, and participants were
forms than paper, the researcher decided to use QR Codes to collect asked to write further comments to support their selection to collect
evaluations at the end of training. qualitative data. To investigate H1 ‘The course registration and evalu
ation using QR Code is easy and straightforward,’ the responses for
2. Methodology participants to choose were; (1) Strongly Disagree, (2) Disagree, (3)
Agree, and (4) Strongly Agree. Along with these choices, the participants
After considering the use of QR Codes, the researcher submitted a were provided free text space to write their comments to support their
paper to the People Development Cabinet (PDC) which includes Deputy choice. For H2 ‘The use of QR Code affects the likelihood of learners
Director Training and Education – the chair of Cabinet and senior completing the evaluation’, the choices were; (1) less likely to complete,
managers within the Trust asking for their approval to pilot QR Codes (2) No change – wouldn't do it anyway, (3) No change – would do it
for course registration and evaluation, and conduct a study to assess the either way and (4) More likely to complete. A free-text box was provided
perception of using QR Codes among the learners. The paper was to write further comments to support their choice. These multiple-choice
approved by the PDC. survey questions and further comments to support the selection of re
Studies show that the perception of learners is a stronger predictor of spondents' choice, elicit the same and/or similar response that supports
effectiveness and outcomes of tools and/or strategies used in the training the reliability of the survey. According to Gaur et al. (2020), reliable
and education (Shrestha et al., 2019). It was noticed that over time the surveys pose questions in a manner that evokes the same or similar re
response rate of evaluations was hugely decreased and the survey forms sponses from responders, regardless of the construction of the questions.
were not completed properly. Therefore, there was a need to implement The web-hosted survey gives assurance of its reliability having the
a new system that can accelerate the response rate and encourage the advantage of storing data that bypasses the manual input, thus reducing
learners to complete the survey form properly in a timely fashion. The data entry errors (Maymone et al., 2018).
researcher took this opportunity to use the QR Code application to To investigate the hypothesis 3 (H3) ‘The use of QR Code increases
gather evaluations to find if there was an increase in response rate. the evaluation responses as compared to the traditional paper-based
A mixed-method design was employed for this study to investigate collection of evaluations’, all attendees of the courses over the 5
the following hypotheses; months were given QR Code evaluations and the number of responses
was compared to the total number of paper-based evaluations distrib
1. The course registration and evaluation using QR Code is easy and uted and responses received over the same 5 month period of the pre
straightforward. vious year. The distributed number of paper-based evaluations and
2. The use of QR Code affects the likelihood of learners completing the responses were counted retrospectively from the Trust's records for the
evaluation. previous year, because the study was not planned at that time. There
3. The use of QR Code increases the evaluation responses as compared fore, the attendees of courses completing the paper-based evaluations
to the traditional paper-based collection of evaluations. were not aware of the study. Three courses from the aforementioned list;
blood transfusion, SSSA Training, and Intravenous drugs and infusions
The study was conducted over 5 months that recruited 570 at calculations workshop were excluded from the investigation of this
tendees, including men (n = 75) and women (n = 495), of different hypothesis as they were not run during the period of 5 months when
courses: non-medical clinical induction, blood transfusion, administra paper-based evaluations were distributed. A total of 520 participants
tion of intravenous drugs and infusions, central vascular access devices, were given QR Code evaluations and 508 participants were given paper-
venepuncture, and peripheral cannulation, Standards for Students' Su based evaluation forms.
pervision and Assessment (SSSA) training, intravenous drugs and
2
E.A. Masih Nurse Education Today 111 (2022) 105305
3
E.A. Masih Nurse Education Today 111 (2022) 105305
Table 4
QR code evaluation responses over the same 5 month period in the following
year.
Course Number of Number of responses Responses
attendees received %
text from all responses is not in agreement with the system being easy
and straightforward and argues that scanning the code seems to be
confusing for some people if they are not hands-on with technology.
However, instructions in the form of a step-by-step guide were provided
Fig. 2. Results for testing H2 as percentages. to ensure that novice users could successfully register and complete
evaluations on the first attempt at using QR codes. The application is
To investigate H3, ‘The use of QR Code increases the evaluation re cost-effective, as compared with paper forms and supports the Global
sponses as compared to the traditional paper-based collection of eval green agenda.
uations’, 508 participants of different courses over 5 months were given
paper-based evaluations and 520 participants were given QR Code
5.2. Scanning the QR code at the end of a course encourages completing
evaluations for the same courses over the same 5 month period of the
the evaluation that can be done from anywhere and at any time, enabling
following year. For paper-based evaluation (Table 3), only 268 partici
more learners to complete the evaluations
pants completed and returned the evaluation form. Whereas, using QR
Code evaluations (Table 4), 467 participants completed the evaluations
57.78% coverage of the entire text of all gathered responses has
which were simultaneously stored on MOODLE.
generated this theme. Scanning the QR Code enhances the accessibility
of the evaluation questionnaire which can be accessed from anywhere
5. Analytical themes and at any time. This can be even completed at home or on the way out
of the classroom after finishing the training, rather than staying behind
The following four overarching analytical themes were identified to complete the evaluation and handing it over to the teacher. The QR
while analysing the qualitative data obtained from the submitted Code is displayed at the end of a classroom session to prevent the
surveys. learners from forgetting to complete the evaluation. Thus, it is a prompt
and therefore completion of the evaluation is much more likely. How
ever, 5.28% coverage of the entire text reflects that some people are
5.1. The use of QR codes for registration and evaluation is excellent,
more likely to complete paper-based evaluations.
efficient, easy, and straightforward
This theme reflects the perception of learners; what they think about 5.3. QR code registration and evaluation saves time and is essential for
using this method of registration and completion of evaluations at the continuous improvement
end of a course they have attended. A vast majority of respondents
evaluated the use of QR codes as an excellent and brilliant tool that is This theme was merged while coding the survey data. The use of QR
easy and straightforward to use. The respondents said that this does not Codes for registration and evaluation is not only easy and straightfor
require someone to be a technology expert, but is absolutely easy to ward, but is also a fast and efficient system that saves time for enrolment
manage if they have the right equipment, such as a mobile phone or a and evaluation. This encourages more learners to complete the evalua
tablet with the ability to scan the code, and it is a way forward. Scanning tion, which is essential for continuous improvement.
the QR Code instantly redirects to the page for submission of the
enrolment key, provided by the teacher, to complete the registration and 5.4. Using QR code is safe and efficient in preventing cross-contamination
for evaluation to the questionnaire page. However, 1.29% of the entire
This was another unintentional merging theme, which recommends
Table 3 the use of QR Codes to improve the safety of fellow learners and teachers
Paper-based evaluation responses over 5 months. by taking away paper registers and evaluations especially during the
Course Number of Number of responses Responses COVID-19 pandemic. This method of registration and evaluation re
attendees received % duces the possibility of cross-contamination, as compared to signing a
Non-medical clinical 150 71 47% paper-based register and passing it on to the next learner to sign. There is
induction a similar risk of cross-contamination when completing the paper-based
IVI study day 107 37 35% evaluation and handing it over to the teacher.
CVAD study day 40 18 45%
Venepuncture & 97 60 62%
cannulation 6. Discussion
PSA workshop 73 61 84%
Catheterisation 38 18 47% The study examined the feasibility of using QR Codes to complete in-
Manual BP 3 3 100% class registration from learners' perspective and the increase, if any, in
TOTAL 508 268 53%
the likelihood of learners completing the evaluations, thus increasing
4
E.A. Masih Nurse Education Today 111 (2022) 105305
the evaluation response rate as compared to the traditional paper-based use the application.
evaluations. The results are in favour of the hypotheses. QR Codes are
versatile and novel tools for improving the classroom experience in a
fast, easy and fun way to engage learners (Crompton et al., 2011). 7.1. Limitations
In response to the questionnaire posed to investigate H1, results
show that participants strongly agreed that using QR Codes for regis This study could be improved upon by investigating the impact of
tration is easy and straightforward. According to the results, 66% of additional variables which could factor into the perception of QR code
respondents strongly agreed and 29% agreed. Although, 29% of re technology and its usage. Certain demographic factors could affect the
spondents selected their response ‘Agree’, they are in line with H1 ‘ the perception; for instance, age. According to Czaja et al. (2006), older
course registration and evaluation using QR Code is easy and straight adults are less confident in their ability to successfully use technology as
forward,’ making it a total of 95% respondents in agreement with using compared to young adults. However, the number of older adults using
QR Code registration. Attendance of a course can be completed easily technology is increasing and is similar in numbers to their younger
using the QR Code application, as compared to any other attendance counterparts (Olson et al., 2011). Thus, further study into the effect of
system (Galib and Shehjad, 2019). However, there are some barriers to age, and possibly other demographic factors, such as gender and
using QR Codes, such as cultural background and technical knowledge, ethnicity, upon the perception of QR codes usage for registration and
that need to be addressed (Snyder et al., 2018). This study shows that evaluation of training is recommended.
having a good support mechanism in place, for instance, written in
structions available in the classroom or sent to the learners prior to them CRediT authorship contribution statement
attending the course, builds the confidence of novice users in using the
QR Code application. A registration system that requires the input of a I have revised the manuscript as advised by the reviewer's feedback.
teacher every time a learner registers to the lesson, robs the class time of I have submitted the following files:
the learners, especially for late arrivals (Masalha and Hirzallah, 2014).
In response to the questionnaire posed for testing H2, the results 1. Response to Reviewer
show that there is an increased likelihood of learners completing the 2. Revised manuscript with changes marked in colour (green and red)
evaluations as compared to the traditional paper-based method. 58% of and have explained in the Response to Reviewer that green is for text
respondents said that they are more likely to complete the evaluations deleted from the original manuscript and red is the additional text.
using the QR Code application, as this is a stimulant to do so when it is 3. Revised manuscript – a clean copy
displayed at the end of the session. Using online feedback via QR Code is
simple and less expensive, hence yielding a higher response rate and is
Declaration of competing interest
instantly available to the teacher for a quicker analysis (Onimowo et al.,
2020). Although 37% of respondents said, there will be no change as
I ‘the author’ certify that there is no conflict of interest with any
they will be completing the evaluations either way, a comparison of
financial/research/academic organisation, with regards to the contents
paper-based and QR Code evaluations shows a 37% increase in the
and/or research work discussed in the revised manuscript.
response rate of evaluations when using QR Code application. This is a
significant increase to support H3.
Acknowledgments
While analysing the qualitative data, two themes; ‘QR Code regis
tration and evaluation saves time and is essential for continuous
The author thanks Joy Simpson (author's line manager) for her
improvement’ and ‘Using QR Code is safe and efficient in preventing
support and proofreading and Shaleem Ajeet for proofreading the paper.
cross-contamination’, were unintentionally merged. Although they are
important themes, the study was not aimed at investigating them;
therefore specific questions were not asked. Thus, there was insufficient References
data in support of these themes to enable the researcher to conclude
Alhojailan, M.I., Ibrahim, M., 2012. Thematic analysis: a critical review of its process and
them as an outcome of the study. Therefore, further study is recom evaluation. WEI Int. Eur. Acad. Proc. 1, 8–21.
mended to examine these themes. The perception of adopting new Bellot, J., Shaffer, K., Wang, M., 2015. Use of quick response coding to create interactive
technology, such as QR Codes, can be affected by learners' age due to patient and provider resources. J. Nurs. Educ. 54, 224–227. https://doi.org/
10.3928/01484834-20150318-07.
cognitive differences (Mendelson and Romano Bergstrom, 2013). This Brodie, K., Madden, L.L., Rosen, C.A., 2020. Applications of Quick Response (QR) codes
study has not considered the age of learners, thus a further study is in medical education. J. Grad Med. Educ. 12, 138–140. https://doi.org/10.4300/
recommended to investigate whether the age of learners influences their JGME-D-19-00516.1.
Clarke, V., Braun, V., 2017. Thematic analysis. J. Posit. Psychol. 12, 297–298. https://
perception of QR Code-based registration and evaluation. doi.org/10.1080/17439760.2016.1262613.
Crompton, H., LaFrance, J., van't Hooft, M., 2011. In: QR Codes 101. Learn. Lead. With
7. Conclusion Technol, 39, pp. 22–25.
Czaja, S.J., Charness, N., Fisk, A.D., Hertzog, C., Nair, S.N., Rogers, W.A., Sharit, J., 2006.
Factors predicting the use of technology: findings from the Center for Research and
In line with the increasing use of technology in training and educa Education on Aging and Technology Enhancement (CREATE). Psychol. Aging 21,
tion, there is a need to bring all aspects of training and education under 333–352. https://doi.org/10.1037/0882-7974.21.2.333.
Feistauer, D., Richter, T., 2017. How reliable are students' evaluations of teaching
the same umbrella, including in-class registration and evaluations. To quality? A variance components approach. Assess. Eval. High. Educ. 42, 1263–1279.
implement any innovation, acceptance among learners is an essential https://doi.org/10.1080/02602938.2016.1261083.
element. The study was aimed at learners' perception of using QR codes Galib, N.P., Shehjad, A.A., 2019. Smart Attendance Using QR Code — An Android Based
Mobile Application.
application. This study has concluded that using QR Codes is easy and Gaur, P.S., Zimba, O., Agarwal, V., Gupta, L., 2020. Reporting survey based studies – a
straightforward. Course evaluations are a vital element to improve primer for authors. J. Korean Med. Sci. 35, 1–15. https://doi.org/10.3346/
teaching, so a greater number of feedback responses gathered further jkms.2020.35.e398.
Javadi, M., Zarea, K., 2016. Understanding thematic analysis and its pitfall. J. Client Care
aids this improvement. The use of QR Codes increases the likelihood of
1. https://doi.org/10.15412/j.jcc.02010107.
learners completing the evaluation surveys, thus increasing the response Jugder, N., 2016. The thematic analysis of interview data: an approach used to examine
rate. QR Code application is easy for learners to use, hence encouraging the influence of the market on curricular provision in Mongolian higher education
learners to complete evaluations and yielding a higher response rate. institutions. In: Reasearch Gateesesrch gate 8.
Karia, C.T., Hughes, A., Carr, S., 2019. Uses of quick response codes in healthcare
The QR Code application's ability to instantaneously and automatically education: a scoping review. BMC Med. Educ. 19, 1–14. https://doi.org/10.1186/
record the responses is an attractive aspect that encourages teachers to s12909-019-1876-4.
5
E.A. Masih Nurse Education Today 111 (2022) 105305
Kickbusch, I., Leung, G.M., Bhutta, Z.A., Matsoso, M.P., Ihekweazu, C., Abbasi, K., 2020. Onimowo, J.O., Knowles, G., Wrighton, G., Shah, M., 2020. Use of quick response (QR)
COVID-19: how a virus is turning the world upside down. BMJ 369, 10–12. https:// codes to achieve timely feedback in clinical simulation settings. BMJ Simul. Technol.
doi.org/10.1136/bmj.m1336. Enhanc. Learn. 6, 172–174. https://doi.org/10.1136/bmjstel-2018-000426.
Koumpouras, F., Helfgott, S., 2020. Stand together and deliver: challenges and Ramalingam, N.D., Tran, H.N., Gangopadhyay, A., 2020. As simple as taking a
opportunities for rheumatology education during the COVID-19 pandemic. picture—how use of QR codes improved evaluation response rates, documentation,
ArthritisRheumatol. 72, 1064–1066. https://doi.org/10.1002/art.41278. and timeliness. J. Gen. Intern. Med. 35, 1615–1616. https://doi.org/10.1007/
Masalha, F., Hirzallah, N., 2014. A students attendance system using QR code. Int. J. s11606-020-05674-9.
Adv. Comput. Sci. Appl. 5 https://doi.org/10.14569/ijacsa.2014.050310. Shrestha, E., Mehta, R.S., Mandal, G., Chaudhary, K., Pradhan, N., 2019. Perception of
Maymone, M.B.C., Venkatesh, S., Secemsky, E., Reddy, K., Vashi, N.A., 2018. Research the learning environment among the students in a nursing college in Eastern Nepal.
techniques made simple: web-based survey research in dermatology: conduct and BMC Med. Educ. 19, 1–7. https://doi.org/10.1186/s12909-019-1835-0.
applications. J. Invest. Dermatol. 138, 1456–1462. https://doi.org/10.1016/j. Snyder, M.J., Nguyen, D.R., Womack, J.J., Bunt, C.W., Westerfield, K.L., Bell, A.E.,
jid.2018.02.032. Ledford, C.J.W., 2018. Reply to “The use of QR codes to promote timely feedback.”.
Mendelson, J., Romano Bergstrom, J.C., 2013. Age differences in the knowledge and Fam. Med. 50, 635–636. https://doi.org/10.22454/FamMed.2018.747674.
usage of QR codes. In: Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Vaismoradi, M., Jones, J., Turunen, H., Snelgrove, S., 2016. Theme development in
Intell. Lect. Notes Bioinformatics) 8010 LNCS, pp. 156–161. https://doi.org/ qualitative content analysis and thematic analysis. J. Nurs. Educ. Pract. 6 https://
10.1007/978-3-642-39191-0_18. doi.org/10.5430/jnep.v6n5p100.
Olson, K.E., O’Brien, M.A., Rogers, W.A., Charness, N., 2011. Diffusion of technology: Walters, T., 2016. Using thematic analysis in tourism research. Tour. Anal. 21, 107–116.
frequency of use for younger and older adults. Ageing Int. 36, 123–145. https://doi. https://doi.org/10.3727/108354216X14537459509017.
org/10.1007/s12126-010-9077-9. Young, I., Waddell, L., 2016. Barriers and facilitators to safe food handling among
consumers: a systematic review and thematic synthesis of qualitative research
studies. PLoS One 11, 1–21. https://doi.org/10.1371/journal.pone.0167695.