Blank 2
Blank 2
ONLINE LEARNING
IN HIGHER EDUCATION
No part of this digital document may be reproduced, stored in a retrieval system or transmitted in any form or
by any means. The publisher has taken reasonable care in the preparation of this digital document, but makes no
expressed or implied warranty of any kind and assumes no responsibility for any errors or omissions. No
liability is assumed for incidental or consequential damages in connection with or arising out of information
contained herein. This digital document is sold with the clear understanding that the publisher is not engaged in
rendering legal, medical or any other professional services.
EDUCATION IN A COMPETITIVE
AND GLOBALIZING WORLD
ONLINE LEARNING
IN HIGHER EDUCATION
YARON GHILAY
New York
Copyright © 2017 by Nova Science Publishers, Inc.
All rights reserved. No part of this book may be reproduced, stored in a retrieval system or transmitted
in any form or by any means: electronic, electrostatic, magnetic, tape, mechanical photocopying,
recording or otherwise without the written permission of the Publisher.
We have partnered with Copyright Clearance Center to make it easy for you to obtain permissions to
reuse content from this publication. Simply navigate to this publication’s page on Nova’s website and
locate the “Get Permission” button below the title description. This button is linked directly to the
title’s permission page on copyright.com. Alternatively, you can visit copyright.com and search by
title, ISBN, or ISSN.
For further questions about using the service on copyright.com, please contact:
Copyright Clearance Center
Phone: +1-(978) 750-8400 Fax: +1-(978) 750-4470 E-mail: [email protected].
Independent verification should be sought for any data, advice or recommendations contained in this
book. In addition, no responsibility is assumed by the publisher for any injury and/or damage to
persons or property arising from any methods, products, instructions, ideas or otherwise contained in
this publication.
This publication is designed to provide accurate and authoritative information with regard to the subject
matter covered herein. It is sold with the clear understanding that the Publisher is not engaged in
rendering legal or any other professional services. If legal or any other expert assistance is required, the
services of a competent person should be sought. FROM A DECLARATION OF PARTICIPANTS
JOINTLY ADOPTED BY A COMMITTEE OF THE AMERICAN BAR ASSOCIATION AND A
COMMITTEE OF PUBLISHERS.
Additional color graphics may be available in the e-book version of this book.
Preface ix
Chapter 1 Introduction 1
The Book’s Structure 2
Chapter 2 Learning Management System (LMS) 5
LMS – Main Characteristics 6
Universal Learning Management System – Moodle 9
Research Findings: Lecturer Attitudes toward
Moodle 9
Follow-Up Research: Student Attitudes
toward Moodle 10
Independent Design of Pages in Moodle 14
Characteristics of the Synchronized Interface
Between LMS (Moodle) and AAS 15
Responsibilities of the Institutional Head of ICT
Regarding LMS 17
Chapter 3 Text, Hypertext and Screen Capture 19
Research Findings 20
Creating PDF Files 20
Adding Links to Pages of Text 23
Chapter 4 Integrating Audio into Online Courses 27
Research Findings: Digital Voice Recording 29
Chapter 5 Video in Online Courses 33
Disciplinary Areas 34
The Method’s Advantages 34
vi Contents
INTRODUCTION
This book is designed to enrich the knowledge of both academic staff and
decision makers in higher education with regard to the constructs of online
learning. It can assist teachers, principals, and tutors in promoting meaningful
learning, diversification of learning methods and use of new technological
tools including smartphones and tablets. The text is focused on the creation,
development, management and updating of online courses in institutions of
higher education. However, these educational principles and technological
tools that focus on learners and their ways of learning are suitable to other
scholastic frameworks as well.
The main difficulty in the creation and management of online courses is
the lack of information both in technology-based educational concepts and in
the technological tools that allow these concepts to become reality. The aim of
the book is to help lecturers overcome the complexities posed by educational
technology and to assist them in integrating technology into their educational
activity.
The text is based on international research literature, published studies by
the author, 2012-2015 as well as his multi-year experience in managing online
academic courses and in guiding lecturers in the field of educational
technology. These studies detail innovative models designed to meet the
following educational needs:
Active learning
Feedback-based learning
Online asynchronous learning which can be a replacement for face-to-
face learning
2 Yaron Ghilay
(Ghilay & Ghilay, 2015a; Ghilay & Ghilay, 2015b; Ghilay & Ghilay,
2015c; Ghilay & Ghilay, 2014; Ghilay & Ghilay, 2013; Ghilay & Ghilay,
2012).
In addition, the book describes the author’s research, 2015-2016 which
deepens and continues the above studies. It focuses on:
RESEARCH FINDINGS:
LECTURER ATTITUDES TOWARD MOODLE
A two-year study by the Mofet Institute of Tel-Aviv examined lecturer
perceptions of a model designed to train faculty in the management of online
courses. The study examined twenty staff members who teach in ten different
Israeli teacher-training colleges and who participated in a two-year, seven
10 Yaron Ghilay
academic hour-per-week course based on the new model. At the end of each
year (2012-2013 and 2013-2014) the lecturers answered a Likert questionnaire
on their perception of Moodle’s contribution toward their academic work.
Faculty members evaluated the contribution of the LMS as high for their
academic work (4.00 and 4.06 out of 5, respectively). There was no
statistically significant difference between these two years (t-test, 0.05 ),
as shown in Table 2.1. The similar annual results give the findings more
validity (Ghilay & Ghilay, 2014).
The findings indicate that LMS is a major infrastructure tool for all those
involved in online learning in higher education. Faculty members also
indicated that they need guidance and tutoring in order to develop competence
with the tool.
In 2016, more research to complete the previous study was done at the NB
School of Design and Education. This study examined the effectiveness of
Moodle from the learner’s perspective. The research was focused on exploring
the advantages of Moodle for student learning processes. It also investigated
Learning Management System (LMS) 11
For each factor, all the items composing it are presented (questions in the
questionnaire). High reliability (Cronbach's alpha) was found for each factor.
Scores were calculated based on the means of the items composing them.
Table 2.2 introduces the means of the factors.
Table 2.2 shows that both convenience of learning and contribution to the
learning process received very high scores, 4.63 and 4.58 respectively
indicating that students perceive Moodle to be very effective for a variety of
courses.
Learning Management System (LMS) 13
Table 2.3 presents the means of the four items as relates to the
contribution of Moodle to learning in the four different types of courses.
As seen in Table 2.3, the four items have very high scores: multi-text
(4.57), online distance learning (4.52), face-to-face learning (4.50) and
quantitative (4.43). The Paired Samples T-test examines the significance of the
differences among all six pairs of items ( .05) . The findings show that
there is no significant difference among all these pairs indicating that students
give equally high scores to the contribution of LMS in all four different types
of courses.
Respondents were also asked to add verbal notes on their preferred way of
learning. Below are a few examples of student comments:
The findings of this study combined with those of the previous one show
that LMS such as Moodle is a tool that significantly contributes to learning
from the perspective of both faculty and students.
In both studies it was found that the effectiveness of the course website is
critically dependent upon the degree of lecturer investment in it. Students
14 Yaron Ghilay
explicitly point out that they received significant support for their learning
process when the course site was well maintained. Indeed, the ability of
faculty members to manage their course sites properly depends upon the
knowledge and skills that they have acquired. Faculty point out
unambiguously that they need guidance and direction and without them, they
find it difficult to meet student expectations (Chapter 12 deals with the training
of staff members to manage online courses).
Texts are essential in managing and supporting online learning. Before the
digital age, texts were printed on paper and physically distributed to readers. In
the digital age text is distributed over the net. Students now have access to
enormous amounts of high-quality text without a limit on quantity. While
learners can still print out the text on paper, these writings can now be
comfortably read without printing them due to sophisticated mobile devices
such as tablets and smartphones.
The most common digital replacement for paper output is the PDF
(Portable Document Format) file invented by Adobe. It is able to accurately
display digital documents regardless of platform, (computer hardware or
operating system). Accompanying the PDF concept is the “virtual page,” i.e.,
what the screen shows is identical to the printed page as opposed to HTML
Internet files which employ separate tools for viewing and printing.
Today PDF is the accepted standard for distributing text files. A
significant advantage of PDF is the ability to lock documents so they cannot
be changed and thus prevent distortion. This read-only file and does not have
the possibility of editing. Adobe has developed the reading software (Adobe
Reader) and distributes it for free so that every user can read PDF files.
In the online learning world it allows for the distribution of texts (and
hypertext) produced by a variety of software tools without the necessity of
acquiring the software that created the original document. Thus, it is possible
to read output from SPSS (Statistical Package for the Social Sciences) in PDF
without having the SPSS software or the knowledge of how to use it. Even if
the readers do have the software used to generate a document, such as MS
Word, they may encounter a problem while receiving a file in Word format
20 Yaron Ghilay
since a document produced in a newer version of Office does not allow the
document to be viewed on a computer with an older version. PDF overcomes
these difficulties by standardizing all documents and platforms. Moreover, the
PDF output is identical to that of the source so it can be read and printed.
Another advantage of PDF is the possibility of creating a single file which
combines text from different sources that can be numbered and arranged in
any order enabling lecturers to prepare digital booklets that include texts from
a variety of sources, such as a word processor, a spreadsheet, or a scanner, etc.
Preparing such a booklet can be undertaken using software tools, a large
number of which are freeware. These booklets can then be uploaded to the
learning management system (detailed in Chapter 2).
RESEARCH FINDINGS
The findings of a two-year long study focusing on training faculty
members to manage online courses (see Chapter 12), show that lecturers’
appreciation of management of PDF files is high (3.83, 3.89 on a 5-point
Likert scale). There was no statistically significant difference between the two
years (Paired Samples T-test, 0.05 ), as presented in Table 3.1 which is
an indication of their validity (Ghilay & Ghilay, 2014).
contents or links to bookmarks that were defined in the word processor file.
Operating the internal and external links are easier in a PDF file than in the
original file; only one click is required, whereas in Word, the Ctrl key must
also be depressed. The same applies to spreadsheets (such as Excel or
Numbers) and presentations (PowerPoint or the equivalent). Most of the
scanning software produces documents in PDF with the ability to save
multiple scanned pages in a single file.
When necessary to convert files originating from sources that are not
Microsoft Office, Pages (Apple) or a scanned page, additional software may
be required. The full version of Adobe Acrobat Professional allows conversion
of any text file with operations such as merging, splitting, deleting pages,
changing page order, video embedding, numbering and more; however, most
of these central operations can be performed using free tools.
The main steps required to support online learning with PDF files are:
Save the word processor file that now includes all screenshots and
then save to PDF. The PDF file will include all selected screenshots.
1) Full URL without hyperlink: Pasting the full-length URL into the text.
For example, https://www.novapublishers.com/catalog/index.php.
QR - 3.2
INTEGRATING AUDIO
INTO ONLINE COURSES
Digital audio may be the appropriate option for multi-text courses that do
not require visual elements.
In online learning, digital audio has two main aims:
QR - 4.1
QR - 4.2
QR - 4.3
QR - 4.4
While there are differences among TTS tools, most have common
attributes such as options for selecting the desired text, listening to the
reading, choosing a male or female voice, controlling the speed of the
reading and saving output to an mp3 file. This is crucial for sharing.
The files generated by the software can be uploaded to the course site
(or other collaborative websites) and learners can listen to them via
appropriate links.
2) Lecture recording: Voice recording of a lecture may be an alternative
to or a supplement for a face-to-face lecture. The recorded lecture is
saved as an audio file. There is no need to record a lecture in one shot.
It is possible, even desirable to prepare the audio file small portions
and merge all the sections into one complete lecture (this requires the
editing procedures described below). When recording each unit, the
instructor can pause and then resume the recording.
The pedagogic and technical features of digital sound recording and its
editing are:
QR - 4.5
DISCIPLINARY AREAS
Nowadays, educators in many disciplines use screencasting for
instructional purposes in subjects such as computer programming languages
(Yuen, 2007), instructional design and technology (Sugar, Brown and
Luterbach, 2010), object-oriented programming (Lee, Pradhan, & Dalgarno,
2008), mathematical modeling (Ellington & Hardin, 2008), nursing (Phillips &
Billings, 2007) and more. These screencasts and video tutorials demonstrate
specific actions associated with a particular content area.
A moving picture can be invaluable for explaining and demonstrating the
complicated content in today’s computer world (Yuen, 2007). Pre-recorded
videos of computer-based steps have proven to be effective in showing how
software applications work. Digital video technology and video screen capture
software allow teachers to easily create original, high-quality pre-recorded
software presentations that can be used for in-class demonstrations and
reviewed by students at their convenience on the Web.
Students can follow the videos and then practice on their own and
complete assignments. They can learn complex computing techniques and
tasks via digital videos or access lectures that they may have missed. Video
screen capture software is an effective way of delivering software instruction
and is ideal for student-centered learning and online learning environments
(Yuen, 2007).
The following six factors divided into three groups were examined
(n = 30):
Comments:
For each factor, all the items composing it are presented (questions
that appear in the questionnaire).
For each factor, high reliability was found (Cronbach's alpha ranges
from 0.568 to 0.707).
The mean score and standard deviation of each factor are indicated in
parentheses.
Scores were calculated based on the means of the items composing them.
Item scores were graded on a five-point Likert scale.
The learners considered the video clips to be of very high quality, giving
the attribute a score of 4.79 on the 5-point Likert scale. This is a necessary
condition for further examination of the next factors (since it is unreasonable
to examine the characteristics and advantages of clips if they are not
considered to be of high-quality).
It turns out that the flexibility of use (4.90) and contribution to learning
(4.68) constitute a significant advantage in learning via viewing video capture
clips. An additionally important finding is that use of video capture technology
is more advantageous (4.52) than use of general texts and images. The results
indicate that this technology should be used to support the learning process
more often.
Respondents were also asked to add verbal notes to describe the learning
process that they experienced through viewing these video clips. The attached
examples reinforce the quantitative findings, giving them more validity:
A student in the PSPP course:
“Video clips have a great advantage and they are very helpful for
learning. They give me the feeling that I am in class even while I am at
home. It helps me understand and succeed. Nevertheless, I would not give
up the face-to-face lectures. They are also very helpful for
communicating with the lecturer in real time. The clips are also useful if I
forgot or did not understand something.”
Video in Online Courses 39
PRACTICAL IMPLICATIONS
The use of video capture technology does not require significant
investment in technological infrastructure or in software development teams.
Every lecturer needs to learn the educational and technical aspects of video
capture and then with minimal equipment, a personal computer and
microphone, suitable software and access to LMS and file-sharing sites such as
YouTube or Vimeo experiment with the technology.
Many screencast programs exist and they vary in features and cost. Tools
are divided into two main groups:
QR - 5.1
The software is simple to operate but does not have editing options and is
not updated. Editing can be accomplished by an additional free tool such as
Windows Movie Maker, found at: goo.gl/yek0M1
QR - 5.2
INTRODUCTION
As assessment is critical to learning (Brown, Bull & Pendlebury, 1997),
considerable pressure has been placed on institutions of higher-education to
measure learning outcomes more formally and more often (Brown et al., 1997;
Farrer, 2002; Laurillard, 2002). Computer-assisted assessment (CAA), has the
potential both to ease the assessment load and to provide innovative and
powerful assessment tools (Brown et al., 1997; Bull & McKenna, 2004).
Furthermore, as use of ICT increases, ‘inherent difficulties in teaching and
learning online but assessing on paper’ may arise (Bull, 2001; Bennett, 2002).
Objective test questions (multiple-choice, true/false or numeric answers)
which require the choice of a predetermined answer are the most common
format in CAA. However, other types of questions are also possible (such as
essay, matching, matrix question, drag and drop into text/image, selection of
missing words, etc.). A major concern on the part of both academics and
quality assurance staff (Bull, 1999; Warburton & Conole, 2003) is whether
multiple-choice questions can assess higher-order learning outcomes
(Pritchett, 1999; Davies, 2002). The most optimistic view states that if
sufficient care is taken in the construction of questions (Farthing & McPhee,
1999; Duke-Williams & King, 2001), item-based testing may successfully
examine the full range of learning outcomes. This can be done using questions
that students cannot answer by relying solely on memory. Good questions
should examine understanding and the ability of students to apply, analyze,
evaluate and create.
46 Yaron Ghilay
CAA is not a new approach; it has been rapidly developing over the last
decades in schools, universities, and other institutions, offering educational
and technical sophistication that includes simulations and multimedia-based
questions which are not feasible in paper-based assessments (Bull &
McKenna, 2004). As the numbers of students are increasing while financial
resources are decreasing, objective tests may offer a way to cut costs.
CAA systems must be tailored so students receive advanced training
before taking part in summative evaluations so as to avoid the danger that
CAA evaluates competence in the use of information technology rather than
the knowledge of the course content.
Possible advantages of CAA are (Bull & McKenna, 2004):
This study reveals that CAA has significant advantages over traditional
assessment, as is shown in Table 6.1 (Ghilay & Ghilay, 2012(:
Table 6.1 shows the advantage of CAA over traditional assessment in all
four areas: test effectiveness (4.55, 4.19, respectively), test experience (4.12,
3.70), test flexibility (4.33, 3.38) and test integrity (4.20, 3.66). The
advantages of CAA over traditional assessment are statistically significant as
indicated by the Paired Samples T-test, .05 . These advantages are:
1) Time and duration: The date of the test can be restricted (or not) to a
specified time window (e.g., between two dates or on a specific day at
scheduled hours). Additionally, the duration can be set so that the
timer starts only from the beginning of the test. Examinees can submit
the test on their own initiative before the end of the time limit, but
automatic submission occurs as soon as time runs out. There is no
way for an examinee to extend the duration of the test by delaying its
delivery. If, for example, the time of the test is set to be between
09:00 and 12:00 on a specified date and the test duration is two hours,
50 Yaron Ghilay
any item can have a weight (the default is 1) for automatic weighting
of the final score. In the case of open-ended questions where manual
evaluation is required, scores can be automatically weighted for final
score calculation.
Lecturers can determine whether and when test scores will be posted
as well as different types of feedback received. Also, the class grade
sheet including a collection of exercises or tests (all or part of them)
can be exported to common data management formats such as Excel
which might be helpful for further processing, reporting or external
storage.
Instructors have the option to review the results of the test of every
student, read all the answers, seeing what was done right and what
was done wrong. So, without any paperwork, full and detailed
documentation of all student responses is possible. Based on these
digital reports alone, it is possible to have a discussion with students
concerning test results.
7) Restricting access to the test/exercise: Lecturers can set advanced
restrictions on access to tests/exercises, for example, access to late-
testing questionnaires for those who have not yet been tested at all.
This may be relevant in situations where some students are retaking
the test while others are just making their first attempt. Without any
human intervention, it is possible to ensure that each group of students
is tested only on a suitable questionnaire, enabling various tests to be
held at the same time.
8) The variety of questions: It is believed that computerized assessment
deals only with multiple-choice questions, but actually this is not true.
Moodle enables more than 30 different types of questions, the most
common of which are:
Multiple-choice: An unlimited number of distractors can be
mixed and numbered in different forms (or not numbered at all).
Numbering is not recommended because it has no advantage and
may disturb test integrity.
Lecturers can decide whether students must select only one
answer or are allowed multiple answers. If there is only one right
answer, wrong answers can get a zero or a partial score. When
required to select multiple answers, each correct answer has to
receive a partial mark so that the total grade adds up to 100%.
Other distractors are scored as zero.
CAA – Computer Assisted Assessment 53
2) Test construction: One or more tests can be built from the question
bank. Construction of tests relies on:
Any wrong parameter can cause a failure in administering the test. For
example, an incorrect date might mean students are not able to start the test or
that time duration may be too short. A similar error might occur in the wrong
determination of the number of permitted answering attempts. In such cases,
CAA – Computer Assisted Assessment 57
students need to be allowed to retake the test. It is desirable that during the
administration of an exam there be technical assistance in case of
malfunctions, problems relating passwords, unsuitable browsers, etc. The
consequences of power failures or involuntary rebooting of the computer
before answers have been saved should be very carefully considered in
advance for in such cases, answers may be lost with all the implications
involved.
In order to avoid such loss, it is recommended that students save their
answers as often as possible. The system automatically saves answers after a
page break (including the transition to the final part of the test). If every
question appears on a separate sheet, there is low probability of fault since data
is saved each time the examinee passes to the next question. Also, students
receive an indication (“Answer saved”) when returning to a page containing an
item that has been already answered. The most problematic situation is when
all test questions are on the same page. In such cases, answers are not saved
until the examinee passes to the final stage (the examinee can jump to the final
page after each question without finishing the test). Before submitting an
exam, it is desirable to go back over the questions including the indicators of
whether questions were saved or have yet to be answered. Sometimes, students
do not answer all the questions owing to lack of attention. It is highly
recommended to remind students to save their work frequently, making sure
that all questions have been answered before submitting a test. Moreover, if
few questions are placed on each page, saving takes place frequently.
Chapter 7
TBAL:
TECHNOLOGY-BASED ACTIVE LEARNING
INTRODUCTION
Students are more likely to access their prior knowledge which is key
to learning
Students are more likely to find personally meaningful solutions to
problems
Students receive more frequent and immediate feedback
Students increase their self-confidence and self-reliance
For most learners, it is more motivating to be active than passive
A task that one has done by himself/herself or as part of a group is
more highly valued
Beatty (2004) claims that since clickers help students actively engage in
the learning process, they encourage more robust, integrated and useful
understandings of concepts and their applicability. Clickers are superior to
some active learning methods such as classroom discussion where only a few
students get the opportunity to answer a question. Even if the answer is
correct, the instructor has no way to gauge if other students know the correct
answer. SRS helps to overcome this quandary. Another benefit of clickers is
that they follow the principles of game-based learning with which students are
well acquainted having grown up playing computer games for entertainment
(Martyn, 2007).
Students in higher education all have smartphones, tablets or laptops.
These devices, when connected to an LMS or other web-based application can
function as more sophisticated clickers than the devices of the previous
generation. They make transforming a regular class into a technology-based
one easy and effective. This is the first step to active learning.
activities in which all students in the class participate. Ghilay & Ghilay
(2015c) recently examined the effectiveness of the model.
1) All course texts are presented on the course website which is divided
into main topics that comprehensively cover the curriculum.
2) Each main theme is divided into subtopics, one of which includes a
few activities. Each activity includes a short text from the course
syllabus and an open-ended question. Such activities are introduced
via tools like Moodle “Chatroom” or the equivalent. In the classroom
all students are able to answer simultaneously while watching answers
that appear on the main screen. Every student in the course may
answer questions via any mobile device.
3) Each activity is hidden until its turn arrives. Students can read the text
and the question either on the main screen in the classroom or on their
personal device. The instructor can show responses on the main
screen in real time, including student names. The lecturer can refer to
answers presented on the main screen by adding his/her own oral
explanations, questions, or relevant assessments. Such pedagogy
TBAL: Technology-Based Active Learning 63
was to investigate whether the model enhances the learning process in face-to-
face courses and if so, what the characteristics of such learning are.
Six factors were examined (n = 67):
Comments:
For each factor, all the items composing it are presented below
(questions in the questionnaire). High reliability was found for each
factor (as indicated in parentheses).
Items were scored on a five-point Likert scale. Factor scores are the
means of the items composing them.
claim that they had multiple opportunities to participate and they were
completely focused and linked to the lessons. Collaboration and teamwork
were significantly improved as well.
Chapter 8
All the items composing each factor (questions that appear in the
questionnaire) are presented. High reliability was found for each
factor (as indicated in parentheses).
The score for each factor is the mean of the items composing it
(presented in Table 8.1).
The findings show that FBL significantly improves the learning process
(4.54). Also the next three factors received high scores: diagnosis: identifying
learning difficulties (4.69), prognosis: handling problems (4.69) and sense of
belonging and motivation (4.51).
Respondents were asked to add verbal comments on the effectiveness of
FBL. The following quotes from students and lecturers confirm the positive
influence of FBL on the learning process:
Students:
“It is very helpful to have feedback to inform the lecturer in real time
what we understand and what is unclear. In such a way, the instructor can
go over difficult issues. FBL improves the whole learning process.”
“In my view, feedback has many advantages because relevant data is
given to the lecturer concerning the extent of students’ understanding.
FBL can be especially appropriate for students who need targeting and
close monitoring to improve their learning.”
Lecturers:
Technology offers a huge range of tools for online learning needs. Here
we focus on the main well-known utilities that offer high-quality reliable
solutions for specific educational needs or use in learning models. The tools
are intended to promote:
QR - 9.1
78 Yaron Ghilay
With regard to online learning, three important tools that are part of
Google Drive are:
File Storage
Google Drive allows the uploading personal files on any computer, but
installing the Google Drive application on the PC and linking it to an account
automatically syncs between the PC and the server. Moreover, if there are
several computers belonging to the same user, the application can be installed
on each and then all computers will be connected to the same account,
permitting automatic synchronization of the drive folder (and subfolders) on
all computers. Different sharing settings for specific files or even folders
(including subdirectories) are possible. For example, a collection of files can
be uploaded to Google Drive (instead of Moodle), and a link posted on the
course’s Moodle website or other sites. This makes just one database
necessary which can be shared with students in different courses or even at
various institutions without the necessity of duplicating files.
Google Docs
Google Forms
QR - 9.2
YouTube allows users to search, view, upload, share and even download
video clips. HD videos can be uploaded without a limit on the length of the
video. After producing a video clip (detailed in Chapter 5), it can be uploaded
to a YouTube account and shared on the course site by:
1) Linking: Clicking on the link takes the user to the specific clip on
YouTube. A regular link to the video can be created by copying the
video’s URL links to various points on the video’s runtime line. This
makes it possible to create a “table of contents” for a long film by
setting up links that bring viewers to different sub-topics. Another
type of link can present the video in full-screen without any reference
to parts of the clip or to other clips.
2) Embedding: Video can be embedded into the course site (or any other
site) and can be activated on the website.
In both alternatives the videos are not on the course website and there is
no need to download them (although that is possible). They are linked to
YouTube directly and operated via video streaming. The advantages of this
method are:
QR – 9.3
site design, etc. The above tasks are usually controlled by a menu system, but
various features can be determined using code language. Each site has a
relatively small volume of 100 MB only. However, this does not pose a real
problem because an unlimited number of websites can be created and linked so
high-volume files from other databases (such as Google Drive) can be
accommodated. As for video clips, it is recommended to create links to
YouTube which has no volume limit.
QR - 9.4
The software has several versions and is distributed free for personal non-
commercial use.
Major releases of this software:
QR - 9.5
2) Quick support:
http://download.teamviewer.com/download/TeamViewerQS_he.exe
A single file given to the learner through a link via the course site for
downloading and operating without installation.
QR - 9.6
Lecturers should use the full version while the simpler version is sufficient
for students.
and incurs a cost). Lessons are scheduled for a specific date and time and all
participants can see who is in the session. The lecturer either gives a
presentation prepared in advance or shows everything that is on his/her screen
with relevant oral explanations. The instructor can also present a live video of
him/herself. Learners can “raise a hand” to ask a question and the instructor
can reply. Learners can signify applause, satisfaction, dissatisfaction, etc. They
are also allowed to communicate with the instructor and among themselves via
text messages. If necessary, a participant may get permission to speak as a
lecturer enabling seminars in which there are several lecturers in remote
places.
Before the beginning of a synchronous meeting, it is important that the
instructor and the learners test their equipment, the software, and microphone.
A synchronous lesson can also be recorded so it can be watched
asynchronously (of course, without active participation).
TeamViewer-Meeting is a similar single file application which the learner
can download at:
http://download.teamviewer.com/download/TeamViewerQJ_he.exe.
QR - 9.7
The advantage of a portable hard drive is that the current price of a two-
terabyte disk that does not require an electrical outlet is relatively low. It has
large volume and high reliability. Degradation of the portable disk is largely
eliminated due to the fact that it is rarely used, only during the backup
operation. For this reason, the chance of it being exposed to net attacks is also
minimized. The most basic requirement is a daily backup of files that have
been changed/added (backing up the entire content of the computer is
unnecessary). There are tools which automatically do this. One of the
recommended free tools is FreeFileSync which can be found at:
http://www.freefilesync.org.
QR - 9.8
The software quickly and reliably compares the two drives and copies
only new files or those that have changed. Various parameters can be set such
as the method of comparison (time, file size, file content), the method of
synchronization (two-way, mirror, upgrade) and the folders that should be
synced. A tutorial is found at: http://goo.gl/TDKQ1t.
86 Yaron Ghilay
QR - 9.9
Backup to Server
QR - 9.10
QR - 9.11
Online learning has roots in the tradition of distance education going back
at least 100 years to the early correspondence courses. With the advent of the
Internet and the World Wide Web, the potential to reach learners around the
world has increased exponentially. Today’s online learning offers rich
educational resources in multiple media and has the capability to support both
real-time and asynchronous communication between instructors and learners
as well as among students themselves. Institutions of higher education and
corporate training have been quick to adopt online learning (Means et al.,
2010).
Online learning has become popular because of its potential to provide
flexible access to content and instruction at any time and from any place with a
focus on:
Objective
Learning Experience
The type of learning experience depends upon who (or what) determines
the way learners acquire knowledge and can be classified according to the
amount of control students have over the content and nature of the learning
activity. In traditional didactic or expository learning, they have none. Content
is transmitted in a lecture, written material, or other mechanisms. Such
Online Learning – A Full Substitute for Face to Face Learning 89
Communication Type
students attitudes toward the model during 2011-12, 2012-13 (Ghilay &
Ghilay, 2013). The research was carried out in three courses:
For each factor, all the items composing it are presented (questions
that appeared in the questionnaire). High reliability was found
(Cronbach's alpha) as indicated in parentheses.
Factor scores were the means of the items composing them.
1) Inputs:
Hypertext: Hypertext is helpful for learning.
Lectures/texts (Alpha = 0.818):
Listening to the lecture recordings helps in learning
I listened to the professor's recordings
Lecturer's assistance (Alpha = 0.569):
Getting assistance from the lecturer is possible
I got help from the lecturer during the course
Exercises (Alpha = 0.682):
Optional exercises are helpful
Mandatory exercises are useful
The required activities reflected my knowledge
2) Learning process:
Learning Effectiveness (Alpha = 0.932):
I could understand the material well
The texts in the course website are clear and understandable
94 Yaron Ghilay
1) Inputs: Students rate all OTLA inputs with high scores. The
contribution of the exercises (4.36 out of 5), hypertext (4.29), lecturer
assistance (4.26) and lectures/text reading (3.97) is substantial.
2) The learning process: Flexibility and convenience of learning is rated
as very effective (4.26). The learning process is considered to be
effective as well (3.89).
3) Time characteristics: Time pressure is moderate (3.2) and students
invest much time in learning (3.88) which should be considered
positively.
Students who participated in the study attended one of the two distance
learning courses as well as the face-to-face course given during 2014-15 and
2015-16. They were asked to answer an online questionnaire giving their
impressions of both modes of learning upon completion of the courses. The
questionnaire which included 28 items evaluated on a five-point Likert scale
and an open-ended question that focused on the preferred way of learning with
an explanation of students’ reasoning was administered twice, once for OTLA
and once for TBAL.
The following five factors were examined:
Comments:
For each factor, all the items composing it are presented (questions
that appeared in the questionnaire). High reliability (Cronbach's
alpha) was found for each factor (consisting of two items or more)
indicated in parentheses, for Part A – online distance learning (the
value on the left side) and Part B – active learning in a classroom (the
value on the right side).
Factors’ scores were calculated based on the means of the items
composing them.
Outcome:
Possible reasons:
Table 10.4 presents the mean scores mentioned above for distance
learning (OTLA) and classroom learning (TBAL).
Online Learning – A Full Substitute for Face to Face Learning 101
The study reveals that all factors received high scores and there was no
significant difference between distance learning and classroom learning
(Paired Samples T-test), as shown in Table 10.4. This means that since quality
of learning received high scores in both formats (4.18, 4.27 respectively), both
learning methods are considered to be effective. This may be explained by
students' high concentration (3.97, 4.19), effectiveness of the lectures (4.50,
4.53), quality of the learning experience (4.29, 4.27) and the effectiveness of
the course website (4.57, 4.54).
Respondents were asked to add verbal comments concerning their
preferred way of learning. Below are some samples:
“I felt that distance learning is dependent upon the lecturer. There are
instructors whom I cannot understand without repeating the material.
There are others with whom it is pleasant to learn. However, I felt that
distance learning is easier for me than learning in the classroom.”
“I think that in the 21st century, distance learning substantially
connects to millennials. Technological systems and rapid access via
mobile phone or landline enable students to learn quickly and thoroughly.
It is different and unique, and I find this method superior to the
classroom. Furthermore, the lecturer is courteous, professional, listens
and helps remotely at any time. I had a lot of fun.”
“I prefer learning in the classroom, although I certainly love the
distance learning courses. The significant advantage of distance learning
is that we can hear the text and then listen to the lectures. The lectures are
recorded in the best way and sometimes I feel like I am in the classroom.
The lecturer highlights the important points in the recording and explains
everything very well. I enjoyed learning in the distance learning courses.”
COMPREHENSIVE TECHNOLOGY-BASED
LEARNING (CTBL)
Comments:
The findings show that CTBL model significantly improves the learning
experience in a quantitative course (4.59). Possible explanations for this may
be: Flexibility, comprehensiveness (the variety and coverage of material), the
ability to overcome knowledge gaps, and the excellence of the learning
experience, 4.65, 4.59, 4.58, 4.51, respectively.
The learners’ verbal comments on the model show that comprehensive
learning has a significant positive impact:
“I appreciate the lecturer who has invested much time preparing the
training tools and is very interested in how we progressed in the course.
Investment in videos helps us to learn a lot of the material and to prepare
better for the test.”
“There is no doubt that the material is comprehensive and is well
grounded in Howard Gardner’s theory of multiple intelligences. This
makes a significant contribution to learning. For me it was also very
helpful to enter the course website anytime and learn.”
“It was very enjoyable and useful for the learning process.”
110 Yaron Ghilay
SUMMARY: COMPREHENSIVE
TECHNOLOGY-BASED LEARNING
A common phenomenon in quantitative courses at institutions of higher
education is the difficulty in absorbing new material due to lack of a strong
base. Because of the hierarchic nature of the knowledge, breaks in
understanding impair comprehension and integration of new information.
Differentiated instruction overcomes the formation of these gaps, effectively
meeting various student needs and learning styles. The Comprehensive
learning model is based on:
courses and learn the new technologies required to maintain them cause
faculty frustration.
The Curriculum
QR - 12.1
QR - 12.2
Learning Methodologies
1) Face-to-face lectures: The first nine topics in TMOC are practical and
require much practice. Therefore, all these lessons should be based
both on demonstrations and exercises (course restricted to a maximum
of 25 learners). The rate of presentation of material should match
student progress; learners have to practice each sub-topic at least on a
basic level after its presentation. The practice stage requires both a
lecturer and a tutor.
2) Booklets: Each topic/subtopic in a lecture needs to be accompanied by
a comprehensive text as it is essential to enable learners to repeat,
deepen or complete lessons they did not attend or did not fully absorb
during face-to-face meetings.
Training for Management of Online Courses 117
For each item, respondents were requested to give their opinion (on a five-
point Likert scale) on the item’s contribution/effectiveness. The questionnaire
included two open-ended questions so students could elaborate both on the
contribution of the course contents and the related learning methodologies.
All items regarding the ten components of the curriculum are presented
separately except for four items relating to video clips that were combined into
one factor: videos. This factor's reliability (Cronbach’s alpha) was found to be
high (first year: 0.904, second year: 0.756). The score of the video factor was
determined by calculating the mean value of the four items composing it.
Table 12.1 introduces all the items on the questionnaire relating to
curriculum:
Instructional booklets
Discussion of pedagogical implications of ICT tools and applications
Instructional video clips
Personalized instruction
Lectures
Final project
Home practice
Classroom practice
As shown in Table 12.3, at the end of the second year lecturers give CAA
(Computer Assisted Assessment) the highest score (4.69). There is a
significant difference in this item’s score and all the others (with the exception
of lecture recording and principles of full distance online courses). All the
other items received high scores as well: recording and editing a lecture (4.11),
principles of full distance online courses (4.11), video (4.10), LMS (4.06),
PDF files (3.89), website building (3.88), synchronous online learning (3.82),
screen capture (3.81) and control of a remote computer (3.76). There was no
significant difference among these nine items.
The findings indicate that lecturers in the TMOC course evaluated the
contents of the curriculum as having made a big contribution to their ability to
manage online courses.
At the end of each year, learners were asked about learning methodologies
for delivering the curriculum. There were no significant differences between
the two years (t-test, 0.05 ) except with regard to:
Training for Management of Online Courses 121
1) Booklets: The score at the end of the first year, 3.79 increased to 4.65
at the end of the second year (𝑇(15) = 2.236, 𝑝 = .041).
2) Final project: The score at the end of the first year, 3.33 increased to
4.00 at the end of the second year, 𝑇(15) = 2.551, 𝑝 = .022).
This indicates that most learning methodologies got high scores during
both years. Regarding the two above mentioned learning methodologies, lower
scores in the first year picked up significantly at the end of the second year.
Table 12.4 presents the mean scores of both years and the t-test showing the
significance of differences between the two years.
Table 12.4. Evaluation of the learning methodologies in year one and two
As can be seen in Table 12.4, lecturers give all the learning methodologies
high or very high scores at the end of the course. Booklets (4.65), videos
(4.59), discussion of pedagogic implications (4.56), personalized instruction
(4.35) and lectures (4.17) receive very high scores. The final project (4.00),
home practice (3.88) and classroom practice (3.78) are rated with high scores.
There is no significant difference in the ratings of Booklets, Videos,
Discussions of pedagogic implications, Personalized instruction, and Lectures
(second year). However, significant differences in the ratings of Booklets-
122 Yaron Ghilay
“The combination of ICT tools and pedagogy was very helpful for
me. It significantly improved my ability to manage an online course
effectively.”
“The Moodle lessons were systematic and relevant to my basic need
to manage online courses.”
“The lessons dealing with website building by Google Sites had high
value for me. It is a fantastic complement to Moodle because it is
absolutely personal.”
“The tools selected in the curriculum reflect real needs we all have in
the college. Therefore, the learning process was meaningful.”
“CAA was crucial for me. If possible, I would be delighted to go into
this topic even more intensively.”
The lecturers’ quotes stress the importance of the contents of the TMOC
model, especially the necessary linkage between tools and pedagogy.
Instruction in LMS, website building and CAA all reflect the real needs of
academics. The lecturer quotes relating to learning methodologies emphasize
Training for Management of Online Courses 123
the power of comprehensive texts and video clips combined with tutor
dedication and accessibility.
Learning experience
Flexibility
Monitoring and evaluation
Communication
Learning Experience
Instead of bored students counting the minutes to the end of the lesson,
appropriately integrated technology opens up new worlds of experience,
interest, activity, and enjoyment. Engaged learners have improved motivation
and this is reflected in the quality of learning.
126 Yaron Ghilay
Flexibility
Communication
Allen, I. E., & Seaman, J. (2008). Staying the Course: Online Education in the
United States. Needham MA: Sloan Center for Online Education.
Beatty, I. (2004). Transforming student learning with classroom
communication systems. EDUCAUSE Centre for Applied Research,
Research Bulletin, 3, 5.
Bennett R. E. (2002). Inexorable and inevitable: the continuing story of
technology and assessment. Journal of Technology, Learning and
Assessment, 1, 100-108.
Bernard, R. M., Abrami, P. C., Lou, Y., Borokhovski, E., Wade, A., Wozney,
L., Wallet, P.A., Fiset, M. & Huang, B. (2004). How does distance
education compare with classroom instruction? A meta-analysis of the
empirical literature. Review of Educational Research 74 (3), 379–439.
http://dx.doi.org/10.3102/00346543074003379.
Black, P., & Wiliam, D. (1998). Assessment and classroom learning.
Assessment in Education: Principles, Policy & Practice, 5(1), 7-74.
http://dx.doi.org/10.1080/0969595980050102.
Bonwell, C., & Eison, J. (1991). Active learning: Creating excitement in the
classroom. ASHE-ERIC Higher Education Report No. 1, Washington,
D.C.: The George Washington University, School of Education and
Human Development.
Boyer, E. (1990). Scholarship reconsidered. New York: The Carnegie
foundation for the Advancement of Teaching.
Brogden, L.M., & Couros, A. (2002). Contemplating the virtual campus:
Pedagogical and administrative considerations. The Delta Kappa Gamma
Bulletin, 68(3), 22-30.
130 Yaron Ghilay
class size, 61
A classes, 75
classroom, 3, 11, 33, 35, 39, 60, 61, 62, 64,
academic administrative system (AAS), v,
71, 91, 97, 98, 99, 100, 101, 102, 106,
ix, 7, 15, 16
110, 117, 121, 122, 129, 132, 133, 134
academic learning, 5
coding, 35, 134
access, 6, 7, 11, 17, 19, 34, 39, 52, 60, 86,
cognitive load, 136
87, 102, 123
cognitive processing, 35
administrative efficiency, 46
cognitive tool, 35, 133
administrators, 135
collaboration, 62, 66
age, 14, 19
colleges, 9, 36, 96, 118
ANOVA, 74, 75, 106
commercial, 83, 84
ARS, 61
communication, 5, 7, 8, 11, 13, 69, 106,
assessment, ix, 45, 46, 47, 48, 49, 50, 52,
109, 127, 129
56, 63, 70, 102, 113, 116, 117, 128, 129,
communication systems, 129
130, 131, 132, 135, 136
comprehension, 110
assessment tools, 45
comprehensive technology-based learning
asynchronous communication, 87, 89
(CTBL), vi, ix, 2, 3, 105, 106, 109, 110,
asynchronous learning, ix, 1, 89, 132
126
computer, ix, 19, 20, 21, 22, 33, 34, 36, 37,
B 39, 47, 49, 50, 57, 61, 73, 78, 79, 82, 84,
85, 91, 103, 105, 113, 115, 119, 120,
banks, 7, 8, 49 128, 130
blogs, 113, 119 computer assisted assessment, ix
browser, 14, 23 computer technology, 105
computer use, 84
computerized assisted assessment (CAA),
C vi, ix, 2, 3, 45, 46, 48, 49, 92, 113, 118,
119, 120, 122, 127, 128, 130, 131, 136
CAD, 35 computing, 34, 49
class period, 61 construction, 45, 55
142 Index
D face-to-face interaction, 88
face-to-face learning, ix, 1, 2, 3, 11, 12, 13,
data processing, 71 94, 97, 98, 99, 101, 116
database, 17, 23, 42, 51, 56, 78, 114 facilitators, 89
decision makers, 1 factor analysis, 36, 106
decoding, 24 faculty development, 134
deep learning, 88 feedback-based learning (FBL), vi, ix, 1, 3,
Delta, 129 69, 70, 73, 75, 76, 79, 106, 110, 131
demonstrations, 34, 116 financial, 42, 46
Department of Education, 134 financial resources, 46
dissatisfaction, 70, 84 flexibility, 27, 38, 46, 47, 48, 49, 51, 64, 94,
distance education, 87, 129, 137 96, 102, 126
distance learning, 5, 11, 12, 13, 82, 89, 90, freedom, 51, 126
97, 98, 99, 100, 101, 102, 111, 116, 128,
131
diversification, 1 G
Google, vi, 23, 25, 71, 77, 78, 79, 80, 81,
E 86, 115, 119, 122
grades, 8, 35, 51, 98
education, 1, 45, 60, 69, 112, 117, 126, 130, grants, 126
131, 132, 133, 135, 136 group membership, 6, 7, 8
educational institutions, 5
educational objective, 49
educational system, 5 H
educators, ix, 2, 27, 28, 34, 60, 69
handheld devices, 34
e-learning, 28
higher education, ix, 1, 4, 5, 10, 59, 60, 61,
electricity, 98
69, 70, 75, 76, 87, 90, 102, 110, 111,
employability, 133
112, 115, 122, 123, 130, 131, 133, 134,
encoding, 24, 59
135, 136
encouragement, 60
hypertext, v, ix, 3, 5, 19, 23, 90, 92, 93, 95,
engineering, 131
96
entrepreneurship, 12
Index 143
light, 69, 94
I Likert scale, 11, 20, 29, 36, 37, 46, 64, 72,
73, 93, 99, 106, 118
ideal, 34, 39
logging, 51
improvements, 9, 76
love, 97, 102
in transition, 66
individuals, 3
information and communications M
technology (ICT), v, ix, 3, 17, 45, 102,
119, 122 management, ix, 1, 3, 4, 5, 9, 12, 20, 42, 51,
information technology, 46 52, 72, 84, 93, 112, 113, 118, 119, 128,
infrastructure, 10, 39, 127 131
institutions, 1, 45, 46, 70, 76, 78, 102, 110, manipulation, 89
111, 112, 123, 126, 134 materials, 13
instructional design, 34 mathematics, 105
instructional materials, 111, 112 media, 87
integration, ix, 17, 105, 110 medical, 131
interface, 6, 7, 14, 40 memory, 45
intervention, 3, 50, 52, 72, 76 mentoring, 132
investment, 13, 39, 94, 95, 96, 105, 110, messages, 5, 9, 17, 81, 84, 92
128 meta-analysis, 70, 129
IP address, 8, 50 methodology, 22, 59
Israel, 46, 63, 71, 92, 106, 139 Microsoft, 20, 22, 28, 39, 86, 113, 114, 116
issues, 8, 51, 56, 59, 71, 74, 75, 76, 92, 105, Microsoft Word, 28
106, 107, 108, 117 mobile device, 9, 19, 24, 62, 79, 114, 126
item bank, 14 mobile phone, 13, 102
models, ix, 1, 2, 77, 87, 123, 125, 130, 132,
136
L modules, 35
moodle, v, vi, 5, 6, 7, 9, 10, 11, 12, 13, 14,
laptop, 11, 62, 64, 126
15, 16, 49, 50, 52, 55, 62, 63, 78, 90, 91,
leadership, 93, 133
92, 113, 115, 122, 128
learning activity, 88
motivation, 64, 74, 75, 108, 125, 134
learning difficulties, 73, 75
multimedia, 33, 35, 46, 70, 135
learning disabilities, 8, 27, 51
multiple-choice questions, 45, 51, 52, 53
learning environment, 60, 62, 69, 76
learning management system (LMS), v, ix,
2, 5, 6, 7, 8, 9, 10, 12, 13, 15, 17, 20, 31, N
39, 42, 61, 62, 80, 90, 91, 92, 113, 115,
119, 120, 122, 127 New Zealand, 136
learning outcomes, 45, 88, 130 nursing, 34, 133, 135
learning process, ix, 2, 3, 6, 10, 11, 12, 13,
14, 33, 38, 60, 61, 62, 64, 65, 66, 73, 75,
76, 92, 94, 95, 96, 100, 105, 106, 109, O
122, 125, 127, 128
learning styles, 35, 97, 110, 112, 117, 126 objective tests, 46
objectivity, 46
144 Index
online courses, ix, 1, 2, 3, 4, 9, 10, 14, 20, reliability, 12, 36, 64, 73, 85, 93, 99, 106,
29, 36, 39, 73, 94, 97, 111, 112, 113, 107, 118
115, 116, 118, 119, 120, 122, 123, 126, remote control, ix, 3, 77, 82, 84, 92, 106,
131 115, 119
online learning, ix, 1, 3, 10, 19, 21, 27, 33, replication, 65, 94, 119
34, 35, 77, 78, 84, 87, 88, 89, 92, 94, 96, reproduction, 49
112, 115, 119, 120, 125, 126, 127, 128, resources, 2, 3, 5, 6, 7, 8, 11, 12, 14, 17, 23,
132, 133 35, 87, 126, 127
operating system, 19 restrictions, 8, 51, 52, 56, 102
operations, 21, 31, 82 routines, 73
opportunities, 47, 48, 59, 62, 65, 66, 67,
112, 127
overlap, 51 S
savings, 27, 98
P school, 35, 46
science, 131, 132
password, 6, 49, 51, 78, 82 screen capture, 3, 22, 34, 35, 116, 120, 136
pedagogy, 62, 112, 122 self-confidence, 60
personal choice, 64 seminars, 84
personal learning, 107, 126 servers, 81, 86
platform, 3, 5, 19, 50 simulation, 35, 46, 89
post-compulsory education, 135 SMS, 9, 24
principles, 1, 3, 35, 60, 61, 73, 120, 123, software, 19, 20, 21, 27, 29, 30, 34, 36, 39,
128, 130 40, 73, 79, 82, 83, 84, 85, 90, 106, 108,
prior knowledge, 60 114, 115, 117
professional development, 112, 130, 132 speech, 27, 28
programming languages, 34 spreadsheets, 21, 79
psychology, 135 SPSS software, 19
staff members, 9, 10, 14
standard deviation, 36, 119
Q Statistical Package for the Social Sciences,
19
quality assurance, 45
statistical processing, 79
quality control, 42, 56
statistics, 36, 73, 106
quantitative research, 122
storage, 9, 42, 52, 59, 78, 86
query, 66
strategic management, 12
questionnaire, 10, 11, 12, 36, 51, 52, 64, 71,
stress, 122
72, 73, 76, 79, 93, 99, 106, 107, 118, 119
structure, 2
student achievement, 88, 98, 125
R student attitudes, 63
synchronization, 7, 15, 16, 17, 78, 85
reading, 19, 23, 27, 29, 39, 90, 95, 96, 100, synchronous learning, ix, 89, 115, 119
101, 114
real time, 33, 38, 61, 62, 65, 71, 75, 102
Index 145
T U