Course Manual Business Research Methods
Course Manual Business Research Methods
Alfred Hitchcock: “The three most vital elements in any good film are
the script, the script, the script.”
1
Table of Contents
1 Symbols ................................................................................................................................................. 4
2 Introduction ........................................................................................................................................... 5
2.1 Why scientific research matters .................................................................................................... 7
2.2 Scope of the training: learning outcomes ..................................................................................... 8
2.3 Assignment: review examples of business research ..................................................................... 8
2.4 Optional background information ................................................................................................. 9
2.4.1 Neuroscience: Why good managers make bad decisions ..................................................... 9
3 Research design ................................................................................................................................... 10
3.1 Philosophical introduction .......................................................................................................... 10
3.1.1 Scientific method ................................................................................................................. 10
3.2 Post-assessment .......................................................................................................................... 11
3.2.1 What type of researcher are you?....................................................................................... 11
3.3 The research template (the Turtle!) ............................................................................................ 12
3.4 How to start your own empirical research project ..................................................................... 12
3.5 Literature review ......................................................................................................................... 15
3.6 Unit of analysis vs unit of observation ........................................................................................ 16
3.7 Measurement scales and variables ............................................................................................. 16
3.7.1 Likert scales ......................................................................................................................... 17
3.8 Validity and reliability .................................................................................................................. 19
3.9 Triangulation and mixed methods .............................................................................................. 21
3.10 Design Science ............................................................................................................................. 22
3.11 Ethics in business research .......................................................................................................... 23
3.11.1 Optional background reading .............................................................................................. 23
3.11.2 Optional useful material ...................................................................................................... 24
3.12 Optional background information ............................................................................................... 24
3.12.1 Evidence-based management ............................................................................................. 24
4 Data collection ..................................................................................................................................... 26
4.1 Theory on data collection ............................................................................................................ 26
4.2 Quantitative data collection ........................................................................................................ 26
4.2.1 Qualtrics research suite ....................................................................................................... 27
4.2.2 Designing a survey ............................................................................................................... 27
2
4.2.3 Post-assessment: Review this survey .................................................................................. 27
4.2.4 Optional assignment: create your own survey in Qualtrics ................................................ 28
4.2.5 Background: The McNamara Fallacy ................................................................................... 28
4.3 Qualitative data collection .......................................................................................................... 29
4.3.1 Performing an interview ...................................................................................................... 29
4.3.2 Interviewing in qualitative research .................................................................................... 29
4.3.3 Focus group research .......................................................................................................... 29
4.3.4 Optional assignment: Apply theory on a project ................................................................ 30
4.4 Other types of data collection ..................................................................................................... 30
4.5 Sampling ...................................................................................................................................... 30
4.6 Optional background information ............................................................................................... 32
4.6.1 Big data & business intelligence .......................................................................................... 32
5 Data analysis ........................................................................................................................................ 34
5.1 Qualitative ................................................................................................................................... 34
5.1.1 Software packages............................................................................................................... 34
5.2 Quantitative................................................................................................................................. 34
5.3 Significance testing ...................................................................................................................... 37
5.4 Correlation vs causation .............................................................................................................. 37
6 Reporting ............................................................................................................................................. 40
6.1 Academic writing ......................................................................................................................... 40
6.1.1 Writing styles ....................................................................................................................... 40
6.2 Reporting at the Faculty of Business and Economics .................................................................. 42
6.3 Presentation style: the pecha kucha ........................................................................................... 42
6.4 Optional: The deluge of science .................................................................................................. 44
6.5 Optional background information ............................................................................................... 45
6.5.1 Data visualization ................................................................................................................ 45
6.5.2 Writing a press release ........................................................................................................ 45
6.6 Conclusion ................................................................................................................................... 46
7 Attachment: Turtle Template .............................................................................................................. 47
3
1 Symbols
Optional readings
optional
optional
Optional assignments
Read this chapter from the package ‘Research and Writing Skills’
RWS via Blackboard > Courses > ECLIPS - FBE Learning Channel > Research methods and tools >
Research and Writing Skills
4
2 Introduction
Welcome to the course on Business Research Methods! As Alfred Hitchcock reflects on the art of making
a good film in the quote above, this course will make a reflection on the vital elements that are concerned
with making a good research. The study of research methods will provide you with the knowledge and
skills you need to solve the problems and meet the challenges of a fast-paced decision-making
environment. Business research may be defined as a systematic inquiry for which the objective is to
provide the correct information that will allow managerial decisions to be taken. Business research courses
recognize that students preparing to manage business, not-for-profit and public organizations – in all
functional areas – need training in a disciplined process that will enable them to investigate and solve a
research or management dilemma (i.e. any problem or opportunity that requires a management decision).
Three factors have stimulated an interest in this scientific approach to decision-making:
1. the need for more and better information as decisions become more complex
2. the availability of improved techniques and tools to meet this need
3. an information overload that is difficult to interpret as a result of incorrect and uninformed research analysis.
The past two decades have seen significant changes in the business environment. Emerging from what
historically can be labelled as an economic role, the business organization has evolved in response to the
social and political mandates of national public policy, explosive technology growth, cultural changes and
continuing innovations in global communications. These changes have created new knowledge needs for
the manager and new publics that should be considered when evaluating any decision. Other knowledge
demands have arisen as a result of problems with mergers, trade policies, protected markets, technology
transfers and macroeconomic savings–investment issues. The current trend towards complexity has
increased the risks associated with making business decisions, meaning that it is more important than ever
to have a sound information base. Likewise, the complexity of the phenomena that scientists are
investigating impedes our understanding of what is really happening. Rather than concluding that ‘all
depends on almost everything’ we must strive for meaningful explanations. Below is a list of factors that
characterize the complex business decision-making environment; each factor requires that managers and
scientists have more and better information on which to base their decisions.
5
To succeed in such an environment, we need to know how to identify high-quality information and how
to recognize the solid, reliable research on which high-risk decisions can be based.1
Overview
The course is organized in five modules and follows a blended learning approach. This means that students
learn through a combination of online delivery of content and instruction – in which students maintain
control over time, place, path or pace of study – and face-to-face classroom sessions2. In-class methods
will be combined with computer-mediated activities such as watching online videos and reviewing
resource websites to deliver a series of impetus that combined form the course content.
In the text, additional links to a Blackboard self-study package ‘Research and Writing Skills’ are made for
students enrolled at the Faculty of Business and Economics at the University of Antwerp.
Course content
The course is structured through five instalments. Each instalment will refer to a different type of bias that
a scientific research aims to diminish. Bias in research is anything that produces systematic (but
unexpected) variation in a research finding. Research bias occurs when errors in a research design or
execution lead to selecting or encouraging one outcome or answer over others. Bias can occur at any phase
of research, including study design, data collection, as well as in the process of data analysis and reporting
and publication. Methodology in essence is the process of minimalizing this potential for biases, even
though a situation where bias = 0 is impossible in the research of social sciences (such as business
research). We must therefore be aware and accepting of the fact that a certain level of bias (and thus
errors in research) will always be present in any research.
Each instalment will have its own interactive sequences of videos and other reference material, arranged
in a logical progression. Instructions for each instalment will be posted on Blackboard. Please take the time
to watch each suggested video and the provided readings in detail. Additionally, optional background
material will at times be provided that give you supplementary insights into related topics at your
discretion.
Instalment 1 Introduction to Business Research Methods. Participants will learn about the importance of
studying research methods in business settings, and what are current trends in this field.
Instalment 2 Research Design. Participants will learn how to design a research study, will learn more about their
personal research preferences and will start their assignment.
Instalment 3 Data Collection. Different formats and methods in data collection will be the focus of the third
instalment. Participants will get hands-on experience in survey design and performing research
interviews, after which they will apply this directly to their group assignment.
Instalment 4 Data Analysis. Participants will learn how to perform sound analysis of both qualitative and
quantitative data.
Instalment 5 Reporting. The fifth instalment will focus on reporting of research. In particular, (academic) writing
styles and performing will be covered. For academic writing, Dutch-speaking participants are able to
contact Monitoraat op Maat of the University of Antwerp to improve their academic Dutch. For
academic English, participants can contact Linguapolis.
1
Excerpt from: Blumberg, B., Cooper, D., & Schindler, P. (2014). Business Research Methods (4th Revised edition.).
McGraw-Hill Higher Education.
2
The face-to-face classroom sessions are not applicable to students who merely use this document as background
information on how to make a good paper/thesis. For them, this course is 100% e-learning.
6
2.1 Why scientific research matters
Read the following article by Duncan Watts, principal researcher at Microsoft Research, in the MIT
Technology Review of 22nd January 2014 ‘Scientific Thinking in Business’. The article gives an insight into
the growing necessity of the ‘scientific method’ in business.
http://www.technologyreview.com/news/523661/scientific-thinking-in-business/
Watch the following video which gives a general overview on the topic of research, and how to perform
a research study.
https://www.youtube.com/watch?v=Og4BGyZr_Nk
As an introduction text to this course, please read the following article published by The Wharton School of
the University of Pennsylvania on the use and misuse of statistics. It gives many interesting examples in
which research results are not all that they appear to be.
The Use and Misuse of Statistics: How and Why Numbers Are So Easily Manipulated.
http://knowledge.wharton.upenn.edu/article/the-use-and-misuse-of-statistics-how-and-why-
numbers-are-so-easily-manipulated/
As organizations and individuals try to make sense of an increasingly large and complex barrage of
information, the skills required to judge the validity and reliability of results are increasing. “Today,
consumers of information are drowning in data,” says Justin Wolfers, Wharton professor of business and
public policy. “Terabytes of data are being generated from the constant measurement of businesses,
workers, government and other activity, and there are many ways to draw inferences from the raw data.
Unfortunately, many of them lead in the wrong direction.”
7
Background: placing everything in perspective
Even though it might seem like it, doing research is often not an exact science. The interpretation and
application of the findings to particular circumstances will always be an important part of the exercise, in
which the researchers need to be able to place the scope, ‘truthfulness’, and limitations of the findings in
perspective. The film “What the bleep do we know!?” gives an interesting viewpoint on the fact that even
though we seem to know and understand a lot, we are still missing an awful lot and instead of observing
everything without bias, we create our own reality.
Always be critical towards scientific research and the communication about it:
https://www.youtube.com/watch?v=0Rnq1NpHdmw
Analyst You have insight into the formal requirements of a scientific text.
You are able to distinguish diverse ethical aspects of research.
Coordinator You are able, based on a given problem, to define a problem statement, to formulate
research questions and to design a research plan.
You are able, based on a problem statement, to indicate which qualitative and/or
quantitative research methods are most appropriate.
You are able to track, critically select, manage and process scientific sources in
references and a bibliography.
Communicator You are able to write a text which is compliant with the rules for academic Dutch or
English (academic style and right language).
8
2.4 Optional background information
Throughout the course, we will provide optional (non-mandatory) background material. This optional
material represents thought-provoking recent trends in business research. As the use of and the
philosophy on business research evolves constantly, new ideas and practices emerge that are interesting
to review. The first topic that is presented in this section is the neuroscience of decision-making. Below are
several sources that elaborate on this topic that you can review as background material (optional).
Harvard Business Review: Campbell 2009 - Why good leaders make bad decisions.pdf
(available on Blackboard)
Additionally, the following TED talk by behavioural economist Dan Ariely, the author of Predictably
Irrational, uses classic visual illusions and his own counterintuitive (and sometimes shocking) research
findings to show how we are not as rational as we think when we make decisions.
TED talk: Dan Ariely: Are we in control of our own decisions? (17 min)
http://www.ted.com/talks/dan_ariely_asks_are_we_in_control_of_our_own_decisions
9
3 Research design
In an abductive logic, researchers try to find the simplest and most likely explanation of the observations.
Abduction begins with and is sustained by doubt. An abductive inference to the best explanation also
includes inferring A as an explanation of B, whereas there can be multiple possible explanations for B.
Please read this webpage in order to understand the differences between inductive and deductive
reasoning. These two forms of logic (a) make general statements about incidences from the data that we
collect (induction) and (b) use those general statements to predict future incidences (deduction). At the
end of this reading, you should be able to define induction and deduction and to describe the differences
between them.
For a more in-depth explanation of both types of reasoning, please watch the following video.
10
Paradigms and research methods
Different philosophical paradigms exist in the debate on business research. These paradigms form
different ways in which we understand social reality and the nature of knowledge. The two main paradigms
are interpretivism and positivism. Positivists are concerned that social science is performed in a scientific
manner and should therefore analyse social facts. Interpretivists on the other hand are looking for
meanings and motives behind people's actions such as behaviour or interaction with others.
The following websites give a more thorough insight on the difference between the two different
paradigms:
In science (and society) there is a continuous debate on how to proceed with creating knowledge. In
fundamental research, the scope is to create new knowledge or insights, divided in disciplines with specific
theories and methods (e.g. marketing, strategy, logistics). In applied research the scope is more to develop
insights there are useful and applicable in everyday (management) settings, regardless of their
contribution to science. For long, research at graduate level was considered to be applied research, and
PhD-research to be fundamental research. Nowadays, a PhD research can be phenomenon or industry
based. Industry-based research refers to applying inductive or deductive (or abductive) reasoning to shed
light on an industry (e.g. banking industry, aviation industry, or e-commerce). Phenomenon-based
research focuses on identifying and reporting on new or recent phenomena of interest and relevance to
management and organization science (von Krogh et al., 2012). Rigorous phenomenon-based research
tackles problems that are relevant to management practice and fall outside the scope of existing theories.
It usually bridges epistemological and disciplinary divides to unite scholars around a phenomenon.
Examples of phenomenon-based research are (the rise and shine of) transnational corporations, the
environmental impact of firm-level conduct, and the rapid diffusion of social networking.
3.2 Post-assessment
3.2.1 What type of researcher are you?
Most of us have our own unique style of inquiry. Some styles embody the traditional norms of science
while others exemplify non-traditional norms. There is no one right or wrong way to investigate a problem
per se, but if you have a very strong research style, you might find it frustrating to work on a project that
is designed for a different type of researcher. Regardless of its intent, you should find a project that you
are passionate (or extremely interested) about working diligently on.
11
It is important to keep in mind that in doing research there is room for the daring, speculative, inventive
spirit who creates new theories or tries bold, imaginative experiments, as well as for the cautious, critical
spirit who examines theories searchingly or for those who will patiently design experiments requiring
complete attention to detail. There are researchers who prefer the precision of mathematics and those
who prefer the colour of words, those who prefer to deal with human beings and human problems and
others who prefer to work with computers or microscopes. However, according to Goldstein and Goldstein
in their book How We Know (1985), “for all there should be the same goal—the joy and excitement of
discovery and the same outcome—knowledge.”
Individual assignment
optional
1. Following this link (https://uamangementschool.eu.qualtrics.com/SE/?SID=SV_5nGFetZBrj0VbNj) you
will find a short test that give an indication of what type of researcher you are. This is based on a
typology of major ways in which people make inquiries, adapted from Mitroff and Kilmann’s
Methodological Approaches to Social Science (1978).
2. Write down your scores on each of the researcher types.
3. Review Researcher types explanation.pdf (on Blackboard) to learn more about each of the
researcher types.
1. Research philosophy
2. Body of knowledge
3. Problem statement and research question
4. Conceptual model
5. Operationalization
6. Research design & methods
7. Ethics
First, you will need a topic or research question. Please watch the following video about how to develop a
good research topic.
12
How to develop a good research topic (4 min):
https://www.youtube.com/watch?v=nXNztCLYgxc
For a paper or thesis, you will probably be asked to design a research proposal including a problem
statement and research question. The research proposal can serve many useful functions. The most
important is that it helps you to think out the research project you are about to undertake and predict any
difficulties that might arise. For those who are not quite sure what their focus will be, the research proposal
can be a space to explore options -- perhaps with one proposal for each potential topic (which can then
be more easily compared and evaluated than when they are still just ideas in one's head). Research
proposals can be effective starting places to discuss projects with your peers and supervisors, too. A
professor who is initially sceptical about a project may be able to imagine it more easily after reading a
well written research proposal (this does not mean he or she will approve the topic, especially if there are
significant potential difficulties that you have not considered).
A research problem or problem statement is the topic you would like to address, investigate, or study,
whether descriptively or experimentally. It is the focus or reason for engaging in your research. It is
typically a topic, phenomenon, or challenge that you are interested in and with which you are at least
somewhat familiar.
The problem statement functions as the starting point of your research project and will always describe
the managerial issue at stake. Examples of problem statements in a business research setting are:
Typical elements that should be addressed when describing the problem statement are:
The problem statement will in turn form the basis on which the research question is formed. The research
question is in essence: what you want/have to research. A research question is a way of expressing your
interest in a problem or phenomenon. Identifying a research question will provide greater focus to your
research or clarify the direction of your investigation. Quite significantly, a well-written research question
will also shed light on appropriate research methods (e.g. specify the intended actions of the variables and
how they might be measured). Examples of research questions in a business research context are:
‘What are the differences in leadership styles between male and female managers?’
‘To what extent is job satisfaction influenced by work pressure?’
13
‘What is the effectivity of inter-organizational relationships in the not-for-profit sector?’
Translating the problem statement into a research question can be a difficult task and should be
approached with thorough consideration as it brings direction and focus to all choices that will come in
throughout the rest of the research process. Research questions…:
And very importantly: a bad research question always leads to bad research. A good research question
does not necessary lead to good research.
Below you can find 9 questions you can use to evaluate your own research question. These questions
evaluate the quality of your research question and the ease with which you should be able to answer it:
1. Does the question deal with a topic or issue that interests me enough to spark my own thoughts and opinions?
2. Is the question easily and fully researchable?
3. What type of information do I need to answer the research question? E.g., The research question, "What impact has
deregulation had on commercial airline safety?" will obviously require certain types of information:
i. statistics on airline crashes before and after
ii. statistics on other safety problems before and after
iii. information about maintenance practices before and after
iv. information about government safety requirements before and after
4. Is the scope of this information reasonable? Is it in line with the time and budget constraints (e.g., can I really research
30 online writing programs developed over a span of 10 years)?
5. Given the type and scope of the information that I need, is my question too broad, too narrow, or okay?
6. What sources will have the type of information that I need to answer the research question (journals, books, Internet
resources, government documents, and people)?
7. Can I access these sources?
8. Is the research question in line with the expectations of the research sponsor? Often times a research is issued by a
specific person or organization (the sponsor), which will have certain expectations of the direction and content of the
study. Every research will therefore necessitate a certain degree of ‘negotiation’ or ‘fine-tuning’ with the sponsor in
the design stage.
9. Given my answers to the above questions, do I have a good quality research question that I actually will be able to
answer by doing research?
Examples (useful for your assignment, not to be studied for the exam):
https://cirt.gcu.edu/research/developmentresources/tutorials/question
optional
14
Read the following chapters from ‘Research and Writing Skills’ (via Blackboard):
Read the following chapter from ‘Research and Writing Skills’ (via Blackboard):
RWS
- Chapter 1: Preparing your research & managing your supervisor
Read the following chapters from ‘Research and Writing Skills’ (via Blackboard):
Watch the following video and read the documents to learn what to focus on when reading a scientific
article. Some interesting optional papers are mentioned as well.
15
The Writing Center_Strategies for Reading Academic Articles.pdf (available on Blackboard)
Booth_et_al 2011 – The literature review its role within research.pdf (available on Blackboard)
This is not to be confused with the unit of observation, which is the unit described by one's data (for
instance employees’ opinions that are gathered using surveys, etc.). The unit of observation is a concept
in research that represents the objects that are observed and about which information is systematically
collected. This is determined by the method by which observations have been selected. For example, a
study may have a unit of observation at the individual level (employees) but may have the unit of analysis
at the organizational level and will therefore draw conclusions on organizational characteristics from data
collected from individuals.
Scientific experiments have several types of variables. The independent and dependent variables are the
ones usually plotted on a chart or graph. The independent variable is the one condition that you change
in an experiment. Example: In an experiment measuring the effect of advertisements on sales, the
independent variable is (the amount of) advertisements. The dependent variable is the variable that you
measure or observe. The dependent variable gets its name because it is the factor that is dependent on
16
the state of the independent variable. In the experiment measuring the effect of advertisements on sales,
sales would be the dependent variable.
There are different measurement scales to distinguish the content of a variable. For data analysis, it is
important to the data user to be able to understand what kind of classification scheme is used. A common
way of distinguishing measurement scales is the so-called NOIR Scale of Measurement. NOIR stands for
Nominal, Ordinal, Interval, Ratio and represents four different ways to classify data.
The following video and pdf file will give you a simple explanation of the concept of variables, and the
different measurement scales most commonly used.
Types of Data & Measurement Scales: Nominal, Ordinal, Interval and Ratio
http://www.mymarketresearchmethods.com/types-of-data-nominal-ordinal-interval-ratio/
1. Strongly disagree
2. Disagree
4. Agree
5. Strongly agree
People have gradually come to use the term, "Likert scale" in very different ways. It is variously applied to
both groups of items and to single items, and in either case there is disagreement about what specific
formats apply. This is not good in general, since we would like mutually agreed-on definitions. Otherwise
if a researcher says, "We used a Likert scale" it is not clear what is meant. Therefore, here are some
important notes on Likert Scales:
17
1. What is a Likert Scale vs. a Likert Item?
A “Likert Scale” is actually the sum of responses to several Likert items. These items are usually displayed
with a visual aid, such as a series of radio buttons or a horizontal bar representing a simple scale.
In a “good” Likert Scale, the scale is balanced on both sides of a neutral option, creating a less biased
measurement. The actual scale labels, as well as the numeric scale, may vary.
A “Likert Item” is a statement that the respondent is asked to evaluate. In the example below, this item,
“The checkout process was easy” is a Likert item — and the table as a whole is the Likert scale.
Here is how to remember it: The “scale” in “Likert scale” refers to the total sum of all Likert items in the
question — not the 1-5 range you see for each item.
This is a tricky question. When you look at one Likert item separately, the responses should be seen as
ordinal: an order is detectable (e.g. Strongly Disagree is lower than Strongly Agree), but the difference
between specific points on the scale is not measurable (e.g. you cannot claim that Agree is two times
better than Disagree).
However, as stated above, a Likert Scale is comprised of multiple Likert Items. Responses to several Likert
items may be summed or averaged, providing that all questions use the same Likert scale. In such an
aggregated scale, the range of coded answers takes on a different format. In a single 5-point Likert item,
coded answers can be only 5 different options (1 to 5), with a Likert Scale that is averaged over a multitude
of items, coded answers have more different options (e.g. an end result of a Likert Scale comprised of four
items can be 1, 1.25, 1.50, 1.75, 2, etc.). In this case, the Likert Scale can be treated as a metric (interval)
variable. This is an important point, as this allows the researcher to make different statistical tests to the
data that are not possible with an ordinal variable. Examples of this are an analysis of variance, or an
application of the scale in a regression analysis.
For more information on Likert Scales and its behaviour as a variable, please review the following
document.
18
3.8 Validity and reliability
Validity and reliability are two important concepts in research. Reliability is the degree to which an
assessment tool produces stable and consistent results. The idea behind reliability is that any significant
results must be more than a one-off finding and be inherently repeatable. Other researchers must be able
to perform exactly the same experiment, under the same conditions and generate the same results. This
will reinforce the findings.
Validity is described as the degree to which a research study measures what it intends to measure. There
are two main types of validity, internal and external. Internal validity refers to the validity of the
measurement and test itself, whereas external validity refers to the ability to generalize the findings to the
target population. Both are very important in analysing the appropriateness, meaningfulness and
usefulness of a research study. There are 4 main types of validity used when assessing internal validity.
Each type views validity from a different perspective and evaluates different relationships between
measurements (Definitions taken from Research Methods for the Behavioural Sciences by Gravetter and
Forzano, 2009).
1. Face validity-This refers to whether a technique looks as if it should measure the variable it intends to measure. For
example, a method where a participant is required to click a button as soon as a stimulus appears, and this time is
measured appears to have face validity for measuring reaction time.
2. Concurrent validity-This compares the results from a new measurement technique to those of a more established
technique that claims to measure the same variable to see if they are related. Often two measurements will behave
in the same way, but are not necessarily measuring the same variable, therefore this kind of validity must be examined
thoroughly.
3. Predictive validity-This is when the results obtained from measuring a construct can be accurately used to predict
behaviour. There are obvious limitations to this as behaviour cannot be fully predicted to great depths, but this validity
helps predict basic trends to a certain degree.
4. Construct validity-This is whether the measurements of a variable in a study behave in exactly the same way as
the variable itself. This involves examining past research regarding different aspects of the same variable.
External validity is related to generalizing. External validity refers to the approximate truth of conclusions
that involve generalizations. Put in more pedestrian terms, external validity is the degree to which the
conclusions in your study would hold for other persons or organizations in other places and at other times.
For more information on external validity and ways in which to provide evidence for generalization,
please review the following text.
For a research to yield useful results, in measurement both reliability and validity need to be high and are
therefore important concepts to consider in your research design. We often think of reliability and validity
as separate ideas but, in fact, they are related to each other. A good metaphor for the relationship between
reliability and validity is that of the target. Think of the centre of the target as the concept that you are
trying to measure. Imagine that for each person you are measuring, you are taking a shot at the target. If
19
you measure the concept perfectly for a person, you are hitting the centre of the target. If you do not, you
are missing the centre. The more you are off for that person, the further you are from the centre.
The figure above shows four possible situations. In the first one, you are hitting the target consistently,
but you are missing the centre of the target. That is, you are consistently and systematically measuring the
wrong value for all respondents. This measure is reliable, but not valid (that is, it is consistent but wrong).
The second situation shows hits that are randomly spread across the target. You seldom hit the centre of
the target but, on average, you are getting the right answer for the group (but not very well for individuals).
In this case, you get a valid group estimate, but you are inconsistent. Here, you can clearly see that
reliability is directly related to the variability of your measure. The third scenario shows a case where your
hits are spread across the target and you are consistently missing the centre. Your measure in this case is
neither reliable nor valid. Finally, we see the ’Robin Hood‘ scenario -- you consistently hit the centre of the
target. Your measure is both reliable and valid.3
The following video gives an introduction into both concepts (mostly in regard to quantitative
research).
Both qualitative and quantitative paradigms try to find the same result; the truth. However, since we
maintain our humanity throughout the research process, it is largely impossible to escape the subjective
experience, even for the most experienced of researchers. Reliability and validity are issues that have been
described in great deal by advocates of quantitative researchers. The validity and the norms of rigor that
are applied to quantitative research are not entirely applicable to qualitative research. Validity in
qualitative research means the extent to which the data is plausible, credible and trustworthy; and thus
can be defended when challenged. Reliability and validity remain however appropriate concepts for
attaining rigor in qualitative research.
3
Adapted from: http://www.socialresearchmethods.net/kb/relandval.php
20
Reliability and Validity Issues in Research.pdf (available on Blackboard)
Bashir - Reliability and validity of qualitative and operational research paradigm.pdf (available on
optional Blackboard)
Evaluative criteria
In their important work on qualitative research, Miles and Huberman (1994) give an overview of five
evaluative criteria that can be used to determine the quality of a (qualitative) research study. These five
evaluative criteria are:
Reliability/Dependability/Auditability is the process of the study consistent and reasonably stable over
time and across researchers and methods? (Miles and Huberman, 1994, p. 278):
Internal Validity/Credibility/Authenticity - truth value. Do the findings of the study make sense? Are they
credible to the people studied, members of the research community, and others?
External Validity/Transferability/Fittingness - Do the conclusions of a study have any larger import? Are
they transferable to other contexts? Do they fit with what we already know? How far can findings be
generalized?
Utilization/Application/Action Orientation - What does the study do for participants? What is the
pragmatic value of the research?
Reference: Miles, M.B. & Huberman, A.M. (1994) Qualitative Data Analysis (2nd edition). Thousand Oaks,
CA: Sage Publications.
Triangulation
Triangulation is a powerful technique that facilitates validation of data through cross verification from two
or more sources. In particular, it refers to the application and combination of several research
methodologies in the study of the same phenomenon. By combining multiple observers, theories,
methods, and empirical materials, researchers can hope to overcome the weakness or intrinsic biases and
the problems that come from single method, single-observer and single-theory studies.
21
Additionally, this short document, written by Alan Bryman, is a handy guide to the issue of
triangulation. It can be found on the Encyclopaedia of Social Science Research Methods Web
site.
Triangulation.pdf https://edge.sagepub.com/system/files/Triangulation.pdf
Mixed Methods
Mixed methods research is a methodology for conducting research that involves collecting, analysing, and
integrating (or mixing) (multiple) quantitative and/or qualitative research (and data) in a single study. The
purpose of this form of research is that both qualitative and quantitative researches, in combination,
provide a better understanding of a research problem or issue than either research approach alone.
The essential goal of mixed methods research is to tackle a given research question from any relevant
angle, making use where appropriate of previous research and/or more than one type of investigative
perspective. Sometimes referred to as mixed methodology, multiple methodology or multi-methodology
research, mixed methods research offers you the best of both worlds: the in-depth, contextualized, and
natural but more time-consuming insights of qualitative research coupled with the more efficient but less
rich or compelling predictive power of quantitative research.
These approaches are far more comprehensive than attacking a problem from only one point of view and,
with the emergence of strategies and tools for blending these different types of data, allow for the crossing
of disciplinary boundaries like never before.
In design science, the goal of your research is to create a new and often innovative artefact. This artefact
will bridge the gap between a problematic state an organisation is facing, and a future desired state. As
such design science is problem driven and leads to an artefact that solves the practical problem
(Johannesson & Perjons, 2014). Artefacts can be a raw material, an information system, a blueprint or
method. In the field of Business and Economics, it is often the case that you develop technology-based
solutions to important and relevant business problems (Hevner et al., 2004).
22
Examples are:
1. Building the specifications for an information system in different domains (accountancy, finance, management, etc.).
The artefact here is the specifications, or a process (flowcharts etc.) or data models.
2. Building a new organisation structure for a company or a group of companies. The artefact here is the organisational
structure.
Read the following chapter from ‘Research and Writing Skills’ (via Blackboard):
RWS
Chapter 5: The importance of ethics
To get a good introduction into ethical issues involved in business research, please read the
following chapter from the book Business Research Methods by Greener (2008). The complete
book is available on download through www.bookboon.com.
As an example of a research study in which ethics are under debate, please read the following
article on Facebook’s emotion study published in The Guardian on 30 June 2014.
optional Facebook emotion study breached ethical guidelines, researchers say.pdf (available on
Blackboard)
23
principles are frequently accessible from the Internet. Some useful codes of ethics for business and
management researchers can be found at the following Internet addresses:
Academy of management
The Academy of Management is the preeminent professional association for management and
organization scholars.
http://aom.org/About-AOM/AOM-Code-of-Ethics.aspx
RESPECT
The RESPECT code is a European Union project looking at developing an ethical code for all researchers
working in the socio-economic field. This site is useful because it contains not just the code but also
information on how the code was developed. www.respectproject.org/main/index.php
In the following pdf document you will find a sample interview consent form and a sample study
information sheet (from: Bryman, A., & Bell, E. (2011). Business Research Methods (3 edition.).
Cambridge ; New York, NY: OUP Oxford.).
24
optional
Optional test (executive education participants): Assess whether your organization employs
evidence-based management (don’t click on, but copy past this link):
https://uamangementschool.eu.qualtrics.com/SE/?SID=SV_9GfiJamywObgnRj
25
4 Data collection
Read the following chapter from ‘Research and Writing Skills’ (via Blackboard):
RWS
Chapter 7: Data collection methods
As a short introduction, watch the two videos below, which give an overview on data collection methods,
and a summary on the differences between qualitative and quantitative data collection methods.
Furthermore, as an introduction to quantitative data collection, please review the following PowerPoint
presentation.
26
4.2.1 Qualtrics research suite
Qualtrics is a Web-based, research survey software licensed to UAntwerp. Qualtrics offers many advanced,
but user-friendly features such as:
Easy survey design with question libraries, point-and-click editing, automatic choices and question randomization
Comprehensive list of question types including pick, group & rank, drill down, rank order, heat map and hot spots
Collaboration
Polls
Distribution & Panel Management
Qualtrics is available to all UAntwerp faculty, staff and students who are faculty-supervised in a class or
research setting (via https://uantwerpen.qualtrics.com). Our license allows for use of the software for
legitimate UAntwerp-related research and educational activities.
The following document helps you to gain more insights in practical considerations that are important
when designing an effective (online) questionnaire:
27
Individual assignment:
https://uamangementschool.eu.qualtrics.com/SE/?SID=SV_4PjtcRePNjZgeyh
optional
Individual assignment:
create your own survey in Qualtrics. Send the link to the survey to the professor.
Social scientist Daniel Yankelovich (1972) described the incorrect reasoning in the fallacy as follows:
The first step is to measure whatever can be easily measured. This is OK as far as it goes. The second
step is to disregard that which can't be easily measured or to give it an arbitrary quantitative value.
This is artificial and misleading. The third step is to presume that what can't be measured easily
really isn't important. This is blindness. The fourth step is to say that what can't be easily measured
really doesn't exist. This is suicide.
Ted has a lot of money. Lots of money makes a person happy. Ted says that he is depressed. What
Ted says does not necessarily indicate how he feels. Depression cannot be proven. Therefore, Ted is
happy.
Reference: Yankelovich, D. (1972). Corporate priorities: A continuing study of the new demands on
business. Yankelovich Inc., Stamford, CT.
28
4.3 Qualitative data collection
Performing a good qualitative data collection is an art on its own, and many different elements are
involved in setting the correct stage that yield valuable input.
As an introduction to qualitative data collection, please review the following PowerPoint presentation.
What is an interview? In this video, Dr. John Schulz of the Southampton Education School
discusses different types of interview set-ups: (11 min):
https://www.youtube.com/watch?v=A-VhzWKaHB4
Interviewing in Qualitative Research.pdf. In this document, you will find many practical tips in
choosing the correct questions, probing techniques and other useful tips. (chapter 3)
On Asking Productive Research Questions.pdf. This short page by Dr. Stuart Blythe at Indiana
University has some useful information especially regarding biased questions and how to avoid
them. http://people.wku.edu/david.lenoir/sbrq.html
Skills in Questioning.pdf. This site has links to a number of pages where there are practical
examples of questions that can be asked. It also has a number of exercises that you can
undertake to improve your questioning technique.
http://managementhelp.org/communicationsskills/questioning-skills.htm
optional
29
4.3.4 Optional assignment: Apply theory on a project
As an assignment, you are asked to create a good topic list that is useful for qualitative data collection.
This topic list should be based on the research question that you’ve composed in Instalment 3.4.
optional
For a non-exhaustive overview of common (and less common) research designs, please review the
following PDF document.
(the need-to-know items here are: action research, case study research, content analysis, CIT,
ethnographic, experimental research, grounded theory, hermeneutic research, meta-analysis,
quasi-experimental, trend analysis.)
4.5 Sampling
Sampling is the process of selecting units (e.g., people, organizations) from a population of interest so that
by studying the sample we may fairly generalize our results back to the population from which they were
chosen. As a first step into understanding how sampling works, we will examine some of the terminology
that is often used. “As with anything else in life you have to learn the language of an area if you are going
to ever hope to use it.” The following website gives an introduction into different terms involved in the
sampling process.
30
Sampling in quantitative studies
Since it is generally impossible to study an entire population (every individual in a country, all customers,
every geographic area, etc.), researchers typically rely on sampling to acquire a section of the population
to perform an experiment or observational study. It is important that the group selected be representative
of the population, and not biased in a systematic manner. For example, a group comprised of the
wealthiest individuals in a given area probably would not accurately reflect the opinions of the entire
population in that area. For this reason, randomization is typically employed to achieve an unbiased
sample. The most common sampling designs are simple random sampling, stratified random sampling,
and multistage random sampling. For more information on these three different sampling designs, please
read the following webpage from Yale University.
For more in-depth learning on sampling and its different techniques, watch the following YouTube video.
In qualitative studies, sampling typically takes on a different approach. The researcher's goal is not the
representative capture of possible variations, but to gain a deeper understanding of analysed cases and
facilitate the development of concepts used in their research. In qualitative research, sampling is guided
not by the need to generalize about people but rather by the need to select subjects and data likely to
generate robust, rich, and deep levels of understanding. It is systematic but non-probabilistic sampling.
Sampling in such a research context is a very complex issue as there are many variations of qualitative
sampling described in the literature. Sampling procedures in qualitative research are not so rigidly
prescribed as in quantitative studies. This flexibility in sampling, however, may be confusing for some
researchers. Two terms are commonly used when describing sampling techniques for qualitative research:
purposeful sampling, and theoretical sampling.
The logic and power of purposeful sampling lies in selecting information-rich cases for in-depth study.
Information-rich cases are those from which one can learn a great deal about issues of central importance
to the purpose of the research.
31
In theoretical sampling, the aim is to identify specific groups of people who either possess characteristics
or are in certain circumstances relevant to the phenomenon being studied. Informants are identified
because they will enable exploration of a particular aspect or behaviour relevant to the research.
Snowball sampling
Snowball sampling (or chain referral sampling) is a non-probability sampling technique often used in
(qualitative) research. This technique is used by researchers to identify potential subjects in studies where
subjects are hard to locate. The main idea behind snowball sampling is that existing study subjects help
indicate or even recruit future subjects.
Specific to business research snowball sampling can be used to things such as identify experts in a certain
field, product, manufacturing processes, customer relation methods, etc. 3M did this when they were
trying to identify experts in different fields of work in order to become the lead user for surgical drapes,
the small plastic covering that is applied at the incision site of a surgery. To do this, 3M called in specialists
from all fields that related to how a surgical drape could be applied to the body. For example, they called
in a veterinarian, who specializes with surgeries on creatures with a lot of hair, and a Broadway make-up
artist who specialized in applying foreign materials to human skin in a non-irritating manner. In order to
successfully identify these people, 3M used snowball sampling. They called "experts" that had contacts
and after gathering information, they asked them to suggest another expert that they may know who
could offer more information. They repeated this process until they were satisfied with their experts and
felt that they had found the most knowledgeable individuals in a specific field. Thus, snowball sampling
can be used to gather expert information.
For more information on snowball sampling, please review the following website:
32
Creating a smarter world with big data: Sudha Ram at TEDxTucson 2013 (14 min):
https://www.youtube.com/watch?v=9vGR3VaFxJM
Harvard Business Review: Ross 2013 - You may not need big data after all.pdf (available on
Blackboard)
Harvard Business Review: McAfee 2012 - Big data, the management revolution.pdf (available on
optional Blackboard)
33
5 Data analysis
Read the following chapter from ‘Research and Writing Skills’ (via Blackboard):
RWS
Chapter 8: Data analysis
5.1 Qualitative
In the following videos, Dr. John Schulz of the Southampton Education School and Kent Löfgren of Umeå
University in Sweden give an interesting step-by-step explanation and guide of analysing qualitative
interviews for research purposes.
The developers of NVivo offer an NVivo eDemo package specifically for students. It is completely free and
provides an overview of how NVivo can be used to support your studies.
A thinking tool: to help you map out your research area and define your research questions
An organizer and analysis tool for literature review: libraries created in bibliographic tools can be
imported into NVivo, where users have additional tools to annotate, reflect upon and code your
literature
A tool to help users see and reflect upon your research design: with NVivo you can experiment
with and refine the design of your project even before you start to collect data
5.2 Quantitative
There are many online resources that can help you in your quantitative analyses. A first interesting
resource is the personal website of University of Sussex professor of psychology Andy Field: Statistics Hell.
On his website professor Field explains various statistical concepts (including direct application in the
statistical software package SPSS) in an understandable, and often humorous manner. His book:
“Discovering Statistics Using IBM SPSS Statistics” is also highly recommended.
34
An important aspect of performing quantitative analyses, is to make the correct interpretation of the
findings. As a second interesting reading, the article on the misuse of statistics from the Harvard Business
Review summarizes some of the major pitfalls that you can encounter in statistical analysis.
Choosing an appropriate statistical technique can seem to be a daunting task. Dependence methods test
for the presence or absence of relationships between two sets of variables. Table 1 gives an overview of
statistical methods that are appropriate according to certain criteria (number of (in)dependent variables,
and type of variables).
Additionally, Table 2 provides an overview of different statistical methods ordered by the type of test you
are interested in completing.
35
Table 2 Methods of statistical analysis
Measurement variables
Nominal Ordinal Interval/Ratio
Variable description Frequency table Core numbers
Multiple-answer analysis
Determining central Mode Median Average
tendency
Comparing sample Binominal test Sign test t-test for 1 sample
average to other
averages
Testing a variable’s Chi-square Kolmogorov-Smirnov
distribution
Describing groups Crosstab Core numbers
Comparing two Chi-square Mann-Whitney t-test
independent groups Test of median
Comparing more than Chi-square Kruskal-Wallis F-test
two independent Test of Median Analysis of variance
groups
Comparing related Wilcoxon signed ranks Paired t-test
groups Sign test
Friedman
Determining the Chi-square Spearman-rank-corr. Correlation analysis
coherence between
two variables
Explaining a variable Regression analysis
Source: Huizingh, E. (1999). Inleiding SPSS voor Windows. Schoonhoven: Academic Service Economie en
Bedrijfskunde.
The correct use of statistical concepts is important in the data analysis portion of your research project. In
order to get you reacquainted with the basics of statistics and some of its important elementary concepts,
the next short video will show an easy way that will make you never forget some of the basic statistic
terms again.
36
5.3 Significance testing
P<0.05 is the figure you will often find printed on an academic paper, that is commonly (mis)understood
as indicating that the findings have a one in twenty chance of being incorrect. The phenomenon has
become a somewhat universal barrier which scientists must cross but, in many cases, has also
inadvertently become a barrier to readers of scientific research accessing the very important numbers
often hidden underneath this indication of statistical significance. Instead of focusing just on p-values,
methodologists increasingly emphasize changing the scope from p-values to analysis of sample size and
confidence intervals.
As the misinterpretation of the use of significance testing is become increasingly widespread, one journal
(Basic and Applied Social Psychology, BASP) has taken an important step. In an editorial in their first issue
of 2015, the editors explain to have decided to not accept the use of null hypothesis significance testing in
papers any longer. As this technique is used almost universally in psychology research and much scientific
research across the board, it has created a shock in the research community.
The blogpost 'The first crack in the wall of significance testing' by Simon Oxenham gives a good explanation
of the current thinking on p-values and includes an interesting video in which a simple simulation
experiment shows the potential for wrong interpretations in statistical analysis.
One of the most common errors made in the data analysis phase of (business) research is the confusion
between correlation and causation in scientific studies. In theory, these are easy to distinguish — an action
or occurrence can cause another (such as smoking causes lung cancer), or it can correlate with another
(such as smoking is correlated with alcoholism). If one action causes another, then they are most certainly
37
correlated. But just because two things occur together does not mean that one caused the other, even if
it seems to make sense. In general, it is extremely difficult to establish causality between two correlated
events or observances.
In this regard, an interesting type of relation between two variables is the so-called ‘spurious relationship’:
relationships in which two events have no causal link, but still appear to due to either a coincidence or a
third, confounding variable.
A well-known example is the high correlation between the number of storks and birth of babies that has
been found in several areas, such as in Copenhagen in the period after World War II. This could be wrongly
interpreted as a proof that storks deliver babies. However, a more thorough investigation of the manner
will uncover that both the number of storks and the number of babies being born are both dependent on
a third ‘lurking’ variable: urbanization. During the ten or twelve years following World War II, the
populations of most western European cities steadily grew as a result of migrations from surrounding rural
areas. There was also that spurt of fecundity known as the post-war baby boom. As population in urban
areas increased through migration and by the baby boom, there was more building construction to
accommodate the larger number, which in turn provided more nesting places for storks (chimneys); hence
increasing numbers of storks.
Created by Tyler Vigen, "Spurious Correlations" is a website devoted to documenting examples of these
spurious relationships. Vigen's charts show causal relationships between things like divorce rates in Maine
and margarine consumption, the number of people who died by becoming tangled in their bedsheets and
total revenue generated by skiing facilities, and US crude oil imports from Norway and the number of
drivers killed per annum in railway train collisions.
Many studies are actually designed to test a correlation but are suggestive of “reasons” for the correlation.
People learn of a study showing that “girls who watch soap operas are more likely to have eating disorders”
— a correlation between soap opera watching and eating disorders — but then they incorrectly conclude
that watching soap operas gives girls eating disorders.
For a clear explanation and examples on the differences between correlation and causation, watch the
following TED-talk by Ionka Smeets, a Dutch mathematician.
38
Prof. Dr. Dries Benoit is a professor of business analytics at the University of Gent, who keeps a blog in
which he links current events to statistics and data analysis (in Dutch).
optional
39
6 Reporting
Read the following chapter from ‘Research and Writing Skills’ (via Blackboard):
Read the following chapter from ‘Research and Writing Skills’ (via Blackboard):
40
Citations and bibliography
When you use resources in your own text, you need to mention these resources:
1) In your text (near the specific sentence): citation, AND
2) At the end of your paper in a bibliography
This way, the reader can easily find the used materials.
If you do not do this, you commit fraud (plagiarism). At our university, all bachelor and master theses are
scanned for plagiarism:
When you use a reference manager, the software will help you write down your references (citations and
bibliography) in a correct way. However, it is always wise to check the automatically retrieved ways of
referring because the reference manager does not always display the source in the correct way.
There are different ways of citing and referring e.g. APA, Chicago and MLA. At our Faculty, we always use
APA:
General guide: https://www.indiana.edu/~istd/overview.html
In-text: citing vs. paraphrasing: http://blog.apastyle.org/apastyle/paraphrasing/
Bibliography: sources in one alphabetical list at the end of your paper (without subdivisions
according to the type of resource).
! Interviews and surveys: According to APA you do not need to refer to interviews and surveys in
your text and bibliography. For your bachelor and master theses you do need to refer to them as
follows:
o In text: (surname, year)
o In bibliography:
Surname interviewed person
Initials first name
Year the interview/survey took place (between brackets)
Subject (title) in italic font
“(phone) interview with” and position of the interviewee
Full date
Place of the interview
41
For practical guidelines on (referencing) using APA, which you need to know how to use:
APA Citation Style – Cornell University Library.pdf
https://www.library.cornell.edu/research/citation/apa
APA Referencing Guide.pdf http://www.usq.edu.au/library/referencing/apa-referencing-
guide
Advice on Paraphrasing
The following site is among the most popular links used by other academic institutions around the world.
This section is chosen for its valuable advice on paraphrasing our readings, but you will find lots of other
useful pointers elsewhere in the site’s pages.
Quoting and Paraphrasing.pdf (use the links on the site for further insights into specific quoting
and paraphrasing topics http://www.wisc.edu/writing/Handbook/QuotingSources.html
The documents below contain the reporting standards specifically for our FBE students and the
dissertation outline of Duquesne University. The target group for the latter is doctoral students in
psychology, with a focus on quantitative research. However, it can be applied to all research projects,
master theses and PhD manuscripts.
On YouTube you can find several video’s on how to work with Word (e.g. generate a table of contents,
generate a bibliography automatically (watch out with mistakes in Word!), etc.)
Obviously, there are multiple ways to present your research. The most common one is still (and most
probably will be) the PowerPoint presentation. At academic conferences, you will also often see a poster
presentation (check out: https://www.scientifica.uk.com/neurowire/tips-for-presenting-your-scientific-
poster-at-a-conference).
42
This is not a course on presentation styles. Below, we offer some insights in Pecha Kucha, a presentation
style that is somewhat unique and limited in time (because scholars tend to lose track of time when they
talk about their topic).
Pecha Kucha is a style of presenting that is limited to 20 slides or pictures shown for 20 seconds each so
that the presentation is limited to 6 minutes and 40 seconds in total. This style of presenting forces
students to make use of images and efficient use of spoken word in order to be able to communicate the
message in only 6 minutes. The format keeps presentations concise but requires a rather creative
approach from students.
43
6.4 Optional: The deluge of science
In recent years, the academic system of publishing science in peer-reviewed journals is under debate. Peer
review is commonly accepted as an essential part of science in which academic peers judge the merit of a
scientific research before it is allowed to be published in a reputable journal. Achieving publications in
reputable journals are for academics very important, as it is one of the most important measures to prove
the quality of their work.
However, the system has it downsides, as it has been criticized for enabling academic pressure to publish
in "top" journals, encouraged researchers to cut corners (with many examples of academic fraud as cases
in point) and pursue “trendy” fields of science instead of doing more important, truly ground-breaking
work. Moreover, there is a debate on the merits of the system in which especially the large publishing
houses such as Sage, Elsevier and Wolters Kluwer take an (unfair?) large part of the proceeds. Suggestions
have been made recently to change this system, as top researchers have even announced to boycott
journals as an outlet for their scientific finds.
For more information on this debate, the following articles from the Guardian form a good introduction
on current themes that are being discussed.
The Guardian - Why we are not ready for radical changes in science publishing.pdf
http://www.theguardian.com/science/occams-corner/2014/jan/06/radical-changes-science-
publishing-randy-schekman
optional
The Guardian - Hundreds of open access journals accept fake science paper.pdf
http://www.theguardian.com/higher-education-network/2013/oct/04/open-access-journals-fake-
paper
optional
44
6.5 Optional background information
6.5.1 Data visualization
Data visualization is the study of the visual representation of data and serves as a powerful way to simplify
complexity. The main goal of data visualization is to communicate information clearly and effectively
through graphical means. To convey ideas effectively, both aesthetic form and functionality need to go
hand in hand, providing insights into a rather sparse and complex data set by communicating its key-
aspects in a more intuitive way, keeping in mind the important adage: ‘a good graph contains an minimum
amount of ink and a maximum amount of information’.
Visualizations help people see things that were not obvious to them before. Even when data volumes are
very large, patterns can be spotted quickly and easily. Visualizations convey information in a universal
manner and make it simple to share ideas with others. It lets people ask others, “Do you see what I see?”
And it can even answer questions like “What would happen if we made an adjustment to that area?”
As more and more data is collected and analysed, decision makers at all levels welcome data visualization
software that enables them to see analytical results presented visually, find relevance among the millions
of variables, communicate concepts and hypotheses to others, and even predict the future.
3 Reasons Why You Should Use Your Survey Data to Create An Infographic.pdf
http://www.surveygizmo.com/survey-blog/3-reasons-why-should-use-your-survey-data-to-
create-an-infographic/
optional
45
6.6 Conclusion
As we have come to the end of this course on Business Research Methods and we have reached the stage
that we can reflect on the development we have made in the course of the past weeks, we would like to
end with one summarizing quote that paraphrases Alfred Hitchcock:
46
7 Attachment: Turtle Template
(Source: adapted and elaborated on Faff, 2015; Bryman & Bell, 2013; Cambré & Van Andel, 2015)
INFO
AUTHOR(S) Name(s)
BODY OF KNOWLEDGE
KEY PAPERS What is already known? What are top-articles (guru’s; high impact journal articles; high citations)?
RESEARCH QUESTION What is the basic research question? Are there sub-questions?
WHAT IS NEW Is there a gap in the literature? Is there novelty in idea, data, tools, analysis?
SO WHAT Why is it important to know the answer to the RQ? What can be the managerial impact?
RELATIONS & CAUSALITY What are the dependent and independent variables? What are other variables and relations?
47
LEG3: operationalization
UNIT OF ANALYSIS & UNIT OF What is the unit of analysis? What is the unit where you collect data?
OBSERVATION
DESIGN What major design? Combination of designs? Why is this the best possible design to answer your RQ?
DATA What data? Why these data? Access? Primary or secondary data? Database issues? Missing data? Cleaning data?
METHODS & TOOLS What data collection methods? In what sequence (if applicable)? Availability of software? How will you do the analysis? Do you
have the appropriate knowledge (e.g. statistical skills)?
VALIDITY & RELIABILITY Meaningful data? Quality? What will you do to increase validity and reliability?
ETHICS Are there ethical considerations in research design, access to data, analysis, reporting data?
CHALLENGES Is collaboration needed? What are the risks? What are the challenges in executing the research? Is the time frame realistic?
Personal advantages? Potential pitfalls? What can go wrong? What will make it happen?
48