MIX METHOD RESEARCH: COLLECTING DATA,

ANALYSIS DATA AND INSTRUMENT

Submitted as a group assignment in the course Research Methodology on ELT

Lecturer: Kheryadi, S.Pd., M.Pd.

Commited By:

Rismatun Uyun (211230098)

Vica Regina Aulia (211230098)
Kholifatut Taziah (211230119)

ENGLISH EDUCATION DEPARTEMENT

FACULTY OF EDUCATION AND TEACHER TRAINING
STATE ISLAMIC UNIVERSITY
SULTAN MAULANA HASANUDDIN BANTEN
2023 M/1445 H
 PREFACE

We give thanks to God Almighty, because of His blessing and mercy, we

were able to complete this paper. This paper was written in order to fulfill a paper
assignment for the Research Methodology on ELT course on "Mix Method
Research: Collecting Data, Analysis Data And Instrument".

We realize that, without help and guidance from various parties, from the
learning period to the preparation of this paper, it would be very difficult for us to
complete this paper. Therefore, we would like to thank: Kheryadi, S.Pd.,
M.Pd.who have provided the time, energy and thoughts to direct and provide a lot
of knowledge before we could write this paper. As well as parents and family who
have provided material and moral support.

Finally, we hope that Allah Almighty will repay all the kindness of all
those who have helped. Hopefully this paper will bring benefits to the
development of science.

Serang, 17 November 2023

1
 CONTENT

PREFACE ⅰ

CONTENT ⅱ

CHAPTER Ⅰ INTRODUCTION 1

A. Background 1
B. Research Problem 2
C. Objectives 2

CHAPTER Ⅱ DISCUSSION 3

A. Design Mix Method Research 3

B. Data Collecting in Mix Method Research 4
C. Analysis Data in Mix Method Research 6
D. Instrumrent in Mix Method Researh 8

CHAPTER Ⅲ 11

CONCLUSION 11

REFERENCES 13

2
 CHAPTER Ⅰ
INTRODUCTION
A. Background

Data collection, data analysis, and the use of instruments in mixed

methods are essential in modern research. Research today increasingly recognizes
the advantages of combining quantitative and qualitative approaches to provide a
more comprehensive and in-depth insight into the phenomenon under study.

Data collection involves a series of processes to gather information,

whether through surveys, interviews, observation or documentation. A mixed
approach allows researchers to get a more complete picture and understand the
context of the phenomenon.

Data analysis in mixed methods includes a combination of statistical and

interpretive techniques. Quantitative provides numbers and patterns, while
qualitative helps explore the meaning behind the data, bridging deep
understanding.

Research instruments, such as questionnaires, interview guides, or

structural observations, must be carefully designed to ensure the validity and
reliability of the data collected. Proper use of instruments supports the integrity of
mixed methodologies.

B. Research Problem

1. What is the Design Mixed Methods Research?

2. How is Data Collection in Mixed Methods Research?
3. How is Data Analysis in Mixed Method Research?
4. What are the Instruments in Mix Method Research?

C. Objectives

1. To find out the Design Mixed Methods Research.

2. To find out How to Collect Data in Mixed Methods Research.

1
3. To find out How to Analyze Data in Mixed Methods Research.
4. To find out what are the Instruments in Mix Method Research.

2
 CHAPTER Ⅱ
DISCUSSION

A. Design Mix Method Research

Mixed Research, or what is referred to as mixed methods research,
involves “mixing or combining quantitative and qualitative research techniques,
methods, approaches, concepts or language into a single study” (Johnson &
Onwuegbuzie, 2004, p. 17). As noted by Collins, Onwuegbuzie, and Sutton
(2006), mixed research studies contain 13 steps each of which occur at one of the
following three phases of the mixed research process: research conceptualization
(i.e., determining the mixed goal of the study, formulating the mixed research
objectives, determining the rationale of the study and rationales for mixing
quantitative and qualitative approaches, determining purpose of the study and the
purposes for mixing quantitative and qualitative approaches, determining the
mixed research questions), research planning (i.e., selecting the mixed sampling
design, selecting the mixed research design), and research implementation (i.e.,
collecting quantitative and qualitative data, analyzing the quantitative and
qualitative data, legitimating the data sets and mixed research findings,
interpreting the mixed research findings, writing the mixed research report,
reformulating the mixed research questions).
There are two mix method research designs including the triangulation
design and the explanatory design.
1. Design triangulation
Triangulation design is an attempt to combine qualitative and
quantitative research methods by conducting two different types of
research at the same time. Where in qualitative and quantitative research
methods, efforts will be made to collect data, analyze, and produce
research results according to the methods used. If he method has been
done then the two will be combined, the results are marged to compare,
interrelate, or validate the results. The results of this triangulation design

3
 depend on the results produced from the two methods. This design is used
to ascertain whether the results of quantitative research are supported by
qualitative research and vice versa.
2. Exploratory design
Qualitative research, Data collextion, data analysis, results.
Mixing, Develop instrument or theory based on qualitative results to test
quantitatively. Quantitative, there is a process of data collection, data
analysis and research results.Interpretation, Generally emphasis on
qualitative, quantitative results generalize & test.
3. Explanatory design
Explanatory design is conducting research in stages. In this design,
the first thing to do is quantitative research, there is a process of data
collection, data analysis and research results. Mixing: Quantitative results,
Lead to need for further clarification or participant selection. Qualitative,
Data collextion, data analysis, results Interpretation, Generally emphasis
on quantitative, qualitative results explain & elaborate.
B. Data Collecting in Mix Method Research
Data collection techniques in mixed methods with sequential mixed
methods strategies, especially sequential explanatory strategies, are strategies for
researchers to combine data found from one method with other methods. First,
interviews will be conducted to obtain qualitative data followed by quantitative
data.
1. Interviews
An interview is a conversation with a specific purpose conducted
by two parties. Namely, the interviewer (interviewer) who asks questions
and the interviewee (interviewee) who provides answers to these questions
with the intention of constructing people, events, organizations, feelings,
motivations, demands, concerns and others. Interviews are the main data
collection technique in qualitative research. Especially in-depth interviews
(dept interviews). Qualitative experts say that interviews will intensively

4
 know the feelings, perceptions, feelings, and knowledge of the interviewee
(interview subject).
2. Quisioners
Questionnaires are designed to reveal positive and negative, agree-
disagree attitudes towards social objects. The scale contains attitude
statements, namely a statement about the attitude object. In this case the
researcher used a Likert scale. The Likert scale is used to measure the
attitudes, opinions, and perceptions of a person or group of people about
social phenomena (Sugiyono, 2012: 136). In the Likert scale there are two
attitude statements, namely statements that are supportive (favorable) and
statements that do not support (unfavorable). Where in this scale there are
four answer choices, namely very suitable (SS), suitable (S), not suitable
(TS), and very unsuitable (STS). The scoring criteria move from 4,3,2,1
for favorable answers and 1,2,3,4 for unfavorable answers.

Questionnaires are doubtless one of the primary sources of

obtaining data in any research endeavor. However, the critical point is that
when designing a questionnaire, the researcher should ensure that it is
“valid, reliable and unambiguous” (Richards & Schmidt, 2002, p. 438). On
the whole, questionnaires can appear in three types:

1) Closed-ended (or structured) questionnaires

2) Open-ended (or unstructured) questionnaires
3) A mixture of closed-ended and open-ended questionnaires.
As a matter of fact, closed-ended questionnaires provide the
inquirer with quantitative or numerical data and openended questionnaires
with qualitative or text information. In this regard, Blaxter et al. (2006, p.
170) divide questionnaires into “seven basic question types: quantity or
information, category, list or multiple choice, scale, ranking, complex grid
or table, and openended.” Generally, a questionnaire might make use of
one or several types of these question forms. On the other hand, divides
administering questionnaires into two methods. The first one is the self-

5
 administered questionnaire which is usually mailed out to the indented
respondents. This procedure has some major defects. That is, the
respondents usually hardly return the questionnaire. Also, if any
misunderstandings arise, or if there be any vague questions, the researcher
is not available to clarify them. Finally, the researcher has no idea how the
questions were answered. The second type is the group administered
questionnaire. In this procedure the questionnaire “is administered to the
groups of individuals all at one time and place …” . It is believed that this
method of administering the questionnaire is more preferable than the self-
administered one. That is, the return rate is high, the researcher is present
to explain any unclear questions and the researcher knows the conditions
under which the questionnaires were filled out.
3. Document Analysis
Document analysis: Document analysis involves the systematic
analysis of written, visual, or audio materials. Documents can include
diaries, letters, emails, photographs, videos, and audio recordings.
4. Observation
The observation method (observation) is a data collection
technique that requires researchers to go to the field to observe things
related to space, place, actors, activities, objects, time, events, goals,
objectives, and feelings. The use of this method with the aim of obtaining
richer data so that the research results can be reinforced with facts in the
field. Observations were made during the interview process, and the
distribution of scales.

C. Analysis Data in Mix Method Research

Mixed analysis is the term used for analyzing data in mixed research.
Onwuegbuzie and Combs (2010) recently provided an inclusive definition of
mixed analysis that incorporates the definition and typologies that have been
presented in major methodological works. These works included articles, book
chapters, books, and paper presentations across numerous fields and disciplines

6
such as the social and behavioral sciences (including psychology and education),
nursing and allied health, business, and linguistics that spanned 21 years. Based
on their interpretations of the extant literature, Onwuegbuzie and Combs (2010)
identified 13 criteria that represent decisions that mixed researchers make before,
during, and/or after the conduct of their mixed analyses:

1. rationale/purpose for conducting the mixed analysis

2. philosophy underpinning the mixed analysis
3. number of data types that will be analyzed
4. number of data analysis types that will be used
5. time sequence of the mixed analysis
6. level of interaction between quantitative and qualitative analyses
7. priority of analytical components
8. number of analytical phases

Mixed analysis involves the use of both quantitative and qualitative

analytical techniques within the same framework, which is guided either a priori,
a posteriori, or iteratively (representing analytical decisions that occur both prior
to the study and during the study). It might be based on one of the existing mixed
methods research paradigms (e.g., pragmatism, transformative-emancipatory)
such that it meets one of more of the following rationales/purposes: triangulation,
complementarity, development, initiation, and expansion. Mixed analyses involve
the analysis of one or both data types (i.e., quantitative data or qualitative data; or
quantitative data and qualitative data), which occur either concurrently (i.e., in no
chronological order), or sequentially in two phases (in which the qualitative
analysis phase precedes the quantitative analysis phase or vice versa, and findings
from the initial analysis phase inform the subsequent phase) or more than two
phases (i.e., iteratively). The analysis strands might not interact until the data
interpretation stage yielding a basic parallel mixed analysis, although more
complex forms of parallel mixed analysis can be used, in which interaction takes
place in a limited way before the data interpretation phase. The mixed analysis
can be designed based, wherein it is directly linked to the mixed methods design

7
(e.g., sequential mixed analysis techniques used for sequential mixed methods
designs). Alternatively, the mixed analysis can be phase based, in which the
mixed analysis takes place in one or more phases (e.g., data transformation). In
mixed analyses, either the qualitative or quantitative analysis strands might be
given priority or approximately equal priority as a result of a priori decisions (i.e.,
determined at the research conceptualization phase) or decisions that emerge
during the course of the study (i.e., a posteriori or iterative decisions).

Traditionally, as noted by Creswell and Plano Clark (2007), “Data analysis

in mixed methods research consists of analyzing the quantitative data using
quantitative methods and the qualitative data using qualitative methods” (p. 128).
However, mixed analyses also can involve the sequential analysis of one data type
—which are referred to as sequential mixed analyses (Tashakkori & Teddlie,
1998), wherein data that are generated from the initial analysis then are converted
into the other data type. For example, a researcher could conduct a qualitative
analysis of qualitative data followed by a quantitative analysis of the qualitative
codes that emerge from the qualitative analysis and that are transformed to
quantitative data.

D. Instrumrent in Mix Method Researh

Research instruments are tools used to collect, measure, and analyze data
in research. They are a critical part of the research process, as they allow
researchers to gather evidence to answer their research questions. Research
instruments can be quantitative, qualitative, or mixed methods.

In mixed methods research, instruments are tools used to collect, measure,

and analyze both quantitative and qualitative data. These instruments play a
crucial role in gathering evidence and addressing the research questions
effectively. The specific instruments employed in mixed methods research vary
depending on the research objectives, data requirements, and available resources.
However, some commonly used instruments include:

1. Quantitative Instruments

8
 a. Surveys
Surveys are questionnaires administered to a sample population to
gather quantitative data on their attitudes, opinions, or behaviors. They
typically consist of structured questions with predetermined response
options.
b. Questionnaires
Similar to surveys, questionnaires are self-administered
instruments used to collect quantitative data from a larger population.
They can be designed in various formats, such as Likert scales, multiple-
choice questions, or open-ended questions.

c. Standardized Tests
Standardized tests are pre-developed assessments designed to
measure specific skills, knowledge, or abilities in a standardized manner.
They are often used to assess student achievement, cognitive abilities, or
language proficiency.
d. Experiments
Experiments are carefully controlled studies that involve
manipulating variables to observe their effects on a dependent variable.
They are commonly used in scientific research to establish causal
relationships between variables.
2. Qualitative Instruments
a. Interviews
Interviews are in-depth conversations between a researcher and a
participant, allowing for the collection of detailed qualitative data. They
can be structured, semi-structured, or unstructured, depending on the
researcher's objectives.
b. Focus Groups
Focus groups involve small groups of participants guided by a
moderator to discuss a specific topic or issue. They are useful for

9
 generating rich insights into participants' perspectives, beliefs, and
experiences.
c. Observation
Observations involve systematically observing participants in their
natural settings to gather data on their behaviors, interactions, and
environments. They can be structured, semi-structured, or unstructured,
depending on the researcher's focus.
d. Document Analysis
Document analysis involves analyzing written or visual materials
to extract meaning and gain insights into the research topic. It can
involve analyzing texts, images, videos, or other forms of recorded
information.
3. Mixed Methods Instruments
a. Mixed Methods Surveys
Mixed methods surveys combine quantitative and qualitative
components within a single survey. They may include sections with
structured questions and sections with open-ended questions or prompts
for qualitative responses.
b. Qualitative Interviews with Quantitative Data Collection
This approach involves conducting qualitative interviews while
simultaneously collecting quantitative data, such as facial expressions or
physiological responses. This combination provides a deeper
understanding of participants' experiences and their underlying emotions.
c. Quantitative Experiments with Qualitative Data Collection
In this approach, quantitative experiments are augmented with
qualitative data collection methods, such as interviews or observations.
This combination allows researchers to explore the mechanisms
underlying the observed quantitative results.

The selection of appropriate instruments is crucial for the success of mixed

methods research. Researchers should carefully consider their research questions,
data needs, and available resources to choose the instruments that will best

10
address their objectives. Additionally, pilot testing the instruments is essential to
ensure their validity, reliability, and effectiveness in collecting relevant and
meaningful data.

CHAPTER Ⅲ

CONCLUSION

In conclusion, mixed methods research offers a comprehensive approach

to inquiry by combining both quantitative and qualitative methodologies. The
design of mixed methods research involves careful consideration of the research
conceptualization, planning, and implementation phases. Two common designs,
triangulation, and explanatory, provide researchers with flexibility in addressing
complex research questions.

Data collection in mixed methods research often follows sequential

strategies, such as sequential explanatory approaches. This involves collecting
qualitative data first, followed by quantitative data to provide a holistic
understanding of the research problem. Common data collection techniques
include interviews, questionnaires, and observations, each serving specific
purposes in gathering rich and diverse information.

The analysis of data in mixed methods research is a critical aspect that

requires thoughtful decision-making. Researchers must determine the rationale for
conducting mixed analysis, the philosophy guiding the analysis, the number of
data types and analysis types, and the time sequence of analysis. The level of
interaction between quantitative and qualitative analyses, as well as the priority of
analytical components, further shape the mixed analysis process.

11
 Research instruments play a pivotal role in mixed methods research,
serving as tools for collecting, measuring, and analyzing both quantitative and
qualitative data. The selection of appropriate instruments depends on the research
objectives, data requirements, and available resources. Common instruments
include surveys, questionnaires, interviews, focus groups, observations, and
document analysis, tailored to the specific needs of the study.

In summary, the integration of quantitative and qualitative research

approaches through mixed methods research offers a comprehensive and nuanced
understanding of complex phenomena. Researchers employing mixed methods
should carefully design their studies, select appropriate data collection techniques
and instruments, and conduct rigorous analyses to ensure the validity and
reliability of their findings. The flexibility and depth provided by mixed methods
research contribute to a more holistic and robust approach to addressing research
questions across various disciplines.

12
 REFERENCES

Benge, C., Onwuegbuzie, A.J., Mallette, M.H., & Burgess, M.L. (2010). Doctoral
students’ perceptions of barriers to reading empirical literature: A mixed
analysis. International Journal of Doctoral Studies, 5, 55-77.

Brown, J. I., Fishco, V. V. & Hanna, G. (1993). Nelson-Denny Reading Test:

Manual for scoring and interpretation, Forms G and H. Itasca, IL: Riverside
Publishing.

Collins, K. M. T., Onwuegbuzie, A. J., & Sutton, I. L. (2006). A model

incorporating the rationale and purpose for conducting mixed methods
research in special education and beyond. Learning Disabilities: A
Contemporary Journal, 4, 67-100.

Creswell, J. W., & Plano Clark, V. L. (2007). Designing and conducting mixed
methods research. Thousand Oaks, CA: Sage.

Morgan, G. A. (2012). Qualitative research methods: A practical guide for social

scientists (2nd ed.). Sage Publications.

Morse, J. M. (2008). Mixed methods research: Combining the strengths of

qualitative and quantitative approaches (2nd ed.). Jossey-Bass.

Onwuegbuzie, A. J., & Combs, J. P. (2010). Emergent data analysis techniques in

mixed methods research: a synthesis. In A. Tashakkori & C. Teddlie

13
 (Eds.), Handbook of mixed methods in social and behavioral research (2nd
ed., pp. 397-430). Thousand Oaks, CA: Sage.

Sandelowski, M., & Barratt, J. (2003). Integrating qualitative and quantitative

research methods: An introduction to mixed methods research
methodology. In K. L. Mertens (Ed.), Mixed methods research: A research
guide for the social and behavioral sciences (pp. 1-33). Jossey-Bass.

14