pr2 - q2 - Mod5a - Collecting Data Using Appropriate Instrument Edited 2
pr2 - q2 - Mod5a - Collecting Data Using Appropriate Instrument Edited 2
Republic Act 8293, section 176 states that: No copyright shall subsist in any work of the
Government of the Philippines. However, prior approval of the government agency or office wherein
the work is created shall be necessary for exploitation of such work for profit. Such agency or office
may, among other things, impose as a condition the payment of royalties.
Borrowed materials (i.e., songs, stories, poems, pictures, photos, brand names, trademarks,
etc.) included in this module are owned by their respective copyright holders. Every effort has been
exerted to locate and seek permission to use these materials from their respective copyright owners.
The publisher and authors do not represent nor claim ownership over them.
Management Team:
Schools Division Superintendent : Romeo M. Alip, PhD, CESO V
Asst. Schools Division Superintendent : Rolando M. Fronda, EdD, CESE
Chief Education Supervisor, CID : Milagros M. Peñaflor, PhD
Education Program Supervisor, LRMDS : Edgar E. Garcia, MITE
Education Program Supervisor, AP/ADM : Romeo M. Layug
Education Program Supervisor, Learning Area: Edwin Bermillo
District Supervisor, Assigned Subject : Francisco B. Bautista
District LRMDS Coordinator, Assigned Subject: Jaypee M. Villa
School LRMDS Coordinator, Assigned Subject: Donna T. Santos-Villanueva
School Principal, Assigned Subject : Amelinda A. Fandialan
Lead Layout Artist, Assigned Subject :
Lead Illustrator, Assigned Subject :
Lead Evaluator, Assigned Subject :
This learning resource hopes to engage the learners into guided and independent
learning activities at their own pace and time. Furthermore, this also aims to help learners
acquire the needed 21st century skills while taking into consideration their needs and
circumstances.
In addition to the material in the main text, you will also see this box in the body of
the module:
As a facilitator you are expected to orient the learners on how to use this module.
You also need to keep track of the learners' progress while allowing them to manage their
own learning. Furthermore, you are expected to encourage and assist the learners as they
do the tasks included in the module.
The hand is one of the most symbolized part of the human body. It is often used to
depict skill, action and purpose. Through our hands we may learn, create and accomplish.
Hence, the hand in this learning resource signifies that you as a learner is capable and
empowered to successfully achieve the relevant competencies and skills at your own pace
and time. Your academic success lies in your own hands!
This module was designed to provide you with fun and meaningful opportunities
for guided and independent learning at your own pace and time. You will be enabled to
process the contents of the learning resource while being an active learner.
This module has the following parts and corresponding icons:
What I Need to Know This will give you an idea of the skills or
competencies you are expected to learn in the
module.
1. Use the module with care. Do not put unnecessary mark/s on any part of
the module. Use a separate sheet of paper in answering the exercises.
2. Don’t forget to answer What I Know before moving on to the other activities
included in the module.
3. Read the instruction carefully before doing each task.
4. Observe honesty and integrity in doing the tasks and checking your
answers.
5. Finish the task at hand before proceeding to the next.
6. Return this module to your teacher/facilitator once you are through with it.
If you encounter any difficulty in answering the tasks in this module, do
not hesitate to consult your teacher or facilitator. Always bear in mind that you
are not alone.
We hope that through this material, you will experience meaningful learning
and gain deep understanding of the relevant competencies. You can do it!
What I Need to Know
This module was designed and written to help you to be able to make a plan that
the community may use to conserve and protect its resources for future
generations.
CS_RS12-IId-g-2;
What I Know
Instruction: Rearrange the letters to identify the different steps of the research
process and give its definition. Write your answer on a separate sheet of paper.
Answer Definition
1 YVTAILID
2 YOTBIJVEICT
3 ECVOIGTNI
4 EADPUTTI
5 EAVFIFTEC
6 HRCERSAE
TINNESMTUR
Lesson Collecting Data Using Appropriate
1 Instrument
What’s In
Let's proceed!
1. Data: ____________________________________________________
2. Survey : __________________________________________________
3. Questionnaire : ___________________________________________
4. Interview : ________________________________________________
5. Affective : _________________________________________________
6. Aptitude : _________________________________________________
7. Cognitive : ________________________________________________
8. Validity : _________________________________________________
9. Reliability : _______________________________________________
10. Objectivity : _________________________________________
What is It
Now let us find out how to collect data using the appropriate instrument!
Whatever the specialization, this digital platform will save you time, making it
quicker for the professional and more comfortable for the subjects The platform
makes it simple to collect, manage, and analyze the received data.
The next step is to find an expert in the field who will validate the content of
your instrument. It is also necessary to have your instrument checked by a
language editor for face validation. Content validity refers to the extent to which
the items on a test are fairly representative of the entire domain the test seeks to
measure. This entry discusses the origins and definitions of content validation,
methods of content validation, the role of content validity evidence in validity
arguments, and unresolved issues in content validation. Whereas Face validity,
also called logical validity, is a simple form of validity where you apply a
superficial and subjective assessment of whether or not your study or test
measures what it is supposed to measure. Revise the instrument according to the
comments and suggestions were given by the content and face validators.
After the content and face validation, you are now ready to pilot test your
instrument. You should bear in mind that the actual number of respondents
should double the number of your target respondents in the study to increase the
validity and reliability of your instrument. During pilot testing, you will also
determine the average time the respondents took to answer the instrument.
Respondents can also comment on the reliability of your instrument.
If applicable, after collecting data from the pilot test, you can now use
statistical tests to check the reliability of your instrument. Item analysis is one
way to check the reliability of your instrument. Item analysis is a statistical
technique that measures the effectiveness of a research instrument. This is done
by getting the difficulty and discrimination indices of the research instrument.
This is done by getting the difficulty and discrimination indices of the research
instrument. Difficulty index is the proportion or probability that candidates, or
students, will answer a test item correctly, whereas discrimination index is a
measure of how well an item can distinguish between examinees who are
knowledgeable and those who are not, or between masters and non-masters.
where: Np is the number of test-takers in the total group who pass the item, and N
indicates the total number of test-takers in the group
The formula for the item-discrimination index is
where: Up and Lp are the numbers of test-takers in the upper and lower groups
who pass the item, and U is the total numbers of test-takers in the upper group.
As an example, assume that 50 people take a test. For the difficulty index,
27 test-takers answers the item correctly. For the discrimination index, the upper
and lower groups will be formed from the top 14 and bottom 14 test-takers on the
total test score. If 12 of the test-takers in the upper group and 7 of those in the
lower group pass the item, then:
p= 27 =.54 d= 12-7=0.36
50 14
The item difficulty index (p) has a range of 0.00 to 1.00. If no one answers
the item correctly, the p-value would be 0.00. An item that everyone answers
correctly would have a p-value of 1.00.
The optimal level for an acceptable p-value depends on the number of options per
item. A formula that can be used to compute the optimal level is:
2
In our case, we will have four options; therefore, g = .25. Therefore, the
optimal level for our tests will be .63. In general, as the number of options
increases, the optimum p-value decreases; we would expect questions with more
options to also be more difficult to answer.
We can also compute the lower bound for item difficulty. We do not want
too many questions to have a difficulty index below this bound, because it means
that these items were too difficult for the group of examinees and therefore will not
help us discriminate among the test takers.
Activity 1
In this activity, you are asked to calculate difficulty and discrimination indexes for
the results of two test items and to interpret the results.
SHOW ALL COMPUTATIONAL STEPS
1 Compute the difficulty (p) and discrimination (d) indices of a test item
administered to 84 people if 52 test-takers answered the item correctly; 20 in the
upper group (upper 27% of total test score distribution) and 12 in the lower group
(lower 27% of total test score distribution) got the item right? (Note: k = 4)
p = ________ Optimal Level: ________
d = ________ Lower Bound: ________
2 Compute the difficulty(p) and discrimination (d) index for an item administered
to 263 people where 74 people answered the item correctly; 32 people in the upper
group and 23 people in the lower group passed the item (k = 4).
For rating scales and inventory test, the appropriate way to check its
reliability is to compute the Cronbach’s alpha of the instrument, which can be
computed using statistical tools such as the Statistical Package For Social
Science (SPSS) or even Microsoft Excel. Cronbach’s alpha refers to a measure
of internal consistency, that is, how closely related a set of items are as a
group. It is considered to be a measure of scale reliability. A “high” value for
alpha does not imply that the measure is unidimensional. If, in addition to
measuring internal consistency, you wish to provide evidence that the scale in
question is unidimensional, additional analyses can be performed. Exploratory
factor analysis is one method of checking dimensionality. Technically speaking,
Cronbach’s alpha is not a statistical test – it is a coefficient of reliability (or
consistency).
One can see from this formula that if you increase the number of items,
you increase Cronbach’s alpha. Additionally, if the average inter-item correlation
is low, the alpha will be low. As the average inter-item correlation increases,
Cronbach’s alpha increases as well (holding the number of items constant).
An example
First, we calculated the standard deviation (SD) of the data of each column.
For calculation of SD of column B data, we wrote B10 cell formula as “= STDEV
(B2:B7)”, and the SD was calculated as 0.752773. Similarly, we calculated the SD
of other columns. In column F, we calculated the total score of four questions of
each subject. For calculation of total score of subject 1, we wrote formula for F2
cell as “= SUM (B2:E2)” and the sum score was calculated as 11. Then, we
calculated the SD of sum score in cell F10.
The formula for calculation of α is:
Si = SD of ith item
St = SD of sum score
We wrote A12 cell text as for ease of identification and the right
adjacent cell (B12) equation was written as “= COUNT (B2:E2)/(COUNT (B2:E2)-
1)”. Then, we wrote D12 cell text as and the right adjacent cell (E12)
formula was written as “= SUMSQ (B10:E10)”, and the sum square of all SD was
calculated in the cell E2. The A13 cell text was written as and the right
adjacent cell (B13) formula was written as “= F10^2”. The α was calculated in cell
E13 when we put the cell formula as “= B12* (1-(E12/B13))”. The calculated value
of α in E13 was 0.835.
Those who have access to Microsoft Excel, they can carry out the same
calculation in an Excel ® spreadsheet as described above. We had tested all the
formulae in Excel and found it compatible. In addition, we calculated α for the
above example in IBM SPSS Statistics (New Orchard Road Armonk, New York,
USA) and it showed same result.
Surveys are a valuable data collection and analysis tool that is commonly
used with key stakeholders, especially customers and employees, to discover
needs or assess satisfaction.
1. Determine what you want to learn from the survey and how you will use the
results.
2. Determine who should be surveyed by identifying the population group. If they
are too large to permit surveying everyone, decide how to obtain a sample.
Decide what demographic information is needed to analyze and understand the
results.
3. Determine the most appropriate type of survey.
Conducting a survey creates expectations for change in those asked to answer it.
Do not administer a survey if action will not, or cannot, be taken as a result.
Satisfaction surveys should be compared to objective indicators of satisfaction,
such as buying patterns for customers or attendance for employees, and to
objective measures of performance, such as warranty data in manufacturing or
re-admission rates in hospitals. If survey results do not correlate with the other
measures, work to understand whether the survey is unreliable or whether
perceptions are being modified by the organization’s actions.
Surveys of customer and employee satisfaction should be ongoing processes
rather than one-time events.
Get help from a research organization in preparing, administering, and analyzing
major surveys, especially large ones or those whose results will determine
significant decisions or expenditures.
What is an Interview?
Types of Interviews
1. Define your objectives → identify what you want to achieve and the information
you need to gather. Make sure an interview is an appropriate way to meet your
objectives.
2. Choose the type of interview → Review your required information, budget, time,
and potential respondents and decide whether you need to conduct structured,
semi-structured, or unstructured interviews.
4. Decide how you will conduct the interviews → Consider telephone or face-to-
face interviews. For large surveys, consider computer-aided interviewing and
recording.
6. Decide how you will record the interviews → Depending on the type of interview,
you may fill in a prepared form, use written notes, voice recorders, or computer
devices.
7. Make a list of questions and test them with a sample of respondents → the
questions must be aligned with the type of interview. If you are running
structured interviews, see our Tip Sheets on “Questionnaire Design” and Survey
Research Methods” for more information.
8. Decide who will conduct the interviews → develop an information kit that
includes an introduction to the research topic and instructions. For unstructured
interviews, you may need to hire skilled interviewers.
During the interview:
2. Explain the purpose of your project, the importance of their participation, and
the expected duration of the interview.
5. Tell respondents how the interview will be recorded and how the collected
information will be used → if possible, to obtain their written consent to
participate.
7. Control your tone of voice and language → remain as neutral as possible when
asking questions or probing on issues.
8. Keep the focus on the topic of inquiry and complete the interview within the
agreed time limit.
10. Complete the session → make sure all questions were asked, explain again
how you will use the data, thank the respondent, and ask them if they have any
questions.
1. Make sure the interview was properly recorded → make additional notes, if
needed.
3. Get ready for data analysis → search for resources for analyzing qualitative
and/or quantitative data.
Checklist for Conducting Interviews
o Have you identified research questions that will be adequately addressed by using
interviews?
o Have you chosen the appropriate type of interview?
o Have you selected an interviewer?
o Have you prepared the list of questions?
o Have you tested them?
o Have you decided on the setting of interviews and how responses should be
recorded?
o Have you contacted your respondents and set up appointments?
o Have you obtained enough data for analysis?
Sample Research on
After reading and learning the topic, let us have a comprehension check!
Directions: Answer the following questions and write your answer on a separate
paper.
Questions:
How is it going? Did you have fun learning the topic? Let us recall what you have
learned! Write your answer on a separate sheet of paper.
After all the activities, now let us test your learning! No worries, I am pretty sure
that this challenge is very easy now. Good luck!
Instruction: Multiple Choice: Choose the letter of the best answer. Write your
answer on a separate sheet of paper.
_____ 2. It is a tool that measures variables in the study and is designed to obtain
data on a topic of interest from the subjects of research.
a) Data Gathering
b) Research Instrument
c) Collection of data
d) Instrumentation
_____ 3. It pertains to the proportion of students who answered the test item
correctly.
a) Item analysis
b) Discrimination Index
c) Difficulty Index
d) Content Validation
_____ 9. ‘Test/retest’ and ‘parallel forms of the same test’ are _________.
_____ 10. Which of the following is a procedure for verifying the internal
consistency of the reliability of a measure?
a) Test/retest
b) Split-half technique
c) Parallel forms of the same test
d) None of the above
Additional Activities
Directions: As you have learned from this lesson, answer each question
comprehensively.
________________________________________________________________________________
________________________________________________________________________________
________________________________________________________________________________
________________________________________________________________________________
________________________________________________________________________________
1. VALIDITY
2. OBJECTIVITY
3. COGNITIVE
4. APPTITUDE
5. AFFECTIVE
6. RESEARCH INSTRUMENT
Assessment
1. A 6. C
2. B 7. A
3. C 8. D
4. D 9. B
5. D 10. B
References
Groves, R. M., (1987). Research on survey data quality. Public Opinion Quarterly,
51, 156-172.