Tools For Data Collection 1
Tools For Data Collection 1
• Schedule is the tool for data collection when the method is of interview.
• It is the proforma containing a set of questions which is filled by enumerators who are specially
appointed for the purpose.
• The enumerators/interviewers go to the respondents, put to them the questions from the
proforma in the order the questions are listed and record the replies in the space meant for for
the same in the proforma.
• Enumerators/Interviewers explain the aims and objectives of the investigation and remove the
difficulties which any respondent may feel in understanding the implications of a particular
question or the definition or concept of difficult terms.
• Enumerators/interviewers have to be trained to perform their job well and should be intelligent
and possess the capacity of cross-examination in order to find the truth.
• They should be honest, sincere, hard working, with patience and perseverance.
• This method is very useful in extensive inquiries and can lead to fairly reliable results but is
expensive.
QUESTIONNAIRE
• A questionnaire is a written list of questions, the answers to which are recorded by
respondents.
• In a questionnaire respondents read the questions, interpret what is expected and then write
down the answers.
• The only difference between an interview schedule and a questionnaire is that in the former
it is the interviewer who asks the questions (and if necessary, explains them) and records the
respondent’s replies on an interview schedule, and in the latter replies are recorded by the
respondents themselves.
• In questionnaire, there is no one to explain the meaning of questions to respondents, so it is
important that the questions are clear and easy to understand.
• The layout of a questionnaire should be such that it is easy to read and pleasant to the eye,
and the sequence of questions should be easy to follow.
• A questionnaire should be developed in an interactive style; respondents should feel as if
someone is talking to them.
• A sensitive question or a question that respondents may feel hesitant about answering
should be prefaced by an interactive statement explaining the relevance of the question.
Different font for these statements can be used to distinguish them from the actual
questions.
Ways of administering
• The mailed questionnaire – Most common approach; send the questionnaire to prospective
respondents by mail when have access to their addresses.
• One should send a prepaid, self-addressed envelope with the questionnaire as this might increase
the response rate. A mailed questionnaire must be accompanied by a covering letter.
• One of the major problems with this method is the low response rate. In the case of an extremely
low response rate, the findings have very limited applicability to the population studied.
• Nowadays, these are sent by emails, whatsapp links etc.
• Collective administration – One of the best ways of administering a questionnaire is to obtain a
captive audience such as students in a classroom, people attending a function, participants in a
programme or people assembled in one place.
• This ensures a very high response rate as you will find few people refuse to participate in your
study. Also, as you have personal contact with the study population, you can explain the purpose,
relevance and importance of the study and can clarify any questions that respondents may have.
• It is the quickest way of collecting data, ensures a very high response rate and saves you money
on postage.
• Administration in a public place – Sometimes you can administer a questionnaire in a public
place such as a shopping centre, health centre, hospital, school or pub depending upon the type
of study population you are looking for and where it is likely to be found.
• Purpose of the study is explained to potential respondents as they approach and their
participation in the study is requested. Apart from being slightly more time consuming, this
method has all the advantages of administering a questionnaire collectively.
Choosing between an interview and a questionnaire
• The nature of the investigation – If the study is about issues that respondents may feel
reluctant to discuss with an investigator, a questionnaire may be the better choice as it
ensures anonymity.
• This may be the case with studies on drug use, sexuality, indulgence in criminal activities and
personal finances.
• However, there are situations where better information about sensitive issues can be obtained
by interviewing respondents. It depends on the type of study population and the skills of the
interviewer.
• The geographical distribution of the study population – If potential respondents are scattered
over a wide geographical area, you have no choice but to use a questionnaire, as interviewing
in these circumstances would be extremely expensive.
• The type of study population – If the study population is illiterate, very young or very old, or
handicapped, there may be no option but to interview respondents.
Merits-
• It is less expensive. As you do not interview respondents, you save time, and human and financial
resources.
• The use of a questionnaire, therefore, is comparatively convenient and inexpensive. Particularly
when it is administered collectively to a study population, it is an extremely inexpensive method
of data collection.
• It offers greater anonymity. As there is no face-to-face interaction between respondents and
interviewer, this method provides greater anonymity. In some situations where sensitive
questions are asked it helps to increase the likelihood of obtaining accurate information.
• It is free from bias of interviewer; answers are in respondent’s words.
• Respondents have adequate time to give well thought answers.
• Respondents who are not easily approachable; can be reached conveniently.
• Large samples can be made use of and thus the results can be made more dependable and
reliable.
Demerits-
• Application is limited to a study population that can read and write. It cannot be used on a
population that is illiterate, very young, very old or handicapped.
• Response rate may be only 20-50% and depends upon a number of factors: the interest of the
sample in the topic of the study; the layout and length of the questionnaire; the quality of the
letter explaining the purpose and relevance of the study; and the methodology used to deliver
the questionnaire; slowest method.
• Not everyone who receives a questionnaire returns it, so there is a self-selecting bias. Those who
return their questionnaire may have attitudes, attributes or motivations that are different from
those who do not. Hence, the findings may not be representative of the total study population.
• In case of any doubt, there is almost no opportunity for respondents to have the meaning
clarified. If different respondents interpret questions differently, this will affect the quality of the
information provided; there may be ambiguous replies.
• Spontaneous responses are not allowed for, respondents get time to think.
• The response to a question may be influenced by the response to other questions. As
respondents can read all the questions before answering (which usually happens), the way they
answer a particular question may be affected by their knowledge of other questions.
• With mailed questionnaires respondents may consult other people.
• When an investigator wants to find out only the study population’s opinions, this method may be
inappropriate, though requesting respondents to express their own opinion may help.
• An interview can sometimes be supplemented with information from other methods of data
collection such as observation, but a questionnaire lacks this advantage.
• Contents of the covering letter
• It is essential that you write a covering letter with your mailed questionnaire. It should
very briefly:
• introduce you and the institution you are representing;
• describe in two or three sentences the main objectives of the study;
• explain the relevance of the study;
• convey any general instructions;
• indicate that participation in the study is voluntary – if recipients do not want to respond
to the questionnaire, they have the right not to;
• assure respondents of the anonymity of the information provided by them;
• provide a contact number in case they have any questions;
• give a return address for the questionnaire and a deadline for its return;
• thank them for their participation in the study.
Form of questions
• The form and wording of questions used in an interview or a questionnaire are extremely
important in a research instrument as they have an effect on the type and quality of information
obtained from a respondent.
• The wording and structure of questions should therefore be appropriate and relevant.
• In an open-ended question the possible responses are not given. In the case of a questionnaire,
the respondent writes down the answers in his/her words, but in the case of an interview
schedule the investigator records the answers either verbatim or in a summary.
• In a closed question the possible answers are set out in the questionnaire or schedule and the
respondent or the investigator ticks the category that best describes the respondent’s answer. It is
usually wise to provide a category ‘Other/please explain’ to accommodate any response not
listed.
• When deciding whether to use open-ended or closed questions to obtain information about a
variable, one should be clear how to use the information generated.
• The way one frames the questions determines the unit of measurement which could be used to
classify the responses. The unit of measurement in turn dictates what statistical procedures can
be applied to the data and the way the information can be analysed and displayed. Eg income.
• In closed questions, having developed categories, you cannot change them; If you ask an open-
ended question, you can develop any number of categories at the time of analysis.
• Both open-ended and closed questions have their advantages and
disadvantages in different situations; these depend upon whether they are
being used in an interview or in a questionnaire and on whether they are
being used to seek information about facts or opinions.
• As a rule, closed questions are extremely useful for eliciting factual
information and open-ended questions for seeking opinions, attitudes and
perceptions.
• The choice of open-ended or closed questions should be made according to
the purpose for which a piece of information is to be used, the type of study
population from which information is going to be obtained, the proposed
format for communicating the findings and the socioeconomic background of
the readership.
• Advantages and disadvantages of open-ended questions-
• Open-ended questions provide in-depth information if used in an interview by an
experienced interviewer.
• In a questionnaire, open-ended questions can provide a wealth of information provided
respondents feel comfortable about expressing their opinions and are fluent in the
language used. On the other hand, analysis of open-ended questions is more difficult.
The researcher usually needs to go through another process – content analysis – in order
to classify the data.
• In a questionnaire, open-ended questions provide respondents with the opportunity to
express themselves freely, resulting in a greater variety of information. Thus respondents
are not ‘conditioned’ by having to select answers from a list. The disadvantage of free
choice is that, in a questionnaire, some respondents may not be able to express
themselves, and so information can be lost.
• As open-ended questions allow respondents to express themselves freely, they virtually
eliminate the possibility of investigator bias (investigator bias is introduced through the
response pattern presented to respondents). On the other hand, there is a greater
chance of interviewer bias in open- ended questions.
• Advantages and disadvantages of closed questions-
• One of the main disadvantages of closed questions is that the information obtained
through them lacks depth and variety.
• There is a greater possibility of investigator bias because the researcher may list only the
response patterns that he is interested in or those that come to mind. Even if the
category of ‘other’ is offered, most people will usually select from the given responses,
and so the findings may still reflect researcher bias.
• In a questionnaire, the given response pattern for a question could condition the thinking
of respondents, and so the answers provided may not truly reflect respondents’
opinions. Rather, they may reflect the extent of agreement or disagreement with the
researcher’s opinion or analysis of a situation.
• The ease of answering a ready-made list of responses may create a tendency among
some respondents and interviewers to tick a category or categories without thinking
through the issue. Closed questions, because they provide ‘ready-made’ categories
within which respondents reply to the questions asked by the researcher, help to ensure
that the information needed by the researcher is obtained and the responses are also
easier to analyse.
• Formulating effective questions
• The wording and tone of your questions are important because the information and its quality
largely depend upon these factors.
• Always use simple and everyday language- Respondents may not be highly educated and may
not know some of the ‘simple’ technical jargon that you are used to. Particularly in a
questionnaire, you will have no opportunity to explain questions to them. A pre-test should
show you what is and what is not understood by your respondents.
• Do not use ambiguous questions, the one that contains more than one meaning and that can be
interpreted differently by different respondents. This will result in different answers, making it
difficult to draw any valid conclusions from the information.
• Do not ask double-barrelled questions i.e., a question within a question. In this one does not
know which particular question a respondent has answered. Some respondents may answer
both parts of the question and others may answer only one of them.
• Do not ask leading questions, one which, by its contents, structure or wording, leads a
respondent to answer in a certain direction. Such questions are judgemental and lead
respondents to answer either positively or negatively.
• Do not ask questions that are based on presumptions. In such questions the researcher assumes
that respondents fit into a particular category and seeks information based upon that
assumption.
• Essentials of good questionnaire-
• Short and simple;
• Questions in logical sequence from easy to more difficult;
• Personal and intimate questions in the end;
• Technical terms and vague expressions capable of different interpretations to be avoided;
• Questions can be dichotomous, multiple choice or open ended; open ended more difficult to analyse
and should be avoided;
• There should be some control questions which indicate reliability of respondent eg consumption of
particular material can be asked first in terms of weight and then financial; these are a cross-check to
see that information filled is correct;
• Questions regarding sentiments of respondents should be avoided;
• Adequate space for answers should be provided;
• There should be a provision of do not know/not applicable/no preference etc. ;
• Brief directions regarding filling of questionnaire should be provided;
• Physical appearance of questionnaire should be good, in case of paper questionnaire quality of paper
should be attractive, should attract respondent;
• Nowadays online surveys by email, some surveys are also paid surveys.
Difference between questionnaire and schedule
1. Questionnaire generally sent through mails along with a covering letter without any further
assistance from sender. Schedule is generally filled out by the research worker or the enumerator
who can interpret questions when necessary.
2. Data collection through questionnaire is relatively cheap, no field staff is required. Only cost of
preparing questionnaires and mailing is involved.
3. Non-response is higher in questionnaires. Schedules are filled by the enumerators so non-response
is low but chance of bias and cheating may be there.
4. In questionnaire, not sure who replied but in schedule identity of respondent is known.
5. Questionnaire speed slow, people have to be reminded but schedules on time.
6. Personal contact not possible in questionnaires.
7. Questionnaires only for literate and cooperative respondents.
8. Wider and more representative distribution of sample possible in questionnaire.
9. Risk of collecting incomplete and wrong information more in Questionnaire whereas more accurate
in schedules.
10. Success of questionnaire is on its quality and for schedule on honesty and competence of
interviewer.
11. Questionnaires must be attractive to attract people, not required for schedules.
12. In Schedules, observation method can also be used, not possible in questionnaires.
Constructing a research instrument in quantitative research
• The construction of a research instrument or tool is an extremely important aspect of a
research project because anything that is said by way of findings or conclusions is based upon
the type of information collected, and the data collected is entirely dependent upon the
questions asked from the respondents.
• The research tool provides the input to a study and therefore the quality and validity of the
output, the findings, are solely dependent upon it.
• Clearly defined objectives play an extremely important role as each question in the
instrument must stem from the objectives, research questions and/or hypotheses of the
study.
• It is suggested that a beginner should adopt the following procedure:
• Step I Clearly define and individually list all the specific objectives, research questions or
hypotheses, if any, to be tested.
• Step II For each objective, research question or hypothesis, list all the associated questions to
be answered through the study.
• Step III For each question identified in Step II, to list the information required to answer it
• Step IV Formulate questions to be asked from respondents to obtain the required information.
• In the above process, same piece of information may be required for a number of questions.
In such a situation the question should be asked once only.
• Asking personal and sensitive questions
• In the social sciences, sometimes one needs to ask questions that are of a personal
nature. Some respondents may find this offensive. This may affect the quality of
information or even result in an interview being terminated or questionnaires not being
returned.
• For asking sensitive or threatening questions, there are two ways in which the question
is asked: 1. a direct manner; 2. an indirect manner.
• With the first approach there is surity that an affirmative answer is accurate.
• In second approach it is believed that direct questioning is likely to offend respondents
and hence they are unlikely to answer even the non-sensitive questions.
• Some ways of asking personal questions in an indirect manner are as follows: by
showing drawings or cartoons; by asking a respondent to complete a sentence; by
asking a respondent to sort cards containing statements; by using random devices.
• The order of questions
• The order of questions in a questionnaire or in an interview schedule is important as it
affects the quality of information, and the interest and even willingness of a respondent
to participate in a study.
• There can be two ways to order questions, either to ask in a random order or to follow a
logical progression based upon the objectives of the study.
• Logical progression is better as it gradually leads respondents into the themes of the
study, starting with simple themes and progressing to complex ones. This approach
sustains the interest of respondents and gradually stimulates them to answer the
questions.
• However, the random approach is useful in situations where a researcher wants
respondents to express their agreement or disagreement with different aspects of an
issue. In this case a logical listing of statements or questions may ‘condition’ a
respondent to the opinions expressed by the researcher through the statements.
• Pre-testing a research instrument
• Having constructed your research instrument, whether an interview schedule or a
questionnaire, it is important to test it out before using it for actual data collection.
• Pre-testing a research instrument entails a critical examination of the understanding of
each question and its meaning as understood by a respondent.
• A pre-test (Pilot study) should be carried out under actual field conditions on a group of
people similar to the study population.
• The purpose is not to collect data but to identify problems that the potential
respondents might have in either understanding or interpreting a question.
• Aim is to identify if there are problems in understanding the way a question has been
worded, the appropriateness of the meaning it communicates, whether different
respondents interpret a question differently, and to establish whether their
interpretation is different to what you were trying to convey.
• If there are problems, there may be need to re-examine the wording to make it clearer
and unambiguous.
• Prerequisites for data collection
• Before starting to obtain information from potential respondents it is imperative
to make sure of their:
• motivation to share the required information – It is essential for respondents to
be willing to share information. Every effort should be made to motivate them
by explaining clearly and in simple terms the objectives and relevance of the
study, either at the time of the interview or in the covering letter accompanying
the questionnaire and/or through interactive statements in the questionnaire.
• clear understanding of the questions – Respondents must understand what is
expected of them in the questions. If respondents do not understand a question
clearly, the response given may be either wrong or irrelevant, or make no sense.
• possession of the required information – The third prerequisite is that
respondents must have the information sought. This is of particular importance
when seeking factual or technical information. If respondents do not have the
required information, they cannot provide it.
METHODS OF DATA COLLECTION IN QUALITATIVE RESEASRCH
• A clear distinction between quantitative and qualitative methods of data collection is both
difficult and inappropriate because of the overlap between them.
• The difference between them is in the manner in which a method is applied in an actual data
collection situation.
• Use of these methods in quantitative research demands standardisation of questions to be
asked of the respondents, a rigid adherence to their structure and order, an adoption of a
process that is tested and predetermined and making sure of the validity and reliability of the
process as well as the questions.
• However, the methods of data collection in qualitative research follow a convention which is
almost opposite to quantitative research. The wording, order and format of these questions are
neither predetermined nor standardised. Qualitative methods are characterised by flexibility
and freedom in terms of structure and order given to the researcher.
• Most qualitative study designs are method based with the method of data collection
determining the design. Sometimes it maybe difficult to separate a study design from the
method of data collection. eg, in-depth interviewing, narratives and oral history are both
designs and methods of data collection.
• 3 main methods of data collection in qualitative research- unstructured interviews, participant
observation, secondary sources.
• Flexibility, freedom and spontaneity in contents and structure underpin an interaction in all types
of unstructured interview.
• This interaction can be at a one-to-one (researcher and a respondent) or a group (researcher and
a group of respondents) level.
• There are several types of unstructured interview that are prevalent in qualitative research, for
example in-depth interviewing, focus group interviewing, narratives and oral histories.
• The theoretical roots of in-depth interviewing are in what is known as the interpretive tradition.
• According to Taylor and Bogdan, in-depth interviewing is ‘repeated face-to-face encounters
between the researcher and informants directed towards understanding informants’ perspectives
on their lives, experiences, or situations as expressed in their own words’.
• Researcher spends an extended length of time with an informant, so the rapport between them
gets enhanced, and the corresponding understanding and confidence between the two leads to
in-depth and accurate information.
• The difference between a focus group interview and an in-depth interview is that FGI is
undertaken with a group and the in-depth interview with an individual.
• In a focus group interview, you explore the perceptions, experiences and understandings of a
group of people who have some experience in common with regard to a situation or event.
• Broad discussion topics are developed beforehand, either by the researcher or by the group.
These provide a broad frame for discussions which follow.
• The specific discussion points emerge as a part of the discussion. Members of a focus group
express their opinions while discussing these issues.
• Researcher needs to ensure that whatever is expressed or discussed is recorded accurately by the
method most suitable to him.
• He may audiotape discussions, employ someone else to record them or record them himself
immediately after each session.
• If taking his own notes during discussions, he has to be careful not to lose something of
importance because of involvement in discussions. He should take the write-up on discussions
back to the focus group for correction, verification and confirmation.
• The narrative technique of gathering information has even less structure than the focus group.
• Narratives have almost no predetermined contents except that the researcher seeks to hear a
person’s retelling of an incident or happening in his/her life.
• The person tells his/her story about an incident or situation and the researcher listens
passively. The researcher lets the person talk freely and without interrupting, encouraging him
with only appropriate words like ‘right’, ‘yeah’ or nodding which shows that he is actively
listening.
• Narratives are a very powerful method of data collection for situations which are sensitive in
nature.
• Researcher asks these people to narrate their experiences and how they have been affected.
Narratives may also have a therapeutic impact.
• Researcher needs to choose the recording system that suits him the best. Having completed
narrative sessions, he needs to write detailed notes and give them back to the respondent to
check for accuracy.
• Oral histories involve the use of both passive and active listening. These are more commonly used
for learning about a historical event or episode that took place in the past or for gaining
information about a cultural, custom or story that has been passed from generation to generation.
• Narratives are more about a person’s personal experiences whereas historical, social or cultural
events are the subjects of oral histories.