Introduction To Research Methods PDF
Introduction To Research Methods PDF
(Preparatory module for Addis Ababa University graduate programs) compiled by Abiy Zegeye Alemayehu Worku Daniel Tefera Melese Getu Yilma Sileshi
Graduate Studies and Research Office Addis Ababa University September 2009
Page 1
Preface
From the dawn of human history, people have been engaged in exploring their surrounding; and in more recent history this exploration has extended to the cosmos. It is an innate human nature to be curious, to want to know or learn something new. When something catches the eyes of a young child, he or she examines the thing, studies it, observes it, and touches it so as to learn about the phenomenon. From passive observations and active interactions a child gradually learns about his/her world. In other words, the child is applying some kind of procedure or approach in his/her day-to-day living to discover new knowledge about the world and express the knowledge gained. The methods or approaches used, however, are not systematic or structured. As adults, when you experience something new, you go beyond your five senses and raise different questions about the phenomenon you encountered. And then you start to explore about it so as to get convincing answers to your questions. You use various ways of learning about the new phenomenon. The way of knowing about the phenomenon may not be the same for all people. And the answers you may get about the questions you raised are not absolute, since there is no absolute truth. As prospective graduate students, you are now embarking on a scientific journey. By the time you finish your post-graduate training you would have acquired sufficient know-how, and critical and analytical thinking to be able to frame your questions in a scientific context, as well as devise ways to systematically obtain answers to your questions. In short, you will conduct scientific research. As a scientist you will be expected to adapt to standards and norms about what constitutes research, how research is conduct, and how research output is communicated. The main thrust of this preparatory module is to lay the foundation for the more rigorous training and research you will encounter upon joining your postgraduate program. The wealth of scientific information that is now available to you is the cumulative effort of many that preceded you in your area of study. The entire scientific endeavor is based on implicit trust. You are the beneficiaries of many years of scientific output that was done rigorously and honestly. Can you imagine what could happen if everyone cooked their data to fit their hypothesis? That is why this preparatory module also covers the ethics of scientific inquiry and reporting. From where you stand now, you may perceive research as some lofty enterprise that only a gray bearded, bespectacled know-it-all can dare undertake. By the end of this preparatory module, it is hoped that scientific research is de-mystified and made accessible. Moreover, we hope that the entire exercise will sharpen your understanding of scientific research methods, and sufficiently increase your confidence to explore new frontiers of science.
Page 2
Page 3
Practical judgment
Theoretical framework
Data collection
Data analysis
Publication
Page 4
Table of Content
Unit 1: The Concept of Research Lesson 1: Sources of Knowledge Lesson 2: Definition and Purposes of Research Lesson 3: Philosophy of Research Unit 2: Types of Research Lesson 1: Classification of Research Lesson 2: Basic and Applied Research Lesson 3: Descriptive, Explanatory and Exploratory Research Lesson 4: Qualitative and Quantitative Research Unit 3: Process in Research Proposal Development Lesson 1: What is the Research Proposal? Lesson 2: Components of Research Proposal Unit 4: Process in Conducting Research Lesson 1: The Research Processes Lesson 2: The Research Processes Described Unit 5: Research Ethics Lesson 1: The Basics Lesson 2: Research Ethics Explained Lesson 3: Codes and Policies for Research Ethics Unit 6: Reporting Research Findings Lesson 1: Writing a Scientific Report Lesson 2: Oral Presentation
Reproduction, distribution or sale of this material without the express authorization of the Office of the Graduate Studies and Research of the Addis Ababa University is strictly forbidden.
FOR USE BY AAU GRADUATE PROGRAMS ONLY
Page 5
UNIT 1
Key Concepts
Common sense Deductive reasoning Inquiry Science Epistemology Empirical
Objectives
After completing this unit you should be able to: Distinguish the difference between the two sources or approaches to knowledge (commonsense vs. science/ everyday observations vs. planned observations); Distinguish between science and commonsense; Differentiate between the various ways of knowing; Give example of each way of knowing; Define the concept of research; Explain the purpose of research; Describe the difference between research methodologies and research methods; Explain the methodologies; assumptions that underlie research
Describe the epistemological issues that underlie scientific inquiry; and Discuss the philosophy of research.
Page 6
As we live in this world and interact with our surrounding we may be confronted with new ideas that may have important impact on our lives. We get access to this new information through our senses --the most immediate way of knowing something. This is what we call sensory knowledge. Reflecting on your own experiences, do you think your senses provide a perfect means of observation? Are eye witnesses to a crime as reliable as some people think? Are the stars in the night sky actually twinkling? Does the sun really move across the sky?
We may also use the opinion of others as sources of knowledge. We might have experienced a stimulus with our senses but we want to check on the accuracy and authenticity of these sensations. We often ask: Does this food taste delicious to you? Did you hear someone cry for help?
Being open minded is not about accepting new ideas that fit neatly into our existing knowledge. It is the willingness and readiness to question our most ardent beliefs in the face of new evidence.
Exercise
Do you rely only on your senses and trust the data you collected, because it has been said, seeing is believing? How reliable are your senses? Do you think that a majority opinion defines what is true? There are also other ways of knowing from our everyday experiences. These are presented below. 1.1.1 The Method of Tenacity The term tenacity refers to the acceptance of a belief based on the idea that we have always known it to be this way. In other words, it represents the automatic acceptance of the prevailing
Page 7
traditional beliefs and customs in which we have been socialized. We accept those beliefs and customs as true without exploring them and then behave with it. Even when we come across evidences that contradict our beliefs, we still tend to cling to our traditional belief. As a way of learning about the surrounding world the method of tenacity has two problems: 1. The information may gain wide acceptance through its familiarity alone. 2. Tenacity offers no means for correcting erroneous ideas.
Your point of view is correct, as long as it agrees with that of your boss.
Exercise
Is darker colored injera more nutritious? Give two examples of the general beliefs that you have accepted without evaluating them. For instance, in some cultures Female Genital Cutting (FGC) is an accepted practice. 1.1.2 The Method of Authority If we enter into a new culture, we may experience so many things for which we are not familiar. If we are nave to most of the practices what we do, is we ask someone in that culture who is supposed to have the knowledge an authority figure. We are likely to ask others whom we think have a wealth of experience and knowledge about the cultural practices of the community. We may, then, accept a new idea or information stated by this authority figure. In many cases, referring to an authority, especially in areas about which we know nothing, is useful and beneficial. We often rely on the judgment and expertise when we consult, for example, electrician, civil engineer or chemist. Remember that authority can be incorrect and at times can lead people in the wrong directions. Hence, it is important to examine the basis of the authoritys claims. We have to raise questions like, are these claims based on opinion, tradition, or direct experience? How valid are the sources of this information?
Exercise
In our day-to-day living we accept what we have been told by an authority figure, for example, a physician may tell us that smoking affects our health. Can you list examples that can be explained in terms of the method of authority?
Page 8
Is there a problem if we unquestioningly accept the knowledge and expertise of others? 1.1.3 The a Priori Method The idea that underlies the a priori method is that first we develop general knowledge, opinion, or belief about the world through the aforementioned methods or personal observation of things around us and then we draw new and specific conclusion from this general knowledge. As a result it is also known as a deductive reasoning. Our intellect allows us to use sensory data to develop a new kind of knowledge. If we take the FGC example once again, a person living in a culture where the practice of female genital cutting is common and well accepted may draw specific knowledge that the practice is against the rights of females because it is the removal of a body part without asking the consent of the victims. Reason and logic are the basic tools of an a prior method and often take the form of a logical syllogism such as All men are tall; Alemu is a man; therefore, Alemu is tall. Hence, logical conclusions may not necessarily lead to correct conclusions. We all use reason everyday as we try to solve problems and understand relationships. As useful as it is to be reasonable, however, reason alone will not always produce the appropriate knowledge.
Exercise
Is there an a priori method without problems? Draw your own syllogistic conclusion: Ethiopia has the best longdistance runners in the world. Mossisa is an Ethiopian, therefore Does this conclusion always hold true? 1.1.4 Common Sense This method of knowing offers an improvement over acceptance based on tenacity, authority, or reason because it appeals to direct experience. Common sense is based on our own past experiences
Page 9
and our perceptions of the world. It originates from our day-to-day practical experiences and in turn guides our daily interaction with our surrounding. Note that our experiences and perceptions of the world may be quite limited. The concepts that we have about the world may be seriously misleading. Although common sense may help us deal with the routine aspects of daily life, it may also form a wall and prevent us from understanding new ideas.
Exercise
Since common sense is related to our practical experience, can you say that it is the method of knowing is devoid of shortcomings? What is the difference between common sense and science? Where would it be more appropriate to apply common sense: knowing what will happen to the price of teff when the rainy season fails, or knowing how bacteria will respond to a new type of drug? 1.2 The Scientific Method as a Source of Knowledge
Science is a body of systematized knowledge. In scientific method ideas are evaluated and corrected through dispassionately observing by means of our bodily senses or measuring devices - in this case science can be seen as a systematic and controlled extension of common sense - and using reason to compare various theoretical conceptualization based on experience which represents a direct application of the principles of logic. This blend of direct sensory experience (or measurement) and reason gives science a selfcorrective nature. One of the characteristics of science is a reliance on information that is verifiable through experience. That is, it must be possible for different people in different places and at different times using the same method to obtain comparable results. Science and common sense differ in terms of: the use of conceptual schemes and theoretical structures the notion of control the explanations of different observed phenomena The difference between common sense and science revolves around the concepts systematic and controlled. Scientists systematically build theoretical structure, test them for internal consistency, and
Page 10
subject aspects of them to empirical test. The scientific method of knowing is the scientific research, and its goal is the discovery of regularities of nature and their representation in theories from which predictions can be made. The steps in the scientific method guide researchers in planning, conducting, and interpreting research studies. Scientific research follows logical steps, which include: defining the problem making tentative explanations gathering information testing the validity of the hypothesis making conclusions as to whether the hypothesis can be accepted or rejected Scientific methods: find general rules, collect objective evidences, make testable statements, adopt a skeptical attitude about all claims, are creative, are public, and are productive. It should be noted that, apart from its importance in knowing the world, the scientific method of knowing has some limitations. The scientific method cannot answer all questions Application of the scientific method can never capture the full richness of the individual and the environment The measurement devices always have some degree of error.
Exercise
What is the difference between common sense and science? What are the steps that people should follow in scientific methods of knowing? What are the strengths of scientific method? What are the limitations of scientific method of knowing? Can you subject a faith-based knowledge to a scientific method?
Page 11
I soon learned that it did not require a great brain to do original research. One must be highly motivated, exercise good judgment, have intelligence, imagination, determination, and a little luck. One of the most important qualities in doing research, I found, was to ask the right questions at the right time. Julius Axelrod
People have long strived to come to grips with their environment and to understand the nature of the phenomena it presents to their senses. One of the means by which they set out to achieve these ends is research. Research is an often-misused term; its usage in everyday language is very different from the strict scientific meaning. In the field of science, it is important to move away from the looser meaning and use it only in its proper context. Scientific research adheres to a set of strict protocols and long established structures. Research is defined as human activity based on intellectual application in the investigation of matter. In other words, research is the systematic process of collecting and analyzing information to increase our understanding of the phenomenon under study. It is the function of the researcher to contribute to the understanding of the phenomenon and to communicate that understanding to others. It may be said that the general aims of research are to observe and describe, to predict, to determine causes and explain. 2.2 Scientific Research Explained
The strict definition of scientific research is performing a methodical study in order to prove a hypothesis or answer a specific question. Finding a definitive answer is the central goal of any experimental process. Research must be systematic and follow a series of steps and a rigid standard protocol. These rules are broadly similar but may vary slightly between the different fields of science. Scientific research must be organized and undergo planning, including performing literature reviews of past research and evaluating what questions need to be answered. Any type of real research requires some kind of interpretation and an opinion from the researcher. This opinion is the underlying principle, or question, that establishes the nature and type of experiment.
Page 12
The scientific definition of research generally states that a variable must be manipulated; although case studies are purely observational science and do not always comply with this norm. For a successful career in science, you must understand the methodology behind any research and be aware of the correct protocols. Science has developed these guidelines over many years as the benchmark for measuring the validity of the results obtained. Failure to follow the guidelines will prevent your findings from being accepted and taken seriously. These protocols can vary slightly between scientific disciplines, but all follow the same basic structure. For any study, there must be a clear procedure so that the experiment can be replicated and the results verified. Again, there is a bit of a gray area for observation-based research, as is found in anthropology, behavioral biology and social science, but they still fit most of the other criteria. Most scientific research looks at an area and breaks it down into easily testable pieces, i.e. breaking down a large and seemingly insurmountable problem into manageable chunks. The incremental experimentation of the individual pieces will allow the larger questions to be approached and answered. In conclusion all scientific research has a goal and ultimate aim, repeated and refined experimentation gradually reaching an answer. These results are a way of gradually uncovering truths and finding out about the processes that drive the universe around us. Only by having a rigid structure to experimentation, can results be verified as acceptable contributions to science. Some other areas, such as history and economics, also perform true research, but tend to have their own structures in place for generating solid results. They also contribute to human knowledge but with different processes and systems. As explained above, scientific research is a systematic attempt to obtain answers to meaningful questions about phenomena or events through the application of scientific procedures. It is impartial, objective, empirical and logical analysis and recording of controlled observations that may lead to the development of generalizations, principles or theories, resulting into some extent in prediction and control of events that may be causes or consequences of specific phenomena. The analysis of the above given definition of research will identify the salient features that distinguish it from casual observations. Research is: Systematic - so ordered, planned and disciplined;
Page 13
Controlled - the researcher can have confidence in his/her research outcomes; Empirical - putting beliefs, ideas, or assumptions to a test; and Critical - many truths are tentative and are subject to change as a result of subsequent research.
Exercise
What do the terms systematic and controlled represent in scientific research? 2.3 Characteristics of Scientific Research
As mentioned above research has been considered as an impartial, objective, empirical and logical analysis and recording of controlled observations that may lead to the development of generalizations, principles or theories, resulting, to some extent, in prediction and control of events that may be causes or consequences of specific phenomena. We can summarize the main characteristics of research as follows. Research: is directed toward the solution of a problem; is based upon observable experience or empirical evidence; demands accurate observation and description; involves gathering new data from primary or first-hand sources or using existing data for a new purpose; is characterized by carefully designed procedures, always applying rigorous analysis. However, it is sometimes somewhat random and unsystematic; requires expertise; is characterized by patient and unhurried activity; is carefully recorded and reported; sometimes requires courage; emphasizes the development of generalizations, principles, or theories that will be helpful in predicting future occurrences; and strives to be objective and logical, applying every possible test to validate the procedures employed, the data collected, and the conclusion reached. 2.4 Goals of Scientific Research
The purpose of scientific research is problem solving. The problem could be of an immediate and practical value or they could be of theoretical nature. That is, research focuses on answering various Addis Ababa University Page 14
questions and acquiring new knowledge. It is the primary tool used in virtually all areas of science to expand the frontiers of knowledge. In addition, by conducting research, researchers attempt to reduce the complexity of problems, discover the relationship between seemingly unrelated events, and ultimately improve the way we live. On the whole, across all types of science, research is frequently used for describing a thing or event, discovering the relationship between phenomena, or making predictions about future events. In short, research can be used for the purposes of description, explanation, prediction, and control all of which make important and valuable contributions in solving practical problems and also in the expansion of what we know and discovery of new knowledge. Seeking solutions to practical or theoretical problems involves doing the following important tasks. Describing phenomena Explaining phenomena Predicting phenomena Controlling phenomena Comparing phenomena 2.4.1 Description Description represents efforts exerted to give pictorial account of the phenomenon being studied. It is actually the first step in research since it provides the basis for further exploration about the phenomenon under consideration. E.g. If a researcher collects data about womens participation in politics and reports their level of participation based on the data collected, then we can say that females participation in politics has been described. E.g. A researcher may also describe that water in the solid state that in its liquid state. In description, the researcher attempts to find answers to the questions what, who, and where? 2.4.2 Explanation In explanation, the researcher is interested in exploring or the causes of the occurrence of certain behavior involves understanding the cause and effect between phenomena. Attempts have been made to Addis Ababa University the reasons or event. It relationship answer the
Page 15
question why? E.g. Why do females fail to actively participate in politics? Here the researcher attempts to answer the causes of low level of participation females in politics. Is there causal link between gender and level of participation in politics? E.g. Why does ice have lower density than water? Having found possible causes for a particular happening or state of affairs, the researcher has to build generalizations that will explain a wider body of knowledge in the area. 2.4.3 Prediction In research, generalization is made not only to explain the past but also to predict what will happen in the future. A widely based conceptual framework or theory will be used to make prediction about the variable of interest. E.g., Females empowerment improves their level of participation in politics. 2.4.4 Control Researchers are also interested in influencing or changing a particular event or condition for different purposes. Therefore, the description, explanation, and or prediction of events which result from any research undertaking are not casual or without aim. It is to explore and allow possibilities of control to intervene and subsequently observe an expected result. E.g., If educational level and male dominance are identified as the causes of low participation of females in politics and if the researcher predicted that an intervention program that raises females educational level and changes males attitude increases females level of participation in politics, the researcher will introduce the intervention package to bring about the desired change. 2.4.5 Comparison The researcher may also be interested in comparing two or more groups on a certain behavior. The purpose here is to explore whether two or more groups are similar or different with respect to the occurrence of certain event. Comparison may take different forms. Instead of comparing groups on one behavior, the researcher
Page 16
may instead compare different behaviors in one group simply to determine which behavior is more likely to occur in this same group of individuals. E.g., Is there gender difference in terms of level of participation in politics? 2.6 The Difference between Research Method and Research Methodology Although the terms methods and methodologies are often used synonymously, it is helpful for you to understand that the terms convey/carry different meanings. A method is a particular research technique or way to gather evidence about a phenomenon. Therefore, methods are the specific research tools we use in research projects to gain fuller understanding of phenomena. That is, the range of approaches used in research to gather data which are to be used as a basis for inference and interpretation, for explanation and prediction. E.g., surveys, interviews, participant observations Methodology describes the theory of how inquiry should proceed that involves analysis of the principles and procedures in a particular field of inquiry. It involves the researchers assumptions about the nature of reality and the nature of knowing and knowledge. In other words, methodology represents a theory and analysis of how research does or should proceed. Methodology encompasses our entire approach to research. Our assumptions about what we believe knowledge is are embedded in methodological discussions and therefore have consequences for how we design and implement research studies.
Epistemology is how we come to know.
Page 17
3.1
Epistemology is a branch of philosophy that studies the nature of knowledge and the process by which knowledge is acquired and validated. Some epistemologists have a particular interest in the nature of inquiry and knowledge in the natural sciences and others in social sciences. These philosophers tried to seek answers to questions as: Are the objects that the researchers study real? How is research knowledge different from other forms of knowledge, and does it have any special authority? What is a theory, and how can it be validated? What does it mean to find laws that enable us to predict individual and group behavior? Is inquiry in the social sciences fundamentally different from inquiry in the natural sciences? As philosophers have investigated that nature of scientific inquiry over a period of many centuries, they have different schools of thought. There are different schools of thought that describe the nature of reality but we will focus on the major ones. As described earlier, epistemology is a philosophy of knowledge and methodology is also concerned with how we come to know, but is much more practical in nature. Epistemology and methodology are intimately related: the former involves the philosophy of how we come to know the world and the latter involves the practice.
Exercise
What is epistemology? Is there difference between epistemology as a philosophy of knowledge and methodology? 3.2 Positivism and Post-Positivism
When people are asked about science, they think individuals who work with facts in the laboratory. A scientist is someone who is brilliant who thinks, spins complex theories, and spends his/her time in ivory towers aloof from the world and its problems. Such kinds of stereotypes about science come from a period where science was dominated by a particular philosophy - positivism. Positivism is a position that holds that the goal of knowledge is simply to describe the phenomena that we experience. Positivists believe that the purpose of science is simply to stick to what we can observe and measure. Knowledge of anything beyond that is
Page 18
impossible. According to this philosophical thought the key approach of the scientific method is the experiment, the attempt to discern natural laws through direct manipulation and observation. The following are three tenets of positivism: Scientific attention should be restricted to observable facts; inferred constructs, such as beliefs or motives, have no place in science, The methods of the physical sciences (e.g., quantification, separation into independent and dependent variables, and formulation of general laws) should also be applied to the social sciences, and Science is objective and value free. On the other hand, post-positivism rejects the central tenets of positivism. A post-positivist might begin by recognizing that the way scientists think and work and the way we think in our everyday life are not distinctly different. Scientific reasoning and common sense reasoning are essentially the same process. The difference between the two is not in kind but it is in terms of degree as has been mentioned earlier science is the extension of commonsense knowledge. Most post-positivists are constructivists who believe that we each construct our view of the world based on our perceptions of it. Because perception and observation is fallible, our constructions must be imperfect. It is difficult to believe that individual scientists would perfectly see the reality as it is. Scientists, like any other human being, are inherently biased by their cultural experiences, worldviews, and so on. We are all biased and all of our observations are affected (theory- laden). So what is objectivity? Positivists and post-positivists differ in the way they look at objectivity. Positivists believed that objectivity is a characteristic that resided in the individual scientist. Scientists are responsible for putting aside their biases and beliefs and seeing the world as it 'really' is. Post-positivists reject the idea that any individual can see the world perfectly as it really is. Our best hope for achieving objectivity is to triangulate across multiple fallible perspectives. Thus, objectivity is not the characteristic of an individual; it is inherently a social phenomenon. Although positivism conceived a social and cultural life as objective, quantitative, or empirical, and governed by laws, it was increasingly argued that social life was in many ways subjective and socially constituted. It has been argued by post-positivism that positivistic science was inappropriately applied to social and cultural life. This
Page 19
required a research methodology that could capture the actual nature of social and cultural life.
Exercise
What is the main theme of positivism? In your opinion, which tenet best describes modern scientific research?
Unit Summary
There are two broad sources of knowledge: Everyday experience as a source of knowledge and scientific method as a source of knowledge. Everyday sources of knowledge include the method of tenacity, authority, a priori method and common sense. The scientific method as a source of knowledge represents scientific research. The goal of research is problem solving. The problem could be of an immediate and practical value or they could be of theoretical nature. The specific purposes of scientific research include description, explanation, prediction, control and comparison. Scientific research relies on the application of the scientific method, a harnessing of curiosity. Research provides scientific information and theories for the explanation of the nature and the properties of the world around us. Research is systematic, controlled, empirical and critical investigation of natural, behavioral and social phenomena. There is difference between research method and research methodology the former represents a particular research technique used to gather data about the phenomenon being studied and the later describes the theory of how inquiry should proceed. Scientific research has epistemological and philosophical roots. Positivism and post-positivism are the two philosophical perspectives discussed in this unit.
Research is the systematic process of collecting and analyzing information to increase our understanding of the phenomenon under study.
Assignment
1. List the everyday sources of knowledge and give examples for each of these sources of knowledge. ______________________________________________________
Page 20
______________________________________________________ 2. What are the limitations of using everyday experience as sources of knowledge? ________________________________________________________ ____________________________________________________ 3. How do lay people and scientists differ in the way they use theories? ________________________________________________________ ____________________________________________________ 4. Some researchers argue that positivism is less successful in its application to the study of human behavior? Why? ________________________________________________________ ____________________________________________________ 5. Why is the scientific method superior to any other sources of knowledge? ________________________________________________________ ____________________________________________________ 6. Research methods can be considered as simply technical exercises. Argue against or for by citing evidences.. ________________________________________________________ ______________________________________________________ 7. Describe the limitations of scientific method by giving at least one example. ________________________________________________________ ________________________________________________________ 8. What is objectivity for positivism and post-positivism? ________________________________________________________ ________________________________________________________
References
1. Belay Tefera (2007). Research Methods in Behavioral Sciences: Modular Text for Psychology Students.
Page 21
2. de Marrais, K & Lapan, S.D. (eds.) (2004). Foundations for Research: Methods of Inquiry in Education & the Social Sciences. Mahwah: Lawrence Erlbaum Associates. 3. Gay, L.R.; Mills, G.E.; & Airasian, P. (2009). Educational Research: Competencies for Analysis and Applications (9th ed.). New Jersey: Pearson. 4. Marczyk, G.; DeMatteo, D.; and Festinger, D. (2005). Essentials of Research Design and Methodology. New Jersey: John Wiley & Sons, Inc. 5. Mitchell, M.L. & Jolley, J.M. (2004). Research Design (5th ed.). Wadsworth: Thomson. 6. Ray, W. J. (2003). Methods Toward a Science of Behavior and Experience (7th ed.). Wadsworth: Thomson.
Page 22
UNIT 2
Types of Research
Key Concepts
Curiosity/motivation Descriptive Explanatory Exploration Qualitative Quantitative
Objectives
After completing this unit you will be able to: Classify research into different types based on different criteria; Describe the difference between basic research and applied research; Identify the link between basic and applied research; Identify the situations where basic or applied research can be conducted List the aims of basic and applied research; Discriminate among descriptive, explanatory and exploratory research; Identify the different types of descriptive and explanatory research; Discuss when to use descriptive or explanatory or exploratory research; Explain the uses of each of the three types of research; Define qualitative and quantitative research; and Distinguish between qualitative and quantitative research.
Page 23
As you will recall, it has been mentioned in Unit One that the goal of research is problem solving. The nature of the problem that the research attempts to solve could be theoretical or practical building a theory or solving immediate practical problems. These two types of problems that the research tries to solve leads to two broad classifications of research: basic research, and applied research. 1.2 Classification of Objectives of Research Research based on the Specific
From your knowledge of Unit One, research also addresses specific purposes. Your interest could be describing a phenomenon of Addis Ababa University Page 24
interest or explaining causal link between two variables. Or you may be interested in comparing two or more groups on the basis of a particular phenomenon. Research, therefore, can be classified differently when the issues at hand are specific objectives of research. Hence, according to the specific objectives research can be classified as: descriptive, explanatory, or exploratory research.
1.3 Classification of Research based on Approaches of Research Research can be classified as qualitative research and quantitative research when the issue at hand is the approaches to be employed in conducting research. As mentioned above, this structure is mainly for educational purpose. Otherwise, some even argue that these approaches lie on a continuum ranging from unstructured qualitative approach to a structured quantitative approach. 1.4 Classification of Research based on Designs
Another way of classifying research is by design. Once the researcher has determined the specific question to be answered and has operationalized the variables and research question into a clear, measurable hypothesis, the next task is to consider a suitable research design. Although there are endless ways of classifying research designs, they usually fall into one of three general categories: experimental, quasi-experimental, and non-experimental. 1.5 Classification or Research by Type of Data
Depending of the type of data generated and used research can be classified as Primary research (also called field research) and Secondary research (also known as desk research). Primary research involves the collection of data that does not already exist whereas secondary research involves the summary, collation and/or synthesis of existing data rather than generating primary data, where data are collected from, for example, research subjects or
Page 25
Research can also be classified based on fields of study. Therefore, there are: natural science research, social science research, educational research, behavioral science research, health science research, etc.
Exercise
What is the difference between natural science research and social science research? Describe the difference between descriptive and explanatory research? How do you choose a particular type of research?
Page 26
2.1
Some science, often referred to as pure science, is about explaining the world around us and trying to understand how the universe operates. It is about finding out what is already there without any greater purpose of research than the explanation itself. It is a direct descendent of philosophy, where philosophers and scientists try to understand the underlying principles of existence. Basic research (also called fundamental or pure research) has as its primary objective the advancement of knowledge and the theoretical understanding of the relations among variables. It is basically concerned with the formulation of a theory or a contribution to the existing body of knowledge. That is, basic research is designed to add to an organized body of scientific knowledge and does not necessarily produce results of immediate practical value. The major aims of basic research include: Obtaining and using empirical data to formulate, expand, or evaluate theory; and Discovery of knowledge solely for the sake of knowledge. Hence, basic research may take any of the following forms: Discovery: where a totally new idea or explanation emerges from empirical research which may revolutionize thinking on that particular topic. Invention : where a new technique or method is created. Reflection : where an existing theory, technique or group of ideas is re-examined possibly in a different organizational or social context. The driving force in basic research is a researchers curiosity or interest in a scientific question. The motivation behind is to expand human knowledge, not to create or invent something that has practical significance. Whilst offering no direct benefits, pure research often has indirect benefits, which can contribute greatly to the advancement of humanity. For example, pure research into the structure of the atom has led to x-rays, nuclear power and silicon chips. In general, basic research: Represents a rigorous and structured type of analysis; Employs careful sampling procedures in order to extend the findings beyond the group or situation; and
Basic research lays down the foundation for the applied research that follows
Page 27
Has little concern for the application of the findings or social usefulness of the findings.
2.2
Basic research lays down the foundation for the applied research that follows
Applied research is designed to solve practical problems of the modern world, rather than to acquire knowledge for knowledge's sake. One might say that the goal of the applied scientist is to improve the human condition. It is undertaken to solve immediate practical problem and the goal of adding to the scientific knowledge is secondary. Some scientists feel that the time has come for a shift in emphasis away from purely basic research and toward applied science. This trend, they feel, is necessitated by the problems resulting from globalization, migration, overpopulation, pollution, and the overuse of the earth's natural resources. Applied scientists might look for answers to specific questions that help humanity, for example medical research or environmental studies. Such research generally takes a specific question and tries to find a definitive and comprehensive answer. The purpose of applied research is about testing theories, often generated by pure science, and applying them to real situations, addressing more than just abstract principles. Applied scientific research can be about finding out the answer to a specific problem, such as Is global warming avoidable? or Does a new type of medicine really help the patients? The primary purpose for applied research is discovering, interpreting, and the development of methods and systems for solving practical problems on a wide variety of real life situations of our world and the universe. Applied research: Is conducted in relation to actual problems and under the conditions in which they are found in practice; Employs methodology that is not as rigorous as that of basic research; Yields findings that can be evaluated in terms of local applicability and not in terms of universal validity. 2.3 Distinction between Basic and Applied Research
Traditionally, basic and applied research were seen as activities of a different nature, carried out by different institutions and financed from
Page 28
different sources. It is, however, difficult to draw a clear boundary between these two types of research. Researchers believe that basic and applied types of research should not be thought of as two mutually exclusive categories, into one or the other of which all instances of research can be placed unambiguously. Even thinking of basic and applied as representing ends of a continuum is an oversimplification because research often yields results that have both theoretical and practical implications. It may be appropriate to view the distinction as better considered a matter of emphasis than as representing a true dichotomy. Some researchers prefer to focus on one type of research or the other, addressing natural curiosity or concerns about specific problems faced by humans. Others may flit back and forth, or find themselves starting a research which could be considered basic which turns applied, or vice versa. Although for applied researchers the focus of research for which the practical motivation is relatively strong, we believe that much of their work include both theoretical and practical concerns and the same applies true for researchers who conduct basic research.
Exercise
Is there commercial value involved in the discoveries that result from basic research? Is basic research important for progress to take place? When do we use basic research? Is applied research different from action research? Is applied research the order of the day? If yes why? When do we use applied research? How do basic and applied researches differ? Which is more important? When is each type of research useful? Can you give examples?
exists. On the other hand, explanatory research, aims at establishing the cause and effect relationship between variables. The researcher uses the facts or information already available to analyze and make a critical evaluation of the data/information. Exploratory research is less formal, sometimes even unstructured and focuses on gaining background information and helps to better understand and clarify a problem. It can be used to develop hypotheses and to develop questions to be answered. 3.1 Descriptive Research
As said earlier, the goal of descriptive research is to describe some aspect of a phenomenon, i.e., the status of a given phenomenon. It can help understand a topic and lead to causal analysis. Descriptive research, therefore, involves a variety of research methods to achieve its goal. The methods that come under descriptive research are: Surveys Correlation studies Observation studies Case studies The details of the methods are given in the subsequent units. 3.1.1. Surveys
Surveys gather data at a particular point in time with the intention of describing the nature of existing conditions, or identifying standards against which existing conditions can be compared, or determining the relationships that exist between specific events. They may vary in their levels of complexity and in terms of their scope. Typically survey method is used to scan a wide field of issues, populations, programs etc. in order to measure or describe any generalized features. It is useful in that it usually: gathers data on a one-shot basis and hence is economical and efficient; represents a wide target population generates numerical data; provides descriptive, inferential and explanatory information; manipulates key factors and variables to derive frequencies; and
Page 30
Surveys can be distinguished as cross-sectional and longitudinal. Longitudinal surveys can further be classified as trend studies, cohort studies and panel studies.
Exercise
In what situation is survey more appropriate? Distinguish among the different types of surveys. 3.1.2 Correlational Studies
Correlational studies trace relationships among two or more variables in order to gain greater situational insight. We may wish to know, for example, whether there is relationship between sex and choice of field of study; whether criminal behavior is related to social class background; or whether an association exists between the number of years spent in full-time education and subsequent annual income. In this case we conduct correlational study- where researchers measure a number of variables for each participant, with the aim of studying the associations among these variables. The purpose of correlational studies is not to establish cause-effect relationship among variables but to determine whether the variables under study have some kind of association or not. Variables being studied may have positive or negative relationship or they may not have relationship at all.
Exercise
Give examples of variables that are positively or negatively related, or are unrelated. 3.1.3 Observation Studies
There are many instances where we may be interested in a behavior that occurs in its natural environment. In such situation we conduct observation studies. What is observation study? Observation studies, as their name implies, involve observing and recording of behavior or trait or attribute as it occurs in its natural settings.
Page 31
In general, observation study has the following important features: The first and most fundamental principle is that of noninterference. Second, observation study involves the observation and detection of invariants, or behavior patterns or other phenomena that exist in the real world. Third, observation study is particularly useful when we know little or nothing about a certain subject. Finally, observation study is basically descriptive. Although it can provide a somewhat detailed description of a phenomenon, it cannot tell us why the phenomenon occurred.
Exercise
Give examples of variables that can be studied most effectively with observation studies. 3.1.4 Case Studies
Case studies emphasize detailed contextual analysis of a limited number of events or conditions and their relationships. They are largely descriptive examinations, usually of a small number of sites (small towns, hospitals, schools). Case studies can provide very engaging, rich explorations of a project or application as it develops in a real-world setting.
Exercise
When do you decide to use case study than surveys or correlational study? What are the problems associated to case study?
3.2
Explanatory Research
When we encounter an issue that is already known and have a description of it, we might begin to wonder why things are the way they are. The desire to know "why," to explain, is the purpose of explanatory research. It is a continuation of descriptive research and builds on exploratory and descriptive research and goes on to identify the reasons for something that occurs. The researcher goes beyond merely describing the characteristics, to analyze and explain why or how something is happening. Thus, explanatory or analytical research aims to understand phenomena by discovering and
Page 32
measuring causal relations among them. That is, explanatory research looks for causes and reasons. For example, it is one thing to describe the crime rate in a country, to examine trends over time or to compare the rates in different countries. It is quite a different thing to develop explanations about why the crime rate is as high as it is why some types of crime are increasing or why the rate is higher in some countries than in others.
Exercise
The way in which researchers develop research designs is fundamentally affected by whether the research question is descriptive or explanatory. Discuss. Explanatory research builds on both exploratory and descriptive researches. It involves: Explaining things not just reporting. Why? Elaborating and enriching a theory's explanation. Determining which of several explanations is best. Determining the accuracy of the theory; test a theory's predictions or principle. Providing evidence to support or refute an explanation or prediction. Testing a theory's predictions or principles. Answering the why questions involves developing causal explanations. Causal explanations argue that phenomenon Y is affected by factor X. In this example, the cause or the reason is Y which is technically termed as independent variable and the effect or the behavior is X which is also known as dependent variable. Some causal explanations will be simple while others will be more complex. There are two types of explanatory research: Experimental research Ex post facto research 3.2.1 Experimental Research
In its simplest form, experimental research involves comparing two groups on one outcome measure to test some hypothesis regarding causation. The key element in true experimental research is scientific control and the ability to rule out alternative explanations. An experimenter interferes with the natural course of events, in order
Page 33
to construct a situation in which competing theories can be tested. It is the best method when the purpose of research is to determine causal influences between variables. In experimental research, the researcher intentionally manipulates one variable to measure its effect on the other. 3.2.2 Ex Post Facto Research
Ex post facto research is a method of teasing out possible antecedents of events that have happened and cannot, therefore, be engineered or manipulated by the investigator. Ex post facto in research means after the fact or retrospectively and refers to those studies which investigate possible cause-and-effect relationships by observing an existing condition or state of affairs and searching back in time for plausible causal factors. If a researcher is interested in investigating the reasons why fatal traffic accident is increasing in Ethiopia, he/she can not do it by randomly assigning research participants into experimental and control group. There is no way in which a researcher can study the actual accidents because they have happened . What a researcher can do, however, is to attempt to reconstruct the causal link by studying the statistics, examining the accident spots, and taking note of the statements given by victims and witnesses. This means that a researcher is studying the independent variable or variables in retrospect for their possible relationship to, and effects on, the dependent variable or variables.
Exercise
What are the characteristics of ex post facto research? Why do we use ex post facto research? What is the difference between experimental research and ex post facto research? 3.3 Exploratory research
Exploratory research is conducted when there are few or no earlier studies to which references can be made for information. It provides insights into and comprehension of an issue or situation for more rigorous investigation later. Exploratory research is a type of research conducted because a problem has not been clearly defined. Its purpose is to gain background information and better understand and clarify a problem. Exploratory research helps to: determine the best research design, develop hypotheses,
Page 34
develop questions to be answered, understand how to measure a variable, determine data collection method, and determine selection of subjects.
It can be said that exploratory research is generally a precursor to a more formal study. It helps save time, and resources. If a researcher is starting a new project, she/he probably should start with exploration. Exploratory research often relies on secondary research such as reviewing available literature and/or data, or qualitative approaches such as informal discussions with consumers, employees, management or competitors, and more formal approaches through in-depth interviews, focus groups, projective methods, case studies or pilot studies. The results of exploratory research are not usually useful for decision-making by themselves, but they can provide significant insight into a given situation. Although the results of qualitative research can give some indication as to the "why", "how" and "when" something occurs, it cannot tell us "how often" or "how many."
Exercise
What are the methods used in exploratory research? The aim of exploratory research is to look for patterns, ideas or hypotheses rather than testing or confirming a hypothesis. WHY?
Page 35
4.1
Qualitative Research
Qualitative research involves studies that do not attempt to quantify their results through statistical summary or analysis. Qualitative research seeks to describe various aspects about behavior and other factors studied in the social sciences and humanities. In qualitative research data are often in the form of descriptions, not numbers. But sometimes results of qualitative research are subjected to relatively less rigorous quantitative treatment. Often the goal of qualitative research is to look for meaning. That is, stress is laid on the socially constructed nature of reality, the intimate relationship between the research and researched and situational constraints that shape the enquiry. Qualitative research is characterized by adherence to diverse array of orientations and strategies for maximizing the validity of trustworthiness of study procedures and results. It is thus a type of empirical enquiry that entails purposive sampling for gathering data. It typically involves in-depth interviews, group discussions, artifact studies, projective techniques, and observations without formal measurement. A case study, which is an in-depth examination of one person, is a form of qualitative research. Qualitative research is much more time consuming, but provides more richness to the data. In epistemological terms, qualitative research is identified with phenomenological and interpretative research.
Exercise
What is qualification in qualitative research? What are the advantages and disadvantages of qualitative research? 4.2 Quantitative Research
Quantitative research is the systematic and scientific investigation of quantitative properties and phenomena and their relationships. The objective of quantitative research is to develop and employ mathematical models, theories and hypotheses pertaining to natural phenomena. The process of measurement is central to quantitative research because it provides the fundamental connection between empirical observation and mathematical expression of an attribute. It usually starts with a theory or a general statement proposing a general relationship between variables. With this approach it is likely that the researchers will take an objective position and their approach will be to treat phenomena as hard and real. As a result
Page 36
proponents of such studies claim that quantitative research is undertaken in a value free framework. Quantitative researchers favor methods such as surveys and experiments, and will attempt to test hypotheses or statements with a view to infer from the particular to the general. This approach typically concentrates on measuring or counting and involves collecting and analyzing numerical data and applying statistical tests.
Exercise
In what sense is quantitative research different from qualitative research? What are the advantages and disadvantages of quantitative research? What does quantification mean? 4.3 Characteristics Research of Qualitative and Quantitative
The main characteristics of qualitative and quantitative research are summarized in the following table.
Characteristics Typical Data Collection Methods Formulation of Questions and Answers Selection of Respondents Qualitative Research Participant observation, semi-structured interviews, introspection. Open loosely specified questions and possible answers. Questions and answers are exchanged in two way communication between researcher and research participant. Information maximization guides the selection of respondent. Every respondent may be unique (key person). Quantitative Research Laboratory observations, questionnaire, schedule or structured interviews. Closed questions and answer categories to be prepared in advance. Representativeness as proportion of population N. Sample selection, sample size according to assumptions about distribution in population N. Respondents should be directly comparable. After data collection Standard statistical methods are frequently used Cross tabulations, correlation analysis and tests of significance on numerical data A-priori deducted theories are operationalised and tested on data. The process of analysis is basically deductive.
Timing of Analysis Application of Standard Methods of Analysis Typical forms of Analysis The Role of Theories in the Analysis
Parallel with data collection Are rarely used. Methods of analysis are formulated during the data collection process. Critical analysis and interpretation of source materials. Selection, systematizing and summarizing interview transcripts and observations. Existing theories are typically used only as point of departure for the analysis. Theories are further developed by forming new concepts and relations. The contents of the new concepts are studied and illustrated. Practical application of theory is illustrated by cases.
Page 37
between
Qualitative
and
Quantitative
The above summary also provides us with important features where qualitative and quantitative researches differ. In addition we may summarize the differences between the two approaches as follows: 1. They differ in terms of the nature of reality. Quantitative researchers believe that there are human characteristics and processes that constitute a form of reality in that they occur under a wide variety of conditions and thus can be generalized to some degree. On the other hand, qualitative researchers believe that there are no human characteristics and processes from which generalizations can emerge. Instead, each subject or phenomenon is different and can only be studied holistically. 2. They also differ in terms of the relationship of the researcher to the research participants. In quantitative research, the researcher can function independently of the participants of the research to a major degree, although some interaction is probably inevitable. Whereas in qualitative research the researcher and the research participant interact to influence one another and are inseparably interconnected. In addition, in qualitative research the research participants play a role in interpreting the outcomes of the study. 3. Qualitative research often does not know what it is looking for whereas quantitative research does - designs and measurements decisions are made prior to conducting the research. In qualitative research the design of the research emerges as the research progresses. That is, in qualitative inquiry the investigator starts with a very tentative design and develops the design as the inquiry progresses. 4. Qualitative researchers are often immersed in the data and look at it more subjectively whereas quantitative research demands objectivity. 5. Qualitative research typically employs small samples than quantitative research.
Page 38
6. The ultimate goal of research in quantitative research is to develop a body of knowledge in the form of generalization that will hold at least to some degree over time and in contexts similar to those in which the generalizations were developed. In Qualitative research the aim of inquiry is to develop a body of knowledge that is unique to the individual being studied, and that can be used to develop hypotheses about the individual. 7. Qualitative research describes meaning or discovery whereas quantitative establishes relationship or causation. That is, in quantitative research, given sufficient research with valid measures, every action or effect can be explained by a cause or combination of causes that precede the effect in time. In qualitative research all elements in the situation are in a state of mutual simultaneous interaction so it is impossible to distinguish causes from effects. 8. Quantitative inquiry should be made as value-free as possible through the use of sound research design and objective data collection procedures. Qualitative research, on the other hand, is value-bound because inquiries are inevitably influenced by the values of the researcher, the choice of theory, the methodology employed, and the values inherent in the context of the inquiry. 9. Qualitative research uses unstructured data collection whereas quantitative research uses structured data collection methods. In qualitative research, humans are the primary data-gathering instrument. Non-human instruments measurement instruments are the data gathering tools in quantitative research.
Exercise
Qualitative and quantitative approaches differ in terms of the objectives of research. Discuss. Which of the two approaches emphasizes the use of intuitive insights in conducting research?
Page 39
Unit Summary
There are different ways of classifying research. As illustration, in this module research is classified based on goal of research, specific objectives of research, approaches of research, designs, the type of data used in research, and fields of study. In terms of goals, research is divided into basic and applied research. In terms of specific objectives, research is divided into descriptive, explanatory, and exploratory research. In terms of approach, research is divided into qualitative and quantitative research. In terms of design, research is divided into experimental, quasi-experimental, and non experimental research. In terms of the type of data to be generated, research can be classified as primary and secondary research. In terms of fields of study, research can be classified as natural science, social science, health science, engineering, behavioral science, etc. research. The aim of basic research is the advancement of knowledge and involves rigorous and structured type of analysis. Applied scientific research can be about finding out the answer to a specific problem. Descriptive research sets out to describe and to interpret what is. Explanatory research, aims at establishing the cause and effect relationship between variables. Exploratory research focuses on gaining background information and helps to better understand and clarify a problem. The methods that come under descriptive research are: surveys, correlation studies, observation studies, and case studies. There are two types of explanatory research: experimental research and ex post facto research Qualitative and quantitative approaches differ in terms of the nature of reality, relationship of the researcher to the research participants, the possibility of generalizations, the possibility of causal linkage, and in terms of the role of values in research.
Page 40
References
1. Belay Tefera (2007). Research Methods in Behavioral Sciences: Modular Text for Psychology Students. 2. de Marrais, K & Lapan, S.D. (eds.) (2004). Foundations for Research: Methods of Inquiry in Education & the Social Sciences. Mahwah: Lawrence Erlbaum Associates. 3. Gay, L.R.; Mills, G.E.; & Airasian, P. (2009). Educational Research: Competencies for Analysis and Applications (9th ed.). New Jersey: Pearson. 4. Marczyk, G.; DeMatteo, D.; and Festinger, D. (2005). Essentials of Research Design and Methodology. New Jersey: John Wiley & Sons, Inc. 5. Mitchell, M.L. & Jolley, J.M. (2004). Research Design (5th ed.). Wadsworth: Thomson. 6. Ray, W. J. (2003). Methods Toward a Science of Behavior and Experience (7th ed.). Wadsworth: Thomson.
Assignment
1. Which of the two types of research (basic or applied) will be the focus of your graduate research? _____________________________________________________ _____________________________________________________ 2. Is there commercial value involved in the discoveries that result from basic research? _______________________________________________________ _______________________________________________________ 3. Is basic research important for progress to take place? _______________________________________________________ _______________________________________________________ 4. When do we use basic research? _______________________________________________________ _______________________________________________________ 5. Is applied research different from action research? _______________________________________________________ _______________________________________________________ _
Page 41
6. When do we use applied research? ________________________________________________________ ________________________________________________________ 7. How do basic and applied researches differ? Is one type of research more important than the other? ________________________________________________________ ________________________________________________________ 8. When is each type of research useful? Can you give examples? ________________________________________________________ ________________________________________________________ 9. Why is qualitative research inductive in its nature? ________________________________________________________ ________________________________________________________ 10. Which of the two approaches involves flexible methods of data collection? ________________________________________________________ ________________________________________________________
Page 42
UNIT 3
Objectives
The objective of this unit is to demonstrate the various steps involved in the development of a research proposal. After completing this unit you should be able to: Know the contents of a research proposal Describe how to identify a research topic Identify a research question/hypothesis Set the objectives/aims Develop a research design and methods Prepare a review of the literature related to the topic Cite references Prepare work plan Identify resources required and prepare a budget Produce a complete research proposal problem and formulate a research
Page 43
benefits of his or her own experience and knowledge. This sharing will add greatly to the richness and relevance of the research methods module. There will be lectures, exercises, individual assignments and group discussions. Students will work individually or in small groups and design mini-research proposals, step by step, on a problem (research question) they have selected. As each new step is introduced, new concepts and research procedures will be presented. The participants will immediately apply these in the proposals they are developing.
Page 44
Criteria for selecting a research topic: Relevance/Significance Avoidance of duplication Urgency of data needed (timeliness) Feasibility of study Applicability of results Interest to the researcher Ethical acceptability
1.3 What is a research proposal? After proper and complete planning of a research, the plan should be written down. The research proposal is the detailed plan of study. The term "research proposal" indicates that a specific course of action will be followed. It is a document which sets out your ideas in an easily accessible way. The intent of the written research proposal is to present a focused and scholarly presentation of a research problem and plan. The early presentation of a research plan in the post graduate training of students is intended to promote critical and analytical thinking, focused research effort, and extensive interaction with their thesis advisor throughout the research. The objective in writing a proposal is to describe what you will do, why it should be done, how you will do it and what you expect will result. Being clear about these things from the beginning will help you complete your research in a timely fashion. A vague, weak or fuzzy proposal can lead to a long, painful, and often unsuccessful research writing exercise. A clean, well thought-out, proposal forms the backbone for the research itself. A good research proposal hinges on a good idea. Getting a good idea hinges on familiarity with the topic. This assumes a longer preparatory period of reading, observation, discussion, and incubation. Read everything that you can in your area of interest. Figure out what are the important and missing parts of our understanding. Figure out how to build/discover those pieces. Live and breath the topic. Talk about it with anyone who is interested. Then just write the important parts as the proposal. The written proposal: forces the students to clarify their thoughts and to think about all aspects of the study; is a necessary guide if a team is working on the research; is essential if the study involves research on human subjects or on experimental animals, in order to get the institutions ethical approval;
Page 45
From the process of the development of the research proposal, students benefit from the advise of their supervisor(s), experts and colleagues in referring to their plan. But once a proposal for a study has been developed and approved, and the study has started and progressed, it should be adhered to strictly and should not be changed. Violations of the proposal can discredit the whole study. A well-thought out and well-written proposal can be judged according to three main criteria. Is it adequate to answer the research question(s), and achieve the study objective? Is it feasible in the particular set-up for the study? Does it provide enough detail that can allow another investigator to do the study and arrive at comparable results? Issues to remember: Know your area of expertise: what are your strengths and what are your weaknesses? Play to your strengths, not to your weaknesses. Do not assume that, because you do not understand an area, no one understands it or that there has been no previous research conducted in the area. If you want to get into a new area of research, learn something about the area before you write a proposal. Research previous work. Be a scholar. Before you start work on your research proposal, find out whether youre required to produce the proposal in a specific format. Most graduate programs at Addis Ababa University have a general outline and a guide as to how many pages to produce.
Exercise
Why do you need to write a good research proposal? Who do you think will want to read your research proposal?
Page 46
of a proposal are described in this unit in the order in which they most logically appear in a proposal. However, when it comes to related research, the inquirer may find it useful, even necessary, to incorporate some parts of the discussion into other sections of the proposal.
Issues to remember: It is important to remember the components will not always appear in all postgraduate programs at AAU, as separate sections, or in the order listed here. Once you've learned the basic rules for research proposal, you can apply them to any research discipline. Components of a research proposal: 1. 2. 3. 4. 5. 6. 7. 8. 9. Title page Summary/Abstract Introduction/Background Statement of the problem Literature review Hypotheses /Questions Conceptual framework Objective/Aim of the study Research methods, materials and procedures o Study area o Study design o Study subjects o Eligibility Criteria (if any) o Sample size o Sampling methods o Method of data collection o Description of variables o Data quality assurance o Operational definitions o Plan of data analysis 10. Work plan 11. Budget 12. References 13. Appendices/Annexes 2.1 Title page A title ought to be well studied, and to give, so far as its limits permit, a definite and concise indication of what is to come. The title of your research proposal should state your topic exactly in the smallest Addis Ababa University Page 47
possible number of words. Put your name, the name of your department/faculty/college, the name of your advisor(s) and date of delivery under the title. All words in the title should be chosen with great care, and association with one another must be carefully managed. The title page identifies the proposal and provides the endorsement of appropriate body (advisor). A good title is defined as the fewest possible words that adequately describe the contents of the study. Title is a label: it is not a sentence. Titles should almost never contain abbreviations. The title page has no page number and it is not counted in any page numbering.
Exercise
What do you think of the following the research topics? Discuss on their merits and provide your own alternative titles. How does the human brain work when faced with stress? The workings of the human brain in times of stress. Stress and the human brain. Effect of stress on short-term memory Abebes memory function during semester final exams
2.2 Summary/Abstract The abstract is a one page brief summary of the thesis proposal. It needs to show a reasonably informed reader why a particular topic is important to address and how you will do it. To that end, it needs to show how your work fits into what is already known about the topic and what new contribution your work will make. Specify the question that your research will answer, establish why it is a significant question; show how you are going to answer the question. Do not put information in the abstract that is not in the main text of your research proposal. Do not put references, figures, or tables in the abstract.
First impressions are strong impressions: make your title an attention grabber.
Page 48
Issues to remember: The abstract is a concise summary of the material presented in the proposal. Though it appears at the front of the proposal, it is written last. A well-prepared summary enables the reader to Identify the basic content of a document quickly and accurately, Determine its relevance to their interests, and Decide whether they need to read the document in its entirely
Exercise
Do you think it would be appropriate to include your methods in the abstract? Summarizing a wide topic is more difficult than it sounds. By way of illustration, make single sentence statements on the following topics: The role of water in living organisms. Differences between males and females. The political history of Ethiopia. Status of child health care in Ethiopia. Environmental impact of urban living.
2.3 Introduction/background The introduction is the part of the proposal that provides readers with the background information for the research proposal. Its purpose is to establish a framework for the research, so that readers can understand how it is related to other research. Be sure to include a hook at the beginning of the introduction. This is a statement of something sufficiently interesting to motivate your reader to read the rest of the proposal, it is an important/interesting scientific problem that your study either solves or addresses. The introduction should cite those who had the idea or ideas first, and should also cite those who have done the most recent and relevant work. You should then go on to explain why more work is necessary (your work, of course.) The introduction also should address the following points: Sufficient background information to allow the reader to
Page 49
understand the context and significance of the question you are trying to address. Proper acknowledgement of the previous work on which you are building. Sufficient references such that a reader could, by going to the library, achieve a sophisticated understanding of the context and significance of the question. The introduction should be focused on the research question(s). All cited work should be directly relevant to the goals of the research. Explain the scope of your work, what will and will not be included. A verbal "road map" or verbal "table of contents" guiding the reader to what lies ahead. Is it obvious where introductory material ("old stuff") ends and your planned contribution ("new stuff") begins?
Issues to remember: In summary, the introduction/background section should contain a rationale for your research. Why are you undertaking the project? Why is the research needed? This rationale should be placed within the context of existing research or within your own experience and/or observation. You need to demonstrate that you know what youre talking about and that you have knowledge of the literature surrounding this topic. If youre unable to find any other research that deals specifically with your proposed project, you need to say so, illustrating how your proposed research will fill this gap. If there is other work that has covered this area, you need to show how your work will build on and add to the existing knowledge. Basically, you have to convince people that you know what youre talking about and that the research is important.
Exercise
Is it appropriate to include in the introduction theories, hypothesis and findings that go against your stated hypothesis? Is it appropriate to include research works in progress that offer an alternative hypothesis?
2.4 Statement of the problem Most research proposals, whether designed for master's theses or doctoral dissertations, may be considered as responses to a
Page 50
Statement of the problem encapsulates the question you are trying to answer.
problem. A problem might be defined as the issue that exists in the literature, theory, or practice that leads to a need for the study. The prospective researcher should think on what caused the need to do the research (problem identification). The question that he/she should ask him/herself is: Are there questions about this problem to which answers have not been found up to the present? The research problem should be stated in such a way that it would lead to analytical thinking on the part of the researcher with the aim of possibly concluding solutions to the stated problem. The problem statement describes the context for the study and it also identifies the general analysis approach. It is important in a proposal that the problem stand outthat the reader can easily recognize it. Effective problem statements answer the question Why does this research need to be conducted. If a researcher is unable to answer this question clearly and succinctly, and without resorting to hyper-speak, then the statement of the problem will come off as ambiguous and diffuse. The most frequent dilemma among graduate students is their seemingly aimless search for a problem significant enough to pursue and discrete enough to handle. A well-articulated statement of the problem establishes the foundation for everything to follow in the proposal and will render less problematic most of the conceptual, rhetorical and methodological obstacles typically encountered during the process of proposal development. This means that, in subsequent sections of the proposal, there should be no surprises, such as categories, questions, variables or data sources that come out of nowhere: if it can't be found in the problem statement section, at least at the implicit level, then it either does not belong in the study or the problem statement needs to be re-written.
Exercise
Formulate a problem statement in your specific area of research interest Evaluate the research questions provided below and answer the following questions: - Do the questions offer significant area of research? - Are they testable (i.e. can you obtain answers to these questions?) - Are they too broad/narrow? - Propose alternatives that refine the questions. Does frequent use of mobile phones increase the risk
Page 51
of brain cancer? Which of the following cultivars (varieties) of sorghum produces the highest yield in semi-arid regions of Ethiopia? Does capital punishment serve as a deterrent to violent criminals?
2.5 Literature review To conduct research regarding a topic, by implication, means that the researcher has obtained sound knowledge with regard to the research topic. It is therefore imperative that the researcher, at the time of the submission of the research proposal, clearly indicates what theoretical knowledge he possesses about the prospective research. What is a literature review? Literature review is not a compilation of every work written about a topic. It is not simply a list of sources reviewed separately for their own merit. A literature review is a description of the literature relevant to a particular field or topic. It gives an overview of what has been said, who the key writers are, what are the prevailing theories and hypotheses, what questions are being asked, and what methods and methodologies are appropriate and useful. As such, it is not in itself primary research, but rather it reports on other findings. A literature review uses as its database reports of primary or original scholarship, and does not report new primary scholarship itself. The primary reports used in the literature may be verbal, but in the vast majority of cases reports are written documents. The types of scholarship may be empirical, theoretical, critical/analytic, or methodological in nature. Second a literature review seeks to describe, summarize, evaluate, clarify and/or integrate the content of primary reports. The stages of a literature review Define the problem It is important to define the problem or area which you wish to address. Having a purpose for your literature review will narrow the
The literature review asks how similar and related questions have been answered before.
Page 52
scope of what you need to look out for when you read. Carry out a search for relevant materials Relevant materials will probably comprise a range of media: books (monographs, text books, reference books); articles from journals, whether print or electronic (but make sure electronic journals have been subject to the peer review process); newspaper articles; historical records; commercial reports and statistical information; government reports and statistical information; theses and dissertations; other types of information which may be relevant to your particular discipline. Initial appraisal from raw bibliographical data: What are the authors credentials? are they experts in the field? are they affiliated with a reputable organization? What is the date of publication, is it sufficiently current or will knowledge have moved on? If a book, is it the latest edition? Is the publisher a reputable, scholarly publisher? If it is a journal, is it a scholarly journal peer reviewed? Appraisal based on content analysis: Is the writer addressing a scholarly audience? Do the authors review the relevant literature? Do the authors write from an objective viewpoint, and are their views based on facts rather than opinions? If the author uses research, is the design sound? Is it primary or secondary material? Do the authors have a particular theoretical viewpoint? What is the relationship of this work to other material you have read on the same topic, does it substantiate it or add a different perspective? Is the author's argument logically organized and clear to follow? If the author is writing from a practice-based perspective, what are the implications for practice? How to organize a literature review There are a number of ways of organizing a literature review. Here is
Page 53
one suggestion: A. Introduction: define the topic, together with your reason for selecting the topic. You could also point out overall trends, gaps, particular themes that emerge, etc. B. Body: this is where you discuss your sources. Here are some ways in which you could organize your discussion: o chronologically: for example, if writers' views have tended to change over time. There is little point in doing the review by order of publication unless this shows a clear trend; o thematically: take particular themes in the literature; o methodologically: here, the focus is on the methods of the researcher, for example, qualitative versus quantitative approaches. C. Conclusion: summarize the major contributions, evaluating the current position, and pointing out flaws in methodology, gaps in the research, contradictions, and areas for further study. Issues to remember: A literature review must do the following things: be organized around and related directly to the research question you are developing synthesize results into a summary of what is and is not known identify areas of controversy in the literature formulate questions that need further research
Ask yourself the following type of questions: What is the specific research question that my literature review helps to define? What type of literature review am I conducting? Am I looking at issues of theory? methodology? policy? quantitative research? qualitative research ? What is the scope of my literature review? What types of publications am I using? What discipline am I working in? How good was my information seeking? Has my search been wide enough to ensure I've found all the relevant material? Has it been narrow enough to exclude irrelevant material? Is the number of sources I've used appropriate for the length of my paper? Have I critically analyzed the literature I use? Do I follow through a set of concepts and questions, comparing items to Addis Ababa University Page 54
each other in the ways they deal with them? Instead of just listing and summarizing items, do I assess them, discussing strengths and weaknesses? Have I cited and discussed studies contrary to my perspective? Will the reader find my literature review relevant, appropriate, and useful?
Exercise
Is wikipedia an authoritative scholarly source of information? You are studying the impact of flooding on loss of livestock in a region of Ethiopia. Would the Ethiopian Herald newspaper be a reliable source of information for such a study? 2.6 Questions and/or Hypotheses Hypotheses and questions are linked to the speculative proposition of the problem statement, can be inferred from the overall conceptual framework of a study, and are of critical importance to data analysis and interpretation. In research studies, the term hypotheses implies a derivation, within a hypothetic-deductive theoretical system, of a particular assertion or prediction. The hypothesis is subject to test, i.e., to confirmation or rejection on empirical grounds. The term question implies an interrogative statement that can be answered by data, which is logically related to the same conceptual framework, but which does not necessarily stem from that framework through logical deduction. Questions are most often used in qualitative inquiry, although their use in quantitative inquiry is becoming more prominent. Hypotheses are relevant to theoretical research and are typically used only in quantitative inquiry. A research question poses a relationship between two or more variables but phrases the relationship as a question; a hypothesis represents a declarative statement of the relations between two or more variables. Deciding whether to use
questions or hypotheses depends on factors such as the purpose of the study, the nature of the design and methodology of the research. Make a clear and careful distinction between the dependent and independent variables and be certain they are clear to the reader. Hypotheses are
thus tentative statements that should either be acknowledged or rejected by means of research. Because hypotheses give structure and direction to research, the following aspects should be kept in mind when formulating a hypothesis:
Page 55
Hypotheses can only be formulated after the researcher has gained enough knowledge regarding the nature, extent and intensity of the problem. Hypotheses should figure throughout the research process in order to give structure to the research. Hypotheses are tentative statements/solutions or explanations of the formulated problem. Care should be taken not to oversimplify and generalize the formulation of hypotheses. The research problem does not have to consist of one hypothesis only. The type of problem area investigated, the scope of the research field are the determinate factors on how many hypotheses will be included in the research proposal.
Issues to remember: A research hypothesis is usually stated in an explanatory form, because it indicates the expected reference of the difference between two variables. In other words it verifies the reference that the researcher expects by means of incorporating selected research procedures. The research hypothesis may be stated in a directional or nondirectional form. A directional hypothesis statement indicates the expected direction of results, while a non directional one indicates no difference or no relationship.
Exercise
Formulate hypotheses for the questions at the end of 3.2.4
2.7
Conceptual framework
Every research activity is conceptualized and will be carried out within some contextual framework. This contextual framework is in part conceptual, in part valuational, and in part practical (or operational), and all of these factors must typically be considered. A conceptual framework is described as a set of broad ideas and principles taken from relevant fields of enquiry and used to structure a subsequent presentation. When clearly articulated, a conceptual framework has potential usefulness as a tool to scaffold research and, therefore, to assist a researcher to make meaning of subsequent findings. Such a framework should be intended as a starting point for reflection about the research and its context. The framework is a research tool intended to assist a researcher to develop awareness and understanding of the situation under scrutiny and to communicate this. Addis Ababa University Page 56
Exercise
What are some examples of constraining contextual factors? 2.8 Objective/aim of the study The objectives of a research delineate the ends or aim which the inquirer seeks to bring about as a result of completing the research undertaken. An objective may be thought of as either a solution to a problem or a step along the way toward achieving a solution; an end state to be achieved in relation to the problem. The objectives of a research project summarise what is to be achieved by the study. Objectives should be closely related to the statement of the problem. After statement of the primary objective, secondary objectives may be mentioned. Objectives should be simple (not complex), specific (not vague), stated in advance (not after the research is done), and stated using action verbs that are specific enough to be measured.
Commonly, research objectives are classified into general objectives and specific objectives. The general and specific objectives are logically connected to each other and the specific objectives are commonly considered as smaller portions of the general objectives. It is important to ascertain that the general objective is closely related to the statement of the problem. General objective o What exactly will be studied? o General statements specifying the desired outcomes of the proposed project Specific objectives o Specific statements summarizing the proposed activities and including description of the outcomes and their assessment in measurable terms o It identifies in greater detail the specific aims of the research project, often breaking down what is to be accomplished into smaller logical components o Specific objectives should systematically address the various aspects of the problem as defined under Statement of the Problem and the key factors that are
Page 57
assumed to influence or cause the problem. They should specify what you will do in your study, where and for what purpose Why should research objectives be developed? The formulation of objectives will help you to: Focus the study (narrowing it down to essentials); Avoid the collection of data which are not strictly necessary for understanding and solving the problem you have identified; and Organize the study in clearly defined parts or phases. Properly formulated objectives will facilitate the development of your research methodology and will help to orient the collection, analysis, interpretation and utilization of data.
Issues to remember: Keep in mind that when a proposal is evaluated, the anticipated results will be compared to the objectives. If the objectives have not been spelled out clearly, the proposal cannot be evaluated. Take care that the objectives of your study: Cover the different aspects of the problem and its contributing factors in a coherent way and in a logical sequence; Are clearly phrased in operational terms, specifying exactly what you are going to do, where, and for what purpose; Are feasible; Are realistic considering local conditions; Are phrased to clearly meet the purpose of the study; and Use action verbs that are specific enough to be evaluated.
The methods or procedures section is really the heart of the research proposal. You must decide exactly how you are going to achieve your stated objectives: i.e., what new data you need in order to shed light on the problem you have selected and how you are going to collect and process this data. The activities should be described with as much detail as possible, and the continuity between them should be apparent. Indicate the methodological steps you will take to answer every question, to test every hypothesis illustrated in the Questions/Hypotheses section or address the objectives you set.
Page 58
What belongs in the "methods" section of a research proposal? Information to allow the reader to assess the believability of your approach. Information needed by another researcher to replicate your experiment. Description of your materials, procedure, theory. Calculations, technique, procedure, equipment, and calibration plots. Limitations, assumptions, and range of validity. Description of your analytical methods, including reference to any specialized statistical software.
The proposal should describe in detail the general research plan. (may not necessarily be true for all types of research) Description of study area Description of study design Description of study participants Eligibility criteria ( if any) Determination of sample size (if any) Description of selection process (sampling method) Methods of data collection Description of the expected outcome and explanatory variables (if any) How data quality is ensured Operational definition Presentation of the data analysis methods Issues to remember: Be aware of possible sources of error to which your design exposes you. You will not produce a perfect, error free design (no one can). However, you should anticipate possible sources of error and attempt to overcome them or take them into account in your analysis. Important components of the materials and methods section are described in detail below. 2.9.1 Study design The study type may dictate certain research designs. More commonly, the study objectives can be achieved through a number of alternative designs. Students have to select the most appropriate and most feasible design. The type of research design chosen depends on:
Page 59
the type of problem; the knowledge already available about the problem; and the resources available for the study.
Generally, there are two main categories of research design: observational study, and experimental or intervention study. In the observational study, the researchers stand apart from events taking place in the study. They simple observe and record. In the experimental or intervention study, the researches introduce an intervention and observe the events which take place in the study. Observational studies An observational study may be exploratory, descriptive or analytical. An exploratory study is a small-scale study of relatively short duration, which is carried out when little is known about a situation or a problem. If the problem and its contributing factors are not well defined, it is always advisable to do an exploratory study before embarking on a large-scale descriptive or analytic study. Small-scale studies may be called exploratory case studies if they lead to plausible assumptions about the causes of the problem and explanatory case studies if they provide sufficient explanations to take action. A descriptive study is an observational study that simply describes the distribution of a characteristic. An analytical study (correlation in some disciplines) is an observational study that describes associations and analyses them for possible cause and effect. An observational study may be cross-sectional or longitudinal. In cross-sectional study, measurements are made on a single occasion. In a longitudinal study, measurements are made over a period of time. A longitudinal observational study may be retrospective or prospective. In a retrospective study, the researchers study present and past events. In a longitudinal prospective study, the researchers follow subjects for future events. Experimental or intervention studies In the experimental or intervention study, the investigators test the effect of an intervention on the events taking place in the study. An experimental or intervention study may be controlled or noncontrolled. A controlled experimental study may be randomized or non-randomized. Randomized controlled trials are intervention studies characterized by the prospective assignment of subjects, through a random method, into an experimental group and a control
Page 60
group. Controlled trails without randomization are intervention studies in which allocation to either experimental or control groups is not based on randomization, making assignment subject to possible biases influence study results. 2.9.2 Sampling Sampling for quantitative studies Sampling is the process of selecting a number of study units from a defined study population. Often research focuses on a large population that, for practical reasons, it is only possible to include some of its members in the investigation. You then have to draw a sample from the total population. In such cases you must consider the following questions:
What is the study population you are interested in from which we want to draw a sample? How many subjects do you need in your sample? How will these subjects be selected?
The study population has to be clearly defined. Otherwise you cannot do the sampling. Apart from persons, a study population may consist of villages, institutions, plants, animals, records, etc. Each study population consists of study units. The way you define your study population and your study unit depends on the problem you want to investigate and on the objectives of the study. The key reason for being concerned with sampling is that of validitythe extent to which the interpretations of the results of the study follow from the study itself and the extent to which results may be generalized to other situations with other people or situation. Sampling is critical to external validitythe extent to which findings of a study can be generalized to people or situations other than those observed in the study. To generalize validly the findings from a sample to some defined population requires that the sample has been drawn from that population according to one of several probability sampling plans. By a probability sample it is meant that the probability of inclusion in the sample of any element in the population must be given a priori. All probability samples involve the idea of random sampling at some stage. Probability sampling requires that a listing of all study units exists or can be compiled. This listing is called the sampling frame. Of course, at times, it is impossible to obtain a complete list of the population.
Page 61
Another reason for being concerned with sampling is that of internal validitythe extent to which the outcomes of a study result from the variables that were manipulated, measured, or selected rather than from other variables not systematically treated. Without probability sampling, error estimates cannot be constructed. Perhaps the key word in sampling is representative. If researchers want to draw conclusions which are valid for the whole study population, which requires a quantitative study design, they should take care to draw a sample in such a way that it is representative of that population. A representative sample has all the important characteristics of the population from which it is drawn.
A sample is a representative of the population under study.
Examples of probability sampling Simple random sampling The guiding principle behind this technique is that each element must have an equal and nonzero chance of being selected. This can be achieved by applying a table of random numbers or a computer generated random numbers to a numbered sampling frame. Another approach involves drawing numbers from a container. The product of this technique is a sample determined entirely by chance. It should be noted, however, that chance is lumpy, meaning that random selection does not always produce a sample that is representative of the population. Imagine, for example, a sampling frame comprising 10,000 people. Furthermore, consider that altitude is a critical variable, and that the composition of the sampling frame is as follows: 1,500 are from high altitude ; 7,500 are from medium altitude white, and 1,000 are from low altitude. You are going to select a sample of 500 people from this sampling frame using a simple random sampling technique. Unfortunately, the simple random selection process may or may not yield a sample that has equivalent altitudinal proportions as the sampling frame. Due to chance, disproportionate numbers of each altitudinal category may be selected. Systematic sampling The systematic random sampling technique begins with selecting one element at random in the sampling frame as the starting point; however, from this point onward, the rest of the sample is selected systematically by applying a predetermined interval. For example, in this sampling technique, after the initial element is selected at random, every kth element will be selected (kth refers to the size of the intervalthe ratio of the population to sample size) and becomes eligible for inclusion in the study. The kth element is selected
Page 62
through the end of the sampling frame and then from the beginning until a complete cycle is made back to the starting point (that is, the place where the initial random selection was made). If there is a cyclic repetition in the sampling frame, systematic sampling is not recommended. Stratified sampling Stratified random sampling begins with the identification of some variable, which may be related indirectly to the research question and could act as a confounder (such as geography, age, income, ethnicity, or gender). This variable is then used to divide the sampling frame into mutually exclusive strata or subgroups. Once the sampling frame is arranged by strata, the sample is selected from each stratum using simple random sampling or systematic sampling techniques. It is important that the sample selected within each stratum reflects proportionately the population proportions; thus, you can employ proportionate stratified sampling. Cluster sampling It may be difficult or impossible to take a simple random sample of the units of the study population at random, because a complete sampling frame does not exist. Logistical difficulties may also discourage random sampling techniques (e.g., interviewing people who are scattered over a large area may be too time-consuming). However, when a list of groupings of study units is available (e.g., villages or schools) or can be easily compiled, a number of these groupings can be randomly selected. Then all study units in the selected clusters will be included in the study. Multistage sampling Multistage cluster sampling is used when an appropriate sampling frame does not exist or cannot be obtained. Multistage cluster sampling uses a collection of preexisting units or clusters to stand in for a sampling frame. The first stage in the process is selecting a sample of clusters at random from the list of all known clusters. The second stage consists of selecting a random sample from each cluster. Because of this multistage process, the likelihood of sampling bias increases. This creates a lack of sampling precision known as a design effect. It is recommended to consider the design effect during sample size determination.
Page 63
Purposeful sampling strategies for qualitative studies Qualitative research methods are typically used when focusing on a limited number of informants, whom you select strategically so that their in-depth information will give optimal insight into an issue about which little is known. This is called purposeful sampling. There are several possible strategies from which a researcher can choose. Often different strategies are combined, depending on the topic under study, the type of information wanted and the resources of the investigator(s). 2.9.3. Sample Size Sample size in quantitative studies Having decided how to select the sample, you have to determine the sample size. The research proposal should provide information and justification about sample size. It is not necessarily true that the bigger the sample, the better the study. Beyond a certain point, an increase in sample size will not improve the study. In fact, it may do the opposite; if the quality of the measurement or data collection is adversely affected by the large size of the study. After a certain sample size, in general, it is much better to increase the accuracy and richness of data collection (for example by improving the training of interviewers, by pre-testing of the data collection tools or by calibrating measurement devices). than to increase sample size. Also, it is better to make extra effort to get a representative sample rather than to get a very large sample. The level of precision needed for the estimates will impact the sample size. Generally, the actual sample size of a study is a compromise between the level of precision to be achieved, the research budget and any other operational constraints, such as time (see 3.2.7). In order to achieve a certain level of precision, the sample size will depend, among other things, on the following factors: The variability of the characteristics being observed: If every person in a population had the same salary, then a sample of one person would be all you would need to estimate the average salary of the population. If the salaries are very different, then you would need a bigger sample in order to produce a reliable estimate. The population size: To a certain extent, the bigger the population, the bigger the sample needed. But once you reach a certain level, an increase in population no longer
Page 64
You have to make a trade-off between generating a large enough sample size to make a valid generalization to the population and the many constraints that appear with increasing sample size.
affects the sample size. For instance, the necessary sample size to achieve a certain level of precision will be about the same for a population of one million as for a population twice that size. The sampling and estimation methods: Not all sampling and estimation methods have the same level of efficiency. You will need a bigger sample if your method is not the most efficient. But because of operational constraints and the unavailability of an adequate frame, you cannot always use the most efficient technique.
When the study is designed to find a difference or an association, you may not find a difference or an association. In this case, we still want to calculate statistical probability that we may have missed a difference or an association that exists in the population, but was not found in the sample. This so-called statistical power of the study depends also on the size of the sample. The larger the sample size, the higher the power of the study. For calculating sample size before the study begins, the researchers have to make a decision on the level of statistical power they are willing to accept for the study. Traditionally, most studies set a power of 80%. The effect size in a study refers to the actual size of the difference observed between groups or the strength of relationships between variables. The likelihood that a study will be able to detect an association between the variables depends on the magnitude of the association you decide to look for. Large sample sizes are needed to detect small differences. The choice of effect size is difficult and arbitrary, but it must be set beforehand and must make a meaningful difference. In designing a study, the researcher chooses the size of effect that is considered important. Sample size in qualitative studies There are no fixed rules for sample size in qualitative research. The size of the sample depends on what you try to find out, and from what different informants or perspectives you try to find that out. You can start with two or four Focus Group Discussions (FGDs) depending on the complexity of the research objectives. If the different data sets reconfirm each other you may stop at this point; otherwise you conduct one or two FGDs more till you reach the point of redundancy, i.e. no new data comes up any more. In exploratory studies, the sample size is therefore estimated beforehand as precisely as possible, but not determined. Richness of the data and analytical capability of the researcher determine the validity and meaningfulness of qualitative data more than sample size. Still,
Page 65
sampling procedures and sample size should always be carefully explained in order to avoid the allusion of haphazardness. 2.9.4. Analysis Plan Specify the analysis procedures you will use, and label them accurately. The analysis plan should be described in detail. If coding procedures are to be used, describe reasonable detail. If you are triangulating, carefully explain how you are going to do it. Each research question will usually require its own analysis. Thus, the research questions should be addressed one at a time followed by a description of the type of statistical tests (if necessary) that will be performed to answer that research question. Be specific. State what variables will be included in the analyses and identify the dependent and independent variables if such a relationship exists. Decision making criteria (e.g., the critical alpha level) should also be stated, as well as the computer software that will be used (if there is a need to use one). These help you and the reader evaluate the choices you made and procedures you followed. Issues to remember: Provide a well thought-out rationale for your decision to use the design, methodology, and analyses you have selected.
The work plan is the timeline that shows when specific tasks will have been accomplished.
A work plan informs the reader how long it will take to achieve the objectives/answ er the questions.
2.10 Work plan Work plan is a schedule, chart or graph that summarizes the different components of a research proposal and how they will be implemented in a coherent way within a specific time-span. It may include: The tasks to be performed; When and where the tasks will be performed; Who will perform the tasks and the time each person will spend on them; It describes the plan of assessing the ongoing progress toward achieving the research objectives; The plan specifies how each project activity is to be measured in terms of completion, the time line for its completion; A good work time plan enables both the investigators and the advisors to monitor project progress and provide timely feedback for research modification or adjustments.
Page 66
The Budget section will show how much it will cost to answer the question.
Issues to remember: In the work plan: Different components/phases/stages of the study should be stated Description of activities in each phase Time required to accomplish the various aspects of the study should also be indicated
The GANTT Chart A GANTT chart is a planning tool that depicts graphically the order in which various tasks must be completed and the duration of each activity. The GANTT chart indicates: the tasks to be performed; who is responsible for each task; and the time each task is expected to take. The length of each task is shown by a bar that extends over the number of days, weeks or months the task is expected to take. 2.11 Budget and funding Most often than not, you will require to secure funds from a funding organization to cover the cost of conducting a research project. The items to consider when drawing up a budget requirement are outlined below. In addition, it is important to remember that the funding agency will invariably also read through the whole proposal (not just the budget requirement). Therefore, it is critical that the entire proposal document is well thought out and written to effectively communicate the aim of the research and how you plan to achieve it. Budget items need to be explicitly stated Cost for every budget item should be quantitatively shown Their might be a need for budget justification of certain costs whose requirement is not obvious Typically, a proposal budget reflects direct and indirect costs. Direct costs: Personnel: Salaries and wages of all participants of the study Principal investigator; supervisor; data collector; drivers; guards; data entry clerks, data
When drawing up a budget, be realistic. Do no attempt to be too frugal to demonstrate how cheaply you can run the project. At the same time, do not be too expensive so as not to deter the fund providers.
Page 67
analysis, report writing, etc Consumable supplies: office supplies (stationeries), computers, chemicals, and educational materials Equipments: properties which are expensive Travel: cost of projected-related travel Communications: postage, telephone, telegram, fax, e-mail charges associated with a project Publication: the cost incurred of preparing and publishing the results of the research. It includes: technical reports, manuscripts, illustrations, graphics, photography, slides, and overheads Other direct costs: costs of all items that do not fit into any of the above direct costs Indirect costs: Those costs incurred in support and management of the proposed activities that can not be readily determined by direct measurement. Examples includes; Overhead costs for institutions or associations General administrative cost Operational and maintenance Depreciation and use allowance Budget justification It is not sufficient to present a budget without explanation. The budget justification follows the budget as an explanatory note justifying briefly, in the context of the proposal, why the various items in the budget are required. Make sure you give clear explanations concerning why items that may seem questionable or that are particularly costly are needed and discuss how complicated expenses have been calculated. If a strong budget justification is presented, it is less likely that essential items will be cut during proposal review. Obtaining funding for research projects To conduct research, it is usually necessary to obtain funding for the research project. Such funding may be available from local, national or international agencies. In addition, to preparing a good research proposal, the following strategies are useful for researchers to increase the chances of securing adequate funds: A. Familiarize yourself with the policies and priorities of funding agencies. Such policies and priorities may be: - Implicit, i.e. known to officials in the agency and to other local
Page 68
researchers who have previously been funded by that agency. Obtain the names of such persons and make direct contact with them. - Explicit, i.e. available from policy documents issued by the agency. The funding policies of many agencies may emphasize: * a priority given to research aimed at strengthening a particular program * institution building (i.e. building the capacity of an institution to do research) * targeted to a specific thematic area of research (for example, health, family planning, etc.) B. Identify the procedures, deadlines an dformats that are relevant to each agency. C. Obtain written approval and support from relevant local and national authorities and submit together with our proposal. D. If you are a beginning researcher, associate yourself with an established researcher/advisor. Host agencies scrutinize the credibility of the researcher to whom funds are allocated. Such credibility is based on previous projects that were successfully completed. E. Build up your own list of successfully completed projects (i.e. your own reports, publications, etc.) 2.12 References You must give references to all the information that you obtain from books, papers in journals, and other sources. References may be made in the main text using index numbers in brackets (Vancouver style) or authors name (Harvard style). You will also need to place a list of references, numbered as in the main text (or alphabetically ordered), at the end of your research proposal. The exact format for depicting references within the body of the text and as well as the end of the proposal varies from one discipline to another. It is best that you consult with someone who is familiar with the format in your particular area of research. The information you give in the reference list must be enough for readers to find the books and papers in a library or a database. It also demonstrates to those interested in your proposal how well versed you are on the particular area of research.
Page 69
As a general guideline, there are certain items that must be included from each source reference. As mentioned above, the exact format applicable to your particular area of study will be left for you to find out. For a journal paper give: the names of the authors, the year of publication, the title of the paper, the title of the journal, the volume number of the journal, the first and last page numbers of the paper. For a book give: the author, the year of publication, the title, and the edition number if there is one, the name of the publisher, the page numbers for your reference. For an internet reference give: the author of the web page, the title of the item on the web page, the date the item was posted on the web page the date the item was accessed from the web page the complete and exact URL. Particularly with references obtained from websites, it is important to establish the reputability and reliability of the website you are making reference to. Every reference in your main text must appear in the list at the end of your proposal, and every reference in the list must be mentioned in your main text. 2.13 Appendices/Annexes Include in the appendices of your proposal any additional information you think might be helpful to a proposal reviewer. For example, include:
Questionnaire & other collection forms Dummy tables Biographical data on the principal investigator The consent form (if any)
Page 70
Exercise
Would it be appropriate to draw your sample only from AAU graduate students to study the incidence of seasonal flu in Addis Ababa? Why? Can you obtain a complete and accurate list of residents in Addis Ababa? If not, how would you proceed to gather your sample? In a study that investigates the rise of sea levels due to global warming, is it meaningful to try and detect millimeter level differences every week? How about if your measurement is done every decade?
Summary
Scientific research commences with the writing of a research proposal which is a detailed plan that the researcher intends to follow and which will give an adjudicator or evaluator a clear idea of what the researcher plans to do and how he or she intends to complete the research. The research proposal contains a description of the research topic and the literature survey, motivation for the research, a statement of the problem, a hypothesis, the research methodology to be used, clarification of terms, and the sources consulted to demarcate the research problem Quality writing is critical in all good proposals. It should be clear, concise, and free of jargon. There should be no spelling or grammatical errors, and the proposal should be easy to read. Sloppy proposals and proposals laden with jargon do not provide a positive image to the reader, nor do they lend confidence that solid research will follow. Proposals that are well-written and attractive are a pleasure to read, and they make a good impression with readers/reviewers.
References
1. Bowling, A. (2002). Research methods in health: Investigating health and health services (2nd Ed). Berkshire: Open University Press. 2. Brownlee, A., Nchinda, T. C., and Yolande M.-G. (1984) How to develop proposal and design research to solve priority health problems. Boston: WHO/Boston University Health Policy Institute. 3. Day, R. A. (1996) How to write and publish a scientific paper (4th Ed). Cambridge: Cambridge University Press. 4. Dooley, D. (2004) Social Research Methods. New Delhi: PrenticeHall of India 5. Fathalla, M.F. (2004) A practical Guide for Health Research. Addis Ababa University Page 71
Cairo: WHO Regional Office for the Eastern Mediterranean. 6. Majumdar, P.K. (2005) Research Methods in Social Science. New Delhi: Viva Book private Limited. 7. Varkevisser, C.M., I. Pathmanathon and A. Brownlee (2003) Designing and conducting health system research projects, Vol.1: Proposal development and field work. KIT Publisher, Amsterdam, IDCRC in association with WHO Regional Office for Africa.
Assignment
Identify your own research topic. -----------------------------------------------------------------------------------------------------------------------------------------------------------------Write the introduction section of the topic you identified. ----------------------------------------------------------------------------------------------------------------------------------------------------------------------Write the statement of the problem for your topic. ----------------------------------------------------------------------------------------------------------------------------------------------------------------------Review literature for your identified topic ----------------------------------------------------------------------------------------------------------------------------------------------------------------------Formulate your own research question and hypothesis (relevant to your topic) ----------------------------------------------------------------------------------------------------------------------------------------------------------------------Develop a conceptual framework (if needed) -----------------------------------------------------------------------------------------------------------------------------------------------------------------------
Page 72
Define clearly your general and specific objectives. --------------------------------------------------------------------------------------------------------------------------------------------------------------------Write clearly the research design/methods for the identified topic. ----------------------------------------------------------------------------------------------------------------------------------------------------------------------Develop your work plan ----------------------------------------------------------------------------------------------------------------------------------------------------------------------Prepare estimated budget of your research ----------------------------------------------------------------------------------------------------------------------------------------------------------------------Choose one method of citing references and write all the references you used.
Page 73
NB: Development of a research process is a cyclical process. The double-headed arrows indicate that the process is never linear.
Adapted from the International Development Research Center: Designing and Conducting Health Systems Research Projects, VOLUME 1
Page 74
UNIT 4
Objectives
At the end of this unit, you would have obtained a solid grasp of the key process required to conduct a successful research. You must remember that some processes are more appropriate to a specific field; various fields employ specific methods to conduct research, here, attempt is made to highlight
Page 75
Utilizing a more appropriate analytical method can rectify faulty data analysis. But a faulty experimental design will require re-doing the experiment.
the way data collected and the limitation of the work may help. Data Analysis: Method to collect data and the following data analysis technique should match; occasionally problem may emerge as one start to do data analysis. Reporting Conclusions: Writing up and / or further dissemination. Conceptualization and contextualization have already been covered in Unit 3; and data reporting will be covered in Unit 6. The mechanics of data analysis will covered in the sister module on Quantitative methods and computational. In this Unit, we will cover the following: Data Collection and /or generation: Applying the chosen method(s). Although organized in a systematic stage-by-stage approach, in practice it is to be noted that the nature of the research process is intrinsically iterative. You may need to move forwards and backwards between these stages as the circumstances determine. The availability of data, for example, located only during the data gathering exercise, may influence a modification of the specified aims. In certain circumstances it may become apparent that the data required to answer a research question is not available. This can result in a rethink of the initial stages and a modification of the research design. Thus, researchers need to think carefully about the likely accessibility of data during the design phase. They must also be prepared to be flexible and adaptable during the research. Regardless, it is still important that all available information be used to properly design the experiment. Moreover, it is also prudent to make back-up plans to accommodate necessary changes as mentioned above. And if unforeseen circumstances arise, well, then as the primary research, you must devise ways by which to salvage as much of your research project as possible. Exercise Meseret discovers that the experimental design she is using is not suited to the type of research she is conducting. How would you advise her to proceed? 1.1 Research Methods data collection and analysis You need to operationalise the research problem by choosing the most suitable research method, or technique, for your specific study.
Page 76
There are a number of different research methods available and one should be selected which is most likely to meet the objective of the research and gather the correct type of information. Each technique is designed to get certain types of information and not others. Viable methods should be weighed up in terms of their advantages and disadvantages. Research methods should be seen as complementing and supporting each other. In a more generalized way, research is often broken down into two different approaches: Quantitative research: research involving numerical or statistical data. Emphasis is on the quantifiable observations of the research i.e. numbers involved. This type of research is mainly objective. Qualitative research: an approach to gather non-numerical data and related ways of analysis where emphasis is on the qualitative results. Words and observations are used to express the reality where 'getting close to the data' and an 'in-depth' approach are key concerns. This type of research is mainly subjective. Whilst the distinction is often made between these two approaches, they should not be seen as mutually exclusive, or alternative perspectives, and are often used in conjunction with each other. Below follows a list of individual research methods (observation studies, questionnaires, interviews, focus groups, document analysis, experimental research, and mathematical modeling) incorporating a brief description, advantages and disadvantages, ways of collecting data, general hints for carrying out the research and some examples of their use. Exercise A study is conducted to assess the effect of the provision of 1mg folic acid per day to pregnant women on the birth weight of their babies. In this study, is the researcher interested in quantitative or qualitative results? If the above study, was to observe the effect on the alleviation of post-partum depression would your answer be different? Suggest ways in which one can measure post-partum depression.
Page 77
2.1 Observation studies Observation refers to the process of observing and recording events or situations. The technique is particularly useful for discovering how individuals or groups of people or animals (and in some instances inanimate objects) behave, act or react. There are two main types of observation - participant and nonparticipant: Participant observation is usually limited to studies of human subjects. The researcher becomes part of the group studied and participates in their daily life and activities: observing their everyday situations and their behavior in these situations. Conversation is used in order to discover the subjects' own interpretations of events. In non-participant observation the researchers simply observe the activities without taking part themselves. Whilst this has the advantage of preventing the researcher from unduly influencing or becoming involved in activities they may not wish to take part in (for example dangerous or criminal actions), they are less likely to understand fully the meanings behind behavior in the group studied. Beside the study of human subjects, non-participant observation can also be used to study animal behavior. The observation and recording of natural phenomenon can also be considered observation study. In human observation studies the observer can remain covert, hiding their true identity as a researcher, or overt, where their identity is revealed to those studied. It is argued that covert research will lead to a more valid study as the subjects are less likely to modify their behavior if they do not know they are the subjects of research. However, the ethics of such studies should be questioned - have we the right to do this? In all research we have a responsibility to those being studied and research should not interfere with their physical, social or mental welfare.
Advantages and disadvantages of observation studies are described below:
Page 78
Advantages
Disadvantages
Some people see things as they are and ask why, I dream things that never were and ask why not.
Behavior can be observed in its natural Can only study a small group. environment, the subject is undisturbed. Can study deviant groups. Cannot make generalizations - no way of judging whether the group is typical.
Flexibility - researcher may come across conditions and events previously If covert is it ethical? not comprehended. Moral, legal and injury risks associated with this method.
Data collection: It is impossible to keep a record of everything and you must decide at the outset where your interests lie. You may decide to film or tape record events, although the cost of this may be quite substantial. Data is often recorded through writing up notes in private after the event or you could set up your own complex system with specific categories of behavior for post-observation recordings using graphs, charts and plans. These will vary depending on the specific problem under investigation; there is no one perfect example that can be used in all situations. What is important is careful preparation before observation begins; remember the aim of observation is to be unobtrusive so that behavior remains as normal as possible. Placing a tape recorder under someone's nose or scribbling down notes in front of them will not help to maintain this. There are disadvantages with this method of gathering data. The most common criticism is that it is highly subjective, dependent in large on the researcher's own focus and ideas of what should be recorded and their own interpretations of what they have observed. General ideas for carrying out observation are that it is not an easy option for a research project but a method that takes meticulous planning. One should enter the field with a clear idea of exactly what it is one wishes to discover or vast amounts of time and effort can be wasted. Examples of use of participant observation include studies of the social structure and functioning of small communities or deviant
Page 79
Exercise The year 2009 marks 150 years since the publication of On the origin of species by Charles Darwin. The impact of this publication on the science of life on earth is well established. Recall some of the ways in which the major method of study was observational. Do you think this was participatory or nonparticipatory observational study? Also relate Darwin observation to Yardi new finding of October 2009. A space capsule is deliberately sent on a trajectory to collide with Mars. A scientist trains the high-powered Hubble telescope on the planets surface where the capsule will impact to observe the debris cloud. Do you think this is an observational study? 2.2. Questionnaires A questionnaire is a type of survey where respondents write answers to questions posed by the researcher on a question form. A number of respondents are asked identical questions, in order to gain information that can be analyzed, patterns found and comparisons made. Questionnaires are extremely flexible and can be used to gather information on almost any topic involving large or small numbers of people. The commonest type of questionnaire involves closed choice or fixed questions where the respondent is required to answer by choosing an option from a number of given answers, usually by ticking a box or circling an answer. These types of questionnaires only gather straightforward, uncomplicated information, and only simple questions can be asked. The openended questionnaire differs in that it allows the respondent to formulate and record their answers in their own words. These are more qualitative and can produce detailed answers to complex problems. Example: Closed choice question: People go to a bar for different reasons; for which of the following four reasons do you most go? to meet friends to drink alcohol to watch sport to play pool or darts
Page 80
When I ask you what is life? I do not expect a yes or no; answer! And should I ask how old you are there is no need for you to give me your memoirs!
What is the primary reason you applied to the AAU graduate program? to expand my knowledge base to earn a better salary to get a promotion had no specific reason, but did because my friends were applying Open ended question: People go to the bar for different reasons; for what reason do you most go? .............................................................................................................. List the top five reasons why you applied to the AAU graduate program? .............................................................................................................. There are advantages and disadvantages associated with each type of method. Open ended questions give a greater insight and understanding of the topic researched but may be difficult to classify and quantify and must be carefully interpreted. Fixed choice questions are easy to classify and quantify, require less time, effort and ingenuity to answer but do not allow the respondents to qualify, develop or clarify their answers. Examples of advantage and disadvantages of questioners: Advantages
Quick. Cheap. Efficient.
Disadvantages
Limited answers only can be given. Lack of qualitative depth results in superficiality. No way of probing for more information in superficial responses. Not always accurate - not possible to verify what appears to be an inaccurate answer and little check on honesty of responses. Questions may mean different things to different people.
Can reach a large number of people. Consistent format means there is little scope for bias introduced by different researchers.
Low response rate. Construction difficult - instructions must be clear and unambiguous and questions carefully worded.
Page 81
Data collection: the information required will be recorded on the form itself by the respondent. Questionnaires can be given to the respondent personally and completed on the spot, or can be posted, which, although much quicker, increases the cost and decreases the response rate and hence representativeness. Web based questionnaires are often seen as easy to respond to by survey participants, but there is an implicit bias in that only those with internet access and are computer literate can participate. General tips for constructing questionnaires: Get the beginning right - this will encourage respondents to read on. One should state what the survey is about and roughly how long it will take to complete. Make the questionnaire look attractive - use space well and avoid a cramped appearance. Use a large enough type size and avoid block capitals so that questions can be easily read. Keep sentences short and sentence construction simple - the wording of the questionnaire is very important. Avoid leading questions which direct the respondent in a particular way e.g. isnt it true to say that..... Avoid jargon and technical terms - make sure the question is unambiguous - each question should only have a single interpretation. Watch out for double questions - that is those asking two separate
questions at once. If you know what you know is right, what dont you know that is wrong?
Exercise
The census is a form of research that uses a questionnaire that all citizens are expected to provide information for. Does the census conducted in Ethiopia have open- or closed-ended questions? Form groups of five students each. Each group would like to study the daily habits (routines) of unemployed youth in Addis Ababa. Each group is expected to formulate a questionnaire with five questions (you have the option of making it open- or closed ended). Compare the questions with those of the other groups, and discuss the merits and shortcomings of the ways in which each question or type of question is formulated. 2.3 Interviews Interviews are limited to cases where the subjects of study are humans. Interviews are a type of survey where questions are delivered in a face-to-face encounter by an interviewer. The
Page 82
interview is like a conversation and has the purpose of obtaining information relevant to a particular research topic. It is initiated by the researcher and is focused on specific content. As with questionnaires interviews can be approached from either a quantitative or qualitative angle and there are many variations on the general method. Purely quantitative interviews are rather like a closed ended questionnaire that the interviewer fills in for the respondent. These are highly structured, formal interviews which are determined in advance and have fixed responses. At the other end of the scale, the unstructured, purely qualitative interview is rather like an informal conversation. Here questions are asked in the natural course of interaction and arise from the particular context. A large number of interviews will fall somewhere in between these two extremes and are known as semi-structured interviews. These have specific questions already predetermined that are asked to the respondent in a particular order, or topics and issues to be covered in the course of the interview. There are advantages and disadvantages associated with each type of method. Structured interviews maximize reliability and are easier to classify and quantify. By contrast unstructured interviews can give a greater insight and more in-depth understanding of the topic researched, but need more expertise to control and more time for analysis.
Advantages High response rate. Can collect complex information. High degree of researcher control achieved. Can be made more responsive to early results. Relaxed environment.
Disadvantages Limited sample only. Can be difficult to analyse (especially in-depth interviews). May be a hostile reaction. Whole process is time consuming. Recording techniques may cause problems. There is room for interviewer bias - this should be acknowledged.
Page 83
Data collection: a structured format can leave the interviewer with the job of simply ticking a number of boxes on a form, however a less structured format necessitates a different technique for recording data. A tape recorder is often used to collect information in an unstructured interview. This has the advantage over note taking in that everything will have been recorded, details can not be missed, and the interviewer can give their full attention to the respondent. However, the interviewee may be uncomfortable knowing they are on tape. Alongside this, transcribing the tapes is a very time consuming process; this is something to bear in mind if embarking on this method of data collection for your research project. General tips for carrying out interviews: Begin with an explanation of who you are and what the survey is about and ensure confidentiality. Try to achieve rapport with the respondent: be friendly and look as if you are enjoying the interview and are interested in what they have to say. Be aware of the importance of body language in face-toface interviews. Research has shown that interviewees are more at ease with someone who is like them in terms of ethnicity, class, sex, speech and dress code. Whilst the majority of these cannot be changed, you can dress in a similar manner to your interviewee; if interviewing a nomadic community in their locality they are unlikely to be wearing a suit: T-shirt and shorts would be more suitable. Be familiar with your questions and ask them in a neutral manner, endeavor not to lead respondents to answer in a certain way. Be aware of your role as an interviewer, which is to listen, not to speak. Take a full record of the interview either through tape-recording or note taking. Prompts may be necessary if information is not given freely. Examples of use of interviews: When a researcher aims to discover detailed answers to complex questions in a face-to-face situation. The respondents can give quite elaborate answers e.g. opinion polls, life histories.
Exercise
Divide the class into two groups. One group will design open-ended interview questions to gauge the level of consumer confidence on
Page 84
locally produced goods; while the other group will design close ended interview questions. Each group will interview the other group and record the answers. In the end, the class together will review the questions and answers and discuss which of the two approaches was more informative. 2.4 Focus Groups The focus group is a type of interview that involves carefully selected individuals who usually do not know each other. They generally consist of 7-10 members alongside the researcher. These individuals are selected as they hold particular characteristics which the researcher believes are necessary to the topic of focus. A group discussion is held in a permissive environment in order to extract opinions and share ideas and perceptions through group interaction. It is not necessary to reach a consensus. Focus groups are extremely useful in providing qualitative data which gives an insight into attitudes and perceptions difficult to obtain using other procedures. The researcher acts as a moderator and listener posing predetermined open ended questions which the respondents answer in any way they choose. 2.5 Document Analysis This refers to the process of using any kind of document, films, television programs and photographs as well as written sources, such as books, papers and letters, for analysis in relation to a particular research question. It can be used as the singular method of research or as a supplementary form of inquiry. Document analysis, also referred to as content analysis, differs from the majority of research methods in two major ways. - It is an indirect form of research; it is something that has been produced, so the investigator is not generating original data. - It is an 'unobtrusive', or 'non-reactive' method. This refers to the fact that the document will not be affected in any way by your research; it cannot react as a human can. In general, documents have been written from the perspective of those from official sources but a different perspective can be gained from using personal accounts and oral testaments such as letters, diaries, and autobiographies. Reliability and validity are central concerns in document analysis. Documents generally exist for some purpose and the knowledge of this purpose is important in understanding and interpreting the
Page 85
Advantages
Disadvantages
Subject to bias and subjectivity - impossible to allow The data never alters and for biases introduced by the fact that the document studied has been written for a particular purpose and can be subject to reis the author's own particular account; events may be analysis. sensationalised, subject to political bias etc. Unobtrusive. Events can be compared over time and cultures. Gives an expert understanding. Cheap. Computers can aid analysis and lead to complete reliability in applying the rules you set down for coding the text. Evidence may be out of date. May not be accurately recorded. Documents available may be limited. Can be laborious and time consuming.
Data collection: a recording unit must be defined. For example, a study of newspaper content may concentrate on the number of stories on a particular topic or the column inches devoted to a particular subject. There is a vast range of research possibilities for which document analysis may be used, however all must construct particular categories for analysis. General guidelines for carrying out document analysis: Decide initially on categories for research, Keep focused; do not let your research become too wide. Examples of use: For studying racial or sexual bias in newspapers, school textbooks etc. To obtain a historical understanding of a particular institution or group. Commonly used in triangulation, (need to define this term!) Can also be used for analyzing qualitative research data from interviews etc.
Exercise
If you are tasked to study the last few days of the late Emperors reign, what documents would you use as reference and do you think
Page 86
you should use recent documents or those that were contemporaneously published? Discuss and debate the reliability of contemporaneous sources and sources that were published three decades since the reign ended.
Some scientific findings, even though widely accepted, cannot be experimental proven. Case in point: Darwins Theory of evolution
2.6 Mathematical Modeling Mathematical modeling can be used to analyze relationships between different variables and to predict possible outcomes, or causal effects. Experiments can be designed from models of systems, which aim to define links between variables and outcomes.
Disadvantages Does not explain why variables are Can extend powers of linked to particular outcomes - can not explain why particular variables are deductive reasoning. important. Model produced is limited to one Attempts to be objective situation and therefore may not apply to maths is 'neutral'. others. Is an aid to causal explanation Inability to distinguish causal from and can therefore help calculate accidental relations. the effects of actions. Could be built on preconceptions. Advantages
Examples of use: To consider why there is gender difference in the intake of students in science and technology fields at AAU. Using mathematical modeling it is possible to isolate variables that may have an effect on the choices that men and women make. Exercise: A dietician would like to construct a mathematical model that describes physical features to body weight. What variables do you think would be relevant to consider? 2.7 The experimental method This method involves setting up an experiment in order to test a particular theory or hypothesis. In its simplest terms experimentation is concerned with seeing what changes occur if something new is tried out and with the effects of these changes on something else (Robson, 1978). It is a method particularly associated with the physical and life sciences although the approach is also used in
Page 87
Results: One third of the mice responded to the treatment, one third showed no response, and one mouse escaped
social sciences such as psychology, health care and education. In order for an experiment to take place, using the most basic research strategy the researcher should deliberately alter at least one particular element or factor of the study, known as variables, in order to assess the effects of this change on behavior. The effect of this alteration is assessed. Measurement is required before, during and after the experiment. The experiment has to be replicable and produce more or less the same results if it is to have any significance. There are two different types of experiment, the laboratory experiment and the field experiment. 1. In laboratory experiments the researcher will conduct a small-scale study where subjects can be manipulated, observed and tested in a highly controlled environment. In these types of studies, the data obtained is often subjected to statistical analysis (the sister module on Quantitative and computational methods will cover the statistical tools and methods). Such research creates an artificial situation where events normally linked are separated. 2. A field experiment is an experiment that takes place outside the laboratory. This leads to a decrease in researcher control, which may hide the effects of changes made, but the results gained can be still be generalized to the real world. Research into human behavior tested by experimentation is subject to much criticism for ethical reasons. The method could be beneficial or disadvantageous but until the experiment has been completed it is not known which .. Experimental Research is often used where: There is time priority in a causal relationship (cause precedes effect), There is consistency in a causal relationship (a cause will always lead to the same effect), and The magnitude of the correlation is great.
If the researcher suspects that the effect stems from a different variable than the independent variable, further investigation is needed to gauge the validity of the results. An experiment is often conducted because the scientist wants to know if the independent variable is having any effect upon the dependent variable. Variables
Page 88
correlating are not proof that there is causation. Experiments are more often of quantitative nature than qualitative nature, although it happens. General tips for carrying out experiments: Careful preparation is essential and experienced researchers should be consulted before experimentation begins. Project design, sample selection and measurement of dependent variables are crucial to the success of the research.
Advantages Disadvantages
Ideas can be tested in a Where human subjects are involved it is controlled way. generally viewed as unethical. Ideal for investigating causal Results may be different in the real world to relationships. those discovered in a controlled environment. The influence of all variables can never be eliminated; many different circumstances potentially function as variables that can affect the outcome.
Scientifically validated findings Restricted range. give greater value to research. Large amount of preparation is required. Humans may respond to expectations of the experiment not to the experiment itself.
Exercise
A trial is conducted to study the effect of an environmental pollutant (lead in paint) on the occurrence of pancreatic cancer in mice. What is the cause and effect that the researcher is trying to establish? If the outcome of this study shows that there is no causal relationship, does this imply that the experiment was a failure?
References
Bell J. (1993) Doing Your Research Project. A Guide for First-Time Researchers in Education and Social Science, Buckingham: Open
Page 89
University Press. See Part two: Selecting methods of data collection pp. 61-122. Blaxter L, Hughes C. and Tight M (1996) How to Research, Buckingham: Open University Press See Chapter three: Thinking about methods pp. 53-91. Burgess RG (1984) In the field: An Introduction to Field Research, London: Allen and Unwin. See Chapter 6: Using personal documents pp. 123-142. Campbell D T & Stanley JC (1963). Experimental and QuasiExperimental Designs for Research. Chicago: Rand McNally. Cook T and Campbell D (1979) Quasi-experimentation: Design and Analysis for Field Settings, Chicago: Rand McNally. Douglas J (1985) Creative Interviewing, Beverley Hills, CA: Sage. Fisher R A (1959). Statistical Methods & Scientific Inference. New York: Hafner Publishing. Hague, P. (1993) Questionnaire Design, London: Kogan Page. Holstein JA and Gubrium JF (1995) The Active Interview, Newbury park (Ca): Sage. Kane E (1990) Doing Your Own Research. How to do Basic Descriptive Research in the Social Sciences and Humanities, London: Marion Boyars. See Part two: How do you find it pp.151120. Krueger R (1994) Focus groups. A practical guide for applied research, 2nd edition, Sage: London. Lipsey, MW (1990) Design Sensitivity: Statistical Power of Experimental Research, Newbury Park: Sage. McCall G and Simmons JL (eds) (1969) Issues in Participant Observation Reading: Addison-Wesley Patrick J (1973) A Glasgow Gang Observed, London: Eyre-Methuen. Whyte, WF (1993) Street Corner Society: The Social Structure of an Italian Slum, 4th edition,Chicago: University of Chicago Press.
Page 90
Pedhazur, E. J. (1997). Multiple Regression in Behavioral Research (Third Edition). Fort Worth: Harcourt Brace. Student (1931). The Lanarkshire milk experiment. Biometrika, 23, 398-404. Scott J (1990) A Matter of Record: Documentary Sources in Social Research, Cambridge: Polity Press. Scott J (1991) Social Network Analysis: A Handbook, London: Sage. Spradley J P (1980) Participant Observation, London: Holt, Rinehart and Winston Stewart, D. and Shamdasani, P. (1990) Focus Groups: Theory and Practice, Newbury Park: Sage Sudman, S. (1982) Asking Questions: A Practical Guide to Questionnaire Design, San Fransisco: Jossey-Bass. Thiessen H (1997) Measuring the Real World: A Textbook of Applied Statistical Methods, Chichester: Wiley.
Page 91
experimental studies and for attempting to adjust for initial differences in non-experimental studies. The application of ANCOVA for the first purpose is well founded, and may prove useful in diverse research areas. The applications of ANCOVA for the second purpose, however, is highly questionable because it is fraught with serious flaws (p. 628). Unfortunately, application of ANCOVA in quasi-experimental and nonexperimental research is by and large not valid (p. 654). (B) Control: Extraneous factors associated with variation in an outcome variable can be controlled by techniques such as selection, stratification, and possibly statistical adjustment or can be randomized. For example, if there are known socio-economic status (SES) differences on a dependent variable, the researcher can: (i) select cases within a relatively narrow range of SES so that its impact becomes negligible or, at least, lessened; (ii) stratify experimental cases into SES blocks that can be incorporated into the design and analysis; or (iii) obtain a suitable measure of SES and partial out its influence. In experimental settings, the benefit of all of these procedures is to reduce unexplained within-group variation and, thereby, both increase the likelihood of detecting an effect (i.e., increase power) and reduce the uncertainty associated with the magnitude of an effect (i.e., decrease the width of confidence intervals). Alternatively, the research can ignore SES differences, randomly assign cases to groups, and lose the above benefits. (C) Reliability: It is preferred that outcomes (and covariates) be assessed with relatively little measurement error. Other things being equal, unreliability increases unexplained variation within groups and reduces the power of the analysis. In practice, it may be impractical to assess the reliability of measurement procedures within the scope of a given study, but the selection of measurement instruments should certainly take this factor into consideration. On the other hand, if a study involves observations or ratings by judges, some effort must be undertaken to assure consistency of measurement across raters or judges. (D) Validity: In selecting a relevant measure for an outcome variable, it is critical that logical inferences can be made from the operationalizations upon which the measure was based to the theoretical constructs relevant to the study. Construct validity refers to the degree to which inferences of this type can legitimately be made. (E) Implementation of Treatment Variable: An overlooked consideration in many studies is the provision of evidence that the independent variable of interest has actually been applied as intended. Student (1931) described a famous failure of implementation. In 1930 in Scotland the Department of Health conducted the Lanarkshire Milk Experiment to investigate the advantage of giving extra milk to schoolchildren. The experiment, involving 20,000 children, was seriously compromised by some teachers who gave the extra milk to students they considered most needy as opposed to those selected by randomization. The lesson is that there must be some record or documentation supporting the fact that the intended treatment has taken
Page 92
place. (F) Analysis Issues: Research studies without serious design limitations may nevertheless suffer from inadequate or inappropriate analyses. While there are often alternative analytical approaches that result in equivalent analyses with respect to interpretation of results, it is also the case that inappropriate analysis may limit interpretability. Among issues that arise reasonably often are: (a) failure to utilize an appropriate unit of analysis (e.g., ignoring nesting of students within schools and employing ordinary ANOVA when hierarchical linear modeling would be more appropriate); (b) arriving at models by exploratory procedures but interpreting results as if models were confirmed (e.g., using stepwise multiple regression to "confirm" the importance of predictor variables or using model modification indices in structural equation modeling to alter an initial model to improve fit to data); (c) deriving estimates from complex survey designs without considering design issues (e.g., neither using weighted estimates nor modeling the design when analyzing NAEP data); and (d) ignoring distributional assumptions with parametric procedures such as multiple regression, ANOVA, structural equation modeling, etc. (e.g., ignoring the impact of outliers, extremely skewed distributions of residuals, or lack of homogeneity of variance). There are, of course, many more subtle issues such as the mistaken notion that non-parametric tests for location (e.g., Mann-Whitney U) are insensitive to homogeneity of variance assumptions. (G) Interpretation Issues: While the use of inferential statistical methods has been a valuable tool in many applied research fields, their use has also led to some unfortunate opportunities to make incorrect or misleading interpretations of results. Recent emphasis on reporting effect sizes may be viewed as valuable, but all too often this takes the form of comparing a computed effect size (e.g., standardized absolute mean difference) with some completely arbitrary standard (e.g., .5 as indicating a "medium" effect). In fact, a statistically significant outcome for, say, a twoindependent-sample t test for means merely suggests that the result is "surprising" when compared to a model of chance variation. The practical interpretation of the observed outcome must be made within the context of the research setting.
Page 93
What design you choose depends on different factors. What information do you want? How reliable should the information be? Is it ethical to conduct the study? What is the cost of the design?
ii) Qualitative Research There are various designs that are used in research, all with specific advantages and disadvantages: i) ii) iii) iv) v) vi) vii) viii) ix) x) xi) xii) xiii) xiv) xv) xvi) xvii) xviii) xix) True Experimental Design Quasi-Experimental Design Double-Blind Experiment Descriptive Research Archive Study Literature Review Case Study Survey Twin Studies Meta-analysis Systematic Reviews Observational Study Naturalistic Observation Field Experiment Cohort Study Longitudinal Study Factorial Design Case Control Study Pilot Study
Page 94
advancement of knowledge. Qualitative research is research undertaken to gain insights concerning attitudes, beliefs, motivations and behaviors of individuals to explore a social or human problem and include methods such as focus groups, indepth interviews, observation research and case studies. Quantitative research is research concerned with the measurement of attitudes, behaviors and perceptions and includes interviewing methods such as telephone, intercept and door-to-door interviews as well as selfcompletion methods such as mail outs and online surveys. Clinical trials are research studies undertaken to determine better ways to prevent, screen for, diagnose or treat diseases. Epidemiological research is concerned with the description of health and welfare in populations through the collection of data related to health and the frequency, distribution and determinants of disease in populations, with the aim of improving health.
Page 95
Page 96
UNIT 5
Research Ethics
Key Concepts
Ethics Code of ethics Justice Beneficence Non- maleficence Respect for persons/autonomy Protection of the impaired/diminished autonomy Informed consent Confidentiality Identifiers
Objectives
At the end of this unit, you will: be sensitized about research ethics and be able to decipher the basic principles of research ethics, duties and responsibilities as a researcher towards study participants; have increased awareness about research ethics and thereby respect the rights of study participants and uphold research ethical standards while conducting research; have enhanced awareness of the existence of relevant standards of ethics in research; and have enhanced competence in research ethics so that you adhere to ethical principles and rules by following existing ethical clearance standard operating procedures in Ethiopia.