Step 2 in Research Process
Step 2 in Research Process
By knowing the basic facts, theories, predictions, and methods make up the
knowledge base for a specific topic area, you gain a clearer picture of exactly
which variables are being studied and exactly which relationships are likely to
exist.
Testable
• it must be possible to observe and measure all of the variables
involved.
• the hypothesis must involve real situations, real events, and real
individuals.
• You cannot test a hypothesis that refers to imaginary events or
hypothetical situations.
• For example, you could debate what might have happened if John
F. Kennedy had not been assassinated. This proposition does not
lead to a testable hypothesis. It cannot be observed and,
therefore, is inappropriate as scientific hypotheses.
Refutable
• It must be possible to obtain research results that are contrary to
the hypothesis. For example, if the hypothesis states that the
treatment will cause an increase in scores, it must be possible for
the data to show no increase.
• A refutable hypothesis, often called a falsifiable hypothesis, is a
critical component of the research process.
• A refutable hypothesis is one that can be demonstrated to be
false. That is, it is possible for the outcome to be different from the
prediction.
Positive
• it must make a positive statement about the existence of
something, usually the existence of a relationship, the existence
of a difference, or the existence of a treatment effect.
• Statistically, it is called null (no relationship/no difference/no
improvement) and alternative hypothesis (existence of
relationship, difference, improvement)
• Specifically, the basic nature of science is to assume that
something does not exist until there is enough evidence to
demonstrate that it actually does exist.
• Suppose, for example, that I would like to test the hypothesis that
there is a relationship between creativity and intelligence.
• In this case, begin with the assumption that a relationship does
not exist, and the goal for my research study is to gather enough
evidence (data) to provide a convincing demonstration that a
relationship does exist.
Step 3: Defining and Measuring
Variables
• researchers are interested in how variables are affected by
different conditions or how variables differ from one group of
individuals to another.
• For example, a clinician may be interested in how depression
scores change in response to therapy, or a teacher may want to
know how much difference there is in the reading scores for third-
grade children versus fourth-grade children.
• To evaluate differences or changes in variables, it is essential that
we are able to measure them.
• Two aspects of measurement are particularly important when
planning a research study or reading a research report:
Constructs and Operational Definitions
• Occasionally, a research study involves variables that are well
defined, easily observed, and easily measured.
• For example, a study of physical development might involve the
variables of height and weight.
• Both of these variables are tangible, concrete attributes that can
be observed and measured directly.
• On the other hand, some studies involve intangible, abstract
attributes such as motivation or self-esteem. Such variables are
not directly observable, and the process of measuring them is
more complicated.
Theories and Constructs
• In attempting to explain and predict behavior, scientists and
philosophers often develop theories that contain hypothetical
mechanisms and intangible elements.
• Although these mechanisms and elements cannot be seen and
are only assumed to exist, we accept them as real because they
seem to describe and explain behaviors that we see.
• For example, a bright child does poor work in school because she
has low “motivation.” A kindergarten teacher may hesitate to
criticize a lazy child because it may injure the student’s “self-
esteem.”
• But what is motivation, and how do we know that it is low?
• Do we read the child’s motivation meter?
• What about self-esteem? How do we recognize poor self- esteem
or healthy self-esteem when we cannot see it in the first place?
• Many research variables, particularly variables of interest to
behavioral scientists, are in fact hypothetical entities created from
theory and speculation. Such variables are called constructs, or
hypothetical constructs.
• Constructs are hypothetical attributes or mechanisms that help
explain and predict behavior in a theory.
Rewards
Motivation Performance
Reinforcement
Mechanism of construct as defined by
theories in a specific context
Lack of
concentration
worry
Outcomes
exam anxiety nervousness
(behaviors)
This can distort the measurement (e.g., a more expressive person may
appear more depressed than someone who is reserved or unable to
articulate their symptoms).
Using Operational Definitions for Hypothetical
Constructs
• Necessity of Operational Definitions:
• Required when variables are hypothetical constructs (e.g.,
intelligence, motivation).
• Essential to make abstract concepts measurable and observable.
• Creating vs. Adopting Definitions:
• You usually don’t need to create your own operational
definition.
• Best practice: Review previous research involving the same
construct to see how it has been defined and measured.
• Using Established Methods:
• Past research reports describe in detail how variables were
operationally defined
• Reading multiple sources helps identify standard or commonly
accepted measurement procedures.
• Advantages of Conventional Methods:
• Using established methods makes your results comparable with
existing findings.
• Promotes consistency and validity across studies.
Identifying Scales of Measurement and
Evaluating Reliability and Validity
• scales of measurement (nominal ordinal ratio interval)
• Reliability: The reliability of a measurement procedure is the
stability or consistency of the measurement. If the same
individuals are measured under the same conditions, a reliable
measurement procedure produces identical (or nearly identical)
measurements.
• Validity: The validity of a measurement procedure is the degree to
which the measurement process measures the variable that it
claims to measure
Modalities of Measurement
Measure Definition Strengths Weaknesses
Probability Non-Probability
Sampling Sampling
Probability Sampling
• In probability sampling, the entire population is known, each
individual in the population has a specifiable probability of
selection, and sampling occurs by a random process based on
the probabilities.
• For example, if there are 100 people in a group and everyone has
an equal chance of being picked, then each person has a 1 out of
100 (or 1/100) chance of being selected.
• Probability sampling has three important conditions:
The exact size of the population
Each individual in the population Selection must be a random
must be known and it must be
must have a specified probability process, which simply means
possible to list all of the
of selection. that every possible outcome is
individuals.
equally likely
Example of Probability Sampling
• A university wants to evaluate a new teaching method used in a
large introductory psychology course. There are 300 students
enrolled, and the university decides to randomly select 30
students to complete a detailed feedback form.
• Population Size Known (The list of all 300 enrolled students is
available from course records.)
• Specified Probability of Selection (Each student has a 1 in 300
chance of being selected for the survey)
• Unbiased and Random Selection
• The 30 students are selected using a random number generator.
Non-Probability Sampling
• In nonprobability sampling, the population is not completely
known, individual probabilities cannot be known, and the
sampling method is based on factors such as commonsense or
ease, with an effort to maintain representativeness and avoid bias
• the researcher does not know the population size and cannot
list the members of the population.
• the researcher does not use an unbiased method of selection and
has a greater risk of producing a biased sample than does
probability sampling
Example of Non-probability Sampling
• A researcher who wants to study the behavior of preschool
children may go to a local child-care center where a group of
preschool children is al ready assembled.
• Because the researcher is selecting from a restricted group,
rather than the entire population of preschool children, this
sample has an in creased chance of being biased.
• For example, if the child-care center includes only white,
middle-class children, then the sample definitely does not
represent the target population of preschool children..
Probability
Sampling
Techniques
Probability
Sampling
Proportionate
Simple Random Systematic Stratified Random
Stratified Random Cluster Sampling
Sampling Sampling Sampling
Sampling