Behaviorism Theory Revised
Behaviorism Theory Revised
❖ Definition of terms
❖ Types of Behaviorism
❖ Classical conditioning
o Biography
o Criticisms
❖ Operant Conditioning
o Biography
o Self-control processes
o Criticisms
❖ References
2
Introduction
Ivan Pavlov is credited for demonstrating the simple form of learning called classical
conditioning in his famous experiment with dogs, food, a tone, and salivation. In
classical conditioning, the organism learns that one stimulus will be followed by
another stimulus because the two stimuli repeatedly occur closely together in time.
John B. Watson was also another advocate of classical conditioning, through his
famous experiment with “little Albert” he demonstrated that fear to a previously
neutral stimulus can easily be conditioned. Watson and Raynor presented Little
Albert with a white rat and he showed no fear. Watson then presented the rat with a
loud bang that startled Little Albert and made him cry. After the continuous
association of the white rat and loud noise, Little Albert was classically conditioned
to experience fear at the sight of the rat. Albert's fear generalized to other stimuli
that were similar to the rat, including a fur coat, some cotton wool, and a Father
Christmas mask.
Edward L. Thorndike on the other hand contributed to the behavioral theory through
his famous ‘Law of effect’ principle. In Thorndike’s experiment, cats were deprived
of food, and then placed in problem boxes and left there until they accidentally
moved a mechanism that opened a door and allowed them to escape. The animals
usually made a variety of responses before making the correct one- a phenomenon
Thorndike referred to as trial-and-error learning. He explained this trial-and-error
learning by maintaining that an association was established between the animals’
3
responses and the reinforcing consequences. The law of effect states that behaviors
that lead to reward tend to be ‘stamped in’ (i.e. increase in strength), whereas those
that lead to punishment tend to be ‘stamped out’ (i.e. decrease in strength).
B. F. Skinner, popularly known for the operant conditioning, argued that most
behavior is learned based on the reinforcement (consequence of reward or
punishment) to the organism’s response. A response operates on the environment to
produce consequences that either strengthen or weaken that behavior. Skinner
adopted a modification of the law of effect to explain the acquisition of behavior. If
the response is reinforced, it is more likely to occur again; if it is not reinforced, it is
less likely to recur.
Definition of Terms
Classical conditioning is a simple form of learning that occurs through the repeated
association of two or more different stimuli. An initially neutral stimulus (e.g., tone)
4
is repeatedly paired with an unconditioned stimulus (food), to enable it elicit a
conditioned response (salivation) in an automatic manner thus transforming the
neutral stimulus to a conditioned stimulus.
Operant refers to any "active behavior that operates upon the environment to
generate consequences.
Operant behavior- defined as the behavior that acts on the environment to produce
an immediate consequence and in turn is strengthened by that consequence.
Neutral stimulus- a stimulus which does not naturally cause the subject to respond
in a certain way.
5
Unconditioned response refers to an automatic, unlearned response elicited by an
unconditioned stimulus.
Types of Conditioning
CLASSICAL CONDITIONING
6
This conditioning involves pairing a neutral stimulus with an unconditioned stimulus
(UCS) that elicits an unconditioned response (UCR). Through repeated pairing, the
neutral stimulus becomes a conditioned stimulus (CS) that evokes a conditioned
response (CR) similar to the original UCR.
Biography
Ivan Pavlov (1849–1936) author of Lectures on the Work of the Principal Digestive
Glands (1897), Lectures on Conditioned Reflexes (1928), and Conditioned Reflexes
and Psychiatry (1941) hailed from Ryazan, Russia.
He was a natural science graduate of the University of St. Petersburg when he got
admitted into the Academy of Medical Surgery. After obtaining his doctorate, he
7
joined the Military Medical Academy serving as director in the department of
physiology in the Institute of Experimental Medicine.
In 1904, his work on the digestive secretions of dogs at the Institute earned him the
Nobel Prize. This work formed the foundation to his renowned classical
conditioning. Pavlov passed on in 1936 having suffered from pneumonia.
1) Acquisition
Refers to the period during which a response is being learned. Under normal
circumstance a dog cannot salivate at the sound of a tone (neutral stimulus), instead
it can only prick up its ears. If presented with food (unconditioned stimulus), it
automatically starts salivating (unconditioned response), this response is reflexive-
their nature when they see food.
The tone is paired with food to produce salivation response by the dog, this is called
a learning trial. After several learning trials, the dog will salivate upon presentation
of the tone without food. The initially neutral stimulus has thus acquired the status
of conditioned stimulus.
This principle also states that the higher the intensity of the UCS the stronger the
response. The larger the amount of food the more rapid conditioning happens.
Stronger acquisition also occurs when the time interval between presentation of tone
and food is shorter. Forward pairing where CS (tone) appears first then followed by
UCS (food) results in quick learning.
Acquisition can also happen with just one CS-UCS pairing (one-trial learning) in
cases where the UCS is intense and aversive like electric shock or any traumatic
8
event. For example, car phobia following a very traumatic accident. Riding in or
seeing a car, initially NS becomes a CS. Fear, which was the UCR, becomes CR
triggered by the sight of cars.
When a CR extinguishes, not all traces of it are necessarily erased. Even when the
dog had stopped salivating, when the tone is still presented later it may still salivate.
This is termed as spontaneous recovery- defined as the reappearance of a
previously extinguished CR after a rest period and without new learning trials.
Spontaneous recovery indicates that the extinction occurs through the formation of
an inhibition of the CR, rather than the unlearning of the CR.
9
3) Stimulus generalization
This is the process by which CSs that are similar, but not identical to the original CS
elicit a CR. Typically adaptive because it allows us to transfer what we have learned
to new things.
For example, a dog that salivates to a medium-pitched tone is more likely to salivate
to a new tone slightly different in pitch than to a very low-or-high-pitched tone.
4) Stimulus discrimination
This occurs when we exhibit a less pronounced CR to CSs that defer from the
original CS. For instance, the dog does not salivate to presentation of all manner of
sounds, it can differentiate which is the correct one and ignore the others which are
not similar to the original one.
10
A person with car phobia is able to discriminate between cars and bicycles, trains or
airplanes. This is adaptive as it enables one to distinguish between relevant and
irrelevant stimuli.
It is the planned progressive exposure to stimuli that elicit fear or anxiety while the
fear response is suppressed with relaxation techniques. The main principle in this
therapy is to teach the patient how to relax as the session progresses. It involves
gradually presenting successive approximations of the CS until the CS itself does
not produce the CR. Actually, this is the process of extinction of the association
between the CS and the CR.
11
This therapy is useful in eliminating a range of problems involving fear/phobias and
anxiety responses.
12
The process of systematic desensitization (graduated exposure)
2) Aversion therapy
Aversion therapy is based on the learning theory which states that all behaviors are
learned and if we want to change an undesirable behavior, we can change it through
appropriate conditioning.
There have been successful results in its use to treat many behaviors such as
alcoholism, drug dependence, nail biting, gambling, sexual deviance and varying
obsessions and compulsions.
13
For example, an individual ate something and felt sick afterwards. If this happened
2 or 3 times, then he is likely to avoid this kind of food as he doesn’t want to get sick
again.
Sometimes drugs are used to induce unpleasant stimuli such as severe nausea,
palpitation and headache. For example, disulfiram (Antabuse) as used in
management of alcohol addiction by serving as a deterrent to drinking.
ii) Covert sensitization- this technique requires that the individual has the
motivation to change. Instead of relying on external factors, such as drugs, to
produce the unpleasant stimuli, the individual has to produce the stimuli himself.
The individual learns to imagine and create the nauseating feeling. He can practice
this whenever it is required.
14
3) Flooding
This therapy involves bringing the client into direct contact with the CS and keeping
them in contact with it until the CR is extinguished. Used for treatment of phobias
and anxiety disorders.
The principle behind this technique is that anxiety will be experienced at a very high
level and then gradually diminish, thus enabling the client to experience the CS in
the absence of the CR.
It works by exposing the patient to their painful memories with the goal of
reintegrating their repressed emotions with current awareness. With the guidance
and support from the therapist, the anxiety is eventually decreased.
15
CRITICISMS
In real-life settings, many human behaviors are not automatic and not simple as
underestimated by Pavlov’s theory
Classical conditioning theory is deterministic- it does not allow for any degree of
free will in the individual. Accordingly, a person has no control over the reactions
they have learned from classical conditioning, such as a phobia. This is not the case
in real-life experiences.
16
OPERANT CONDITIONING
Skinner is regarded as the father of Operant Conditioning, but his work was based
on Thorndike’s (1898) law of effect.
Skinner’s work has had wide practical applications. Therapeutic techniques derived
from his research are being applied in clinical settings to treat a variety of disorders
including psychoses, mental retardation, and autism. His behavior-modification
techniques are also used in schools, businesses, correctional institutions, and
hospitals.
Biographical Sketch
He then opted to pursue his interest in animal and human behavior by enrolling into
graduate school at Harvard University in 1928, to study psychology. Skinner became
interested in the ideas of Pavlov and Watson, and received his Ph.D. in 1931 despite
never taking a course in this field prior to his enrolment. Thereafter, he did several
postdoctoral fellowships, staying at Harvard until 1936.
17
He later authored some books including The Behaviour of Organisms: An
Experimental Analysis (1938) and Science and Human Behaviour (1953).
On August 10, 1990, Professor Skinner was awarded a Citation for Outstanding
Lifetime Contribution to Psychology by the American Psychological Association.
He died of complications from leukemia on August 18, 1990, in Cambridge,
Massachusetts
18
Difference between Classical and Operant conditioning
19
The Skinner Box (Operant conditioning chamber)
20
learn, especially since it is deprived of food for some time prior to the experimental
session. The key is connected to an electronic recording system that produces a graph
of the pigeon’s response rate, and the apparatus can be programmed so that
reinforcement is available after every peck of the disk or only intermittently.
Skinner’s second version is that of a rat where he established that rats are positively
reinforced by receiving food for pressing a bar.
The Skinner box may also be used to study the effects of negative reinforcement, as
by having a peck of the disk or press of the bar turn off or prevent an electric shock.
Or complicated sequences of behavior may be conditioned, as when a pigeon is
reinforced for pecking a series of disks (with the correct order depending on their
positions or colors).
21
The Basics of Operant Conditioning
Behavior is controlled not only by antecedent stimuli, but also by its consequences.
Such consequences involve the presentation or removal of either pleasant or
unpleasant stimuli following a behavior. The presentation of a stimulus is termed as
positive and the removal of a stimulus as negative.
Creates fear that can generalize to undesirable behaviors, e.g., fear of school.
Does not necessarily guide toward desired behavior - reinforcement tells you
what to do, punishment only tells you what not to do.
2) Schedules of Reinforcement
Schedules of reinforcement are the precise rules, defined in terms of the time and/or
the number of responses, that are used to present (or to remove) reinforcers (or
punishers) following a specified operant behavior.
24
3) Stimulus and Response Generalization
25
4) Discrimination
This refers to the organism’s ability to perceive a difference between two stimuli, or
between the presence and absence of a stimulus, and thus learn to respond to them
in different ways.
A rat will learn to press the bar only when a light is on if reinforcement is withheld
when the light is off. And a child is taught to discriminate between right and wrong
by being reinforced with approval for correct behaviors (“That’s right!”), but not for
incorrect behaviors (“That’s wrong!”).
5) Extinction
If a rat has learned to press a lever because it receives food for doing so, its lever-
pressing will decrease and eventually disappear if food is no longer delivered.
With people, withholding the reinforcer may eliminate some unwanted behaviors.
For instance, parents often reinforce temper tantrums in young children by giving
them attention. If parents simply ignore the child’s tantrums rather than reward them
with attention, the number of tantrums should gradually decrease.
26
to extinction. For example, gamblers who become addicted to slot machines
continue to insert their coins even though they usually lose. Slot machines pay off
only infrequently, and this intermittent reinforcement leads to behavior that is highly
resistant to extinction. But if you put your money into a vending machine that you
have learned “pays off” on every trial (continuous reinforcement), and no candy
emerges, this response is likely to extinguish very quickly.
SELF-CONTROL PROCESSES/TECHNIQUES
Individuals are said to exercise self-control when they actively change those
variables or factors that determine their behavior. For example, an obese person who
exercises control over his behavior by buying and eating only low-calorie foods. He
can also politely refuse to eat high-calorie foods when they are offered to him by
others.
Skinner outlined a number of the techniques that we use to control our behavior:
i) Physical restraints- For instance, some of us clap our hands over our mouths to
avoid laughing at someone else’s mistakes. Others choose to walk away from
someone who has insulted them, lest they lose control and physically attack him/her.
ii) Physical aids -Some truckers take stimulants to avoid falling asleep at the wheel.
Students often drink large amounts of coffee after all-night study sessions in an effort
to remain alert during early morning exams. People with vision problems can put on
eyeglasses or the hearing-impaired make use of hearing aids.
27
iii) Changing the stimulus conditions- Overweight people put a box of candy out
of sight so that they can restrain themselves. Smokers diminish smoking frequency
by reducing the range of stimuli associated with it. Smokers typically have favorite
times and situations in which they smoke—for example, while studying, working,
eating, partying, or watching television. Various studies have shown that, if they can
break these associations, they can reduce their smoking drastically.
vii) Self-punishment- Individuals also punish themselves for failure to reach self-
generated goals. College football players often voluntarily jog extra laps around the
track Monday morning as punishment for failure to perform adequately during a
game on Saturday afternoon.
28
APPLICATIONS OF OPERANT CONDITIONING
When working with children with attention deficit hyperactivity disorder, goals
include task completion for homework, hygiene tasks, turn-taking when talking, and
so forth. The child is given a “star” or sticker when tasks are completed. Upon
reaching a specified number of stars, the child receives a reward.
Modern behavior therapists use a variety of techniques. Some of these are based on
Skinner’s ideas, whereas others involve somewhat different concepts and
procedures.
29
ii. Active control is exercised by the therapist, who selects and imposes specific
procedures designed to bring about the desired changes in behavior.
iii. Behavior therapy emphasizes the present aspects of the client’s difficulties,
and is less concerned with childhood causes.
iv. Behavior therapists use different techniques to treat different types of
problems, rather than imposing the same form of therapy on every client.
v. Behavior therapy is typically of shorter duration than psychotherapy, and may
last as little as a few months.
vi. Behavior therapy is not concerned with resistances and transferences.
vii. The techniques of behavior therapy are based on empirical research, rather
than on a psychotherapist’s theoretical speculations and subjective judgments.
The token economy system is a form of behavior modification that was often used
in psychiatric hospitals to manage the behavior of individuals who may be
aggressive or unpredictable. The system was based on selective positive
reinforcement, whereby patients are rewarded with tokens for behaving in
appropriate ways; behavior that is not appropriate is not rewarded.
These tokens can later be exchanged for various privileges (e.g., time watching
television; cigarettes). Initially tokens are awarded often and in higher amounts, but
as individuals learn the appropriate behavior, opportunities to earn tokens decrease.
The token economy system is still applicable within mental health psychiatric units
even if it does not cure psychosis, it is capable of producing marked improvements
in behavior.
30
Parents and teachers too, often use token economies, allowing kids to earn tokens
for engaging in preferred behaviors and lose tokens for undesirable behaviors. These
tokens can then be traded for rewards such as candy, toys, or extra time playing with
a favorite toy.
2) Aversion therapy
31
what to do, or a visual cue, such as displaying a picture designed to cue the
response.
• Shaping: This strategy involves gradually altering a behavior, rewarding
closer and closer approximations of the desired response.
4) Assertiveness Training
5) Biofeedback
Using a screen such as a computer monitor, patients get feedback that helps them
develop control over their physiology (heart rate, skin conductance, skin
temperature, and muscle activity). Just as looking into a mirror allows one to see and
change positions, expressions, etc., biofeedback allows patients to see inside their
bodies, with a trained practitioner serving as a guide directing them to use the
feedback to regulate their physiology in a healthy direction.
32
Common disorders treated in this way include hypertension, anxiety, addictions and
medical conditions exacerbated by stress. Biofeedback also helps to make patients
aware of the thoughts, feelings and behaviors related to their physiology. Over time,
they can learn to self-regulate without feedback screens in front of them.
6) Contingency Contracting
CRITICISMS
B.F Skinner deemphasizes the role of internal thoughts and feelings in behavior thus
presenting humans as lacking free will.
Its application in therapy can be seen as manipulative and unethical like use of
Antabuse in treating alcohol addiction.
33
Strengths and weaknesses of the behaviorist approach
Strengths
● Scientific.
Weaknesses
● Environmental determinism.
●Oversimplified.
The behavioral approach can be used with different personality types and different
groups like children, adolescents, couples and families.
Behavioral theory is easy to apply and can be used in teaching self-care to patients,
teaching alcoholics and neurotics.
34
REFERENCES
Luman, M., Oosterlaan, J., & Sergeant, J. A. (2005). The impact of reinforcement
contingencies on AD/HD: A review and theoretical appraisal. Clinical Psychology
Review, 25, 183–213
Schultz, D., & Schultz, S. E. (2005). Theories of personality (8th ed.). CENGAGE
Learning Custom Publishing.
35