L7 Notes
L7 Notes
Classical Conditioning
Russian physiologist Ivan Pavlov was the first to describe classical conditioning. In
classical conditioning, also called “respondent conditioning” or “Pavlovian
conditioning,” a subject comes to respond to a neutral stimulus as he would to another,
nonneutral stimulus by learning to associate the two stimuli.
Pavlov’s contribution to learning began with his study of dogs. Not surprisingly, his dogs
drooled every time he gave them food. Then he noticed that if he sounded a tone every
time he fed them, the dogs soon started to drool at the sound of the tone, even if no food
followed it. The dogs had come to associate the tone, a neutral stimulus, with food, a
nonneutral stimulus.
Example:
Suppose Adam has a psychology class with Professor Smith, who is determined to teach
him about classical conditioning. In the first class, Professor Smith whips out a revolver
and shoots it into the air. The revolver is loaded with blanks, but when Adam hears the
loud bang, he cringes out of surprise. Professor Smith repeats this action several times
during the class. By the end of the hour, Adam cringes as soon as she whips out the
revolver, expecting a bang. He cringes even if she doesn’t shoot. In this scenario, the
unconditioned stimulus is the bang, the unconditioned response is cringing, the
conditioned stimulus is the revolver, and the conditioned response is cringing.
Acquisition of Conditioned Responses
Extinction
After Adam has been conditioned to cringe at the sight of the revolver, Professor Smith
comes into the next class and pulls out the revolver again. He cringes, but she doesn’t
shoot. If she pulls it out again and again on several occasions without shooting, Adam
will soon stop cringing when she pulls it out. This process called extinction is the gradual
weakening and disappearance of a conditioned response. Extinction happens when the
conditioned stimulus appears repeatedly without the unconditioned stimulus.
Spontaneous Recovery
Suppose that by the end of the second class, Adam has completely stopped cringing when
Professor Smith pulls out the revolver. His conditioned response has been extinguished.
However, if Professor Smith comes into class later in the semester and pulls out the
revolver again, Adam may still cringe, though maybe a little less than before. This is
called spontaneous recovery. Spontaneous recovery is the reappearance of an
extinguished conditioned response when the conditioned stimulus returns after a period
of absence.
Stimulus Generalization
Now suppose Professor Smith conditions Adam again to respond to the revolver as she
did in the first class. Soon he cringes every time she pulls out the revolver. While Adam
is in this conditioned state, the professor pulls out a cell phone. Adam is likely to cringe
at that too because of stimulus generalization—the tendency to respond to a new
stimulus as if it were the original conditioned stimulus. Stimulus generalization happens
most often when the new stimulus resembles the original conditioned stimulus.
Example:
In the 1920s, the behaviorist John Watson and his colleague Rosalie Rayner did a
famous study that demonstrated stimulus generalization. They gave a white rat to an
eleven-month-old boy named Little Albert, who liked the rat and enjoyed playing with it.
In the next stage of the experiment, the researchers repeatedly made a loud noise behind
Albert while offering him the rat. Each time, Albert fell to the floor, frightened. When the
researchers then offered the rat to him without making the noise, Albert showed fear of
the rat and crawled away from it. The researchers were subsequently able to generalize
Albert’s fear to other furry, white stimuli, including a rabbit, a dog, a fur coat, a Santa
Claus mask, and Watson’s hair. This experiment is considered highly unethical by
today’s standards.
Stimulus Discrimination
Suppose Professor Smith used a gray revolver to condition Adam. Once Adam is
conditioned, if she pulls out a brown revolver, he’ll initially cringe at that, too. But
suppose Professor Smith never shoots when she pulls out the brown revolver and always
shoots when she pulls out the gray one. Soon, Adam will cringe only at the gray revolver.
He is showing stimulus discrimination—the tendency to lack a conditioned response to
a new stimulus that resembles the original conditioned stimulus.
Higher-Order Conditioning
Now suppose that after Adam has been conditioned to cringe at the sight of the revolver,
Professor Smith comes to class one day and pulls out the revolver while yelling, “Fire!”
She does this many times. Each time, Adam cringes because he is conditioned to respond
to the revolver. If she then yells, “Fire!” without pulling out the revolver, Adam will still
cringe due to higher-order conditioning—the process by which a neutral stimulus
comes to act as a conditioned stimulus by being paired with another stimulus that already
evokes a conditioned response.
Just as Pavlov’s fame stems from his experiments with salivating dogs, Skinner’s fame
stems from his experiments with animal boxes. Skinner used a device called the Skinner
box to study operant conditioning. A Skinner box is a cage set up so that an animal can
automatically get a food reward if it makes a particular kind of response. The box also
contains an instrument that records the number of responses an animal makes.
Psychologists use several key terms to discuss operant conditioning principles, including
reinforcement and punishment.
Reinforcement
Punishment
Punishment is the delivery of a consequence that decreases the likelihood that a response
will occur. Positive and negative punishments are analogous to positive and negative
reinforcement. Positive punishment is the presentation of a stimulus after a response so
that the response will occur less often. Negative punishment is the removal of a stimulus
after a response so that the response will occur less often.
• Primary reinforcers, such as food, water, and caresses, are naturally satisfying.
• Primary punishers, such as pain and freezing temperatures, are naturally
unpleasant.
• Secondary reinforcers, such as money, fast cars, and good grades, are satisfying
because they’ve become associated with primary reinforcers.
• Secondary punishers, such as failing grades and social disapproval, are
unpleasant because they’ve become associated with primary punishers.
• Secondary reinforcers and punishers are also called conditioned reinforcers and
punishers because they arise through classical conditioning.
Is It Primary or Secondary?
To distinguish between primary and secondary reinforcers, people can ask themselves
this question: “Would a newborn baby find this stimulus satisfying?” If the answer is yes,
the reinforcer is primary. If the answer is no, it’s secondary. The same idea can be
applied to punishers by asking whether a baby would find the stimulus unpleasant.
Shaping
Example:
Lisa wants to teach her dog, Rover, to bring her the TV remote control. She places the
remote in Rover’s mouth and then sits down in her favorite TV–watching chair. Rover
doesn’t know what to do with the remote, and he just drops it on the floor. So Lisa
teaches him by first praising him every time he accidentally walks toward her before
dropping the remote. He likes the praise, so he starts to walk toward her with the remote
more often. Then she praises him only when he brings the remote close to the chair.
When he starts doing this often, she praises him only when he manages to bring the
remote right up to her. Pretty soon, he brings her the remote regularly, and she has
succeeded in shaping a response.
Reinforcement Schedules
There are four main types of intermittent schedules, which fall into two categories: ratio
or interval. In a ratio schedule, reinforcement happens after a certain number of
responses. In an interval schedule, reinforcement happens after a particular time interval.
Response Patterns
Stimulus Discrimination
If Lisa enjoys Rover’s antics with the TV remote only in the daytime and not at night
when she feels tired, Rover will put the remote under her chair only during the day,
because daylight has become a signal that tells Rover his behavior will be reinforced.
Daylight has become a discriminative stimulus. A discriminative stimulus is a cue that
indicates the kind of consequence that’s likely to occur after a response. In operant
conditioning, stimulus discrimination is the tendency for a response to happen only
when a particular stimulus is present.
Stimulus Generalization
Suppose Lisa’s dog, Rover, began to put the remote under her chair not only during the
day but also whenever a bright light was on at night, thinking she would probably pat
him. This is called stimulus generalization. In operant conditioning, stimulus
generalization is the tendency to respond to a new stimulus as if it is the original
discriminative stimulus.
Biological Influences
Conditioning accounts for a lot of learning, both in humans and nonhuman species.
However, biological factors can limit the capacity for conditioning. Two good examples
of biological influences on conditioning are taste aversion and instinctive drift.
Taste Aversion
Psychologist John Garcia and his colleagues found that aversion to a particular taste is
conditioned only by pairing the taste (a conditioned stimulus) with nausea (an
unconditioned stimulus). If taste is paired with other unconditioned stimuli, conditioning
doesn’t occur.
Similarly, nausea paired with most other conditioned stimuli doesn’t produce aversion to
those stimuli. Pairing taste and nausea, on the other hand, produces conditioning very
quickly, even with a delay of several hours between the conditioned stimulus of the taste
and the unconditioned stimulus of nausea. This phenomenon is unusual, since normally
classical conditioning occurs only when the unconditioned stimulus immediately follows
the conditioned stimulus.
Example:
Joe eats pepperoni pizza while watching a movie with his roommate, and three hours
later, he becomes nauseated. He may develop an aversion to pepperoni pizza, but he
won’t develop an aversion to the movie he was watching or to his roommate, even though
they were also present at the same time as the pizza. Joe’s roommate and the movie won’t
become conditioned stimuli, but the pizza will. If, right after eating the pizza, Joe gets a
sharp pain in his elbow instead of nausea, it’s unlikely that he will develop an aversion to
pizza as a result. Unlike nausea, the pain won’t act as an unconditioned stimulus.
An Evolutionary Adaptation
The combination of taste and nausea seems to be a special case. Researchers think that
learning to quickly associate taste and nausea is an evolutionary adaptation, since this
association helps people to know what foods to avoid in order to survive.
Instinctive Drift
Instinctive drift is the tendency for conditioning to be hindered by natural instincts. Two
psychologists, Keller and Marian Breland, were the first to describe instinctive drift. The
Brelands found that through operant conditioning, they could teach raccoons to put a coin
in a box by using food as a reinforcer. However, they couldn’t teach raccoons to put two
coins in a box. If given two coins, raccoons just held on to the coins and rubbed them
together. Giving the raccoons two coins brought out their instinctive food-washing
behavior: raccoons instinctively rub edible things together to clean them before eating
them. Once the coins became associated with food, it became impossible to train them to
drop the coins into the box.
Cognitive Influences
Researchers once thought of conditioning as automatic and not involving much in the
way of higher mental processes. However, now researchers believe that conditioning
does involve some information processing.
The psychologist Robert Rescorla showed that in classical conditioning, pairing two
stimuli doesn’t always produce the same level of conditioning. Conditioning works better
if the conditioned stimulus acts as a reliable signal that predicts the appearance of the
unconditioned stimulus.
Example:
Consider the earlier example in which Adam’s professor, Professor Smith, pulled out a
revolver in class and shot it into the air, causing Adam to cringe. If Adam heard a
gunshot only when Professor Smith pulled out her revolver, he would be conditioned to
cringe at the sight of the revolver. Now suppose Professor Smith sometimes took out the
revolver as before and fired it. Other times, she played an audio recording of a gunshot
without taking out the revolver. The revolver wouldn’t predict the gunshot sound as well
now, since gunshots happen both with and without the revolver. In this case, Adam
wouldn’t respond as strongly to the sight of the revolver.
The fact that classical conditioning depends on the predictive power of the conditioned
stimulus, rather than just association of two stimuli, means that some information
processing happens during classical conditioning. Cognitive processes are also involved
in operant conditioning. A response doesn’t increase just because satisfying
consequences follow the response. People usually think about whether the response
caused the consequence. If the response did cause the consequence, then it makes sense
to keep responding the same way. Otherwise, it doesn’t.
Observational Learning
People and animals don’t learn only by conditioning; they also learn by observing others.
Observational learning is the process of learning to respond in a particular way by
watching others, who are called models. Observational learning is also called “vicarious
conditioning” because it involves learning by watching others acquire responses through
classical or operant conditioning.
Example:
Brian might learn not to stand too close to a soccer goal because he saw another spectator
move away after getting whacked on the head by a wayward soccer ball. The other
spectator stopped standing close to the soccer goal because of operant conditioning—
getting clobbered by the ball acted as positive punishment for standing too close. Brian
was indirectly, or vicariously, conditioned to move away.
• Ivan Pavlov was the first to describe classical conditioning, the type of learning
in which a subject comes to respond to a neutral stimulus as he would to another
stimulus by learning to associate the two stimuli.
• An unconditioned response is the naturally occurring response; an
unconditioned stimulus is the stimulus that evokes an innate response. A
conditioned response is the learned response; a conditioned stimulus is the
learned or associated stimulus.
• A conditioned response is acquired when a conditioned stimulus is paired with an
unconditioned stimulus.
• Extinction is the gradual weakening and disappearance of a conditioned
response. Spontaneous recovery is the reappearance of an extinguished
conditioned response when the conditioned stimulus returns after a period of
absence.
• Stimulus generalization is the tendency to respond to a new stimulus as if it is
the original conditioned stimulus. Stimulus discrimination is the tendency to
lack a conditioned response to a new stimulus that’s similar to the original
conditioned stimulus.
• Higher-order conditioning occurs when a neutral stimulus comes to act as a
conditioned stimulus by being paired with another stimulus that already evokes a
conditioned response.
Operant Conditioning
Biological Influences
Cognitive Influences
Observational Learning