Neisser Autobiography
Neisser Autobiography
Ulric Neisser
Autobiography is always a risky enterprise, but it may be especially so in my case. Whatever other people's
memories may be like, my own tend to be sketchy rather than detailed; some of them are certainly wrong. As an
example, I once described what seemed to be a clearly false personal memory in my book Memory Observed (1982,
p. 45). In the long run, however, the force of that example was not quite what I had expected. Thus it may serve as a
useful introduction to the present enterprise, which is my third - and by far my most thorough - autobiographical
venture (cf. Neisser, 1987, 2002).
heavy even in German, so I was often just called "Der kleiner Dickie," which means "the chubby
little kid."
When Hitler came to power the Weltwirtschaftsinstitut could not long survive: its
members were all anti-Nazi Social Democrats and most of them were Jews. Foreseeing this
development, my father had already negotiated for a position at the Wharton School of the
University of Pennsylvania. For safety's sake he left Germany almost immediately; my mother
and sister and I joined him in England a few months later. We sailed for the United States on the
ocean liner Hamburg, arriving in New York on September 15, 1933. I was not quite five years
old.
Soon after our arrival we settled in Swarthmore Pennsylvania, living for seven years in a
big comfortable house near my school and then for two more years in two other houses. (We
were in the last of them on December 7, 1941). My parents chose Swarthmore not for its college
(which I came to know only later) but because it was an intellectual community with a
convenient commuter train to Philadelphia. They enjoyed life there, and I did too. My father had
a good academic salary; we lived well, and I had no idea that America was going through a great
depression.
Swarthmore is where my memories begin, at age 5. I have no recollection of my earlier
experiences in Kiel, of speaking German, or even of the German governess to whom I was said
to have been very attached. There is a photo of me wearing a sailor suit aboard the Hamburg, but
I have no recollection of it: remembered life begins when I started kindergarten in the USA.
Like boys everywhere, I was desperate to belong to my peer group. Becoming a baseball
fan was probably part of that effort. As a player I was a dead loss, the kid who was always
chosen last. (That experience may have contributed to my lifelong sympathy with the underdog:
I am a committed infracaninophile.) Another part of the same effort was finding an acceptable
name. "Ulrich" was excruciatingly German, and my friends couldn't even pronounce it. Luckily a
common American nickname was already in place: "Dickie." I decided to stick with it, and have
been Dick Neisser ever since. Later I dropped the "h" from "Ulrich," again to be less German. In
a further phase I briefly added a "Richard" to justify the "Dick," but that soon seemed stupid and
I gave it up. "Ulric" and "Dick" are both natural now.
perhaps not even overtly, but with feeling. Hans and Charlotte had foreign accents, scholarly
interests, European cultural values, academic friends. I would have none of all that; their ways
were not for an American boy like me. This deliberate rejection was successful, and I became
100% American in thought and deed. But success came at a price: not wanting to have anything
to do with grown-up culture, I essentially wasted my adolescence. It is in high school that kids
begin to read novels, play instruments, write poetry, form political identities, fall in love. I did
none of those things. I never even went to New York City, which was only an auto-plus-subway
ride away from Floral Park. In later years I have tried to catch up on what I missed in
adolescence, but I'm still a bit behind.
Another factor may also have been important. I knew myself to be a smart kid, but my
father the German-educated professor was even smarter. On one occasion when a school
assignment required looking things up, I asked my mother why we didn't have an encyclopedia
in the house as other families did. Her answer was simple: "Because your father knows
everything." (Half a century later, I'm still not sure if she was joking.) One way to avoid that
particular competition was to stick to things outside Hans Neisser's expertise - baseball, for
example.
In many other ways, however, it was a good life. As the spoiled younger brother of an
older sister, I was indulged and rarely criticized. My parents never tried to indoctrinate me in
anything. On the contrary: for some reason that I don't yet understand, they were surprisingly
reticent. This was the 1940s, and yet there were no discussions of socialism, communism, and
democracy in our house. Did I just not listen? Whatever the reason, I grew up with almost no
views on such matters. An even stranger example concerns the Nazi persecution of the Jews,
which had determined the course of our own lives. To the best of my recollection, we never
talked about it. One consequence of this silence was that I didn't even know my father was
Jewish! Thus I also didn't know that I was Jewish myself (at least by the Nazi criteria), and that I
would surely have ended in a concentration camp had we not left Germany. This seems an odd
thing not to know, but to the best of my recall I learned it only years later, in reminiscent
conversations with my mother.
In contrast, I knew quite a lot about my mother. Although she had rejected Catholicism in
her youth, Lotte still retained a strong religious sensibility. (Perhaps for that reason, my sister
and I were formally christened just before our Atlantic voyage.) Once settled in America she
became a Presbyterian, joining a church in Swarthmore and then another in Floral Park. To
please her I joined them too, though I was fairly dubious about the God hypothesis. My father
never accompanied us to church; I took it for granted that he was some kind of non-churchgoing
Lutheran.
As far back as I can remember, it was assumed that I would become a "scientist." Where
this strong conviction came from I do not know; certainly not from knowledge of science itself. I
had a chemistry set, but was never very interested in it. The science courses at Sewanhaka were
not exciting. Popular accounts of Einstein's theory of relativity were available, but I had no real
grasp of it. In my senior year I read up on atomic bombs and nuclear fission as part of a science
competition, but was quite aware that I didn't really understand the material and unsurprised
when I failed to win. As for psychology, I don't think I had ever heard of it.
Senior year was marked by the acquisition of a first girl friend; we smooched in a clumsy
sort of way, but I was still socially awkward. Soon it was time to apply to college: Harvard was
my first choice. I took the SAT and the Miller Analogies Test, getting a perfect score on the
latter. I applied to the Harvard Club of Long Island for support, and was interviewed by the radio
4
commentator H. V. Kaltenborn. He must have liked me: I went to Harvard (the first Sewanhaka
student to do so) with a $400 scholarship. In those days, that was full tuition.
Discovering psychology
College is supposed to be a transforming experience, and it certainly was for me. I
entered Harvard in 1946 with an insecure personal identity, weak social skills, few political
commitments, little understanding of history or literature or culture, and no career goals beyond a
vague allegiance to "science." Four years later I knew just who I was, what I cared about, and
what I was going to do: to become an experimental psychologist and fight the good fight against
behaviorism. Meanwhile I had also acquired a political identity, making many friends in the
Harvard Liberal Union. We picketed racist establishments, sang leftist songs, campaigned for
Democratic candidates, sat through long dreary meetings, debated current issues. I still have a
happy "flashbulb memory" of the 1948 election, in my junior year. Everyone was sure that
Dewey would win; the Harvard Young Republicans had rented a huge expensive hall for their
victory party. We few Truman supporters gathered around a radio in a small common room for a
"moral victory party," and waited for our guy to fall behind. He never did: at midnight, we
marched up to jeer happily at the Republican losers. Glorious!
Being enrolled in stimulating courses on history and government and literature, having
acquired sophisticated friends who read novels and enjoyed classical music, I soon began to
value the cultural life that I had so determinedly avoided in Floral Park. I attended concerts and
rallies, brooded over freshman conundrums like freedom of the will, played cards far into the
night with my roommates. My only problem was the resolve that had brought me to Harvard in
the first place: the commitment to become a scientist. I soon discovered that I hated chemistry
and was bored by physics. What to do?
E.G. Boring's introductory psychology course came to my rescue. I do not know if it
rescued anyone else: Boring was not an exciting lecturer, and his syllabus - reflecting a recent
bitter split between the departments of Psychology and Social Relations - excluded every
socially interesting topic. But whatever he may have excluded, the psychology that remained -
mostly sensation, perception and learning - was a young and vigorous science. One could see
that it would soon be ready to address important human questions, especially with a push or two
in the right direction. I said to myself "I can do this!" and changed my major to Psychology.
Parapsychology
Another stimulus to my growing psychological interests was J.B. Rhine's book The
Reach of the Mind (1947), a survey of research on extra-sensory perception (ESP). The topic was
immediately intriguing, and became more so when I made the acquaintance of S. David Kahn.
Kahn, my classmate, had a sort of personal commitment to the paranormal: his family took
reincarnation seriously and consulted psychics before making major decisions. It was not long
before David and I began to think about doing some ESP research of our own. To make it
official, we called ourselves The Harvard Society for Parapsychology.
At that time, most ESP research was based on shuffled decks of cards. This seemed
problematic because it left open the possibility of errors in recording the scores, perhaps even of
outright cheating. We therefore abandoned cards in favor of the standard IBM multiple-choice
answer sheets (then very familiar) in which the respondent uses a pencil to blacken one of five
spaces in each row. In our experiments one such answer sheet, filled out with the aid of a table of
random numbers, was hidden away to serve as target. The subjects, given blank answer sheets
5
and pencils, were asked to duplicate the target as best they could. Their responses were then
mechanically scored against that target, eliminating the possibility of error or bias. These
experiments produced surprisingly positive results, so we published them in the Journal of
Parapsychology (Kahn & Neisser, 1949).
My interest in ESP did not last long. David Kahn and I later spent a summer doing ESP
research at the American Society for Psychical Research in New York, but all our experiments
there were failures. We couldn't even replicate the experiments we had carried out successfully at
Harvard! This was discouraging, and I did not pursue the paranormal any further. It may be,
however, that this early exposure to an exotic research area had a subtle influence later on. I have
long had - and perhaps still have - a soft spot in my heart for exciting but unlikely hypotheses.
Becoming a psychologist
Meanwhile, I was a busy psychology major. It was probably in the history course that I
was first exposed to conflicting theories, especially behaviorism and Gestalt psychology.
Choosing sides immediately, I rejected the former and was strongly attracted to the latter. My
antipathy to behaviorism stemmed not only from its dreary mechanical view of human nature but
from the sheer fact of its dominance. I was already a committed infracaninophile, and Gestalt
psychology was clearly the underdog in any department that included B.F. Skinner. I was
particularly intrigued by the way that Max Wertheimer and the other Gestalt theorists viewed
human nature "from above" rather than mechanically "from below." Köhler's principle of
psychophysical isomorphism, for example, impressed me as an important new approach to the
mind-body problem.
Other courses brought me up to date. I took a lab course from Fred Frick and a methods
course from J.C.R. Licklider, who insisted that statistics required "vigor, not rigor." Jerry Bruner
and Leo Postman taught a course on perception and motivation, focusing on what was then being
called the "New Look." A new course on language and communication, taught by my adviser
George Miller, introduced me to linguistics and information theory. Miller encouraged me to
take more mathematics, especially advanced algebra; he was sure the psychology of the future
would require it. I took his advice, albeit without enthusiasm. Later I was one of two seniors (the
other was Marvin Minsky) enrolled in a graduate seminar that discussed Hebb's new book The
Organization of Behavior (1949).
For my senior honors thesis I needed a topic far enough out of the mainstream to be
"original" (which was very important to me then), but not so far out as to seem crazy (i.e., no
parapsychology). What I came up with was obscure indeed: the influence of visual stimulation
on the auditory threshold. A Russian psychologist had reported such an influence, but his results
were not widely accepted. In my theoretically naive state, such an intermodal effect seemed
attractively Gestalt-like. Miller helped me generously even though he wasn't especially interested
in the hypothesis. Using standard psychophysical methods for the auditory threshold, I
manipulated visual stimulation by turning the room lights on or off. The results were negative,
but I got honors anyway.
Swarthmore
It was time to go to graduate school, and I knew just where. Wolfgang Köhler, one of the
founders of Gestalt psychology, had fled Germany in the 1930s and was teaching at Swarthmore
College. To attract Köhler, Swarthmore had also created a position for his colleague Hans
Wallach and an M.A. program to provide them both with graduate assistants. The students in the
6
program served as R.A.s and T.A.s, took the same seminars as Swarthmore honors students, and
completed an thesis in their second year. It sounded great: I applied and was accepted for the fall
of 1950.
My two years at Swarthmore were happy and valuable, but not at all what I had expected.
Except for one seminar I had little contact with Köhler, who was then wrapping up his studies of
direct currents in the visual cortex. My real teachers were Hans Wallach and Henry Gleitman,
from whom I learned two very different ways of doing psychology. As Wallach's RA, my first
task was to run subjects in a study that followed up on his recent demonstration of the kinetic
depth effect (Wallach et al, 1953). The ingenuity of that demonstration made a deep impression
on me: since then I have always been partial to clever experiments that address important
questions, even if they don't have much by way of theoretical basis.
In contrast with the solitary conduct of Wallach's perception experiments, learning with
Henry Gleitman was an essentially social experience. My fellow graduate student Jacob (Jack)
Nachmias and I spent many hours with Gleitman, an assistant professor who had just received
his Ph.D. from E. C. Tolman at Berkeley. We talked psychology, graded papers, made jokes,
became friends. Our chief theoretical concern was the life-and-death struggle between the
mechanistic behaviorists - led by Clark Hull and Donald Spence - and the Gestalt-oriented
"expectancy" theorists led by Tolman. We had a great time finding flaws in Hull's theory of
extinction, and eventually submitted a critique of that theory to Psychological Review. Our paper
(Gleitman et al, 1954) was accepted and we were proud of it, though I have never heard that
anyone actually abandoned Hull's theory because of our arguments.
My second year was even more eventful. Gleitman and Nachmias and I shared an
apartment, and I developed a social life with the Swarthmore co-eds. Occasionally one of them
would keep me company while I ran rats in my M.A. experiment, a study designed to refute
Spence's theory of transposition. (The rats were uncooperative and sometimes bit; I've never run
another animal experiment.) Soon I hooked up with Anna Peirce, an attractive freshman with a
family in Maine. It gradually became clear that she and I would stay together, even in the next
year when I would be attending a different graduate school. But where would that be, and with
what emphasis? Behaviorism was out, and Gestalt psychology no longer seemed a viable
alternative. The hot new idea was information theory, which I had already heard about from
George Miller. Miller himself had just moved to a new psychology department being established
at M.I.T., so I decided to go there too.
they accepted me into the graduate program. I was happy to be a Harvard student again, but felt
that I had lost a lot of time in the intervening four years. To make up for lost time I moved
quickly, taking qualifying exams in my first year and completing a dissertation by the end of the
second. My choice of topic was not governed by any theoretical commitment - Gestalt
psychology and information theory had both lost their allure by this time - but by how quickly I
could do the required research. That criterion led me to a rather obscure topic: S. S. Stevens'
"neural quantum" hypothesis of the auditory threshold. I did not have much rapport with Stevens
himself, but his hypothesis made clear predictions and the necessary apparatus was already in
place. I ran subjects, analyzed data, identified certain artifacts in the "quantal method" (cf.
Neisser, 1957) and got my degree.
By that time, oddly enough, I had begun to think that I was leaving Harvard too soon.
Surely it had more to offer than I had learned in two hasty years! So I arranged to stay a third
year after all, supported by a Harvard instructorship (teaching "Sensation and Perception") and
an NIH fellowship. To get the fellowship I proposed a new technique for the measurement of
pain thresholds - still another obscure topic in which I was again not really interested. (The pain
itself, created by focusing a beam of light onto the back of the subject's hand, was not severe.) In
the upshot I did conduct the research but didn't like it much. A complex apparatus had to be built
and calibrated, and I was beginning to realize that I am not good with apparatus. Other people at
Harvard were much better: George Sperling (1960), for example, was doing elegant
tachistoscopic studies of what he then called the "visual image." Later, in Cognitive Psychology,
I would call it "iconic memory."
Pattern recognition
It was time to move on, and an opportunity soon presented itself. Richard Held, with
whom I had been acquainted since my Harvard undergraduate days, was now teaching at
Brandeis and suggested that I apply for a job there. I don't remember my job talk now, but it
must have been OK: I was appointed assistant professor at $4000/year. By this time Anna and I
had four children (Mark, b.1954, Julie, b.1956, Phil, b.1957, Toby, b.1958), so we certainly
needed the money. We lived for a while in Boston and then built a house in Lincoln Mass.; I
commuted to Brandeis (in Waltham) on a motor scooter. We spent most of our summers in
Maine, courtesy of my artist father-in-law Waldo Peirce. It was a strenuous domestic life, and
unfortunately one in which Anna and I were increasingly at odds.
Intellectually, my 7 1/2 years at Brandeis were years of development. The psychology
department itself was best known for the humanistic psychology of its Chairman, A.H. Maslow. I
liked Maslow's idealism, which reminded me of Gestalt psychology. I also resonated to his
insistence that psychology needed a "third force," i.e., a theoretical approach that was neither
behaviorism nor psychoanalysis. (He hoped that the third force would be humanistic/existential
psychology, but it turned out to be cognitive psychology instead.) Harvard was not far away, and
I often attended talks at the recently established "Center for Cognitive Studies" there. All this
was intriguing, but the theorist who influenced me most was neither at Brandeis nor Harvard and
not even a psychologist: Oliver Selfridge of the M.I.T. Lincoln Laboratory. Introduced by a
mutual friend, Oliver and I soon found many interests in common. At his suggestion I soon
began to spend Thursdays at his Lab as a consultant, an arrangement that benefited me
financially as well as intellectually. Oliver had no advanced degree; nowadays he would be
called a "cognitive scientist, but no such category existed then. He was working on machine
pattern recognition, especially of patterns such as hand-written letters or Morse code. He
8
addressed these problems with an ingenious parallel-processing model (now justly famous)
called Pandemonium. The model was all Oliver's, but it was I who suggested that we write it up
for Scientific American (Selfridge & Neisser, 1960).
Although machine pattern recognition was intriguing, human pattern recognition was
even more so. How to study it empirically? Reaction time (RT) suggested itself as a method but
seemed to have a fatal flaw: each RT includes not only the time needed to recognize the stimulus
but also times for planning and executing the required responses. It was to get around that
requirement that I devised a new visual search paradigm (Neisser, 1963a.) A subject scanning
down a column of letters/numbers has to process each one to determine that it is NOT the target,
but makes no selective response until the target itself has been reached. The scan rate (i.e., the
slope of the linear function relating the position of the target to the search time) should reflect the
time needed to make each of those determinations. This paradigm was an early and
unsophisticated version of what would soon become known as "mental chronometry." In later
studies, including several done with graduate students at Brandeis, I used it to explore other
issues. The most surprising result (Neisser et al, 1963) was that well-practiced subjects can
search as rapidly for any of ten targets (e.g., for a, f, h, k, m, p, u, z, 9, or 4) as for one. I took this
initially counter-intuitive result as clear evidence for parallel processing in pattern recognition.
Cognitive Psychology
Sometime in the early '60s, all this began to jell. Perception, the span of attention, visual
search, computer pattern recognition, human pattern recognition, problem solving and
remembering were all interrelated aspects of information processing. Perception and pattern
recognition were input, remembering was output, everything in between was one or another kind
9
of processing. This was already a rather obvious idea (cf. Broadbent, 1958), but no one had put it
forward clearly and effectively. I could write a book!
The sensible time to write that book would be on my upcoming sabbatical, which was
scheduled to begin in the spring of 1965. But where? I was in luck: my friend Martin Orne was
just then moving his grant-supported hypnosis laboratory, the "Unit for Experimental
Psychiatry," from the Boston Psychopathic Hospital to the Institute of the Pennsylvania Hospital
in Philadelphia. He offered to provide me with an office there for as long as I liked, an offer that
I accepted happily. For financial support, I applied for and received a grant from the Carnegie
Corporation.
Meanwhile, my domestic life had unraveled completely.Anna and I were divorced in
early 1964; I moved out of the house in Lincoln and into a two-room apartment in Somerville. I
also began a relationship with Arden Seidler, who had three children of her own. These personal
developments made me eager to leave the greater Boston area: it was time to start a new life.
Arden and I were married - this time a real wedding - on New Year's Eve of 1964. A few weeks
later we moved to Bala Cynwyd, a Philadelphia suburb. Arden's three children lived with us; my
four children lived with Anna, who soon moved to the Upper West Side of Manhattan where I
visited them often.
In the upshot I stayed at the Unit for Experimental Psychiatry for 2 1/2 years; that's how
long it took to write Cognitive Psychology. Martin Orne was helpful and generous in every
possible way, as was Emily Carota Orne, his wife and collaborator who was then completing a
Ph.D. in psychology at Brandeis. My stay at the Unit also gave me an opportunity to learn a bit
about hypnosis, which turned out to be useful at several points in the book. I was also offered an
adjunct position at the University of Pennsylvania, which provided a pleasant opportunity to
teach a seminar in collaboration with my old friend and mentor Henry Gleitman. When the
Carnegie grant ran out, I applied for and received an NIMH Fellowship. In short, the enterprise
that became Cognitive Psychology (1967) was supported in every possible way.
The primary goal of the enterprise was to bring together what was known about a wide
range of phenomena: "The term 'cognition' refers to all the processes by which the sensory input
is transformed, reduced, elaborated, stored recovered, and used" (p.4). After an introduction that
made this goal explicit, ten chapters gave detailed and often technical accounts of the state of the
art: five chapters on visual cognition, four on audition and language, one on memory and
thought. At the theoretical level the argument relied heavily on the notion of "construction":
perception was a constructive process, speech perception depended on analysis-by-synthesis,
remembering was always constructive, etc. The general tone was positive: instead of attacking
behaviorism I simply ignored its assumptions. "Cognitive processes surely exist, so it can hardly
be unscientific to study them" (p.5). This upbeat attitude may have been one reason why the
book became so popular.
Cognitive Psychology legitimized and interconnected a wide range of research
paradigms, bringing them together by giving them a name. Many psychologists found
themselves in a position like that of Moliere's Monsieur Jourdain, who suddenly discovered that
he had been speaking prose all his life! Most of them were pleased by the discovery, and
"cognitive psychology" soon became an indispensable rubric. In the blink of an eye there were
cognitive journals, courses on cognition, training programs in cognitive psychology, cognitive
conferences of every kind. I myself was a star, now introduced everywhere as "the father of
cognitive psychology." It was a heady experience for a young man not yet 40 years old, and its
effect on me was to create something like an illusion of omnipotence. If I had changed
10
psychology once, perhaps I could do it again! And if I could, perhaps I should! Ever since the
sudden success of Cognitive Psychology, I have been haunted by something like a sense of
personal responsibility for the future direction of the field.
As one might expect from a lover of the underdog, I soon developed misgivings about the
book that had made me top dog so quickly. In any case, one theoretical problem with Cognitive
Psychology soon became obvious. All the phenomena discussed there are indeed examples of
information processing, but that doesn't mean that they are all the same. In particular, it doesn't
mean that they are all "constructive." The construction metaphor works very well for
remembering and moderately well for identifying briefly-flashed words, but it doesn't work at all
for ordinary perception of the immediate environment. Because I had not thought this through
clearly, the opening pages of Cognitive Psychology included some very questionable rhetoric.
"These patterns of light at the retina are the so-called 'proximal stimuli' ... One-sided in their
perspective, shifting radically several times each second, unique and novel at every moment, the
proximal stimuli bear little resemblance to either the real object that gave rise to them or to the
object of experience that the perceiver will construct as a result" (p.3). As I was shortly to learn
from J.J. Gibson, this is not a good way to describe the real information on which perception is
based. Given that real information, nothing has to be constructed. Simply put, perception is not
the same as hallucination.
In late 1966, when a few pre-publication copies of Cognitive Psychology were already
circulating, I got a call from Harry Levin In Ithaca. Would I consider joining the Cornell
Psychology department as full professor? Yes, indeed I would! At my job talk in Ithaca I liked
the whole scene, though I was puzzled by some of Gibson's questions. (Why, he asked, did I
think that information had to be processed?). The salary offer was a princely $25,000, which I
accepted happily. In 1967 Arden and I moved to Ithaca and bought a big house within walking
distance of the University. Eric and the girls enrolled in the Ithaca schools, and our son Joseph
was born in September.
J.J. Gibson
What next? I was 38 years old and moderately famous. All I had to do from then on, it
would seem, was to keep up with the literature and do occasional experiments. For several
reasons, that was not what happened. For one thing, my ambivalence about computers and
models became ever stronger. I did not like the cognitive psychology that was now taking shape:
there was too much mental chronometry in it, too many conflicting models, too little about
human nature. To be sure I had included one or two of those very models in my book, but there
they had been offset (I thought) by the more humanistic notion of "constructive processes." That
notion no longer seemed to work.
Meanwhile, I was beginning to understand what the Gibsons (J.J. and Eleanor) were up
to. My teaching responsibilities included a course in perception, and two of J.J.'s students - Jim
Farber and John Kennedy - were my first T.A.s. Their reactions to my (very conventional)
approach made it obvious that they knew something I didn't know, but what? It helped when I
began to read Gibson's The Senses Considered as Perceptual Systems (1966), a remarkable book
that had come out not long before. What helped even more was to visit the lab the Gibsons had
established in an old warehouse near the airport, and see the ingenious experiments that were in
progress. Conversations with J.J. helped most of all; there were many occasions for these, both
professional and social. Arden and I often played bridge with the Gibsons, who were delightful
company.
11
J.J. Gibson was simply not interested in the kind of experiments that dominated the pages
of Cognitive Psychology - brief presentations of letter strings, for example. He insisted on using
methods that were ecologically valid, so the perceptual systems could operate as they normally
do. Having said similar things about memory myself from time to time, I found this point of
view congenial. It took much longer to understand what he meant by saying that the visual
system "picks up" information that is already "in the light" and need not be processed at all. Well
yes, of course it was in the light: where else would it be? Slowly, I began to see that Gibson was
right on this point too. But where did that leave me? Was there some way we could both be
right? Could information be picked up and processed?
Other aspects of the Gibsonian approach - the commitment to realism, the conception of
perceivers as active seekers for information - were also attractive. I liked them much better than
the mechanical chronometric models that had been inspired by Cognitive Psychology. What's
more, the sixties were in the air. Some of the action was local: African-American students at
Cornell made national news by arming themselves and actually taking over a University
building. Like other faculty, I felt closely involved in what was clearly a crisis for the University.
(The issues at Cornell were eventually compromised; no one was punished. I welcomed this
outcome, though others viewed it with alarm.) Indeed, the whole country was in the throes of
change. Somehow, quite irrationally, this radical atmosphere seemed to increase my interest in
developing a new and more ecologically committed psychology.
Cognition and Reality had several aims. One - perhaps prompted by my continued
sympathy for underdogs - was simply to make Gibson's views better known. I thought people
might take Cognition and Reality seriously because of the reputation I had gained with Cognitive
Psychology, and that this would help the ecological enterprise. That aim may have been
achieved. More ambitiously I was trying to change the direction of cognitive psychology itself,
to reconcile "information pickup" and "information processing" in a new theory of perception.
The central concept was the "perceptual cycle." Information is objectively available in the optic
array, but picking it up requires the activity of appropriate neural structures called "schemata."
The act of picking up information changes the schema, enabling it to pick up new information
that in turn will change it further. This cyclic activity appears in every perceptual system,
becoming more efficient with practice and expertise. To pay attention to something, for example,
is simply to engage with the relevant information in an appropriate perceptual cycle. But
although this way of talking still sounds plausible to me, it has had very little impact on the field.
Selective looking
My student Bob Becklen and I (Neisser & Becklen, 1975) illustrated this definition of
attention with a phenomenon I dubbed "selective looking." When the images of two ongoing
events are shown superimposed on the same screen, viewers who follow one event soon become
oblivious of the other. In our study, subjects visually followed the ball-throwing of one group of
players while ignoring a superimposed similar group. As they were doing this, a woman walked
slowly across the scene carrying an open umbrella. One would think everyone would see such a
strange intruder, but in fact very few people did (Neisser, 1979). This effect, now called
"inattentional blindness," has been demonstrated repeatedly in recent years (Most et al, 2005). In
a related study, Lorraine Bahrick, Arlene Walker and I (1981) were able to show that even very
young infants are capable of selective looking. It is a universal aspect of attention.
Another set of experiments explored the possibility of engaging in two perceptual cycles
at once, i.e., of what is now called "multi-tasking." Bill Hirst and Liz Spelke (Spelke, Hirst &
Neisser, 1976) modified a divided attention paradigm originally devised by Gertrude Stein
(Solomons & Stein, 1896), in which subjects had to copy words at dictation while also reading
stories. Their subjects practiced this every day for weeks: reading more slowly at first, they
finally did reach a point where copying dictated words did not interfere with reading at all.
Further studies have shown that this achievement is not (at least not always) based on rapid
switching, and also that the secondary copying task does not necessarily become "automatic" (cf.
Hirst et al, 1980).
conference, The School Achievement of Minority Children (1986). Over the years a number of
Black professionals have told me that it was important for them, but I've never met a White
person who claims to have read it.
Where memory was concerned, I was again fortunate. One day out of a clear blue sky I
received a flyer announcing an upcoming conference on "Practical Aspects of Memory," to be
held in Cardiff, Wales. Eager to go, Doug Herrmann and I (1978) submitted a modest empirical
paper. (Doug was then teaching at Hamilton College and often attended my graduate seminar.)
At that time I still enjoyed some name recognition; when the conference organizers saw that
Ulric Neisser had submitted a paper, they asked me to give the keynote address as well. Seizing
the opportunity to establish a genuinely ecological approach to the study of memory, I presented
a talk called "Memory: What are the important questions?" (1978). The bottom line was the
claim (quite true at the time) that "...If X is an interesting or socially important aspect of
memory, then psychologists have hardly ever studied X." The conferees loved it.
Memory Observed
My next step was to prepare a volume of readings and commentary that would show how
interesting the ecological study of memory could be. This was Memory Observed (1982), which I
wrote - "assembled" might be a better word - during a 1980-8 1 sabbatical at the University of
Pennsylvania. I enjoyed the whole process: picking out the selections, writing brief connecting
commentaries, putting it all together. In many ways, my goals for Memory Observed were
similar to those that had generated Cognitive Psychology fifteen years earlier. Once again I was
trying to change the direction of psychology, albeit on a smaller scale. This time, however, I had
no subsequent regrets. The ecological study of memory has developed much as I hoped that it
14
would, and indeed continues to do so. To be sure it has not been universally popular: a 1989
paper by Banaji and Crowder even argued that the study of "everyday memory" was "bankrupt."
I was delighted to see their critique. If someone takes the trouble to attack an enterprise in print,
it must be important!
occasions, with which later memories could later be compared. I quickly prepared an appropriate
questionnaire, and later that morning distributed it to a large freshman class. Nearly three years
later, when the erstwhile freshmen had become seniors, we asked those who were still at Emory
to recall how they had heard about the Challenger disaster three years before. The results were
astonishing. While a few subjects did remember the event fairly well, a substantial number
reported highly confident memories that were nevertheless completely wrong. One, for example,
recalled that "...a girl ran screaming through the dorm shouting 'the space shuttle blew up.'" The
memory was vivid, but her original account showed that she had actually heard about the disaster
from friends at lunch.
My student Nicole Harsch and I reported this and related findings (Neisser & Harsch,
1992) in the fourth Emory Symposium (Affect and Accuracy in Recall, co-edited with Gene
Winograd), which also included reports of other Challenger-based studies. Our study was
essentially the first to use this paradigm, i.e., getting an early account of the actual reception
event ("How did you first hear the news of ...") and then testing for recall after a substantial
delay. It was, however, by no means the last: every public disaster now seems to be an occasion
to conduct a memory experiment. Generally speaking, most such studies of the recall of
reception events have confirmed our findings
Not long after Challenger, the 1989 California earthquake offered an opportunity to
conduct a study that would contrast recall of reception events with recalls of direct experience.
On the morning after the quake, I suggested to Steve Palmer at the University of California in
Berkeley that he ask as many students as possible to record their actual earthquake experiences.
A few days later, Gene Winograd contacted Mary Sue Weldon at Santa Cruz with a similar
suggestion. In a third group in Atlanta, Gene and I gave Emory students the usual questionnaires
about how they had heard the news. A year and a half later, subjects in all three groups were
asked for recall. The contrast was sharp (Neisser et al, 1996). The subjects in both California
groups recalled their (direct) experiences almost perfectly, while the Emory group produced the
weak or incorrect memories typical of the (reception event) paradigm. Direct experience makes a
big difference!
About this time, I had one last fling with the ecological approach to perception. Several
neuroscientists had recently argued that there are two distinct visual systems in the primate
cortex. The dorsal "where" system controls space perception and movement, while the ventral
"what" system is specialized for identification and categorization. It occurred to me that the
"where" system is rather Gibsonian: it picks up information, tunes to the invariants specifying
the layout of the environment, controls movement. The ventral "what" system, in contrast, is
essentially an associative network. Thus Gibson and his critics were both right, but about
different systems! I gave a number of talks based on this insight (including an invited address at
the 1989 Cognitive Science meeting), but never felt secure enough in my mastery of
neuroscience to actually publish it. Given the rapid further development of neuroscience since
then, this may have been a wise decision.
Self-knowledge
In 1987-88 I had another sabbatical and we spent it in England, the first half in London
and the second in Oxford. A Guggenheim award helped to cover expenses. This time there was
no new book to work on, but I did have two enterprises in mind. One was the "what/where"
hypothesis described above. The other - much more ambitious - was a new theory of self-
knowledge, based in part on J.J. Gibson's insight that all perception involves self-
16
perception.There is always information in the light to specify how we are moving and what we
are doing - i.e., to specify what I was beginning to call the "ecological self." Recent work on
perception in infancy, much of it from Eleanor Gibson's baby lab, had suggested that even very
young infants are self-aware in this sense. On the other hand I had often read claims by social
psychologists and anthropologists that the self is nothing but a social construction, varying
greatly from one society to the next. How could these disparate views of the self be reconciled?
To solve this puzzle I addressed it in the language of cognitive psychology, i.e., by
thinking in terms of information. On reflection, this approach suggested that the self is specified
by no less than five different types of information and hence that there are five different kinds of
self-knowledge. Another way of putting it is to say that people have five different "selves" - the
ecological self, the interpersonal self, the conceptual self, the remembered self, and the private
self. Having drafted a theoretical paper to this effect, I began to wonder where I could publish it.
That problem was resolved when I happened to meet John Rust in London: he was just then
starting a new journal called Philosophical Psychology, which sounded fine to me (Neisser,
1998).
One day at Oxford I got an unexpected phone call from Billy Frye, the Emory Provost.
The University had received a substantial grant from the Mellon Foundation; could I help them
find a way to spend the money? All I could think of was an expanded version of what the
Cognition Project was doing already, focused more directly on the five kinds of self-knowledge.
This was not a very imaginative idea, but it seemed practical. I recruited an excellent post-doc -
David Jopling, whose degree was in philosophy - and together we conducted five stimulating
conferences on self-knowledge. Eventually, these became three volumes in the Emory
Symposium series. I edited The Perceived Self (1993) myself, co-edited The Remembering Self
(1994) with Robyn Fivush, and finally co-edited The Conceptual Self in Context (1997) with
Jopling. I had high hopes that all this would have some impact on other people's theorizing about
the self, but have seen little evidence of it.
Cognitive Studies was already in business.) I was certainly not a major contributor to ecological
psychology, just a propagandist in its cause. And while I am indeed proud of my role in
encouraging the study of memory in natural contexts, I must admit that it would probably have
happened somehow even without me.
The main thing about developments such as these is not what part I played in them, but
that psychology has moved ahead because of them. It has become a very different science now
than it was in Boring's day, or for that matter in mine: far less dependent on charismatic
individuals and quarrelsome schools, much more closely connected to brain science, generally
doing more research and less talking. All in all I admire the new psychology greatly, but my
reaction is no longer "I can do this." It's more like "Goodbye and good luck!"
Selected Publications of Ulric Neisser
Books
Neisser, U. (1967). Cognitive psychology. New York: Appleton-Century-Crofts. (Also translated into German,
Italian, Spanish, and Japanese.)
Neisser, U. (1976). Cognition and reality: Principles and implications of cognitive psychology. San Francisco:
W.H. Freeman. (Also translated into German, Italian, Spanish, Hungarian, Russian and Japanese.)
Neisser, U. (Ed.) (1982). Memory observed: Remembering in natural contexts. New York: W.H. Freeman. (Also
translated into Japanese.)
Neisser, U. (Ed.) (1986). The school achievement of minority children: New perspectives. Hillsdale, N.J. :
Erlbaum.
Neisser, U. (Ed.) (1987). Concepts and conceptual development: Ecological and intellectual factors in
categorization. New York: Cambridge University Press. (Also translated into Italian.)
Neisser, U. (Ed.) (1993). The perceived self: Ecological and interpersonal sources of self knowledge. New York:
Cambridge University Press.
Neisser, U. (Ed.) (1998). The rising curve: Long-term gains in IQ and related measures. Washington, D.C.:
American Psychological Association.
Neisser, U. & Fivush, R. (Eds.) (1994). The remembering self: Construction and accuracy in the self-narrative.
New York: Cambridge University Press, 1994.
Neisser, U. & Hyman, I.E. Jr. (Eds.) (2000). Memory observed: Remembering in natural contexts (2nd Ed.). New
York: Worth Publishers.
Neisser, U. & Jopling, D. (Eds.) (1997). The conceptual self in context: Culture, experience, self-understanding.
New York:: Cambridge University Press.
Neisser, U. & Winograd, E. (Eds.) (1988). Remembering reconsidered: Ecological and traditional approaches to
the study of memory. New York: Cambridge University Press.
Winograd, E. & Neisser, U. (Eds.) (1992). Affect and accuracy in recall: Studies of "flashbulb" memories.New
York: Cambridge University Press.
Bahrick, L. E., Walker, A. S., & Neisser, U. (1981). Selective looking by infants. Cognitive Psychology, 13, 377-
390.
19
Gleitman, H., Nachmias, J., & Neisser, U. (1954). The S-R reinforcement theory of extinction. Psychological
Review, 61, 23-33.
Hirst, W., Spelke, E. S., Reaves, C.C., Caharack, G., & Neisser, U. (1980). Dividing attention without alternation
or automaticity.Journal of Experimntal Psychology: General, 109, 98-117.
Kahn, S.D. & Neisser, U. (1949). A mechanical scoring technique for GESP. Journal of Parapsychology, 3, 177-
185.
Neisser, U. (1954). An experimental distinction between perceptual process and verbal response. Journal of
Experimental Psychology, 47, 399-402.
Neisser, U. (1957). Response sequences and the neural quantum. American Journal of Psychology, 70, 512-527.
Neisser, U. (1962). Cultural and cognitive discontinuity. In T. E. Gladwin & W. Sturtevant (Eds.) Anthropology
and human behavior. Washington, D.C.: Anthropological Society of Washington.
Neisser, U. (1963a). Decision-time without reaction time: Experiments in visual scanning. American Journal of
Psychology, 76, 376-385.
Neisser, U. (1963b). The multiplicity of thought. British Journal of Psychology, 54, 1-14.
Neisser, U. (1976). General, academic and artificial intelligence. In L. Resnick (Ed.) The nature of intelligence.
Hillsdale, N.J.: Lawrence Erlbaum Associates.
Neisser, U. (1978). Memory: What are the important questions? In M. M. Gruneberg, P. M. Morris, & R. N.
Sykes ( Eds.) Practical applications of memory. London: Academic Press.
Neisser, U. (1979). The control of information pickup in selective looking. In A.D. Pick (Ed.), perception and its
development: A tribute to Eleanor J. Gibson. Hillsdale, N. J. Lawrence Erlbaum Associates.
Neisser, U. (1982). Snapshots or benchmarks? In U. Neisser (Ed.) Memory observed. New York: W.H. Freeman.
Neisser, U. (1986). Remembering Pearl Harbor: Reply to Thompson and Cowan. Cognition, 23, 285-286.
Neisser, U. (1987). Cognitive recollections. In W. Hirst (Ed.) Giving birth to cognitive science: A festschrift for
George A. Miller. New York: Cambridge University Press.
Neisser, U. (1989). Direct perception and recognition as distinct perceptual systems. Paper given at the Cognitive
Science Society, Ann Arbor MI.
Neisser, U. (2002). Adventures in cognition: From Cognitive Psychology to The Rising Curve. In R.J. Sternberg
(Ed.) Psychologists defying the crowd: Stories of those who battled the establishment and won. Washington
D.C.: American Psychological Association.
20
Neisser, U. & Becklen, R. (1975). Selective looking: Attending to visually specified events. Cognitive
Psychology, 7, 480-494.
Neisser, U., Boodoo, G., Bouchard, T.J., Boykin, A.W., Brady, N., Ceci, S.J., Halpern, D.F., Loehlin, J.C.,
Perloff, R., Sternberg, R.J., & Urbina, S. (1996). Intelligence: Knowns and unknowns (Report of an APA
task force). American Psychologist, 51, 77-101.
Neisser, U. & Harsch, N. (1992). Phantom flashbulbs: False recollections of hearing the news about Challenger.
In E. Winograd and U. Neisser (Eds.) Affect and accuracy in recall. New York: Cambridge University Press.
Neisser, U. Novick, R., & Lazar, R. (1963). Searching for ten targets simultaneously. Perceptual Motor Skills,
17, 955-961.
Neisser, U., Winograd, E., Bergman, E.T., Schreiber, C.A., Palmer, S.E., & Weldon, M.S., (1996). Remembering
the earthquake: Direct experience vs. hearing the news. Memory, 4, 337-357.
Selfridge, O.G., & Neisser, U. (Aug 1960). Pattern recognition by machine. Scientific American, 203, 60-68.
Spelke, E., Hirst, W., & Neisser, U. (1976). Skills of divided attention. Cognition, 4,215-230.
Usher, J.A. & Neisser, U. (1993). Childhood amnesia and the beginnings of memory for four early life
events.Journal of Experimental Psychology: General, 122, 155-165.
Wallach, H., O'Connell, D.N., & Neisser, U. (1953). The memory effect of visual perception of three-
dimensional form. Journal of Experimental Psychology, 45, 360-368.
Banaji, M.R, & Crowder, R.G. (1989). The bankruptcy of everyday memory. American Psychologist, 44, 1185-
1193.
Broadbent, D.E. (1958). Perception and communication. New York: Pergamon Press.
Fivush, R. (Ed.) (1990). Knowing and remembering in young children. New York: Cambridge University Press.
Gibson, J.J. (1966). The Senses considered as perceptual systems. Boston: Houghton Mifflin.
Herrrnstein, R.J. & Murray, C. (1994). The bell curve: Intelligence and class structure in American life. New
York: Free Press.
Most, S.B., Scholl, B.J., Clifford, E.R. & Simons, D.J. (2005). What you see is what you set: Sustained
inattentional blindness and the capture of awareness. Psychological Review, 112, 217-242.
Rhine, J.B. (1947). The reach of the mind. New York: W. Sloane Associates.
Solomons, L.M. & Stein, G. (1896). Normal motor automatism. Psychological Review, 3, 492-512.
Sperling, G. (1960). The information available in brief visual presentations. Psychological Monographs, 74, No.
11.
Thompson, C.P., & Cowan, T. (1985). A nicer interpretation of a Neisser recollection. Cognition, 22, 199-202.