Brain Mechanism of Vision
Brain Mechanism of Vision
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide
range of content in a trusted digital archive. We use information technology and tools to increase productivity and
facilitate new forms of scholarship. For more information about JSTOR, please contact [email protected].
Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
https://about.jstor.org/terms
Scientific American, a division of Nature America, Inc. is collaborating with JSTOR to digitize,
preserve and extend access to Scientific American
V
iewed as a kind of invention by of the location (at the surface of the
evolution, the cerebral cortex ican one of us gave the area as 20 square brain) of the electrical brain waves pro
must be one of the great success feet and was quickly corrected by a neu duced when an animal was stimulated
stories in the history of living things. In roanatomist friend in Toronto, who said by touching the body, sounding clicks
vertebrates lower than mammals the ce he thought it was 1.5 square feet-"at or tones in the ear or flashing light in
rebral cortex is minuscule, if it can be least that is what Canadians have.") The the eye. Similarly, motor areas could
said to exist at all. Suddenly impressive folding is presumably mainly the result be mapped by stimulating the cortex
in the lowest mammals, it begins to of such an unlikely structure's having to electrically and noting what part of the
dominate the brain in carnivores, and it be packed into a box the size of the skull. animal's body moved.
increases explosively in primates; in A casual glance at cortical tissue un
man it almost completely envelops the
rest of the brain, tending to obscure the
der a microscope shows vast numbers of
neurons: about 105 (100,000) for each T soon
his systematic mapping of the cortex
led to a fundamental realiza
other parts. The degree to which an an square millimeter of surface, suggesting tion: most of the sensory and motor
imal depends on an organ is an index that the cortex as a whole has some 10lD areas contained systematic two-dimen
of the organ's importance that is even ( 10 billion) neurons. The cell bodies are sional maps of the world they represent
more convincing than size, and depen arranged in half a dozen layers that are ed. Destroying a particular small region
dence on the cortex has increased rapid alternately cell-sparse and cell-rich. In of cortex could lead to paralysis of one
ly as mammals have evolved. A mouse contrast to these marked changes in cell arm; a similar lesion in another small
without a cortex appears fairly nor density in successive layers at different region led to numbness of one hand or
mal, at least to casual inspection; a man depths in the cortex there is marked uni of the upper lip, or blindness in one
without a cortex is almost a vegetable, formity from place to place in the plane small part of the visual world; if elec
speechless, sightless, senseless. of any given layer and in any direction trodes were placed on an animal's cor
Understanding of this large and indis within that plane. The cortex is morpho tex, touching one limb produced a cor
pensable organ is still woefully defi logically rather uniform in two of its respondingly localized series of electric
cient. This is partly because it is very dimensions. potentials. Clearly the body was system
complex, not only structurally but also One of the first great insights about atically mapped onto the somatic senso
in its functions, and partly because neu cortical organization came late in the ry and motor areas; the visual world
robiologists' intuitions about the func 19th century, when it was gradually re was mapped onto the primary visual
tions have so often been wrong. The out alized that this rather uniform plate of cortex, an area on the occipital lobe that
look is changing, however, as techniques tissue' is subdivided into a number of in man and in the macaque monkey (the
improve and as investigators learn how different regions that have very differ animal in which our investigations have
to deal with the huge numbers of intri ent functions. The evidence came from mainly been cond ucted) covers about 15
cately connected neurons that are the clinical, physiological and anatomical square centimeters.
basic elements of the cortex, with the sources. It was noted that a brain injury, In the primary visual cortex the map
impulses they carry and with the syn depending on its location, could cause is uncomplicated by breaks and discon
apses that connect them. In this article paralysis or blindness or numbness or tinuities except for the remarkable split
we hope to sketch the present state of speech loss; the blindness could be total of the visual world down the exact mid
knowledge of one subdivision of the or limited to half or less of the visual dle, with the left half projected to the
cortex: the primary visual cortex (also world, and the numbness could involve right cerebral cortex and the right half
known as the striate cortex or area 17), one limb or a few fingers. The consisten projected to the left cortex. The map of
the most elementary of the cortical re cy of the relation between a given defect the body is more complicated and is still
gions concerned with vision. That will and the location of the lesion gradually perhaps not completely understood. It is
necessarily lead us into the related sub led to a charting of the most obvious nonetheless systematic, and it is similar
ject of visual perception, since the work of these specialized regions, the visual, ly crossed, with the right side of the
ings of an organ cannot easily be sepa auditory, somatic sensory (body sensa body projecting to the left hemisphere
rated from its biological purpose. tion), speech and motor regions. and the left side projecting to the right
In many cases a close look with a mi hemisphere. (It is worth remarking that
T he cerebral cortex, a highly folded croscope at cortex stained for cell bod no one has the remotest idea why there
plate of neural tissue about two mil ies showed that in spite of the relative should be this amazing tendency for ner
limeters thick, is an outermost crust uniformity there were structural varia vous-system pathways to cross.)
wrapped over the top of, and to some tions, particularly in the layering pat An important feature of cortical maps
extent tucked under, the cerebral hemi tern, that correlated well with the clin is their distortion. The scale of the maps
spheres. In man its total area, if it were ically defined subdivisions. Additional varies as it does in a Mercator projec
spread out, would be about 1.5 square confirmation came from observations tion, the rule for the cortex. being that
150
DOMINANCE PATTERN is seen face on in an axonal-transport the label therefore accumulates. This section was cut in a plane tan
autoradiograph of a brain section parallel, rather than perpendicu gential to the dome-shaped surface of the cortex and just below lay
lar, to the surface of the primary visual cortex. As can be seen in the er IV, which therefore appears as a ring of roughly parallel bright
autoradiograph at the top of the page, the label is brightest in one bands. These are the radioactively labeled ocular-dominance regions,
layer of the folded cortex, layer IV. This is tbe level at which the ax which are now seen from above instead of edge on. The actual width
ons bringing visual information to the cortex terminate and where of the ocular-dominance regions is typically about .4 millimeter.
151
the regions of highest discrimination or have been revising their estimates up The implications of this are far-reach
delicacy of function occupy relatively ward. The important basic notion is that ing. Whatever any given region of the
more cortical area. For the body sur information on any given modality such cortex does, it does locally. At stages
face, a millimeter of surface on the fin as sight or sound is transmitted first to a where there is any kind of detailed, sys
gers, the lips or the tongue projects to primary cortical area and from there, tematic topographical mapping the anal
more cortex than a millimeter of trunk, either directly or via the thalamus, to ysis must be piecemeal. For example,
buttocks or back; in vision the central successions of higher areas. A modern in the somatic sensory cortex the mes
part of the retina has a representation guess as to the number of cortical areas sages concerning one finger can be com
some 35 times more detailed than the might be between 50 and 100. bined and compared with an input from
far peripheral part. elsewhere on that same finger or with
Important as the advances in mapping
cortical projections were, they tended T he second major insight into cortical input from a neighboring finger, but
organization came from the work of they can hardly be combined with the
for some time to divert thought from the the anatomist Santiago Ramon y Cajal - influence from the trunk or from a foot.
real problem of just how the brain ana and his pupil Rafael Lorente de No. n\.e same applies to the visual world.
lyzes information. It was as though the This was the realization that the op Given the detailed order of the input to
representation could be an end in itself erations the cortex performs on the' in the primary visual cortex, there is no
instead of serving a more subtle pur formation it receives are local. What likelihood that the region will do any
pose-as though what the cortex did was that means can best be understood by thing to correlate information coming
to cater to some little green man who sat considering the wiring diagram that in from both far above and far below
inside the head and surveyed images emerged from the Golgi method used by the horizon, or from both the left and
playing across the cortex. In the course Cajal and Lorente de No. In essence the the right part of the visual scene. It fol
of this article we shall show that, for wiring is simple. Sets of fibers bring in lows that this cannot by any stretch of
vision at least, the world is represented formation to the cortex; by the time sev the imagination be the place where ac
in a far more distorted way; any little eral synapses have been traversed the tual perception is enshrined. Whatever
green man trying to glean information influence of the input has spread verti these cortical areas are doing, it must be
from the cortical projection would be cally to all cell layers; finally several some kind of local analysis of the senso
puzzled indeed. other sets of fibers carry modified mes ry world. One can only assume that as
The first major insight into cortical sages out of the area. The detailed con the information on vision or touch or
organization was nonetheless the recog nections between inputs and outputs dif sound is relayed from one cortical area
nition of this subdivision into areas hav fer from one area to the next, but with to the next the map becomes progres
ing widely different functions, with a in a given area they seem to be rather sively more blurred and the information
tendency to ordered mapping. Just how stereotyped. What is common to all re carried more abstract.
many such areas there are has been a gions is the local nature of the wiring. Even though the Golgi-method stud
subject of wide speculation. Anatomists' The information carried into the cortex ies of the early 1900's made it clear that
estimates have on the whole been rather by a single fiber can in principle make the cortex must'perform local analyses,
high-up to several hundred areas, de itself felt through the entire thickness in it was half a century before physiolo
pending on the individual worker's sen about three or four synapses, whereas gists had the least inkling of just what
sitivity to fine differences in microscopic the lateral spread, produced by branch the analysis was in any area of the cor
patterns and sometimes also on his abili ing trees of axons and dendrites, is lim tex. The first understanding came in the
ty to fool himself. Physiologists began ited for all practical purposes to a few primary visual area, which is now the
with lower estimates, but lately, with millimeters, a small proportion of the best-understood of any cortical region
more powerful mapping methods, they vast extent of the cortex. and is still the only one where the analy-
152
153
154
LA TERAL GENICULATE NUCLEUS of a normal monkey (left) any radius (black iiI/e) receive signals from the same part of the visu
is a layered structure in which cells in layers 1,4 and 6 (numbered from al scene. The layered nature of the input is demonstrated in the two
bottom to top) receive their input from the eye on the opposite side geniculates of an animal that had vision in the left eye only (two micro
and those in layers 2, 3 and 5 receive information from the eye on graphs at right): in each geniculate cells in the three layers with input
the same side. The maps are in register, so that the neurons along from right eye have atrophied. Geniculates are enlarged 10 diameters.
Complex cells behave as though they ysis of visual forms. It is worth asking tivated will be those whose optimal ori
received their input from a number of which cells at this early stage would be entation happens to coincide with the
simple cells, all with the same receptive expected to be turned on by some very prevailing direction of the border. And
field orientation but differing slightly simple visual form, say a dark blob on among these the simple cells will be
in the exact location of their fields. a light background. Any cell whose re much more exacting than the complex
This scheme readily explains the strong ceptive field is entirely inside or outside ones, responding optimally only when
steady firing evoked in a complex cell as the boundaries of such an image will the border falls along a line separating
a line is kept in the optimal orientation be completely unaffected by the figure's an excitatory and an inhibitory region. It
and is swept across the receptive field. presence because cortical cells effective is important to realize that this part of
With the line optimally oriented many ly ignore diffuse changes in the illumina the cortex is operating only locally, on
cells prefer one direction of movement tion of their entire receptive fields. bits of the form; how the entire form is
to the opposite direction. Several possi The only cells to be affected will be analyzed or handled by the brain-how
ble circuits have been proposed to ex those whose field is cut by the borders. this information is worked on and syn
plain this behavior, but the exact mecha For the circularly symmetrical cells the thesized at later stages, if indeed it is-is
nism is still not known. ones most strongly influenced will be still not known.
Although there is no direct evidence those whose center is grazed by a bound
that orientation-sensitive cells have any
thing to do with visual perception, it is
ary (because for them the excitatory and
inhibitory subdivisions are most un T he second major function of the
monkey visual cortex is to combine
certainly tempting to think they repre equally illuminated). For the orienta the inputs from the two eyes. In the lat
sent some early stage in the brain's anal- tion-specific cells the only ones to be ac- eral geniculate nuclei a neuron may re-
a b
/
I
\
"
"
,
I
RECEPTIVE FIELDS of various cells in the visual pathway are creasingly complex response properties. The cortical cells that receive
compared. Retinal ganglion cells and neurons in the lateral genicu signals directly from the geniculate have circularly symmetrical fields.
late nucleus have circular fields with either an excitatory center and Cortical cells farther along the pathway, however, respond only to a
an inhibito ry surround (a) or the opposite arrangement. A spot of light line stimulus in a particular orientation. A "simple" cell (b) responds
falling on the center stimulates a response from such a cell; so does a to such a line stimulus only in a particular part of its field. A "com
bar of light falling on the field in any orientation, provided it falls on plex" cell (c) responds to a precisely oriented line regardless of where
the center. In the v isual cortex there is a hierarchy of neurons with in- it is in its field and also to one moving in a particular direction(arrow).
155
156
14 � -60 �. z
•
� -90 LAYER IV
5
-120 o
-150
-180� .5 o
__ � ____
1 1.5
-L__��__��__�
2 2.5
,
ORIENTATION PREFERENCES of 23 neurons encountered as a witb tbe observation tbat a microelectrode penetrating tbe cortex per
microelectrode penetrated tbe cortex obliquely are cbarted (left); tbe pendicularly encounters only cells tbat prefer tbe same orientation
most effective tilt of tbe stimulus cbanged steadily in a counterclock (apart from tbe circularly symmetrical cells in layer IV, wbicb bave
wise direction. Tbe results of a similar experiment are plotted (center); no preferred orientation), suggested tbat tbe cortex is subdivided into
in tbis case, bowever, tbere were several reversals in direction of ro rougbly parallel slabs of tissue, witb eacb slab, called an orientation
tation. Tbe results of a large number of sucb experiments, togetber column, containing neurons witb like orientation specificity (right).
ORIENTATION COLUMNS are visualized as anatomical struc jection tbe animal was stimulated witb a pattern of vertical stripes, so
tures in a deoxyglucose autoradiograpb made by tbe autbors and tbat cells responding to vertical lines were most active and became
Micbael P. Stryker. Radioactively labeled deoxyglucose was injected most radioactive. In tbis section perpendicular to surface active-cell
into a monkey; it was taken up primarily by active neurons, and an regions are narrow bands about .5 millimeter apart. Layer IV (witb
early metabolite accumulated in tbe cells. Immediately after tbe in- no orientation preference) is, as expected, uniformly radioactive.
ORIENTATION PATTERN, seen face on, is unexpectedly com sent continuously labeled layer IV. In tbe otber layers tbe orientation
plex. Tbis deoxyglucose autoradiograpb is of a section tangential to regions are intricately curved bands, sometbing like tbe walls of a
tbe somewbat curved layers of tbe cortex. Tbe darker regions repre- maze seen from above, but distance from one band to next is uniform.
157
� L, R,
inserted in a direction perpendicular to
the surface,' all the cells along the path
f'.. of penetration have identical or almost
� identical orientations (except for the
�
R,
cells deep in layer IV, which have no
optimal orientation at all). In two per
L,
� I'-....
R,
R, pendicular penetrations a millimeter or
so apart, however, the two orientations
observed are usually different. The cor
LAYER IV L � L R
tex must therefore be subdivided by
�'"
some kind of vertical partitioning into
L, R,
regions of constant receptive-field ori
entation. When we came on this sys
I'-..... tem almost 20 years ago, it intrigued us
\ , II � because it fitted so well with the hier
archical schemes we had proposed to
GROUPING OF CELLS according to ocular dominance was revealed by pbysiological explain how complex cells are supplied
studies. In one typical vertical penetration of tbe cortex (1) a microelectrode encounters only
by inputs from simple cells: the circuit
cells tbat respond preferentially to tbe left eye (Lr) and, in layer IV, cells tbat respond only to tbe
diagrams involve connections between
left eye (L); in anotber vertical penetration (2) tbe cells all bave rigbt-eye dominance (R /) or, in
layer IV, are driven exclusively by tbe rigbt eye (R). In an oblique penetration (3) tbere is a
cells whose fields cover the same part
regular alternation of dominance by one eye or tbe otber eye. Repeated penetrations suggest of the visual world and that respond to
tbat tbe cortex is subdivided into regions witb a cross-sectional widtb of about .4 millimeter and the same line orientation. It seemed em
witb walls perpendicular to tbe cortical surface and layers: tbe ocular-dominance columns. inently reasonable that strongly inter-
158
© 1979 SCIENTIFIC AMERICAN, INC
159
II
dominated by whichever eye feeds that
I' I1 I1 11 I 1 I 1 1
L region.
Again we were most curious to learn
111.' 1 '
what these left-eye and right-eye regions
I
111111 1 I 1 1 11 1, '1 /1 1 / 1. /1
might look like in three dimensions; any
L I.. of several geometries could lead to the
ill
1I I"I1 I1I
II11
1 I 1 1I1I 11
came from studies with the silver-degen
.eration method for mapping connec
L I tions, devised by Walle J. H. Nauta of
II ! I IIII!I I 'I 1 ,I 1 I 1 . 1 1
the Massachusetts Institute of Technol
ogy. Since then we have found three oth
!I
er independent anatomical methods for
I' I, '
1 demonstrating these columns.
A particularly effective method (be
cause it enables one to observe in a sin
,1 I I '
1'1 I'
,II
II gle animal the arrangement of columns
I I· I
over the entire primary visual cortex) is
1· 1· 1' 1, based on the phenomenon of axonal
;!;I transport. The proced ure is to inject a
1,1·
;tV
radioactively labeled amino acid into an
area of nervous tissue. A cell body takes
up the amino acid, presumably incorpo
rates it into a protein and then transports
it along the axon to its terminals. When
we injected the material into one eye
of a monkey, the retinal ganglion cells
took it up and transported it along their
axons, the optic-nerve fibers. We could
BLOCK OF CORTEX about a millimeter square and two millimeters deep (light color) can be
considered an elementary unit of tbe primary visual cortex. It contains one set of orientation
then examine the destinations of these
slabs subserving all orientations and one set of ocular-dominance slabs subserving botb eyes.
fibers in the lateral geniculate nuclei by
Tbe pattern is reiterated tbrougbout tbe primary visual area. Tbe placing of tbe boundaries coating tissue slices with a silver emul
(at tbe rigbt or tbe left eye, at a vertical, borizontal or oblique orientation) is arbitrary; rep sion and developing the emulsion; the
resentation of tbe slabs as flat planes intersecting at rigbt angles is an oversimplification. radioactive label showed up clearly in
160
\
geniculate on each side.
This method does not ordinarily trace
a path from one axon terminal across a
synapse to the next neuron and its termi R L R L
L R L R
L
nals, however, and we wanted to follow
the path all the way to the cortex. In
1 97 1 Bernice Grafstein of the Cornell
University Medical College discovered
that after a large enough injection in the
eye of a mouse some of the radioactive
material escaped from the optic-nerve
terminals and was taken up by the cells
in the geniculate and transported along
their axons to the cortex. We had the
thought that a similarly large injection
in a monkey, combined with autoradi
ography, might demonstrate the genicu
late terminals from one eye in layer IV
of the visual cortex.
O urnegative
first attempt yielded dismayingly
results, with only faint
hints of a few silver grains visible in lay
er IV . It was only after several weeks HORIZONTAL
that we realized that by resorting to
HYPOTHETICAL PATTERN OF CORTICAL ACTIVITY that might result from stimula
dark-field microscopy we could take ad tion of the left eye with a single short horizontal line, placed in the upper left quadrant of the
vantage of the light-scattering proper visual field, is shown by the colored patches on a diagram of an area of the right cortex, seen
ties of silver grains and so increase the face on. The area receiving input from the object in the visual field is indicated by the broken
sensitivity of the method. We borrowed black line. If ocular-dominance and orientation columns are arrayed as shown, activated cells
a dark-field condenser, and when we will be those that respond optimally to approximately horizontal stimuli from the left eye.
looked at our first slide under the mi
croscope, there shining in all their glory
were the periodic patches of label in lay entire primary visual cortex, once more deep. To know the organization of this
er IV [see top illustration on page 151]. emphasizing the uniformity of the cor chunk of tissue is to know the organiza
The next step was to try to see the tex. Again the widths fit perfectly with tion for all of area 17; the whole must be
pattern face on by sectioning the cortex the idea that all of the apparatus needed mainly an iterated version of this ele
parallel to its surface. The monkey cor to look after an area the size of an aggre mentary unit. Of course the elementary
tex is dome-shaped, arid so a section par gate field must be contained within any unit should not be thought of as a dis
allel to the surface and tangent to layer square millimeter of cortex. The two crete, separable block. Whether the set
IV shows that layer as a circle or an techniques, deoxyglucose labeling and of orientation slabs begins with a slab
oval, while a section below layer IV amino acid transport, have the great ad representing a vertical orientation, an
shows it as a ring. By assembling a series vantage of being mutually compatible, oblique one or a horizontal one is com
of such ovals and rings from a set of so that we have been able to apply both pletely arbitrary; so too is whether an
sections one can reconstruct the pattern together, one to mark orientation lines ocular-dominance sequence begins with
over a wide expanse of cortex. and the other to see the ocular-domi a left-plus-right pair of dominance slabs
From the reconstructions it was im nance columns. The number of brains or a right-plus-left pair. The same thing
mediately obvious that the main overall examined so far is too small to justify is true for a unit crystal of sodium chlo
pattern is one of parallel stripes repre any final conclusions, but the two sys ride or for any complex repetitive pat
senting terminals belonging to the in tems appear to be quite independent, tern such as is found in wallpaper.
jected eye, separated by gaps represent neither parallel nor at right angles but What, then, does the visual scene real
ing the other eye. The striping pattern is intersecting at random. ly look like as it is projected onto the
not regular like wallpaper. (We remind The function served by ocular-domi visual cortex? Suppose an animal fixes
ourselves occasionally that this is, after nance columns is still a mystery. We its gaze on some point and the only ob
all, biology!) Here and there a stripe know there are neurons with all grades ject in the visual field is a straight line
representing one eye branches into two of eye preference throughout the entire above and a bit to the left of the point
stripes, or else it ends blindly at a point binocular part of the visual fields, and it where the gaze is riveted. If each active
where a stripe from the other eye may be that a regular, patterned system cell were to light up, and if one could
branches. The irregularities are com of converging inputs guarantees that the stand above the cortex and look down at
monest near the center of gaze and distribution will be uniform, with nei it, what would the pattern be? To make
along the line that maps the horizon. ther eye favored by accident in any one the problem more interesting, suppose
The stripes always seem to be perpen place. Why there should be all these the pattern is seen by one eye only. In
dicular to the border between the pri grades of eye preference everywhere is view of the architecture just described
mary visual cortex and its neighbor, itself not clear, but our guess is that it the pattern turns out to be not a line but
area 18, and here the regularity is great has something to do with stereoscopic merely a set of regularly spaced patches
est. Such general rules seem to apply to depth perception. [see illustration above]. The reasoning can
all macaque brains, although the details be checked directly by exposing a mon
Given
of the pattern vary from one individual what has been learned about key with one eye closed to a set of verti
to the next and even from one hemi the primary visual cortex, it is clear cal stripes and making a deoxyglucose
sphere to the other in the same monkey. that one can consider an elementary autoradiograph. The resulting pattern
The width of a set of two stripes is piece of cortex to be a block about a should not be a great surprise: it is a set
constant, about . 8 millimeter, over the millimeter square and two millimeters of regularly spaced patches, which sim-
16 1
162
1 Year $ 1 3 . 44
2 Years $ 2 2 .44
P O B o x 92788, D E PT . SAJ4E
M I LW A U K E E , W I 53202