A Corticostriatal Path Targeting Striosomes Controls Decision-Making Under Conflict
A Corticostriatal Path Targeting Striosomes Controls Decision-Making Under Conflict
Authors
Alexander Friedman,
Daigo Homma, Leif G. Gibb, ...,
Ann M. Graybiel
Correspondence
[email protected]
In Brief
Optogenetic manipulation and
electrophysiology of a circuit connecting
the prefrontal cortex to striosomes
compartmentalized structures of the
striatumreveals that it has a selective
role in influencing decision-making for
choices with cost-benefit tradeoffs.
Highlights
d
Article
A Corticostriatal Path Targeting Striosomes
Controls Decision-Making under Conflict
Alexander Friedman,1 Daigo Homma,1 Leif G. Gibb,1 Ken-ichi Amemori,1 Samuel J. Rubin,1 Adam S. Hood,1
Michael H. Riad,1 and Ann M. Graybiel1,*
1McGovern Institute for Brain Research and Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology,
Cambridge, MA 02139, USA
*Correspondence: [email protected]
http://dx.doi.org/10.1016/j.cell.2015.04.049
SUMMARY
A striking neurochemical form of compartmentalization has been found in the striatum of humans and
other species, dividing it into striosomes and matrix.
The function of this organization has been unclear,
but the anatomical connections of striosomes indicate their relation to emotion-related brain regions,
including the medial prefrontal cortex. We capitalized on this fact by combining pathway-specific optogenetics and electrophysiology in behaving rats
to search for selective functions of striosomes. We
demonstrate that a medial prefronto-striosomal circuit is selectively active in and causally necessary
for cost-benefit decision-making under approachavoidance conflict conditions known to evoke
anxiety in humans. We show that this circuit has
unique dynamic properties likely reflecting striatal
interneuron function. These findings demonstrate
that cognitive and emotion-related functions are,
like sensory-motor processing, subject to encoding
within compartmentally organized representations
in the forebrain and suggest that striosome-targeting
corticostriatal circuits can underlie neural processing
of decisions fundamental for survival.
INTRODUCTION
Across the animal kingdom, neural mechanisms have evolved
to allow decision-making based on rewarding and aversive features of the environment (Glimcher and Fehr, 2014). This fundamental capacity, critical to normal human life, is disabled in a
range of neuropsychiatric and neurologic disorders (Gleichgerrcht et al., 2010). As yet, the mechanisms underlying the
relation between decision-making and emotion-related circuit
function remain largely unknown (Aupperle and Paulus,
2010). Pioneering work, however, has shown that behavioral
reactions to value-based decision-making, based on the
perceived potential costs and benefits of taking a given action,
are differentially represented in regions of the medial prefrontal
cortex (Rangel and Hare, 2010; Rudebeck et al., 2006; Rushworth et al., 2011; Walton et al., 2002). These cortical regions
1320 Cell 161, 13201333, June 4, 2015 2015 Elsevier Inc.
et al., 2011). The lack of this information presents a major roadblock to the development of neural circuit-based therapies for
disorders impacting decisions based on value.
We therefore designed a battery of decision-making tests
involving varying combinations of cost and benefit, and then, in
rats performing the different tasks, applied an optogenetic
approach in order to assess the differential contributions to decision-making of striosome-targeting and matrix-targeting prefrontal corticostriatal pathways. We based our strategy on the
finding (Amemori and Graybiel, 2012) that, in monkeys, decisions
based on conflicting combinations of cost and benefit in
approach-avoidance tasks selectively activate a subset of neurons in a medial prefrontal region that could correspond to a
zone targeting the striosome compartment of the striatum, as
indicated by earlier anatomical work (Eblen and Graybiel,
1995). These results in the non-human primate suggested that
in-depth analysis of striosome-targeting and matrix-targeting
circuits with multiple methods feasible in rodent experiments
might uncover causally important decision-making control systems hidden from previous analyses.
To do these experiments, we focused on two corticostriatal
projections from adjacent prefrontal cortical regions implicated
in decision-making (Dwyer et al., 2010; Rudebeck et al., 2006;
Seamans et al., 1995; St Onge and Floresco, 2010) and known
to have distinct bilateral striatal projection patterns predominantly targeting either striosomes or matrix (Donoghue and Herkenham, 1986; Gerfen, 1984). One, originating in the prefrontal
region called prelimbic cortex in rodents (here called PFC-PL),
projects preferentially to striosomes in the associative striatum
(Donoghue and Herkenham, 1986; Gerfen, 1984). The second,
originating in the prefrontal region called in rodents anterior
cingulate cortex (here named PFC-ACC), projects preferentially
to the matrix compartment of the associative striatum (Donoghue and Herkenham, 1986). By optogenetically tagging these
pathways, and then applying manipulations in combination
with behavioral and electrophysiological assays, we tried to
differentiate the functions of these pathways, identified both by
their cortical origins in different medial prefrontal cortical regions
and by their different preferential striatal termination fields in
either striosome or matrix compartment.
Our findings suggest that the medial prefrontal pathway
targeting striosomes is differentially activated by motivational
conflict induced by a pair of options evoking approach-avoidance conflict, and that this circuit, by way of an intrastriatal
inhibitory network, can control both the activity of striosomes
in such cost-benefit decision-making and the behavior
itself. These findings place the cortico-striosomal system as a
potentially crucial control mechanism for organisms facing the
need to act based on conflicting options in their environment.
RESULTS
Rats Develop Distinct, Highly Repeatable Choice
Behaviors under Different Cost-Benefit Context
Conditions
We challenged rats to make decisions in five different contexts
as they performed T-maze tasks in which they could turn right or
left to reach one of the offers presented at the end-arm goals
(E) Choice functions (mean SEM) for nine rats for the four tasks including benefit option. Color indicates degree of motivational conflict estimated by logistic
modeling.
(F) Choice function (mean SEM) for cost-cost task.
See also Figure S1.
Figure 2. Optogenetic Manipulation of PFC-PL Cortico-Striosomal Pathway and PFC-ACC Cortico-Matrix Pathway
(A and B) Virally labeled PFC-PL (A) and PFC-ACC (B) corticostriatal projections (green, EYFP-immunostained) preferentially terminating, respectively, in
striosome (red, MOR1-immunostained) and matrix compartments.
(C) Intrastriatal inhibition of PFC-PL axons (striosome-predominant input, left) increases choice of high-cost, high-reward option in cost-benefit conflict task
(middle). Proportions of choices of such option with and without laser delivery are shown for 25 sessions in ten rats (right).
(D) Behavioral effects of intrastriatal optogenetic inhibition of striosome-predominant PFC-PL inputs (blue) and matrix-predominant PFC-ACC inputs (orange),
shown as percentage increase (mean SEM) in choice of pure chocolate milk (left) or of dim light (right). #p > 0.07 and *p < 0.001 relative to control groups (green
and gray, two-tailed t test).
(E) Intrastriatal stimulation of PFC-PL axons decreases choice of high-cost options in cost-benefit conflict task. Data for nine sessions in three rats.
(F) Intrastriatal inhibition of contralateral striosome-predominant inputs (mean SEM). *p < 0.001, two-tailed t test.
(G) Protocol for optogenetic inhibition applied in the PFC-PL or at PFC-PL terminal zones in ventral tegmental area (VTA) or basolateral amygdala (BLA).
(HJ) Behavioral effects (mean SEM) of laser delivered in VTA (H), BLA (I), and PFC-PL (J). *p < 0.001, two-tailed t test.
See also Figure S2.
the key period during which the animals initiated their runs
and turned to execute their right-left decisions (Figures 3C
and S3A). The activity of these neurons peaked in series during
1324 Cell 161, 13201333, June 4, 2015 2015 Elsevier Inc.
(Figure S3A). Thus, the PFC-PLs neuron activity patterns, like optogenetic inhibition of the PFC-PL pathway, pointed to a unique
influence of this striosome-targeting pathway on performance of
the cost-benefit conflict task.
Identifying the activity of striosomal neurons themselves during task performance would provide a critical test of the selectivity of the effects of PFC-PLs neurons on striosomes. However,
chronic in vivo recording from striosomes has never before been
achieved. We attempted to do this by capitalizing on the preferential PFC-PL inputs to striosomes demonstrable anatomically
(Figures 2A and S2; Supplemental Experimental Procedures).
We applied electrical stimulation to the PFC-PL region that we
had identified as projecting predominantly to striosomes in the
dorsomedial striatum (Figures 3E and 3F), and we simultaneously recorded from large numbers of striatal projection
neurons (SPNs) (Figure S3E) in rats with arrays of tetrodes chronically implanted in the dorsomedial striatum (Figure 3M). At the
end of each session, we determined for each SPN whether it
had short latency responses to the PFC-PL stimulation (Figures
3E, 3F, and 3I), then marked some of these tetrode tip locations
with lesions (Figure 3M) and in histologically prepared brain sections mapped these locations relative to immunostained striosomes (Figure 3N). We found a reliable orthodromic response
signature of putative striosomal SPNs so identified (Figure 3O;
Supplemental Experimental Procedures).
Given that the corticostriatal projection to SPNs is glutamatergic and excitatory, we expected that the activity of these putative
striosomal SPNs would match that of the antidromically identified
PFL-PLs neurons. We found the opposite. During the in-run period
during which the PFC-PLs neurons were highly active (Figure 3C),
the striosomal neurons were largely quieted (Figure 3G). Yet
98% of striosomal SPNs exhibited high activity during this
click-to-turn period in all of the other task-versions, again peaking
at different points during this period (Figures 3H and S3F). Thus,
the striosome-projecting PFC-PLs neurons and the striosomal
SPNs to which they mainly projected had almost perfectly complementary patterns of activity during the maze runs.
To test the selectivity of these patterns, we analyzed the activity
of the PFC-PL neuronal population as a whole, excluding the 54
antidromically identified PFC-PLs neurons. In sharp contrast to
the PFC-PLs cells, this PFC-PL population fired at goal-reaching
in every task (Figures 3J, S3B, and S3C). Thus, the PFC-PLs inrun activity pattern was highly selective. We also analyzed the
activity of striatal SPNs excluded from the putative striosomal
SPN population (Figures 3K, 3L, S3G, and S3H). In contrast to
the population of putative striosomal SPNs, the striatal neurons
identified as non-striosomal SPNs, which should mostly have
been matrix neurons, were active in all tasks (Figures 3L and
S3G; Supplemental Experimental Procedures), and their activity
tended to be selective for choices of higher reward (Figure S3H).
These activations were significantly different from baseline activity (two-tailed t test, p < 0.001), and their response patterns for the
five tasks were significantly different from those of the putative
striosomal SPNs (MANOVA and two-way ANOVA, p < 0.001).
As shown in Figure S3, baseline activity was not uniform
across all tasks, being particularly low in the non-conflict costbenefit task and the cost-cost task and especially for PFC-PLs
neurons. To test the possibility that baseline firing rates might in-
Figure 3. Contrasting Activity of Putative Cortical PFC-PLs Neurons and Striosomal SPNs during Task Performance
(A) Antidromic stimulation protocol to identify PFC-PLs neurons.
(B) Cortical spikes aligned to striatal microstimulation onset.
(C) Spike activity of PFC-PLs neurons (top) and bursty spike activity heat maps (bottom) in cost-benefit conflict (left) and benefit-benefit (right) tasks. Inner T-maze
outline indicates click to first lick (i.e., in-run) time-period; outer outline includes 3 s before and after runs. Activity shown as mean Z scores and firing rates in color
scale from blue (low) to red (high). Heat map rectangles show bursts with lengths proportional to burst durations, with min-max normalized intra-burst firing rates
from yellow (low) to red (high).
(D) PFC-PLs spike activity (mean SEM) during click-to-turn period for all tasks (abbreviated as in Figure 1A). *p < 0.001 (two-tailed t test, difference between
CBC and each of other tasks).
(E) Orthodromic stimulation protocol for identification of putative striosomal neurons.
(F) Putative striosomal SPN activity aligned to PFC-PL microstimulation. Yellow and gray shading respectively indicates peak and inhibition time windows.
(G) Activity of putative striosomal SPNs (top) and associated burst activity heat maps (bottom).
(H) Average click-to-turn activity of putative striosomal SPNs in the five tasks. *p < 0.001 (two-tailed t test; difference between CBC and each of other tasks).
over striatal SPNs (Berke, 2011; Burguie`re et al., 2013; Kita and
Kitai, 1988; Koos and Tepper, 1999) (Figure S3E). We examined
their task-related burst-firing patterns in the five different taskversions (Figures 6A, 6B, and S6F). The putative HFNs, like
cortical PFC-PLs neurons, had high firing rates during runs in
the cost-benefit conflict task, and in particular, high rates of
bursty firing as defined by an in-house algorithm (Figures S6A
S6E; Supplemental Experimental Procedures). The high burst
activity of the HFNs occurred principally in the cost-benefit
task; in the other task-versions, their intra-burst firing rates
were low, relative to baseline intra-burst firing rates (Figures
6A, 6B, and S6F). These sharp, task-dependent differences
were not obvious in the overall firing rates. The similarity of the
burst activity patterns of the HFNs to the PFC-PLs patterns suggested that the PFC-PLs cells might excite these HFNs, leading
to the suppression of the SPN firing that we had observed.
To test this possibility, we searched for pairs of HFNs and
SPNs recorded simultaneously on single tetrodes, concentrating
on the cost-benefit conflict task. When we aligned the spikes of
the SPNs to the peak firing of the HFNs, profound inhibition of the
SPNs was apparent (Figures 6C and S6G). Across the population
of 23 SPN-HFN pairs, the degree of inhibition of the SPN firing
was highly correlated with the burst firing rates (Figures 6D and
S6H), but not the tonic firing rates, of the HFNs. We also
searched for pairs of HFNs and PFC-PLs neurons recorded
simultaneously in the same animal. In these pairs, PFC-PLs activity peaks preceded the HFN peaks (Figure 6E), which occurred
in a temporal succession from 2 s before the start click to 3 s
after the click, and the striosomal SPNs were then inhibited. Experiments with electrical microstimulation of PFC-PL suggested
that HFN activation led SPN activation by 3 ms (Figure 6F), and
combining such microstimulation with intrastriatal optogenetic
inhibition (Figure 6G) led to an increase in firing of the SPNs,
but to a decrease in firing of the HFNs (Figures 6H and S6I).
Thus, the uniquely low firing rates of the striosomal SPNs during
conflict cost-benefit decision-making likely resulted, at least in
part, from task-selective excitation of HFN bursting by PFCPLs neurons and subsequent diminution of striosomal SPN firing
(Supplemental Experimental Procedures).
Computational Modeling Suggests that Optogenetic
Inhibition of PFC-PLs Pathway Reduces Sensitivity to
Cost
We attempted to infer computationally the internal motivations
accompanying decision-making in these tasks (Figures 7A7F;
Supplemental Experimental Procedures). The logistic modeling
estimated that the effect of optogenetically inhibiting the PFCPL pathway targeting striosomes was to halve the sensitivity to
(I) Method to determine time-window of short-latency orthodromic SPN activation (Supplemental Experimental Procedures). Larger squares show spike times
demarcating start and end of time window.
(J and K) Average spike activity of non-PFC-PLs population recorded in PFC-PL (J) and putative matrix SPNs (K) during cost-benefit conflict task.
(L) Average click-to-turn activity of putative matrix SPNs.
(M) Four tetrode tracks and tip marked with micro-lesion (CD11, green) relative to striosomes (MOR1, red).
(N) Sample of tip-striosome measurements (Supplemental Experimental Procedures). Tetrode tip in matrix (red, middle and right panels) along tetrode track
(white, left panel); distance to nearest striosome (light blue) shown (yellow line).
(O) Distribution of SPNs that respond to PFC-PL stimulation (left) was significantly different from that of unresponsive SPNs (right; p < 0.001, chi-square test).
See also Figure S3.
inducing approach-avoidance conflict. Thus, the regulation of internal approach-avoidance drives could be an essential part of
the functional selectivity of the PFC-PL pathway.
Figure 5. Optogenetic Inhibition of PFC-PL Terminals in CostBenefit Conflict Task Increases Firing Rates of Putative Striosomal
Neurons
(A) Consecutive cost-benefit conflict task blocks (20 trials each), without, then
with, laser inhibition for 3 s, starting at click.
(B) Maze activity plots (above) and burst activity heat maps (below) for 46
putative striosomal SPNs.
(C) Trial-by-trial firing rates across the blocks. p < 0.001, paired t test between
blocks.
(D and E) Firing rates (mean SEM) for 1 (D) and for 46 (E) putative striosomal
SPNs recorded across blocks. p < 0.001, paired t test between blocks.
See also Figure S5.
EXPERIMENTAL PROCEDURES
All experimental procedures were approved by the Committee on Animal Care
at the Massachusetts Institute of Technology. Adult Long-Evans rats (n = 55)
were trained to perform value-based decision-making tasks on a T-maze
composed of a running track and two end-arms with light focused on reward
feeders. To dissociate reward, cost, and motivational conflict, we used five
different types of decision-making tasks: cost-benefit conflict, benefit-benefit
with similar reward, benefit-benefit with dissimilar reward, non-conflict costbenefit and cost-cost (Figures 1A and 1B). We adjusted the cost and reward
scales according to the psychometric function of each individual rat. Tasks
were presented in random order, but only one cost-benefit conflict session
was given per week (Figure S1D). We performed simultaneous cortical and
striatal tetrode recordings and optogenetic manipulation to examine functionally corticostriatal circuits anatomically identified as preferentially targeting
striosomes (originating in PFC-PL) or matrix (originating in PFC-ACC) in the
dorsomedial striatum. For optogenetic experiments, virus encoding halorhodopsin or C1V1, or control virus, was injected into the PFC-PL or PFC-ACC.
Light (1.82.2 mW) was intrastriatally delivered for 3 s from trial-starting click
(Figure 1D). Compartment selectivity of the optogenetic manipulations was
estimated by densitometric analysis of EYFP tagged to the opsin (Figure S2).
Following each session, electrical microstimulation was delivered to the dorsomedial striatum or PFC-PL to identify, respectively, PFC-PL neurons projecting to the dorsomedial striatum (PFC-PLs neurons) and putative striosomal
SPNs (Figure 3). Within the striatum, we identified putative SPNs and HFNs
based on their spike waveforms, firing rates and spiking patterns (Figure S3E).
Burst activity was extracted by identifying spike trains with short interspike
intervals (Figure S6). Z scores of trial activity were calculated using the baseline
(113 s before the click) firing rate and SD and were plotted onto the maze
shape. Behavior and optogenetic effects were modeled using logistic regression. Significant differences were determined by two-tailed t tests (for optogenetic manipulation effects) and by chi-square tests (for spike activity in
histograms). More details are given in Supplemental Experimental Procedures.
SUPPLEMENTAL INFORMATION
Supplemental Information includes Supplemental Experimental Procedures
and six figures and can be found with this article online at http://dx.doi.org/
10.1016/j.cell.2015.04.049.
AUTHOR CONTRIBUTIONS
A.M.G. oversaw the project. A.F., D.H., L.G.G., and A.M.G designed the experiments. A.F., D.H., and S.J.R. performed electrophysiological, optogenetic,
and behavioral experiments. A.F., D.H., L.G.G., A.S.H., and A.M.G. analyzed
data. D.H., L.G.G., M.H.R., and A.M.G. performed histological imaging and
analysis. K.A. performed modeling with input from A.F. and A.M.G. All authors
contributed to discussions about the data and their interpretation. A.M.G.
wrote the manuscript with input from A.F., D.H., L.G.G., K.A., and M.H.R.
ACKNOWLEDGMENTS
The authors thank Jannifer Lee, Dan Hu, Henry Hall, Yasuo Kubota, and Xiaojian Li for their help in many aspects of this work, Prof. Drazen Prelec for his
valuable comments, and the undergraduate students who assisted in these
experiments. This work was funded by NIH/NIMH (R01 MH060379 to
A.M.G.), the CHDI Foundation (A-5552 to A.M.G.), the Defense Advanced
Research Projects Agency and the U.S. Army Research Office (W911NF-101-0059 to A.M.G.), the Bachmann-Strauss Dystonia and Parkinson Foundation
(to A.M.G.), the William N. and Bernice E. Bumpus Foundation (RRDA Pilot:
2013.1 to A.M.G.), and the Uehara Memorial Foundation and Japan Society
for the Promotion of Science (to D.H.).
REFERENCES
Amemori, K., and Graybiel, A.M. (2012). Localized microstimulation of primate
pregenual cingulate cortex induces negative decision-making. Nat. Neurosci.
15, 776785.
Aupperle, R.L., and Paulus, M.P. (2010). Neural systems underlying approach
and avoidance in anxiety disorders. Dialogues Clin. Neurosci. 12, 517531.
Aupperle, R.L., Sullivan, S., Melrose, A.J., Paulus, M.P., and Stein, M.B. (2011).
A reverse translational approach to quantify approach-avoidance conflict in
humans. Behav. Brain Res. 225, 455463.
Aupperle, R.L., Melrose, A.J., Francisco, A., Paulus, M.P., and Stein, M.B.
(2015). Neural substrates of approach-avoidance conflict decision-making.
Hum. Brain Mapp. 36, 449462.
Berke, J.D. (2011). Functional properties of striatal fast-spiking interneurons.
Front. Syst. Neurosci. 5, 45.
Burguie`re, E., Monteiro, P., Feng, G., and Graybiel, A.M. (2013). Optogenetic
stimulation of lateral orbitofronto-striatal pathway suppresses compulsive behaviors. Science 340, 12431246.
Canales, J.J., and Graybiel, A.M. (2000). A measure of striatal function predicts
motor stereotypy. Nat. Neurosci. 3, 377383.
Crittenden, J.R., and Graybiel, A.M. (2011). Basal ganglia disorders associated
with imbalances in the striatal striosome and matrix compartments. Front.
Neuroanat. 5, 59.
Dickson, J.M., and MacLeod, A.K. (2004). Approach and avoidance goals and
plans: their relationship to anxiety and depression. Cognit. Ther. Res. 28,
415432.
Donoghue, J.P., and Herkenham, M. (1986). Neostriatal projections from individual cortical fields conform to histochemically distinct striatal compartments
in the rat. Brain Res. 365, 397403.
Dwyer, D.M., Dunn, M.J., Rhodes, S.E., and Killcross, A.S. (2010). Lesions of
the prelimbic prefrontal cortex prevent response conflict produced by actionoutcome associations. Q. J. Exp. Psychol. (Hove) 63, 417424.
Eblen, F., and Graybiel, A.M. (1995). Highly restricted origin of prefrontal
cortical inputs to striosomes in the macaque monkey. J. Neurosci. 15, 5999
6013.
Etkin, A., Egner, T., Peraza, D.M., Kandel, E.R., and Hirsch, J. (2006).
Resolving emotional conflict: a role for the rostral anterior cingulate cortex in
modulating activity in the amygdala. Neuron 51, 871882.
Fitzgerald, K.D., Welsh, R.C., Gehring, W.J., Abelson, J.L., Himle, J.A., Liberzon, I., and Taylor, S.F. (2005). Error-related hyperactivity of the anterior cingulate cortex in obsessive-compulsive disorder. Biol. Psychiatry 57, 287294.
Flaherty, A.W., and Graybiel, A.M. (1991). Corticostriatal transformations in the
primate somatosensory system. Projections from physiologically mapped
body-part representations. J. Neurophysiol. 66, 12491263.
Flaherty, A.W., and Graybiel, A.M. (1993). Output architecture of the primate
putamen. J. Neurosci. 13, 32223237.
Fujiyama, F., Sohn, J., Nakano, T., Furuta, T., Nakamura, K.C., Matsuda, W.,
and Kaneko, T. (2011). Exclusive and common targets of neostriatofugal projections of rat striosome neurons: a single neuron-tracing study using a viral
vector. Eur. J. Neurosci. 33, 668677.
Gerfen, C.R. (1984). The neostriatal mosaic: compartmentalization of corticostriatal input and striatonigral output systems. Nature 311, 461464.
Gleichgerrcht, E., Ibanez, A., Roca, M., Torralva, T., and Manes, F. (2010). Decision-making cognition in neurodegenerative diseases. Nat. Rev. Neurol. 6,
611623.
Glimcher, P.W., and Fehr, E. (2014). Neuroeconomics: Decision Making and
the Brain, Second Edition (New York: Academic Press).
Goldstein, R.Z., Alia-Klein, N., Tomasi, D., Carrillo, J.H., Maloney, T., Woicik,
P.A., Wang, R., Telang, F., and Volkow, N.D. (2009). Anterior cingulate cortex
hypoactivations to an emotionally salient task in cocaine addiction. Proc. Natl.
Acad. Sci. USA 106, 94539458.
Graybiel, A.M. (1990). Neurotransmitters and neuromodulators in the basal
ganglia. Trends Neurosci. 13, 244254.
Graybiel, A.M., and Ragsdale, C.W., Jr. (1978). Histochemically distinct compartments in the striatum of human, monkeys, and cat demonstrated by acetylthiocholinesterase staining. Proc. Natl. Acad. Sci. USA 75, 57235726.
Hong, S., and Hikosaka, O. (2013). Diverse sources of reward value signals in
the basal ganglia nuclei transmitted to the lateral habenula in the monkey.
Front. Hum. Neurosci. 7, 778.
Kahneman, D., and Tversky, A. (1984). Choices, values, and frames. Am. Psychol. 39, 341350.
Kasai, K., Yamasue, H., Gilbertson, M.W., Shenton, M.E., Rauch, S.L., and
Pitman, R.K. (2008). Evidence for acquired pregenual anterior cingulate gray
matter loss from a twin study of combat-related posttraumatic stress disorder.
Biol. Psychiatry 63, 550556.
Kita, H., and Kitai, S.T. (1988). Glutamate decarboxylase immunoreactive neurons in rat neostriatum: their morphological types and populations. Brain Res.
447, 346352.
Koos, T., and Tepper, J.M. (1999). Inhibitory control of neostriatal projection
neurons by GABAergic interneurons. Nat. Neurosci. 2, 467472.
Lak, A., Stauffer, W.R., and Schultz, W. (2014). Dopamine prediction error responses integrate subjective value from different reward dimensions. Proc.
Natl. Acad. Sci. USA 111, 23432348.
Milad, M.R., Quirk, G.J., Pitman, R.K., Orr, S.P., Fischl, B., and Rauch, S.L.
(2007). A role for the human dorsal anterior cingulate cortex in fear expression.
Biol. Psychiatry 62, 11911194.
Miller, N.E. (1971). Selected Papers on Conflict, Displacement, Learned Drives
and Theory (Chicago, Illinois: Aldine Atherton).
Newman, H., Liu, F.C., and Graybiel, A.M. (2015). Dynamic ordering of early
generated striatal cells destined to form the striosomal compartment of the
striatum. J. Comp. Neurol. 523, 943962.
Parthasarathy, H.B., Schall, J.D., and Graybiel, A.M. (1992). Distributed but
convergent ordering of corticostriatal projections: analysis of the frontal eye
field and the supplementary eye field in the macaque monkey. J. Neurosci.
12, 44684488.
Rajakumar, N., Elisevich, K., and Flumerfelt, B.A. (1993). Compartmental origin
of the striato-entopeduncular projection in the rat. J. Comp. Neurol. 331,
286296.
Rangel, A., and Hare, T. (2010). Neural computations associated with goaldirected choice. Curr. Opin. Neurobiol. 20, 262270.
Rudebeck, P.H., Walton, M.E., Smyth, A.N., Bannerman, D.M., and Rushworth, M.F. (2006). Separate neural pathways process different decision
costs. Nat. Neurosci. 9, 11611168.
Rushworth, M.F., Noonan, M.P., Boorman, E.D., Walton, M.E., and Behrens,
T.E. (2011). Frontal cortex and reward-guided learning and decision-making.
Neuron 70, 10541069.
Salamone, J.D. (1994). The involvement of nucleus accumbens dopamine in
appetitive and aversive motivation. Behav. Brain Res. 61, 117133.
Salamone, J.D., and Correa, M. (2012). The mysterious motivational functions
of mesolimbic dopamine. Neuron 76, 470485.
Sangha, S., Robinson, P.D., Greba, Q., Davies, D.A., and Howland, J.G.
(2014). Alterations in reward, fear and safety cue discrimination after inactivation of the rat prelimbic and infralimbic cortices. Neuropsychopharmacology
39, 24052413.
Seamans, J.K., Floresco, S.B., and Phillips, A.G. (1995). Functional differences
between the prelimbic and anterior cingulate regions of the rat prefrontal cortex. Behav. Neurosci. 109, 10631073.
St Onge, J.R., and Floresco, S.B. (2010). Prefrontal cortical contribution to riskbased decision making. Cereb. Cortex 20, 18161828.
Stephenson-Jones, M., Kardamakis, A.A., Robertson, B., and Grillner, S.
(2013). Independent circuits in the basal ganglia for the evaluation and selection of actions. Proc. Natl. Acad. Sci. USA 110, E3670E3679.
Stopper, C.M., Tse, M.T., Montes, D.R., Wiedman, C.R., and Floresco, S.B.
(2014). Overriding phasic dopamine signals redirects action selection during
risk/reward decision making. Neuron 84, 177189.
Tippett, L.J., Waldvogel, H.J., Thomas, S.J., Hogg, V.M., van Roon-Mom, W.,
Synek, B.J., Graybiel, A.M., and Faull, R.L. (2007). Striosomes and mood
dysfunction in Huntingtons disease. Brain 130, 206221.
Vogel, J.R., Beer, B., and Clody, D.E. (1971). A simple and reliable conflict procedure for testing anti-anxiety agents. Psychopharmacology (Berl.) 21, 17.
Pizzagalli, D.A. (2011). Frontocingulate dysfunction in depression: toward biomarkers of treatment response. Neuropsychopharmacology 36, 183206.
Walton, M.E., Bannerman, D.M., and Rushworth, M.F. (2002). The role of rat
medial frontal cortex in effort-based decision making. J. Neurosci. 22,
1099611003.
Prensa, L., and Parent, A. (2001). The nigrostriatal pathway in the rat: a singleaxon study of the relationship between dorsal and ventral tier nigral neurons
and the striosome/matrix striatal compartments. J. Neurosci. 21, 72477260.
Watabe-Uchida, M., Zhu, L., Ogawa, S.K., Vamanrao, A., and Uchida, N.
(2012). Whole-brain mapping of direct inputs to midbrain dopamine neurons.
Neuron 74, 858873.