BREWER Scientific Expert Testimony and Intellectual Due Process
BREWER Scientific Expert Testimony and Intellectual Due Process
Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at .
http://www.jstor.org/page/info/about/policies/terms.jsp
.
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of
content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms
of scholarship. For more information about JSTOR, please contact [email protected].
The Yale Law Journal Company, Inc. is collaborating with JSTOR to digitize, preserve and extend access to
The Yale Law Journal.
http://www.jstor.org
Scott Brewert
CONTENTS
t Professor,HarvardLaw School. I would like to repay debts of thanksfor various kinds of help,
rangingfrom brainstormingconversationsto detailedcriticismof drafts,to JonathanAmsterdam,Anthony
Appiah,BrianBix, Julius Christensen,RichardCraswell,CatherineElgin, CharlesFried,ElizabethGarrett,
Kent Greenawalt,Steven Gross, Deborah Hellman, Larry Lessig, Peter Murray,David Nagle, Martha
Nussbaum, and Cass Sunstein. I presentedearlier versions of this Article in legal theory workshops at
Boston University, Columbia University, Harvard University, McGill University, the University of
Californiaat Berkeley,the Universityof Chicago, and the Universityof Pennsylvania,and I am indebted
to workshopparticipantsfor valuablecomments on those versions.
1535
to use the believed expert's information in resolving the central dispute being
litigated.
Drawing on work in jurisprudence, epistemology, philosophy of science,
and theories of practical reasoning, as well as on doctrines and leading cases
on scientific expert evidence, this Article carefully models the reasoning
process by which nonexpert legal reasoners defer to scientific experts in the
course of applying a law to individual litigants. Drawing on this model, I argue
for four central conclusions. Taken together, these conclusions have far-
reaching consequences for virtually all legal systems in which nonexpert legal
decisionmakers confront expert scientific testimony.
First, the Article argues that in order to avoid making an epistemically
arbitrary choice about which of the competing scientific experts ought to be
believed, a person must understand (in a special sense discussed in the text)
the cognitive aims and methods of science. But nonexpert judges and juries
lack just that kind of understanding, which is why they rely instead on other
indicia of expertise, such as credentials, reputation, and demeanor. Second,
nonexpert judges' and juries' lack of understanding of the cognitive aims and
methods of science and their reliance on such indicia of expertise as
credentials, reputation, and demeanor to choose between competing scientific
experts thus yield only epistemically arbitrary judgments. Third, the
conclusions that nonexpert judges and juries ultimately reach by relying
significantly on expert scientific testimony are often also epistemically arbitrary
and are therefore not justified from a legal point of view. Fourth, I
identify-and begin the process of explicating-an emerging norm that belongs
in the family of rule-of-law values: the norm I call intellectual due process.
Showing that this norm is immanent in values to which many legal
systems-including those in the United States-are already committed, I
explain the way in which this norm places important epistemic constraints on
the reasoning process by which legal decisionmakers apply laws to individual
litigants. This norm requires, among other things, that the decisionmaking
process not be arbitrary from an epistemic point of view. In other words,
nonexpert judges and juries often fail to satisfy the demands of intellectual due
process when they solicit and rely upon scientific expert testimony.
In sum, I argue that values to which legal systems are and ought to be
committed actually condemn one of the most firmly entrenched evidentiary
methods currently in place. As scientific theories continue to become more
specialized, complex, and relevant to a widening range of cases, this
incoherence between normative aspiration and actual doctrinal and institutional
procedure will increasingly threaten the legitimacy of nonexperts' legal
decisions. I conclude the Article with some brief observations about the kinds
of doctrinal and institutional reforms that might better enable legal systems to
meet the high aspirations of intellectual due process, thereby restoring, or at
least improving, the coherence of value and institutional practice.
In the course of making legal decisions, judges, juries, lawyers, and other
legal reasoners must constantly repair to factual judgments about the world.2
Indeed, if one treats judgments about what legal authorities have decided as
being within the scope of "the world," one might even conclude that every
legal decision involves some judgment about the way the world is.3 One of
the most important overall decisions legal systems must make is how, if at all,
to regulate the descriptive claims about the world-claims, that is, about how
the world is, was, or will be-that enter into the legal system. In most civil
and criminal cases, the principal doctrinal and institutional mechanisms for this
kind of regulation are rules of evidence and procedure. In virtually every area
of civil and criminal law, these are the rules that regulate judgments by legal
officials (principally judges, but also legislative officials) about which
conclusions of fact are both relevant to given legal judgments and adequately
justified. In regulating these judgments, rules of evidence and procedure
comprise what we may call the "law's epistemology"-the set of rules and
2. The advisory committee note to FederalRule of Evidence 201 makes the point nicely:
[E]very case involves the use of hundredsor thousandsof non-evidencefacts. When a witness
in an automobileaccident case says "car,"everyone,judge and jury included,furnishes,from
non-evidence sources within himself, the supplementinginformationthat the "car" is an
automobile, not a railroadcar, that it is self-propelled,probablyby an internalcombustion
engine, that it may be assumedto have four wheels with pneumaticrubbertires, and so on. The
judicial process cannotconstructevery case from scratch,like Descartescreatinga world based
on the postulateCogito, ergo sum.
FED.R. EVID.201 advisorycommittee'snote (citationomitted).
3. If assertionsabout what the law is are assertionsof fact, then there is no legal decision that does
not requiresome judgmentaboutthe way the world is, for even what are usually regardedas "purelylegal
questions,"such as questionsof law about the interpretationof statutes,are questionsabout the world. A
properanalysis of this issue concerningthe "factual"natureof the law combines the doctrinalanalysis of
rules of evidence, on the one hand, with the jurisprudentialanalysis of the concept of law, on the other.
Legal positivists characteristicallytreat statements about what the law is as statementsof fact. Jules
Coleman, for example, asserts that legal positivism is best associated with at least two theses about the
nature of law. One is the "negative"thesis that the moral acceptabilityof a norm is not a necessary
condition of its legality. The other is the "positive"thesis that "law is ultimatelya matterof social fact in
the sense that the authorityof the rule of recognition is itself a matterof social convention."Jules L.
Coleman,Rules and Social Facts, 14 HARV.J.L. & PUB. POL'Y703, 716-17 (1991). If law really is a social
fact in this sense, then knowledgeof what the law is itself is knowledgeof a type of fact-i.e., knowledge
aboutthe way (partof) the world is. This positivisttreatmentof law as fact would seem to accordwell with
the common law view that law is the kind of thing that can be "judiciallynoticed."See, e.g., Schultz v.
Tecumseh Prods., 310 F.2d 426, 433 (6th Cir. 1962) ("'The law of any State of the Union, whether
dependingupon statutesor uponjudicial opinions, is a matterof which the courtsof the United States are
bound to take judicial notice, withoutplea or proof."' (quoting Lamarv. Micov, 114 U.S. 218 (1885))).
Nonpositivistaccounts, such as RonaldDworkin's,which view law as interpretiveratherthan factual,are
not easily reconciled with the familiarevidentiarydoctrinethat law can be judicially noticed. There are,
however, ways to explain "interpretive" judgmentsas factual ones-for example, by treatinga statement
about what the law is as that interpretationof the relevantlegal materialsthat in fact makes it "the best"
it can be. See RONALDDWORKIN,LAW'S EMPIRE45-113 (1986).
institutions that determine what, from a legal point of view, can be believed
with sufficient justification for the purposes of the legal system.
Ultimately, my argument is a philosophical one: When a certain condition
("the underdetermination condition")is satisfied by the aggregate testimony
of scientificwitnesses in a particularcase, thereis compellingreason to doubt
that a nonexpert legal reasoner can acquire expert informationfrom a
scientific expert in a mannerthat is both epistemicallyand legallyjustified. I
set up this philosophical analysis with a detailed and focused examination of
legal rules and institutions-chiefly those in U.S. federal law. There is an
important heuristic relation between the highly abstract philosophical analysis
presented in this Article and the rather concrete analysis of doctrine: Each
keeps the other intellectually honest. Philosophical analysis without detailed
facts is blind; recitation of detailed facts without philosophical analysis is
ignorant. Philosophical inquiry into the practices of an institution proceeds by
examining the structures of the concepts, arguments, and other intellectual
procedures that comprise those practices.4 My specific philosophical inquiry
is whether and under what conditions it is possible for scientific experts to
convey justified beliefs to nonexpert judges and juries.5 To be successful, such
inquiry must be deeply informed by at least some actual practices of the type
that are examined and explained. In this area of "legal epistemology," an
understanding of "what is actual" will materially inform the analysis of "what
is possible," just as detailed analysis of scientific theories and methods deeply
informs the philosophical analysis of science.6 Thus, an adequate philosophical
investigation of whether and how a legal system might achieve justified
epistemic deference by nonexperts to experts requires attending to the ways in
which current legal systems seek to achieve it. In this way, the detailed
doctrinal discussion in Part II will inform the philosophical inquiry that this
Article pursues throughout.
In the American federal system (to which, for the most part, I confine my
discussion of doctrine7), the rules most directly concerned with the
shepherding of experts' beliefs from their minds into those of legal
4. I discuss the distinctive philosophical "point of view" at length below. See infra Sections II.B-C.
5. The explanation of how some state of affairs or some condition (e.g., knowledge or truth) is
possible is one standard mode of philosophical explanation. For discussion of this mode, see ROBERT
NOZICK,PHILOSOPHICAL EXPLANATIONS (1981).
6. Norwood Hanson's observation about philosophy of science-"profitable philosophical discussion
of any science depends on a thorough familiarity with its history and its present state"-is no less true for
philosophical analysis of law. NoRwoOD RUSSELLHANSON,PATTERNS OF DISCOVERY:AN INQUIRYINTO
THE CONCEPTUALFOUNDATIONS OF SCIENCE3 (1958).
7. I confine my analysis to federal doctrines of evidence for two reasons. First, a great many states
have adopted rules that are very close to the federal rules and routinely look to federal court decisions
under those rules as persuasive authority. Second, the philosophical issues I raise after discussing some
basic issues in the doctrines of evidence pertain to any system seeking to bring scientific expert information
into the legal decisionmaking process. Focusing on one more-or-less unified jurisdictional system serves
to make the philosophical discussion less abstract by showing how it relates directly to an existing set of
laws.
some overlap. One function, always served by judges, is to make decisions "as
a matter of law" regarding the interpretation and application of laws, including
laws of evidence.'4 The other function is that of factfinder. This is sometimes
performed by the judge without a jury and sometimes performed by the jury
under the close supervision of the judge-supervision itself guided by rules of
evidence and procedure. Factfinders, whether judges or juries, "find" facts that
are relevant to a case-the whos, whats, whens, wheres, and whys of a
litigated dispute. These are sometimes called "evidentiary facts." Factfinders
also make judgments about whether some legal predicate like "murder" or
"breach of contract" or "negligence" applies to the (evidentiary) facts in the
way the complaining litigant claims it does.15 These are judgments about
what are sometimes called "ultimate issues," or "ultimate facts," or "mixed
questions of law and fact." For example, the judgment about whether a person
was "unreasonably searched" under the Fourth Amendment might be broken
into a law component, namely, the meaning of "unreasonable search," and a
fact component, such as where the police were standing, where the citizen was
standing, etc. Perhaps the only real importance of the division of labor into
"lawfinding" and factfinding is that appellate courts are far more deferential
to decisions made by factfinders (whether judges or juries) than they are to the
"lawfinding" decisions of lower court judges. (The reason for this difference
in deference is simple and sensible. Appellate courts are not institutionally
designed to examine testimonial evidence and other kinds of evidence firsthand
and so are far less well-situated than factfinders to make an accurate factual
judgment in the face of competing factual claims.)
Judges have special and quite significant duties vis-a-vis factfinders with
respect to proffers of evidence. It is the judge who must make threshold
decisions about which evidence proffered by a litigant is admissible and which
is not.16 Decisions about admissibility are made as a matter of law and as
such are subject to review by an appellate court (though the review of this
judgment is more lenient, more deferential, than is the review of other legal
judgments, such as the interpretation of statutory, regulatory, or constitutional
provisions or of the jurisdiction's authoritative common law doctrines). The
factfinder is permitted to consider all and only that evidence that passes this
threshold test of admissibility. This is true even when the judge herself is the
factfinder; having ruled as a matter of law that evidence is not admissible, the
judge who is also a factfinder in the case is not permitted to consider it.
Admissibility and relevance are closely related. The Federal Rules of
Evidence, for example, make the relevance of proffered evidence a necessary
17. Rule 402 states in full: "All relevantevidence is admissible,except as otherwiseprovidedby the
Constitutionof the United States, by Act of Congress,by these rules, or by other rules prescribedby the
SupremeCourtpursuantto statutoryauthority.Evidence which is not relevantis not admissible."Id. 402.
18. Id. 401. Relevance is to be distinguishedfrom the burdenof proof, which is also often referred
to in probabilisticterms.The burdenof proof is the rule the factfinderuses in assessing whether,given all
the evidence that has been admitted,the complaininglitiganthas proven his assertions.
19. The modem, statutorilyenacted FederalRules of Evidence have eliminatedthe handy reference
to the distinctionbetweenmaterialityand relevancethatwas a centerpieceof the common law of evidence
(thoughthey fortunatelyhave not eliminatedthe effective legal significanceof the distinctionitself). In the
common law system, evidence was said to be "relevant"if it tendedto establishthe point for which it was
offered. It was "material"if the point for which the evidence was offered actually bore on issues in the
case. See CHRISTOPHER B. MUELLER& LAIRDC. KIRKPATRICK, EVIDENCEUNDERTHE RULES62 (2d ed.
1993). Under Rule 401, however, the requirementthat the fact proved must be "of consequence to the
determinationof the action,"FED.R. EvID.401, effectively assimilatesthe judgmentof materiality(in the
common law sense of the term) into the judgment of relevance. Thus, under the newer rules, a lawyer no
longer makes separate objections regarding the relevance (whether the proffered evidence tends to establish
the point for which it was offered) and materiality (whether the proffered evidence bears on issues in the
case). Instead, there is simply a uniform objection on grounds of irrelevance, which could really be either
an objection that the evidence is not relevant or that it is not material (in the common law senses of these
terms) or both. See John R. Schmertz, Relevancy Under 401: A Dual Concept, LITIGATION, Spring 1988,
at 12, 12. Because of this "underdeterminative" quality of the objection under the Federal Rules of
Evidence on grounds of irrelevance, it would be far more useful to maintain the old common law concepts
of materiality and relevance for both ease of reference and clarity and accuracy of evidential analysis. I use
the basic concepts of materiality and relevance (in their older, common law sense) to articulate the concept
of "rational pertinence." See infra Section V.B.
20. FED. R. EVID. 403.
21. The dispute began in the lower federal courts as an issue about the admissibility of plaintiff-
profferedexpert scientific evidence that the "morningsickness"drug Bendectincaused birthdefects. The
trial court denied the evidence's admissibilityfor failing to satisfy the Frye "generalacceptance"test for
the admissibility of novel scientific evidence and granted summary judgment for the defendant
pharmaceuticalcompany.See Daubertv. MerrellDow Pharms.,Inc., 727 F. Supp. 570, 575-76 (S.D. Cal.
1989), aff'd, 951 F.2d 1128 (9th Cir. 1991), vacated and remanded,509 U.S. 579 (1993). According to
the Frye test, a court should admit "experttestimonydeducedfrom a well-recognizedscientific principle
or discovery"only when "thething from which the deductionis made [is] sufficientlyestablishedto have
gained general acceptancein the particularfield in which it belongs."Frye v. United States, 293 F. 1013,
1014 (D.C. Cir. 1923). After the Ninth Circuitaffirmedthe lower court'sdecision in Daubert,the Supreme
Court grantedcertiorarion the question whetherthe FederalRules of Evidence, adoptedlong after Frye,
had in some way displacedthe Frye test. See Daubertv. MerrellDow Pharms.,Inc., 506 U.S. 914 (1992),
granting cert. to 951 F.2d 1128 (9th Cir. 1991).
22. The Rule reads:
Preliminaryquestionsconcerningthe qualificationof a person to be a witness, the existence of
a privilege, or the admissibilityof evidence shall be determinedby the court, subject to the
provisionsof subdivision(b) [pertainingto conditionaladmissions].In makingits determination
it is not bound by the rules of evidence except those with respectto privileges.
FED R. EVID. 104(a); see also CHRISTOPHER B. MUELLER& LAIRDC. KIRKPATRICK, EVIDENCE190 & n. 1
(1995).
23. Rule 201 reads in full: "A judicially noticed [adjudicative]fact must be one not subject to
reasonabledispute in thatit is either(1) generallyknown within the territorialjurisdictionof the trialcourt
or (2) capable of accurateand readydeterminationby resortto sources whose accuracycannot reasonably
be questioned."FED.R. EvID. 201(b).
24. See supra text accompanyingnote 18.
25. See supra note 17 and accompanyingtext.
26. See supra text accompanyingnote 20.
27. Rule 702 readsin full: "If scientific,technical,or otherspecializedknowledgewill assist the trier-
of-fact to understandthe evidence or to determinea fact in issue, a witness qualified as an expert by
knowledge, skill, experience, training, or education, may testify thereto in the form of an opinion or
otherwise."FED.R. EvID.702.
28. Rule 703 establishesthatexperts may rely on facts or data not themselvesadmissibleas evidence
"[i]f of a type reasonablyrelied upon by experts in the particularfield in formingopinions or inferences
upon the subject."Id. 703.
29. Rule 706 establishesthatthe court"mayappointany expert witnesses agreedupon by the parties,
and may appointexpertwitnesses of its own selection."Id. 706(a). Court-appointed expertsare then subject
to being called to testify by the court or by either party,and are subjectto cross examination.See id.
30. FED.R. Civ. P. 50(a) (providingfor directedverdicts).
31. Id. 56 (providingfor summaryjudgment).
43. Id.
44. Id. at 592.
45. Id. at 592-93.
46. Id. at 593.
47. See id.
48. See id.
49. See id. at 594.
50. See id.
51. Unlike the Frye Court,the DaubertCourtexpressly declined to limit its analysis to the admission
of novel scientific evidence, see id. at 592, althoughit did limit itself to Rule 702's "scientific"evidence
prong, see id. at 590 n.8.
52. See Frye v. United States, 293 F. 1013, 1014 (D.C. Cir. 1923).
53. See Daubert,509 U.S. at 591-95. The Courtassertedthat"[m]anyfactorswill bearon the inquiry,
and we do not presume to set out a definitivechecklist or test," id. at 593, and it expressly qualifiedeach
criterionlisted, see, e.g., id. (arguingthat "[o]rdinarily"a key question for determiningscientific validity
is "whetherit can be (and has been) tested");id. at 593-94 (describingpeer review and publicationas a
"pertinent"and "relevant,though not dispositive, consideration"nor the "sine qua non of admissibility");
id. at 594 (stating that "ordinarily"a court should consider the known or potential rate of error); id.
(maintainingthat "generalacceptance"can still have a bearingon the inquirysince "reliabilityassessment
does not require,althoughit does permit,explicit identificationof a relevantscientific communityand an
express determinationof a particulardegree of acceptancewithin that community"(citation omitted)).
various abstractions and the concepts used to express them, such as truth,
meaning, knowledge, justification, justice, good, bad, evil. That task typically
involves exploring the criteria that are characteristic of those concepts, and this
is precisely what the Daubert majority did in its discussion of the closely
related concepts of science and scientific knowledge. I say that the Court "set
itself' this philosophical task because engaging that task directly was not an
inevitable part of interpreting Rule 702. The Court noted, for example, that it
was interpreting Rule 702 and other "legislatively enacted Federal Rules of
Evidence as we would any statute.",54 Thus, in principle the Court could have
concluded that a particular conception of scientific knowledge-call it C-was
legally authoritative not because in the Court's view C was the correct
conception of science, but rather because in the Court's view C was the
conception of science the legislature that enacted the Rules of Evidence had
endorsed. In this way the Court would endorse a philosophical conception of
science only indirectly. Nevertheless, in order for a legal system to decide
whether certain evidence was "scientifically valid," some legal decisionmaker
along the chain of legal authority would have to undertake the philosophical
inquiry directly.
In any event, the Daubert Court appears to use a "plain meaning" method
of interpretation-hence its rather striking inquiry into the dictionary
definitions of 'knowledge'55 and 'scientific.'56 By relying so heavily on
dictionary definitions, the Court appears to have thought that its conception of
"scientific knowledge" was endorsed by the "plain meaning" of the (American)
English words 'scientific' and 'knowledge.' The decision to "look it up" might
seem incompatible with the idea that the Court was doing philosophy here at
all, but there is no necessary incompatibility between the claim that the Court's
inquiry is a philosophical one and its perhaps naive-seeming resort to the
dictionary. Investigation of ordinary meaning is by now one quite familiar
philosophical method, though, to be sure, that method can be executed with
lesser or greater skill, producing lesser or greater philosophical insights.57
That the Court pursued the distinctly philosophical task of explicating the
criteria of the concept of science also appears from its decision to take judicial
notice of works by philosophers in offering its analysis of scientific validity.58
The Court's effort to rely on work in philosophy of science raises the question
of how, from an epistemic point of view, nonscientific expert information does
and should enter into the legal system. Although I shall not argue the point
here, there is no reason in principle to think that philosophers do not have
"technical, or other specialized knowledge" that can "assist the trier of fact to
understand the evidence or to determine a fact in issue" so that they could
usefully and relevantly serve as "witness[es] qualified as . . . expert[s] by
knowledge, skill, experience, training, or education."59And this I think is so
even though philosophy should not be counted as a "science." Although cases
in which there has been actual testimony of this sort are hard to find,60it is
much less difficult to identify instances in which judges seem to be taking
judicial notice of many different types of philosophical work.6' What criteria
a court might use to regulate admission of expert philosophical work as either
testimonial or as judicially "noticed" evidence is an important subject that
Daubert expressly declines to address.62 But Daubert's reliance on
58. Thus, for example, the Court cited the works of Karl Popper and Carl Hempel to supportthe
propositionthat testabilityand falsifiabilityare characteristicof scientific method. See Daubert, 509 U.S.
at 593 (citing C. HEMPEL,PHILOSOPHYOF NATURALSCIENCE(1966); K. POPPER,CONJECTURESAND
REFUTATIONS: THE GROwTHOF SCIENTIFIC KNOWLEDGE (5th ed. 1989)).
59. FED. R. EVID.702.
60. Hard, but not impossible. For example, two philosophers,MarthaNussbaum and John Finnis,
recently testifiedat a trial in a case raisingvariouschallenges to a state referendumthat forbadeColorado
localities from enacting civil rights protectionsspecifically for homosexuals.See David Orgon Coolidge,
Same-SexMarriage?Baehrv. Miike and the Meaningof Marriage,38 S. TEx. L. REV.1, 119 n.87 (1997).
They testified partlyas experts on ancient Greek cultureand partlyas experts on the moral acceptability
of the referendum.See JohnM. Finnis,Law,Morality,and "SexualOrientation,"69 NOTREDAME L. REV.
1049, 1056-63 (1994); MarthaC. Nussbaum,Platonic Love and ColoradoLaw: The Relevanceof Ancient
GreekNorms to ModernSexual Controversies,80 VA. L. REV.1515, 1522-24 (1994). Deep questions,of
ancient provenance,remainabout this kind of testimony.The deepest and most enduring,perhaps,is one
that comes to us in Plato's thoroughgoingcondemnationof the sophists: Can philosophy maintain its
intellectualand epistemic integritywhen it enters the public political and legal forum?
61. See, e.g., United Statesv. CharlottesvilleRedevelopment& Hous. Auth.,718 F. Supp.461, 468-69
(W.D. Va. 1989) (holding thata public housing authority'stenantassignmentplan was race-consciousand
violated the Fair Housing Act). The court noted:
While the scope of this policy advancingintegrationmust be circumscribed,thatdoes not mean
that the legal principle of integrationgoes away, that CRHA'sduty to seek integrationfades
away, or that the legal value of integrationhas no force.
To utilize an analogy from moral philosophy,when one describes the conflict of moral
principles, it is not accurateto act as if the principle which has been overriddenevaporates
withoutresidue.A principle,even after being overridden,still has some force. It still leaves, in
one philosopher'slanguage,"moraltraces."
Id. (citing Robert Nozick, Moral Complicationsand Moral Structures,13 NAT.L.F. 1 (1968)); see also
American Home Prods. Corp. v. FTC, 695 F.2d 681, 689 (3d Cir. 1982) (using Paul Grice's framework
of conversationalimplicatureto describe a false advertisingclaim).
As ProfessorLawrenceLessig has recentlyemphasized,the SupremeCourt's landmarkdecision in
Erie R.R. v. Tompkins,304 U.S. 64 (1938), relies heavily on taking judicial notice of a change in the
philosophical conception of law from a natural law to a positivist conception. See Lawrence Lessig,
UnderstandingChangedReadings: Fidelity and Theory,47 STAN. L. REV.395, 432 (1995).
62. See Daubert, 509 U.S. at 590, 592.
Judge Kozinski, who wrote the opinion upon remand from the Supreme
Court in Daubert,67 put this question of institutional competence even more
63. The Court shows no awareness of post-positivistcritiques of Popper's falsifiability thesis, for
example. One of the most influentialof these critiques is W.V. QUINE, Two Dogmas of Empiricism,in
FROM A LOGICALPOINTOF VIEW: 9 LOGICO-PHILOSOPHICAL ESSAYS20 (2d ed. 1961).
64. Anthony Kenny may be correct that "[t]he difficulty of deciding in the courtroom whether
something is a science is not a difficulty which could be solved by admitting philosophers into the
courtroomas higherorderexperts,"AnthonyKenny,The Expertin Court,in THE IVORYTOWER:ESSAYS
IN PHILOSOPHY AND PUBLICPOLICY51 (1985), but surelythe admissionof such testimonycould help solve
the problem. Kenny also contends that "[t]he decision whethersomething is or is not a science is . .. a
matterfor philosophy,"and that, on the test Kenny offers for science, "[pihilosophyitself is clearly ...
no science [since it is] neitherconsistent, methodological,cumulative,or predictive."Id.
65. See HENRY M. HART & ALBERTM. SACKS, THE LEGAL PROCESS:BASIC PROBLEMSIN THE
MAKINGAND APPLICATION OF LAW (William N. Eskridge& Philip P. Frickeyeds., 1994).
66. Daubert, 509 U.S. at 600-01 (Rehnquist,C.J., concurringin part and dissentingin part).
67. See Daubert v. Merrell Dow Pharms.,Inc., 43 F.3d 1311 (9th Cir. 1995). Judge Kozinski also
pointedly:
These remarks, however, wholly fail to show how it is possible for a judge
to assess scientific validity (or for a factfinder to "adjudicate" competing
claims to scientific truth) in an epistemically justified manner. The Court
asserts that "vigorous cross-examination, presentation of contrary evidence, and
careful instruction on the burden of proof' are "appropriate" means for
"attacking shaky but admissible evidence." But if a judge or a jury does not
have the requisite scientific training, how can that judge or jury make a
69. I say "ex hypothesi"here because if the factfinderdid have thatexpertise,the evidence would not
be necessary and should thus probably be excluded under Rule 403. See FED. R. EVID. 403 (making
relevantevidence excludable "if its probativevalue is substantiallyoutweighed by ... considerationsof
undue delay, waste of time, or needless presentationof cumulativeevidence").Rule 702 also might afford
a groundfor excluding the evidence; for example, assumingthe law of thermodynamicswere relevantto
a case, and the trierof fact were a physicist, it would not "assistthe trierof fact"to have expert testimony
restatingthat law. See id. 702.
70. Daubert, 509 U.S. at 593.
71. Id. at 595-96.
72. Id. at 596.
Although the main Brown opinion does not expressly address the use by
courts of putatively scientific expert evidence (and although Brown was
decided long before the Federal Rules of Evidence were adopted in 197575),
the use of such information in Brown and subsequent cases decided in its wake
illustrates in a pointed way both the hazards and the vast importance of this
reasoning process.
The facts and basic legal conclusions of Brown are too well-known to
warrant recital here. What I shall focus on instead is the rather striking extent
to which, at least on the argumentative surface of the main Brown opinion, the
Court rested its holding on contested judgments of empirical social science. In
so doing, Brown served as a remarkable culmination of the legal realist project
of taming abstract legal propositions with the whip of social science-a
process that began in the modern Supreme Court with the Court's acceptance
of the "Brandeis brief' in Muller v. Oregon.76
73. Juristsconcerned with the rules and institutionsof expert evidence have long been wary of the
adversary system's capacity to produce truths. Professor John Langbein's skeptical inquiry is a fair
representationof this concern:
Wigmore's celebrated panegyric-that cross-examinationis "the greatest legal engine ever
invented for the discovery of truth"-is nothing more than an article of faith .... Judge
Frankelexplains why: "The litigator'sdevices, let us be clear, have utility in testing dishonest
witnesses, ferretingout falsehoods, and thus exposing the truth.But to a considerabledegree
these devices are like other potent weapons, equally lethal for heroes and villains." . . . In the
hands of many of its practitioners,cross-examinationis not only frequentlytruth-defeatingor
ineffectual, it is also tedious, repetitive,time-wasting,and insulting.
John H. Langbein, The GermanAdvantagein Civil Procedure,52 U. CHI.L. REV.823, 833 n.31 (1985)
(citations omitted).
74. 347 U.S. 483 (1954).
75. See An Act To EstablishRules of Evidence for CertainCourtsand Proceedings,Pub. L. No. 93-
595, ? 3, 88 Stat. 1926, 1926 (1975).
76. 208 U.S. 412 (1907). For a partial reprintand discussion of the brief, see JOHNMONAHAN &
LAURENSWALKER,SOCIALSCIENCEIN THELAW 187-90 (4th ed. 1998).
recordunchallengedas experts in their field, and I think we have arrivedat the stage where the courts do
give credence to the testimony of people who are experts in their fields." ARGUMENT:THE ORAL
ARGUMENTBEFORETHESUPREMECOURTIN BROWNv. BOARDOF EDUCATION OF TOPEKA, 1952-55, at 36,
37 (Leon Friedmaned., 1969) [hereinafterBROWNORAL ARGUMENT].
82. Paul Rosen characterizesit thus. See ROSEN, supra note 80, at 162. In the terms established by
the currentFederalRules of Evidence, this would be judicial notice of a "legislativefact,"and thus would
not be in any way regulatedby the rules. See FEDR. EVID.201(a) advisorycommittee'snote.
83. See supra note 81 and accompanyingtext.
84. 98 F. Supp. 529 (E.D.S.C. 1951), vacated, 342 U.S. 350 (1952). Briggs was the South Carolina
case in which the court upheld the constitutionalityof segregationand expressly refusedto overturnit on
the basis of testimonyby putativeeducationaland sociological experts.Like the othercompanioncases in
Brown, this court's treatmentof the expert evidence stands in instructivecontrastto the treatmentby the
Court in the Brown opinion:
We conclude, therefore,that if equal facilities are offered, segregationof the races in the public
schools as prescribedby the Constitutionand laws of South Carolinais not of itself violative
of the FourteenthAmendment.We think that this conclusion is supportedby overwhelming
authoritywhich we are not at liberty to disregardon the basis of theories advancedby a few
educatorsand sociologists. Even if we felt at libertyto disregardotherauthorities,we may not
ignore the unreverseddecisions of the SupremeCourtof the United States which are squarely
in point and conclusive of the question before us.
Id. at 536-37.
85. The Kansascase was Brownv. Board of Education,98 F. Supp. 797 (D. Kan. 1951). In thatcase,
the court admittedexpert testimony regardingthe psychological harm of public school segregation but
upheld the constitutionalityof segregation.See infra note 89 (noting the SupremeCourt'squotationof the
districtcourt's discussion of this testimony).
86. The Virginiacase was Davis v. CountySchool Board, 103 F. Supp. 337 (E.D. Va. 1952). That
court admittedconflictingexpert testimonyon the questionof the harmof segregationand decided it was
a toss-up on that evidence (so that, given the burdenof persuasion,the plaintiffs failed to establish the
proposition).The opinion provides a nice contrastto the use of social science evidence by the Supreme
Court in Brown, so I quote it at some length:
Eminenteducators,anthropologists,psychologistsand psychiatristsappearedfor the plaintiffs,
unanimously expressed dispraise of segregation in schools, and unequivocally testified the
opinion that such separation distorted the child's natural attitude, throttled his mental
development, especially the adolescent, and immeasurably abridged his educational
opportunities.For the defendants,equally distinguishedand qualifiededucationistsand leaders
in the other fields emphatically vouched the view that, given equivalent physical facilities,
offerings and instruction,the Negro would receive in a separateschool the same educational
opportunityas he would obtain in the classroomand on the campus of a mixed school. Each
witness offered cogent and appealinggroundsfor his conclusion.
On this fact issue the Court cannot say that the plaintiffs' evidence over-balancesthe
defendants'.But on the same presentationby the plaintiffsas just recited, Federalcourts have
rejected the proposition,in respect to elementaryand junior high schools, that the required
separationof the races is in law offensive to the Nationalstatutesand constitution.They have
refused to decree that segregationbe abolishedincontinently.We accept these decisions as apt
and able precedent.Indeed we might groundour conclusion on their opinions alone. But the
facts proved in our case, almost without division and perhaps peculiar here, so potently
demonstratewhy nullificationof the cited sections of the statutesand constitutionof Virginia
is not warranted,that they should speak our conclusion.
Id. at 338-39 (citation omitted).
87. See Belton v. Gebhart,87 A.2d 862 (Del. Ch. 1952); see infra note 89 (providingthe Supreme
Court'squotationfrom the Delawarecourt regardingthat court's assessmentof the expert testimony).
88. Note thatthe clearlyerroneousstandardof FED.R. Civ. P. 52(a) was in place at the time of Brown
and routinelyused in federal courts.
89. The Brown Courtreasoned:
To separate them from others of similar age and qualificationssolely because of their race
generatesa feeling of inferiorityas to their statusin the communitythatmay affect their hearts
and minds in a way unlikely ever to be undone. The effect of this separation on their
educationalopportunitieswas well stated by a finding in the Kansas case by a court which
neverthelessfelt compelled to rule againstthe Negro plaintiffs ....
Brown v. Board of Educ., 347 U.S. 483, 494 (1954). The Courtquoted,withoutcitation, the Kansascourt
as follows:
"Segregationof white and colored childrenin public schools has a detrimentaleffect upon tIhe
colored children.The impact is greaterwhen it has the sanction of the law; for the policy of
separatingthe races is usually interpretedas denotingthe inferiorityof the negrogroup.A sense
of inferiorityaffects the motivationof a child to learn. Segregationwith the sanction of law,
therefore,has a tendencyto [retard]the educationaland mentaldevelopmentof negro children
and to deprivethem of some of the benefitsthey would receive in a racial[ly]integratedschool
system."
Id. In addition, the Supreme Court added the following footnote: "A similar finding was made in the
Delaware case: 'I conclude from the testimonythat in our Delaware society, State-imposedsegregationin
education itself results in the Negro children, as a class, receiving educationalopportunitieswhich are
substantiallyinferior to those available to white children otherwise similarly situated."'Id. at 494 n.10
be found in the celebrated doll study, which the Brown opinion lists first in its
citation of "ample authorities" in footnote eleven.95 In that study, Kenneth
and Mamie Clark sought to measure the self-conception of two groups of black
schoolchildren, one attending integrated schools in the North, the other
attending segregated schools in the South.96 The Clarks asked the children
whether they liked to play with a brown doll or a white doll, which of the
dolls was the "nice doll," which was the doll that "looks bad," and which was
the doll that had a "nice color."97 What survives in the "popular"
understanding of this study among people familiar with the Brown opinion is
that this study showed that black children in segregated schools felt worse
about themselves, as measured by their responses to these questions, than did
the black children in integrated schools in the North. Some such finding, of
course, would be the principal relevance, if not the only relevance, of such a
study-and Kenneth Clark was the leading testimonial expert in many of the
cases leading to Brown. The actual result of the Clarks' research, however, was
quite different. Comparing the responses of black schoolchildren in segregated
southern schools to those of black schoolchildren in integrated northern
schools, the Clarks' study candidly stated:
Both Thurgood Marshall and Clark himself were aware of the problem that
this expert evidence posed for the legal argument about the psychological
harms of segregation.99 These results suggested not only that black
schoolchildren might not be psychically harmed by segregated schooling, but
that they might in fact be harmed by integrated schooling. Clark's own
explanation of this finding vis-a-vis his larger claim about the harm of
segregation was that it would be a mistake to conclude from his findings that
104. See Brown v. Board of Educ., 347 U.S. 483, 492-93 (1954).
105. See ROSEN, supra note 80, at 141-43.
106. See id. at 182-96.
107. Brown, 347 U.S. at 494-95.
108. See id. at 494 ("Whatevermay have been the extent of psychological knowledge at the time of
Plessy v. Ferguson, this finding is amply supportedby modem authority.").
109. 220 F. Supp. 667 (S.D. Ga. 1963), rev'd, 333 F.2d 55 (5th Cir. 1964), cert. denied, 379 U.S. 933
(1964).
110. After noting the Brown opinion's quotationfrom the Kansascourt, the districtjudge asserted:
These are facts, not law. To make these findings the Kansas District Judge considered
evidence-not cases. Whether Negroes in Kansas believed that separate schooling denoted
inferiority, whether a sense of inferiority affected their motivation to learn and whether
motivation to learn was increased or diminished by segregation was a question requiring
evidence for decision. That was as much a subjectof scientific inquiryas the brakingdistance
requiredto stop a two-ton truckmoving at ten miles an hour on dry concrete.
Again, the Supreme Court quoted the record that Negro children in Delaware were
"receivingeducationalopportunitieswhich are substantiallyinferiorto those availableto white
children otherwise similarly situated,"a statementwhich could only be of factual ratherthan
legal significance.
The SupremeCourtput at rest any residualquestionon the natureof its inquirywhen it
indicated its reliance on scientific information:"Whatevermay have been the extent of
psychological knowledge at the time of Plessy v. Ferguson,this findingis amply supportedby
modem authority."The teachings of psychology in 1896, in 1954, or in 1963 are inquiries
requiringevidence in the same sense as repeateddeterminationsof "seaworthiness."Actually,
the non-legal authorityto which the Courtreferredwas neithertestimonialnor documentaryin
characterbut came from a "Brandeis"-typebrief filed directly in the Supreme Court by the
National Association for the Advancementof Colored People.
Id. at 678 (citationsomitted).Althoughthe judge's characterizationof the factualand evidentiarybasis of
Brownseems fair, his analysis needs some such distinctionas thatbetween "legislative"and "adjudicative"
facts-a distinction that did not become common until 1975, when Rule 201 of the Federal Rules of
Evidence made it salient. See FED.R. EvID. 201(a) advisory committee'snote. Such a distinctionwould
have made his argumentfar less plausible,for it was the failureto distinguishthese types of facts thatgave
this stare decisis argument whatever superficial plausibility it had. Brown's holding rested on a finding not
of adjudicativefacts, but ratherof legislative facts. While it is true that adjudicativefacts cannot bind
nonparties, legislative facts are much more likely, as a matter of institutional practice, to do so, as Brown
itself shows. (Whetherand to whatextent a courtshouldbind otherpartiesto its findingsof legislative facts
is a separatequestion, a question on which Brownprovides no guidance.)
111. See Stell, 220 F. Supp. at 676-77.
112. Id. at 678.
present case as having somewhat stronger indicia of truth than that on which
the findings of potential injury were made in Brown."113
On appeal, the Fifth Circuit slapped down the lower court's procedural and
evidentiary insurrection."' One can well understand the likely urgency with
which that court, as the faithful agent of the Supreme Court, must have felt the
need to quell this kind of rebellion before it spread. But is there a principled
basis for the Brown Court to have created, as it apparently intended to create
and as courts like the Fifth Circuit clearly understood it to intend, what the
Stell district court aptly termed "a conclusive presumption of injury to Negro
students by reason of segregation"?"5 If the Court really wanted the
authority of science, was it not obliged, as a matter of principle, to allow
science to reach modest conclusions, tentatively held and ever open to revision,
that are among the most notable characteristics of empirical science-
characteristics probably even more important for social science than for natural
empirical science? By resting so heavily on empirical science, nay, on the least
stable kind of empirical science, the Court opened itself up to the charge of
fiat, of power, rather than reason, in shutting down efforts by the polity to
revisit the scientifically informed fact at issue."6 The very modesty of truly
scientific conclusions does not warrant so strong a result as the Court dictated
with its irrebuttable "inherently." Truly scientific results would seem not only
to permit, but also to invite, if not to require, fresh reexamination.
Many scholars have been distressed at the Court's use of factual evidence
in Brown. Some contend that the Court's decision to "constitutionalize" a
putatively scientific result is deeply problematic because "attaching
constitutional meaning to scientific opinion, even when scientists are in
consensus, condemns the Constitution to fluctuations in meaning as scientific
knowledge changes."117 That admonition is not wholly without merit, but it
is not easy to discern exactly what its merit is. Ronald Dworkin is also among
those who have worried about the relation between empirical judgment and
normative constitutional judgment, and his version of the concern is instructive.
His basic solution to the problem-in an argument that presages his later and
more expressly "hermeneutic" work-was to recharacterize the nature of the
evidence in Brown so that the necessary evidentiary judgment was not one of
science, but was rather an "interpretive" judgment that is presumably more
comfortably within the scope of judicial prowess. As Dworkin put it:
But even if Dworkin's and similar efforts cannot convert empirical questions
into (allegedly) nonempirical "interpretive" or "semiotic" ones, the concern
with "constitutionalizing" putatively scientific empirical results is a real one.
Let us come back directly to the closely related problems that are my chief
concerns in this Article, those of institutional competence and justified
epistemic deference-whether courts, using rules of evidence, procedure, and
other institutional and doctrinal devices, are competent to effect a transfer of
experts' justified beliefs to judges or juries in a way that is sufficiently
legitimate for legal decisionmaking.
Two questions present themselves about the Court's use of expert
information in Brown. First, did the Court really face no serious problem of
competing experts of the sort that threatens the legitimacy of nonexpert judge
and jury decisions under the Daubert regime? Second, is a nonexpert court
capable of discerning the degree of instability in a necessarily tentative
empirical finding-that is, the degree of epistemic repose that the finding
warrants12-and of discerning it sufficiently for the purpose of bringing
about the amount of legal repose that relevant scientific factual findings
warrant?'22
As to the first question, it may be that Brown lucked into a factual finding
that really was supported by the evidence and by the opinion of a majority of
reputable experts (presumably these are not wholly independent variables!),
despite the contrary evidence vigorously adduced by the lawyers in Stell. Such
a degree of support among those we take to be experts triggers in us what I
shall refer to as "the Frye response": If a critical mass of duly recognized
experts support a claim, that claim is very, very likely to be true. (Whether that
response is also epistemically warranted is the issue I take up in more detail
in a later discussion.123 It is crucial to keep in mind that truth alone is no
a Dworkin-like analysis of Brown. Perhaps what Brown was really addressing was whether there was a
"social meaning" of state-mandated segregation, and whether, if so, it created a psychological harm to black
schoolchildren. Dworkin's suggested answer to the first question is, yes, the social meaning was that of
"insult." But even through the "social meaning" lens, there are still fundamentally empirical questions, pace
Dworkin, to be asked about whether in fact a given act or gesture is insulting and stigmatizing, and even
if so, whether that insult or stigma in fact causes psychological harm. Thus, the social meaning
interpretation of Brown cannot obviate, and instead merely restates or relocates, the problem of how courts
can reliably acquire empirical information of this sort.
121. Daubert gives a nice example of what I am referring to here as epistemic repose:
[W]e do not read the requirements of Rule 702 to apply specially or exclusively to
unconventional evidence. Of course, well-established propositions are less likely to be
challenged than those that are novel, and they are more handily defended. Indeed, theories that
are so firmly established as to have attained the status of scientific law, such as the laws of
thermodynamics, properly are subject to judicial notice under Federal Rules of Evidence 201.
Daubert v. Merrell Dow Pharms. Inc., 509 U.S. 579, 593 n.l 1 (1993).
122. The "legal repose" at issue here is both internal to a particular case and external to it. Doctrines
like res judicata and the pragmatic relevance requirement of Federal Rule of Evidence 403 guide judges
in effecting repose within a case. See FED. R. EVID. 403. Judges' use of doctrines of stare decisis help
effect legal repose across cases.
123. See infra Section V.C.
guarantor of epistemic warrant.) But even if the Brown Court did luck into
such a finding, that is precisely the point: The Court lucked into it. It was not
for any skill on the part of the Court in sorting through dozens of studies,
many of which surely relied on statistical modeling and other complex
methodologies, that the Court was able to discern the truth of the psychological
claim. Nor is a court in general competent to do so. Thus, in many other cases
in which social-scientific evidence is relevant, perhaps nearly dispositive,
courts will be in the same position they are in with regard to results in the
hard sciences: placed at the mercy of competing experts. Indeed, other cases
in which psychological evidence is powerfully relevant, and which expose
courts' limited epistemic competence come readily to mind; consider the
increasing reliance by litigants on putatively expert testimony regarding various
syndromes, including post-traumatic stress disorder and battered woman or
battered child syndrome.'24
Consider now the second question, the question of how much legal repose
is warranted by the degree of epistemic repose in an empirical study. Courts
do not appear to be generally competent to make the subtle judgments required
to balance appropriately epistemic and legal repose. To make such judgments,
a court should be capable of assessing rationally the extent to which empirical
data support a conclusion, which would in turn require the judge (or judge plus
jury) to understand formal models, experimental design, and so on. The
epistemic problem presented by the questions of the proper degree of epistemic
and legal repose might even be framed as a problem of "diachronically"
competing experts.125 Even if most experts agree now, at what point in the
future should courts be open to challenges to what is now agreed? In a way,
that is the question that Stell posed to Brown, and neither the Fifth Circuit in
Stell nor the Supreme Court in Brown itself provided any guidance.
The real problem with cases like Brown, no less than in cases like (and
cases decided pursuant to) Daubert, is that scientifically nonexpert judges and
juries do not seem institutionally competent to assess expert scientific evidence
rationally. In a Daubert-type case, the main problem will be the battle of
experts that is waged before spectators who are for the most part not
competent even to understand, much less to apply in a nonarbitrary manner,
that intellectual contest's rules. In Brown, there are likely to be two significant
problems: the capacity of judges and juries to assess competing scientific
testimony, and the capacity of judges to decide, in a principled way, how to
balance the inherent instability of empirical results against the law's desire for
finality, repose, stability, and incremental and conservative evolution. As I
argue below in greater detail (but surely the claim, as vague as it is here, has
intuitive force), legal decisionmakers should make decisions that are not
Brown and Daubert are tips of the iceberg. Questions to which scientific
theories and methods are reasonably likely to have answers that are both
material and relevant (in the older common law sense)127 are raised in an
increasingly large percentage of cases at civil and criminal law. Among the
scientific theories and methods that have been prominent in litigation in recent
years, for example, are the use of genetic theories and laboratory methods to
assess "DNA fingerprint" evidence; findings by psychologists regarding the
veracity of eyewitness testimony; and complex medical and epidemiological
studies regarding the harm that food, drugs, and technologies have caused or
can cause.
Legal and political systems around the world cede legal decisionmaking
authority regarding such questions to scientifically nonexpert decisionmakers
(those who are largely untrained in any field of scientific research) to varying
degrees. Some systems, like that of the United States, give nonexperts the
ultimate say on a great many legal issues to which scientific information is
reasonably likely to be relevant and material. Several Continental systems are
far less inclined to give these science-imbued decisions to nonexperts.128
involving science and technology that are given to judges and juries in the United States, particularly in
torts cases.
129. See Daubert v. Merrell Dow Pharms., Inc., 509 U.S. 579 (1993).
For the purposes of my inquiry here, assume that there is a cogent and
important distinction between practical and theoretical reasoning. I rely on that
assumption to explore and explicate epistemic deference by legal reasoners to
scientific experts. I characterize these as distinct "points of view" and begin
by explaining what a "point of view" is and how I use the concept in my
analysis.
130. See OLIVER WENDELL HOLMES, ThePath of the Law, in COLLECTED LEGAL PAPERS 167,passim
(1920); see also William Twining, The Bad Man Revisited,58 CORNELLL. REV. 275 (1973).
131. See H.L.A. HART, THE CONCEPT OFLAW 89-91, 242-43, 254 (2d ed. 1994).
132. See JOSEPHRAZ, THE AUTHORITYOF LAW: ESSAYS ON LAW AND MORALITY137-45 (1979)
[hereinafterRAz, THE AUTHORITYOF LAW] (discussing Kelsen); JOSEPHRAZ, PRAcrICAL REASONAND
NORMS 170-77 (1975) [hereinafterRAZ, PRAcTICALREASON].
133. DWORKIN,supra note 3, at 14.
134. Id.
135. Id. at 255-56. Dworkin maintains:
Hardcases arise, for any judge, when his thresholdtest does not discriminatebetween two or
more interpretationsof some statute or line of cases. Then he must choose between eligible
interpretations by asking which shows the community's structure of institutions and
decisions-its public standardsas a whole-in a better light from the standpointof political
morality.His own moral and political convictions are now directly engaged.
Id. (emphasis added).
136. See ErnestJ. Weinrib,TheJurisprudenceof Legal Formalism,16 HARV. J.L. & PUB.POL'Y583,
passim (1993) [hereinafterWeinrib,Jurisprudenceof Legal Formalism];see also ErnestJ. Weinrib,Legal
Formalism: On the ImmanentRationalityof Law, 97 YALE L.J. 949 (1988).
Laurence Bonjour has argued the importance of identifying the epistemic point
of view, maintaining that "[t]he distinguishing characteristic of epistemic
143. See LARRY LAUDAN, SCIENCEAND VALUES: THE AIMS OF SCIENCEAND THEIR ROLE IN
SCIENTIFICDEBATE(1984).
144. Id. at 23.
145. See id.
146. Id.
147. See id.
148. See id. at 26. Thomas Kuhn identifies the following aims of scientific inquiry: accuracy
(deducibleconsequencesshould be in agreementwith experiments);consistency (both internallyand with
other currentlyaccepted theories); simplicity (the explanationshould presupposethe existence of fewer
ratherthan more entities);fruitfulness(disclose new phenomenaor previouslyunnotedrelationships);and
broadscope (consequencesshould extend beyond initial observations,laws, or subtheories).See THOMAS
S. KUHN, Objectivity, Value Judgment, and Theory Choice, in THE ESSENTIAL TENSION: SELECTED STUDIES
IN SCIENTIFICTRADITIONAND CHANGE320, 321-22 (1977). Quine and J.S. Ullian identify and describe
"five virtueswhich count towardplausibility,and which a hypothesismay enjoy in varyingdegrees."W.V.
QUINE & J.S. ULLIAN, THE WEB OF BELIEF43 (1970). These virtues are conservatism (the hypothesis
shouldconservepriorbeliefs because"[tgheplausibilityof a hypothesisvariesinverselywith the plausibility
of the prior beliefs that it disallows," id. at 44); generality ("[tihe plausibility of a hypothesis depends
largely on how compatiblethe hypothesisis with our being observersplaced at randomin the world,"id.);
simplicity (that,when choosing among hypothesesequalin all otherrespects,the moreplausiblehypothesis
is the simpler one, see id. at 45); refutability(a hypothesis neitherconfirms nor predicts anythingunless
"[slome imaginableevent, recognizableif it occurs . . . suffice[s] to refute it," id. at 50); and modesty (a
stronger "conservatism"demandingthat the less "extravagant"hypothesis be preferredto those that are
more so, other things being equal, id. at 51).
One might treat as axiological values (aims) the values that Kuhn,on the one hand, and Quine and
Ullian, on the other, identify, but one might also treat some of them as methodologicalrules (methods).
Laudanhimself does not drawa sharpline betweenmethodsand aims. See, e.g., LAUDAN, supra note 143,
at 31. One quite plausible explanationfor this is that no sharp line can be drawn between the concepts
such cognitive norms are often vague,149 they are not so vague as to be
without action-guiding or belief-guiding content.
Suffusing his discussion with examples from the history of science,
Laudan uses his tripartite model of scientific reasoning to argue against both
"arch-rationalist" and "arch-undeterminationist"philosophers of science. The
former are those who believe that there is "an algorithm or set of algorithms
which would permit any impartial observer to judge the degree to which a
certain body of data rendered different explanations of those data true or false,
probable or improbable."'50 The latter are those who believe that because
"we have no perfectly general logic of confirmation or comprehensive theory
of evidence," and because many scientific rules (methodological and
axiological) are vague or ambiguous or highly general, "the application of
shared scientific [methodological] rules or [axiological] values to a specific
choice situation will always be (or always has been) unavailing."'5' (Thomas
Kuhn is Laudan's chief target.)
Against the rationalists, Laudan advances several arguments and
observations (well known in the work of Norwood Hanson, Paul Feyerabend,
Quine, Kuhn, and others). For example, Laudan observes that methodological
rules, though shared by scientists, may still underdetermine preferences among
competing factual beliefs, and shared axiological goals may similarly
underdetermine a preference among competing methodological rules.
Furthermore, even among scientists who accept the same set of axiological
aims (e.g., coherence, simplicity, empirical accuracy), that set will
underdetermine a preference among competing methodological rules whenever
competing methodological rules promote or thwart different members of the
set of axiological goals in different ways. To choose among competing
methodological rules that satisfy some axiological goals but thwart others,
scientists must weigh those goals, and since they might weigh them differently,
even a shared bundle of goals may underdetermine the choice of
methodological rules. While he criticizes the rationalists, Laudan also deploys
"method"and "aim,"and that (as with all vague concepts) the line between them is to be drawnon the
basis of holistic considerations. Consistent with this explanation is the possibility that there is one
fundamentalaxiological aim that all other aims and methodssubserve.For science, a likely candidatefor
such an overall and overridingand supersedingaxiological norm is a norm of truthor accuracy,such as,
"Choose those aims, methods,and beliefs that are most likely to producetrue or accurateaccountsof the
world." Cf. BONJOUR,supra note 142, at 7 ("Whatmakes us cognitive beings at all is our capacity for
beliefs, and the goal of our distinctivelycognitive endeavorsis truth:we want our beliefs to correctlyand
accuratelydepict the world."). Note that if there were such a norm, it would play a structuralrole for
judgments of scientific validity analogous to the role that, on Kelsen's account, the Grundnormplays for
judgments of legal validity. See RAZ,THE AUTHORITYOF LAW,supra note 132, at 122-45 (discussing
Kelsen's "basic norm").
149. Every empirical concept is "open-textured,"i.e., has the possibility of being vague in some
particularcircumstance.See Brewer,supra note 15, at 993-96. If, with Quine, we abandonone of the two
dogmas of empiricism,we would acknowledgethat all concepts, even mathematicaland logical concepts,
are open-textured.See QUINE, supra note 63, at 43.
150. LAUDAN, supra note 143, at 5.
151. Id. at 32.
152. Loud analogiesto consensusand dissensusformationin both legal theoryand legal interpretation
ring in one's ears. Legal theoryhas certainlyhad its arch-rationalists(legal process theorists,perhaps,and
Dworkinians), its arch-underdeterminationists (some Realists, some Crits), and its Laudan-likecentrists
(such as H.L.A. Hart).
153. Id. at 29.
154. For example, in biology, the rules and evidence do not "establishthe unique correctnessof
evolutionarytheory,"but they do rule out several creationistclaims from the permissiblerealm "andthus
provide a warrantfor a rational preference for evolutionary over creationist biology." Id. Of course,
Laudan'sclaim here can be correctonly if thereis a "rational"way to delimit the theoriesthat are placed
"underactive consideration."Id.
155. See id. at 42-66. For an argumentthat instrumentalrationalitydoes not exhaust all types of
rationality, see ROBERTNOZICK,THE NATUREOF RATIONALITY
133-81 (1993).
156. See Brewer,supra note 15, at 938-39.
157. See LAUDAN, supra note 143, at 23-41.
reasoners) in turn guided by certain aims that aspire to bring "intellectual due
process" into the law.
170. Id.
171. See id. at 2-3.
172. See supra note 21.
173. Perhaps Rudner's scientist should defer epistemically to a moral theorist. There is reason to
believe that moral deference takes place-children surely rely on it, and religious adherentsprobablydo
as well. Indeed,the concepts of a "moralleader"and "moralauthority"are not at all alien to the discourse
of communalmoral life. In a well-knowndissent, JudgeFranksuggestedthat the properway for the court
to go about assessing whether an immigrant had "good moral character,"as required by a federal
immigrationstatute, was to ascertain"the attitudeof our ethical leaders,"an attitudethat "would not be
too difficult to learn."Repouille v. United States, 165 F.2d 152, 154 (2d Cir. 1947) (Frank,J., dissenting).
Interestingissues remainto be analyzed regardingthe kind of epistemic deferencethat could occur
in moral settings, and whetherand when such deferenceshould occur-"should" from both epistemic and
moral points of view. As mentioned above, there appear to be cases in which courts defer to moral
philosophers"as such." In Daubert, the SupremeCourtarguablydeferredepistemically to philosophers,
albeit not moral philosophers.See supra notes 58-60 and accompanyingtext.
the nonexpert is pursuing that has led him to turn to the expert in the first
place (my principal concern in this Article is with legal reasoning tasks); the
other is a line of reasoning about the methods and conclusions the expert
scientist reaches in his own reasoning process. Drawing on the distinction
between practical and theoretical reasoning will be of significant heuristic
value in the discussion that follows, for it will facilitate analysis of these
converging lines of reasoning in practical epistemic deference.
As heuristically useful as the practical-theoretical distinction will be, my
analysis of epistemic deference would survive with only minor changes even
if it turned out that the distinction is not, in the end, philosophically tenable.
The object of analysis as I frame it below-deference by a nonexpert practical
reasoner to a scientific theoretical expert (what I have been referring to with
the shorthand phrase "practical epistemic deference")-could very easily be
reframed to omit references to practical and theoretical reasoning while
retaining all of the epistemological consequences of the analysis. The same
question about the cogency of epistemic deference arises when the nonexpert
epistemic "deferer" is not a practical reasoner; that question is raised, for
example, when a nonmathematician decides whether he believes that Fermat's
Last Theorem has been proved after Andrew Wiles tells him that he has
proved it, shows him the proof, and so on.'77
The people who are the epistemic "deferers" and the people who are the
epistemic "deferees" can be more "generic" on both sides of the relation "A
defers epistemically to B" than they are in the special case that is my principal
focus: practical reasoners deferring to scientific experts. On the A side, the
deferer need not be a practical reasoner. Nor need the deferee on the B side be
a scientific expert; indeed, the deferee need not be an expert at all, at least in
a common sense of that term. We will want to understand what features the
epistemic deference relation has to understand better what is special about the
relation when there is a practical (legal) reasoner on the A side who, in the
course of practical reasoning, defers to a scientific expert on the B side. For
now, I offer some observations about the general concept of epistemic
deference and then build on them to note some features of epistemic deference
in the more specific setting of practical epistemic deference.
When there are no special constraints on either A or B in the relation "A
defers epistemically to B," the epistemological issue presented is whether
testimony can be a genuine source of either knowledge or justified belief. I
discuss below a few epistemological accounts of testimony as a general source
of knowledge.'78 For the moment, I focus not on the epistemic probity of
testimony in general, but on the distinct conceptual question of what exactly
it is for one person to defer epistemically to another. Again, answering that
177. For a discussion of Wiles's proof and the publicity it occasioned, see SINGH,supra note 1.
178. See infra Section V.B.
179. See H.L.A. HART, ESSAYS ON BENTHAM: STUDIES IN JURISPRUDENCE AND POLITICAL THEORY
(1982).
180. Id. at 261-62.
Tony Coady makes this distinction a prominent part of both his general
account of testimony, and his explication of the pragmatic conventions that
govern the "speech act of testifying."'85 According to Coady, there are three
individually necessary and jointly sufficient conditions under which speaker S's
statement that p constitutes the speech act of testifying:
181. THOMAS HOBBES, LEVIATHAN (1651), reprinted in 3 THE ENGLISH WORKS OF THOMAS HOBBES
OF MALMESBURY 1, 54 (Sir William Molesworthed., London,John Bohn 1839).
182. G.E.M. Anscombe, WhatIs It To Believe Someone?, in RATIONALITY AND RELIGIOUSBELIEF
141, 144 (C.F. Delaney ed., 1979).
183. Id. at 145.
184. Id. (emphasis added).
185. C.A.J. COADY, TESTIMONY:A PHILOSOPHICAL STUDY (1992).
186. Id. at 42.
does believe S's assertion that p, the hearer also believes p'87), and S's
assertion that p is distinct from p itself with regard to the probity of p.'88
There are various ways to establish the cogency of the distinction between
believing that p and believing S that p. One is to observe that in most cases in
which a speaker S testifies that p, p itself is (at the very least) unlikely to be
evidence of its own truth, whereas in many cases (when Coady's conditions
(2) and (3) are also satisfied, for example) S's testimony that p is evidence that
p. There are distinct reasons for this difference. One is the substantial difficulty
of identifying propositions that are self-evident, a difficulty that I shall not
rehearse here. Another reason, partly linguistic, partly epistemic, is as follows.
In thoroughly Gricean spirit, Coady's conditions (2) and (3) suggest that
testimony is not properly cooperative unless the witness has good reasons for
asserting p'89 and the testimony is relevant to and informative regarding
some inquiry or interest of the hearer.'90Thus, if we assume-as I do-that
Grice is correct in his view that speakers and hearers do by and large obey the
cooperative norms he identifies, the hearer should have some significant doubt
about the truth of p in the normal case of testimony (in which the speaker is
not, for example, trying to generate a conversational implicature). With less of
the supporting machinery, Hobbes put the same point more succinctly: "[N]o
man is a witness to him that already believeth, and therefore needs no witness;
but to him that deny or doubt, or have not heard it."'9' It is doubt about the
subject matter of proffered testimony that enables that testimony to be
cooperative-that is, doubt about p looks like a necessary condition (albeit a
defeasible one) of the cooperativeness of testimony that p. When that
necessary condition obtains, p should not constitute its own evidence.'92
Thus, believing that p is very different from believing a person's testimony
that p.
Though he does not discuss the point directly, Hart's account of epistemic
deference appears to recognize this distinction. It seems fairly presupposed by
his assertion that "the reason for belief constituted by a scientific authority's
statement [that some proposition p is true] is in a sense peremptory."'93Here
it is not just the proposition that constitutes the peremptory reason, but rather
the scientific authority's statement of it that does. Similarly, Hart maintains
that when the witness satisfies certain conditions of competence, it becomes
reasonable for a hearer to "accept the authoritative statement without...
independent investigation or evaluation of [the witness's] reasoning."'194 Here
again, though not quite explicitly, Hart seems to recognize the distinction
between accepting the statement that p and accepting the authoritative
statement that p, the latter of which plausibly carries with it the idea that p is
believed because it issues from this authoritative person.
197. See id. at 261 ("Itis also content-independentsince its statusas a reasonis not dependenton the
meaning of what is assertedso long as it falls within the area of his special expertise.").
recognizes to be the zone of A's expertise and assertions by A that are not
within that zone. These borderlines will inevitably be fuzzy. For example,
where exactly does the epistemic authority of a physicist end when he is
testifying to the nonexpert about the advisability of nuclear energy? Not
exactly anywhere. Even if such an expert is testifying as an "instrumentally
rational" expert, one who is using his expert knowledge to advise the
nonexpert about how best to achieve goals the nonexpert has chosen, the
nonexpert must be ever vigilant to keep the expert within his proper epistemic
domain. The price of rational deference is eternal vigilance.'98
Hart's all-or-nothing criterion is also too strong in that it would condemn
the concept of epistemic authority to overlook a flourishing practice of
epistemic deference among epistemic equals. This practice abounds, for
example, among scientists who work together on large research projects and
divide epistemic labor among themselves for the sake of efficiency, even when
they are epistemically capable of doing the work themselves. A related
phenomenon is the practice in the scientific community of scientists relying on
other scientists' results cumulatively. Cumulative reliance is at the very least
a familiar phenomenon within the scientific community, and some have even
argued that it is a necessary condition of scientificity.'99 Cumulative reliance
of this sort constitutes a type of epistemic deference that ought not to be
defined away.
Hart's account also seems unable to capture the phenomenon of
"persuasive authority"among what we might call epistemic "near-equals."This
is a common phenomenon in legal reasoning. A "persuasive authority"
functions to some degree as an epistemic authority even for decisionmakers
who are themselves substantially competent in the areas the persuasive
authority addresses. An eminent treatise writer might give a judge compelling
reason to believe that the law is as the writer claims. Such a writer's work will
often function as an epistemic authority for a judge, but it is not the case that
this work is "accepted as a reason for belief without independent investigation
198. Otherexamples come to mind. Whereexactly does the epistemic authorityof a psychologistend
when he is testifying about the degree to which a victim of battered-women'ssyndromewas responsible
for her actions?Where exactly does the epistemic authorityof a medical doctorend when she is advising
nonphysiciansat the Immigrationand NaturalizationService regardingwhethera homosexualalien should
be excluded from the United States under a statute that forbids immigrationto persons who have
"psychopathicpersonality,sexual deviation,or mentaldefect"?Hill v. INS, 714 F.2d 1470, 1475 (9th Cir.
1983) (quoting 8 U.S.C. ? 1182(a)(4) (1970)). These and many other adducibleexamples of the vague
bordersthat demarcatethe zone of the expert's special competence reveal that the content-independence
of a nonexpert'sreasonfor deferringcannotbe absolute.See id. ("Itwould thus violate Congress'direction
to allow INS officers who are not medicallytrainedto determinepsychopathicpersonality,sexual deviation,
or mental defect by interrogation.... Congress intendedthe determinationto be made solely by trained
physicians.").
199. Anthony Kenny suggests in his discussion of expert testimony in courts that the possibility of
cumulativereliancewithina putativescientificdisciplineis indeeda necessaryconditionof the discipline's
being a science. On Kenny's view, "thoughany expertmustbe able to repeatthe resultsof others he does
not have to: he can build on the foundationsthatothershave built."Kenny,supra note 64, at 50 (emphasis
added).
Having recognized that epistemic deference and epistemic authority are matters
of degree, I should also observe that by no means every instance of epistemic
deference raises the specific philosophical problem I have set out to explore.
That problem pertains only to the deference that a nonexpert gives to an
expert.
Although Hart clearly believes that justified epistemic deference by
nonexperts to experts ("theoretical authorities," in his terms)203is possible,
his account of epistemic authority and deference does not in any way explain
how it is possible. What it says, slightly rephrased, is that A is an expert if,
vis-a-vis the nonexpert, B, A has superior knowledge, intelligence, or wisdom
that makes it reasonable for B to believe that what A says on that subject is
200. Id.
201. Id.
202. Sometimes it will be vacuously true that B treatsA as an epistemic authority.For example, in
situationsin which B has not made any independentinvestigationon a given subject and A has, B could
judge thatA "has sufficient knowledge, intelligence,or wisdom which makes it reasonableto believe that
whatA says on that subjectis more likely to be truethanthe resultsreachedby B throughB's independent
investigations"-simply by virtue of the fact thatB made no independentinvestigationand plannednever
to make such investigation. Such a judgment by B may be vacuously true, but it would well be true
nevertheless. Despite the vacuity, it is useful to illustratethis possibility with a hypotheticalexample.
Suppose B, an experiencednutritionist,is hiredas a consultantfor C. A is a college studentwho works for
B. B has decided it would be useful, albeit not that importantin the long run, to determinehow many
calories, on an average daily basis, C consumedover a specified time. Both A and B have access to a list
of all the foods and quantitiesof food C consumedduringthattime. It could well be the case thatB treated
A as an epistemic authorityon the questionof C's daily averagecalorie consumption,underthe following
conditions:(1) A took the time to apply his perceptualand inferentialfaculties to the problemwhile B did
not; (2) B did not think it would be worthB's time to do so; even though (3) B also believed that had B
taken the time to do the calculation, he would have produced a more accurate one. (Thanks to Kent
Greenawaltfor useful discussion on this point.)
203. HART,supra note 179, at 261-62. I agree with Raz: "Nowadaysit is not the fashion to talk of
[theoretical]authorities.... Insteadwe have experts."RAZ,supra note 195, at 52.
more likely to be true than the results reached by B through his independent
investigations, so that it is reasonable for B to accept the authoritative
statement without such independent investigation or evaluation of A's
reasoning. Nothing in this definition says what criteria nonexperts are to use
to identify these epistemically superior beings, or whether, being nonexperts,
they can deploy any such criteria in an epistemically warranted manner.2'04
Thus, if Hart is correct in maintaining that his analysis provides an accurate
account of theoretical authority, we may conclude that such an account does
not by itself provide a philosophical explanation of how justified deference to
experts is possible. I am inclined to believe that, with suitably important
modifications, it is an accurate account.205
Building on the foregoing analysis of the structure of epistemic deference,
I offer the following definitions. Although I offer them as stipulated
definitions, I also aspire to have them capture, refer to, and felicitously
describe actual linguistic practice.
An expert is a person who has or is regarded as having specialized training
that yields sufficient epistemic competence to understand the aims, methods,
and results of an expert discipline.206An expert discipline is a discipline that
in fact requires specialized training in order for a person to attain sufficient
epistemic competence to understand its aims and methods, and to be able
critically to deploy those methods, in service of these aims, to produce the
judgments that issue from its distinctive point of view.207A nonexpert is a
person who does not in fact have the specialized training required to yield
sufficient epistemic competence to understand the aims, methods, and
judgments of an expert discipline, or to be able critically to deploy those
methods, in service of the discipline's aims, to produce the judgments that
issue from the discipline's distinctive point of view.
Expert and theoretical authority are different terms for the same kind of
person or group. In accord with the definition of 'expert' offered above, a
'theoretical authority' is a person or group of persons who has or is regarded
204. Note also that Hart's account does not make knowledge a necessary condition of epistemic
authority, only
superior knowledge, intelligence, or wisdom which makes it reasonable to believe that what he
says on that subject is more likely to be true than the results reached by others through their
independent investigations, so that it is reasonable for them to accept the authoritative statement
without such independent investigation or evaluation of his reasoning.
HART, supra note 179, at 262 (emphasis added).
205. Hart offers this as his account of both practical and theoretical authority, and shares with Raz the
basic explanation of the structure of authority.
206. Though I do not try to say it here, more could be said about what constitutes the kind of
"specialized training" that can yield epistemic competence in an expert discipline. For example, certain
kinds of experience, if properly reflected upon, might well provide the requisite "training," so that a
religious mystic might well be an expert on the beliefs and requirements of his religion even without having
what would conventionally be called "training." (Thanks to Kent Greenawalt for helpful discussion on this
point.)
207. See supra Section II.B (discussing axiology and point of view).
208. This particulartheoreticalpoint of view serves also as a practical one. Indeed, it may be a
distinctive feature of religious points of view that they tend to serve both functions. According to some
realist theoriesof moraljudgment,the moralpoint of view is also simultaneouslytheoreticaland practical.
Michael Moore construesRaz's conceptionof practicalauthorityto have this kind of realist dimension:
Why isn't practical authorityalways irrationaland thus always illegitimate in its apparent
requirementthat we act against(or at least not judge for ourselves)what the balanceof reasons
indicates we should do? Raz's answer is very attractive,given in terms of what he calls the
"service conception"of authority.As the name suggests, accordingto the service conception,
authoritiesare legitimate to the extent that they serve us. Authoritiesserve us wheneverthey
promulgatedirectives which, if we follow them, producebehaviorby us that betterconforms
to what we ought to do anyway (independentlyof any authoritativedirective)thanthe behavior
which would result if we calculateddirectly what we ought to do. This is an attractivenotion
of legitimate authority because it meets the irrationalityobjection head-on: authority is
legitimateonly when it is rationalnot to act on those reasonsthat would otherwise(withoutthe
authority)make it rationalfor us to do somethingelse.
The serviceconceptionof legitimatepracticalauthoritysoftensthe line betweentheoretical
and practicalauthority.If one grants that there is such a thing as knowledge about what, all
things considered,one ought to do, then anotherperson is a practicalauthorityfor us usually
when he is also a theoreticalauthority(aboutone area of knowledge,namely,about where the
balance of our reasons for action comes out). It is this greaterknowledge of the reasons that
antecedentlybind us that often gives someone legitimateauthorityover what we should do.
Michael S. Moore,Authority,Law,and RazianReasons,62 S. CAL. L. REv. 827, 830-31 (1989) (footnotes
omitted).
209. See supra Section II.B (discussing axiology and point of view).
210. See supra Section II.C (discussing Rudner).
211. Bonjour, for example, appears to emphasize truth in this way:
The distinguishing characteristic of epistemic justification is . .. its essential or internal relation
to the cognitive goal of truth. It follows that one's cognitive endeavors are epistemically
justified only if and to the extent that they are aimed at this goal, which means very roughly
that one accepts all and only those beliefs which one has good reason to think are true.
BONJOUR,supra note 142, at 8.
Burnyeat speaks of the philosopher who, like Plato, "wants ... to assimilate
knowledge to rational understanding."21 5 Though assimilating knowledge to
understanding or, perhaps even better yet, replacing the concept of knowledge
as the focal point of epistemology with the concept of understanding, has its
attractions,216 I have no ambition in the present work to take on so large a task.
My theoretical needs are far more modest, attempting to explicate only a notion
of epistemic competence that captures and helps to explain the nature of the
cognitive capacity involved in possessing scientific expertise. For that purpose,
the notion of understanding as the possession of a widening, explanatory,217
knowledge in the full sense, i.e. understanding,requiresthe synoptic grasp of a whole field.
Burnyeat,supra note 213, at 21.
218. The view of understandingas possession of a synoptic grasp of explanatoryrelations is not
uncommonamong philosopherswho explicitly discuss the concept. For example, Neil Cooperargues that
"understandingis concernedwith relationsand connections"and that "[i]t is possible to have knowledge
of a bitty or superficial kind, while we only have understandingwhen we relate or connect bits of
knowledge with other bits in a more or less coherent whole." Neil Cooper, Understanding,68 PROC.
ARISTOTELIAN Soc'Y SUPPLEMENT 1, 3-4 (1994). To like effect is CatherineElgin's moreambitiousproject
of articulatingan understanding-oriented, ratherthan a knowledge-oriented,epistemology:
'Understanding'is a bettertermfor the epistemicachievementthatconcernsus here. Not being
restrictedto facts, understandingis far more comprehensivethan knowledgeever hoped to be.
We understandrules and reasons,actions andpassions,objectionsand obstacles,techniquesand
tools, forms and functions and fictions, as well as facts. We also understand pictures, words,
equations, and patterns.Ordinarilythese are not isolated accomplishments;they coalesce into
an understanding of a subject, discipline, or field of study.... Understanding a particular fact
or finding, concept or value, technique or law is largely a matter of knowing where it fits and
how it functions in a matrix of commitments.
ELGIN, supra note 212, at 123.
219. See supra notes 143-158 and accompanying text.
220. See Brewer, supra note 15, at 962-78.
The nonexpert faces at least four distinct problems, which I will call
"selection problems." To explain them, I begin with a simple (and vague, but
226. I briefly pointed to this kind of competitionin the discussion of Brown.See supra Section I.C.
Is the Court really concerned with scientific knowledge? The Court does take
quite seriously the phrase 'scientific knowledge,' but it is clear on reflection
that this cannot quite be the same concept that has concerned traditional
epistemology-at least not those epistemological theories for which truth is a
necessary condition of knowledge. Although the Court and the traditional
epistemologist agree that "the word 'knowledge' connotes more than subjective
belief or unsupported speculation,"232it is obvious that, under the Court's
interpretation, Rule 702 does not presuppose that every expert is testifying to
the truth. Otherwise, the Court would not allow scientific experts to testify to
contrary or contradictory propositions.233 Instead, the Court offers a more
expansive explication of 'knowledge,' one that embraces "any body of known
facts or . .. any body of ideas inferred from such facts or accepted as truths
on good grounds.... Proposed testimony must be supported by appropriate
validation-i.e., 'good grounds,' based on what is known."234(The Court
also concludes that certainty is not a necessary condition of "scientific
knowledge.")235 In a nutshell, the concept of epistemic assessment with
which the Court is concerned when interpreting the term 'knowledge' and the
phrase 'scientific knowledge' is that of a judgment that is supported by good
reasons.
236. Brief for Respondentat 14-15, Daubert (No. 92-102) (emphasis added) (second alterationin
original). The brief adds the following footnote:
It is, of course, perfectlyconceivable for each of several competingscientific (or other expert)
claims to be validatedto the extent possible at any given time. The very reason that scientists
can disagree, and that scientific knowledge advances as it does, is that what is known at a
particularmoment does not uniquely predetermineall answers to new questions. Accepted
standards and available evidence thus may not rule out either of two competing, but
well-reasoned,conclusions. By the same token, however,they do rule out some answers.What
validationmeans, therefore-all it can mean, given the ever-evolving body of knowledge-is
good reasonfor acceptance as true, based on what is known at the time.
Id. at 15 n.8. To similar effect are several other passages in the brief. The brief asserts, for example, that
Rule 702 requiresthat "the specific testimonyof each experthave an adequatefoundation,judged by the
accepted standardsof the expert's field," id. at 12 (emphasisadded);that "lilt is the judge's fundamental
duty underthe Rules to screen evidence for admissibilityto ensure that the body of evidence provides a
rationally reliable basis for judgment," id. (emphasis added); that "by restrictingexpert testimony to
'scientific, technical, or other specialized knowledge [that]will assist the trierof fact,' Rule 702 demands
that an expert's testimony be well-groundedin the standardsgenerallyfollowed in his or her field for
validating-establishingthe truthof-assertionsof the type offered,"id. (emphasisadded) (quoting FED.R.
EvID. 702); and that "[t]hecritical term 'knowledge' demandsmore than individualbelief or speculation,
but instead refers to inferencesor assertions that are groundedin the standardsreliably used to support
such claims," id. at 14 (emphasisadded).
237. I pose this question, with a differentexample, at the beginning of the Article. See supra text
accompanyingnote 1.
that is the concept with which they should be concerned. Why the weaker
concept only? To anticipate later discussion, while it seems that science has
much of importance to tell the law about matters that are rationally pertinent
to a great many legal decisions, it is also clear that scientific truth is elusive.
That science is not an epistemic monolith or a univocal oracle is trite learning.
In a great many cases to which some particular angle of the scientific point of
view is rationally pertinent, and at every "level" of the scientific point of view
(axiological aims, methods, particular judgments), there is room for skilled,
learned, and reasonable scientists to disagree. Were a legal system to set its
rules of procedure and evidence-the rules guiding "legal epistemology"-so
as to insist on only knowledge (with truth as a necessary condition), the law
would vastly deprive itself of counsel it needs to make legal decisions
sufficiently epistemically legitimate to be legally legitimate. The law is wise
not to have its epistemic reach so far exceed its grasp. Justified belief is all it
does and all it should seek to have transmitted from the scientist-witness to the
nonexpert judge or jury.
But can even that more modest goal be achieved?
1. Testimony
Such an account has a ready explanation of both the reach and the limits
of credulity that one ought, from an epistemic point of view, to extend to
beliefs acquired from testimony: "[W]hen the fact attested is such a one as has
seldom fallen under our observation, here is a contest of two opposite
experiences, of which the one destroys the other as far as its force goes, and
the superior can only operate on the mind by the force which remains."245
Several contemporary philosophers have been attracted to accounts of the
epistemic integrity of testimony that have both elements of the Humean
account: empiricism and reductionism. W.V. Quine and J.S. Ullian, for
example, endorse an account not unlike Hume's, save for the particular
naturalistic and holistic flavor familiar from Quine's general epistemology:
Neither Quine and Ullian nor Hume explicitly addresses the question of expert
testimony. The difference between general testimony and scientific testimony
can be quite epistemically significant, especially for a Humean account
according to which the integrity of testimony depends on the hearer's ability
independently to confirm or disconfirm what he has been told (at least, in a
sufficiently large sample of cases). Simple, nontechnical (including
observational) reports are easiest for a nonexpert to confirm. A nonexpert
cannot independently and directly check complex theoretical propositions that
do not have simple observational consequences or whose observational
consequences themselves require complex training even to be recognized as
such. Whatever checking the nonexpert can manage must rely on indirect
devices like demeanor, credentials, and reputation.251
Elizabeth Fricker offers a sustained epistemology of testimony that
emphasizes the importance of a hearer's assessment of a witness's sincerity
and competence.252 Although she does not expressly discuss expert
testimony, her emphasis on epistemic competence is illuminating and helpful
here. The main relevant points of her account are these. First, it is important
to distinguish between global and local reductionism in accounts of testimony.
Global reductionism has two forms: (1) the thesis that it is possible to reduce
all testimonial KJB to more familiar, fundamental, and less problematic
epistemic sources and principles, such as perception, memory, and inference;
and (2) the distinct thesis that the epistemologist must make this reduction in
Fricker reveals just how weak she believes this presumption of competence is,
and perforce, how weak are the "conceptual" requirements that a hearer be
charitable toward testimony and testifiers whose competence may be presumed:
2. Expert Testimony
266. John Hardwig vigorously advances this point about the complexity of the testimony that we
intuitively believe produces KJB in hearers.See infra notes 273-285 and accompanyingtext (discussing
Hardwig'saccount).
267. Fricker,supra note 239, at 407.
268. Id.
269. See HILARYPUTNAM,The Meaning of "Meaning,"in 2 MIND, LANGUAGEAND REALITY215
(1975); John Hardwig,EpistemicDependence, 82 J. PHIL.335, 335 (1985).
270. See COADY,supra note 185; Kenny,supra note 64.
I find myself believing all sorts of things for which I do not possess
evidence: that smoking cigarettes causes lung cancer, . . . that mass
media threaten democracy, . . . that my irregular heart beat is
premature ventricular contraction, that students' grades are not
correlated with success in the nonacademic world.... The list of
things I believe, though I have no evidence for the truth of them is,
if not infinite, virtually endless. And I am finite. Though I can readily
imagine what I would have to do to obtain the evidence that would
support any one of my beliefs, I cannot imagine being able to do this
for all of my beliefs. I believe too much; there is too much relevant
evidence (much of it available only after extensive, specialized
training); intellect is too small and life is too short.273
274. Hardwig offers a nice example of (what he calls) epistemic dependenceamong physicists. See
id. at 346-47.
275. PUTNAM,supra note 269, at 227.
acknowledge the extent to which his own work rests on ... work which he
has not and could not . .. verify."280
There is much intuitive appeal in the collectivist view. It does seem that
nonexperts can, and do, acquire KJB concerning a great many propositions
about complex scientifically articulated subject matters whose warrant can be
ascertained only by the use of specialized tools that they do not possess and
cannot realistically acquire.28' But collectivist accounts like those sketched
by Hardwig and Putnam are just that-sketches-and they too (Hardwig's
most clearly) offer up epistemological pills that are hard to swallow. Basically,
Hardwig offers a collectivist argument that has the structure of a modus
tollens:
Is this argument compelling? Clearly Hardwig believes (as does Putnam) that
justified epistemic deference is possible. But Hardwig's modus tollens leans
very heavily on a parade of epistemic horribles: "If justified deference is not
possible, then see how irrational our culture would be!" Although such a
parade delights the skeptic and strikes fear in the heart of every epistemically
responsible citizen, modus tollens cannot suffice where explanation is lacking.
Aside from standing on some strong intuitions, for all Hardwig and Putnam
have explained, we have no less justification for running the inference this
way:
One philosopher's modus tollens, as the way would have it, is another's modus
ponens. Collectivist arguments like Hardwig's and Putnam's point to a
conclusion that seems compelling: In a complex society, the epistemic whole
280. Id.
281. See supra notes 272-274 and accompanyingtext. This is the intuitionto which I think Fricker
is insufficiently attentive.
is greater than the sum of its parts, and the collective as such can know, or at
least believe justifiably, far more than any member of the collective could
possibly know individually. They point to something we think is true,
something that many would like to believe is true, but without offering any
explanation of how it could be true. Yet it is precisely the account of how
collective knowing is possible that we seek to provide in our philosophical
explanation.282Without more, these collectivist theories do not provide the
necessary analysis.
To be sure, Hardwig's intuition that testimony on such matters does yield
KJB, even under his striking conditions of hearer incompetence, is compelling,
at least prima facie. But is Hardwig entitled, as a matter of epistemological
debate, to his modus tollens presumption, so that the burden of proof is on the
person who would deny that scientific testimony to a starkly incompetent
hearer (as Hardwig concedes many of us to be vis-a-vis the testimony we
receive) can yield KJB in that hearer? In my view, Hardwig is not entitled to
that presumption. Although the intuitions on which Hardwig leans so heavily
are somewhat compelling, we also have compelling experiential reason to
believe that a good deal of testimony, including testimony by experts, is false.
Surely Fricker and Quine and Ullian are on target in this respect. We have too
much evidence of incompetence, dissembling, and epistemically distorting bias
for the burden of argumentative proof to be set as Hardwig seems to claim.
We need not even enter the courtroom to flood ourselves with memorial
evidence of the "stern lesson" that "[p]eople disguise the truth in certain
situations, whether out of deviousness, self-deception, ignorance, or fear. They
also, of course, misremember, misjudge, and misreason."283
In any event, lest my specific focus here on expert scientific testimony
become lost in more general epistemological considerations, I leave my
reaction to collectivist accounts with this contention: Hardwig's modus tollens
can be of no help to a practical legal reasoner who is faced with actually
competing scientific experts.284 Short of making radical revisions to the
logical principles they are willing to accept, nonexperts cannot believe all
scientific experts when those experts testify in contradictory or contrary ways.
Other epistemological accounts of expert scientific testimony, specifically
those that focus on testimony in legal settings, either do not endorse, or at least
do not focus on, collectivist epistemic assumptions. Instead, their central
concern is the manner and setting in which expert testimony is presented to
282. Nozick offers an account of one mode of philosophicalexplanationas the explanationof the
possibility of some state (knowledge,justice, truth)in the face of other apparentlytrue propositionsthat
deny its possibility. See NOZICK,supra note 5, at 8-24.
283. QUINE& ULLIAN,supra note 148, at 37.
284. See supra text accompanyingnote 226 (discussing "actualcompetition").
285. Many of these accounts presuppose some kind of epistemic collectivism, or at least cohere better
with it than with individualism, for the reasons Hardwig highlights. See Hardwig, supra note 269.
286. See Kenny, supra note 64, at 49 (stating that "different experts must not regularly give conflicting
answers to questions which are central to their discipline" though there may be differences about borderline
cases).
287. See id. at 50 ("[T]here will be agreement about the appropriate procedures for gathering
information within the discipline. A procedure carried out by one expert to reach a particular conclusion
is one which must be capable of duplication by any other expert.").
288. See id. ("[T]hough any expert must be able to repeat the results of others he does not have to:
he can build up on foundations that others have built.").
289. See id. ("It need not necessarily predict the future (paleontology does not). But it must predict
the not yet known from the already known ...."). Note that both Kenny and the Daubert opinion articulate
four criteria of science, and they overlap fairly closely on three of them: testing, peer review, and general
acceptance. Kenny has no explicit version of the rate-of-error criterion the Supreme Court endorses.
Compare Daubert v. Merrell Dow Pharms., Inc., 509 U.S. 579, 594 (1993), with Kenny, supra note 64, at
49-50. Note also that Kenny offers his criteria as "four criteria which are necessary conditions for a
discipline to be scientific," Kenny, supra note 64, at 49, while the Court assiduously avoids treating any
of its factors as either necessary or sufficient conditions, see Daubert, 509 U.S. at 593.
290. Kenny, supra note 64, at 51-52.
291. Among evidence scholars, John Langbein articulates this position well:
At trial, the battle of experts tends to baffle the trier, especially in jury courts. If the experts do
not cancel each other out, the advantage is likely to be with the expert whose forensic skills are
the more enticing. The system invites abusive cross-examination. Since each expert is party-
selected and party-paid, he is vulnerable to attack on credibility regardless of the merits of his
of time and money, expert testimony ought to be an effort to discern the truth,
but that the adversary system overwhelms the effort.292This leads to his
principal recommendation:
like Kenny's would succeed only in relocating the competition among experts
from within the courtroom, where the question is either whose testimony to
admit and subsequently whose to credit among those whose testimony has
been admitted, to some antechamber in which the question will be who among
the competing experts is to be appointed to the external commission? What
criteria will be used to select them, and how could this credential advance the
process of reliable deference by a nonexpert to an expert? Without more, we
have no reason to believe that courts (or, for that matter, legislatures) are more
competent to make that judgment reliably than we have reason to believe that
judges and juries can reliably defer to experts inside the courtroom.
two reasons. One is that, on the model of epistemic deference developed earlier
in this Article,297 nothing in principle rules out epistemic deference from
epistemic equals or near-equals, so that nothing in principle prevents a suitably
epistemically qualified practical reasoner from second-guessing the expert on
the merits of his testimony. Such second-guessing does narrow the scope of the
deference as deference, but on my account, deference is a matter of degree and
not an all-or-nothing affair. Even so, considering this to be a mechanism of
practical epistemic deference is still odd, because my stipulated concern is
with the practical reasoner who is not epistemically competent in the scientific
subject matter about which the expert testifies, even though the practical
reasoner has decided that the subject matter of that testimony is rationally
pertinent to a case before him and that information from the expert in that
discipline is therefore worth hearing.
But there is a second reason for considering the "second-guessing" as an
option for even the nonexpert practical reasoner in evaluating expert testimony:
At least some prominent legal systems, including the American federal system,
seem to require it or at least come asymptotically close to doing so. That is,
they seem to require that the nonexpert judge select experts, "defer" to experts,
or choose among competing experts, on the basis of an epistemically
substantive judgment about the merits of an expert's proffered testimony.
The Supreme Court's Daubert opinion is a high-profile culprit here.
Simply put, it instructs judges to make their own independent judgment about
the scientific reliability of proffered expert scientific testimony. Recall that
Judge Kozinski was the appellate judge from whose court the Daubert case
went to the Supreme Court, and to whose court the case was remanded. His
words are worth repeating:
To be sure, the Supreme Court's Daubert opinion qualifies the task of the
judge with the declaration that
299. Daubert v. Merrell Dow Pharms., Inc., 509 U.S. 579, 594-95 (1993) (emphasis added) (footnote
omitted).
300. See supra notes 143-158 and accompanying text.
301. See, e.g., Zuchowicz v. United States, 870 F. Supp. 15 (D. Conn. 1994); see also Developments
in the Law-Confronting the New Challenges of Scientific Evidence, 108 HARV. L. REv. 1481, 1514 (1995)
(discussing Zuchowicz and its application of Daubert). Although this may be within the spirit of Daubert,
it is inconsistent with its letter, since Daubert expressly refused to make any one criterion of scientific
reliability necessary and expressly allowed that the Frye criterion was a permissible one. See supra note
51 and accompanying text.
302. 543 N.E.2d 1106 (Ill. App. Ct. 1989).
the time of the stabbing was attributable to the defendant's faking his
psychosis, that the defendant was "grossly psychotic" on the day of the
stabbing, that the defendant "was able to distinguish right from wrong and
could conform his conduct to the requirements of the law," and that the
defendant "was not mentally ill."303Reviewing this testimony, an Illinois
appellate court held that the doctor's self-contradictory statements did not
provide any evidence of the defendant's sanity.304
Self-contradiction in testimony, as in other assertions, is a hallmark of
rational incoherence. It is not the only kind, however. Consider, for example,
the events and legal proceedings leading to the Kentucky Supreme Court's
decision in Potter v. Eli Lilly & Co.305 Potter arose from a former
employee's shooting and killing or wounding of several of his coworkers. The
employee had been taking the antidepressant drug Prozac, and the victims or
their estates brought a products liability action against Eli Lilly, the drug's
manufacturer. The precise issue at the trial was whether Prozac was
unreasonably dangerous and defective and whether it caused the employee to
kill or injure the plaintiffs.306At trial there was a considerable amount of
expert testimony about whether Prozac caused the defendant to commit the
shootings. After hearing all the testimony, the jury decided for the
defendant.307
A person who is not an expert in medicine or psychopharmacology, and
who is called upon to assess expert testimony in a case like Potter, could, and
indeed should, heed the distinction between a drug's causing certain behavior
and that drug's not preventing that behavior, and impose a suitably heavy
burden of proof on any expert's argument that does not respect that distinction
or present an explanation in light of it.308Similarly, one need not be an
expert in psychiatry to discern the rational problem in the Palmer II expert's
self-contradictory testimony, and the nonexpert court in that case properly
discounted it severely. The avoidance of self-contradiction and the mindfulness
of the distinction between causation and nonprevention are two examples of
what we may call general canons of rational evidentiary support. One who is
not expert in a given discipline can sufficiently understand and use canons like
this to assess expert testimony in an expert discipline.309 It is beyond this
Article's scope to enter into detailed discussion of such canons, though such
a discussion would, I think, be of considerable interest and value. Here, it is
enough to identify the existence of such canons, with the two quick examples
presented above, and consider the extent to which such canons might enable
a nonexpert to evaluate expert testimony in a rationally cogent manner.
To answer that question, let us identify a spectrum along which there are
varying degrees of obscurity in failures of rational evidentiary support. The
obscurity of a message is in the ears of its hearer, and the obscurity with
which I am concerned here is the obscurity to a nonexpert of the failure of
rational coherence in an expert's testimony. At one end of the obscurity
spectrum are those failures that are least obscure and are therefore easiest for
a nonexpert to discern in an expert's testimony. At this end, or close to it,
would be the expert's testimony in Palmer II-assuming that the nonexperts
in that case readily understand (as they seem to) that a person cannot be both
"grossly psychotic" and "sane" at the same time. At the other end of the
spectrum are those failures that are most obscure, and are therefore hardest for
a nonexpert to spot in an expert's testimony. Much closer to this end would
be, for example, the testimony of Dr. Bruce Weir, a statistician and population
geneticist who served as a prosecution expert witness in the O.J. Simpson case.
In his original testimony, Weir gave the jury an analysis that failed to account
for certain DNA characteristics in crucial blood samples, characteristics that
were possibly but not definitely present in some of those samples.310 The
result of this error, as Weir later conceded under cross-examination, was that
his analysis of the probabilities that various combinations of randomly selected
individuals would have certain DNA types, was inaccurate and biased (in a
probabilistic sense) against the defendant.311It seems reasonable to regard
this failing of probabilistic statistical analysis as a failing in the rational
coherence of this expert's testimony, but it is a failing that would require a
good deal of sophistication in the expert's field to discern.
With the spectrum identified, we can assess the question: In what
percentage of cases is it likely that nonexperts will be able to evaluate
rationally expert testimony by deploying general canons of rational evidentiary
support? For at least three related reasons, I speculate (and do not claim
greater certainty) that it is only a relatively small percentage. First, it seems
likely that failures of rational coherence in an expert's testimony will most
often be closer to the obscure end of the spectrum than to the nonobscure end.
Palmer II seems the unusual case; Weir's testimony in the Simpson case, the
more usual. Second, and relatedly, many expert witnesses are repeat players
in the "game" of giving expert testimony. It would not take long for word to
get out to the trial bar about experts whose testimony has been so unartful as
to appear to a nonexpert, nonobscurely, insufficient to satisfy general canons
of rational evidentiary support. Indeed, one would hope that someone
"qualified as an expert" by a court would know enough about the substance of
her field not to render such testimony. Third, when the failure of the expert
testimony does occur toward the more obscure end of the spectrum, it is left
to a sufficiently tutored opposing counsel, perhaps aided by his own opposing
expert, to point out the failing to the jury; this is precisely what happened with
Weir's testimony. But the more obscure the expert's failure of rational
coherence, the more comprehension of the expert discipline one must have in
order to see that it is a failure. The nonexpert will thus be at a serious
epistemic disadvantage in discerning such failures. This problem will be
exacerbated in the many cases in which, unlike Weir, the expert denies that his
testimony suffered from any failure of rational coherence. In those cases, the
nonexpert will be little or no better off deploying general canons of rational
evidentiary support than he would be in trying to make a substantive
assessment of the expert's testimony. For, in such cases, it will be difficult for
the nonexpert to judge on the merits whether there really is a failure of rational
coherence, because it will require considerable information about the expert's
discipline even to know whether there was such a failure, and this is precisely
the kind of information the nonexpert is, by hypothesis, unlikely to have.312
312. In most of my analysis, I assume for the sake of argumentthatexpertsare sincere and testify in
good faith, but we should not wholly overlook those who are not. Considerthe following speech, by an
engineer who often served as an expert witness to other prospectiveexpert witnesses, showing them the
ropes:
The way I counteractedthe thing, I used anothertechnique.I used the techniqueas [sic] science
as a foreign language. I made a statement to the attorney that absolutely nobody could
understand.Now, what it amounts to, it's going to terminatethe cross-examination,and it's
going to terminateit in a hurry.
I want the jury to understandwhat I say when I feel there are certainconditions.Under
direct examination,the jury understandseverythingthat I say. Under cross-examination,there
are some things I will allow the jury to understandand there are some things which I will not
allow the jury to understand.
If you don't want the jury to understandsomething,then what you do is you answer the
question precisely, you see. If somebody is workingwith a form of inertia,why I use a form
of inertia. I say, "Do you mean the second bolt above the first bolt," you know. Just get into
something which is a very precise way of saying something.
The intervalof minus infinityto plus infinityof X times X, X2,and you know the-no one
is going to be able to do much with that kind of thing.
And he says, "Can you simplify it?" You say, "See, there's too much simplification
already.This is the only way that I can state it to you so there will be no misunderstanding."
Sanchez v. Black Bros. Co., 423 N.E.2d 1309, 1320 (III.App. Ct. 1981) (emphasisomitted) (determining
that a trial court's refusal, during cross-examinationof a manufacturer'sexpert witness, to permit
questioningabout this speech was reversibleerror).
You must recognize the jurors have prejudices, and you must try
to anticipate those prejudices ....
Some people may be geniuses, but because they lack training in
speech and theater, they have great difficulty conveying their message
to a jury.320
317. Notice that when the judgmentof the lawyer is also nonexpert,as it often is, the lawyer may not
even be in a good position to decide on substantivegroundswhich expertsare in fact competent.That is,
the lawyer's relativelack of epistemiccompetencecompoundsthe problemof possible divergencebetween
warrantedassertionand persuasiveness.
318. I draw on materialcollected in Samuel R. Gross, Expert Evidence, 1991 Wis. L. REv. 1113,
1126-36. Similar materialsare gatheredin Langbein,supra note 73, at 835-41.
319. Note, The Doctor in Court: Impartial Medical Testimony, 40 S. CAL. L. REv. 728, 728-29 (1967).
It is not clear whether the authors of the survey were attentive to lawyers' relative inability to judge the
epistemic merits of experts' testimony.
320. Hyman Hillenbrand, The Effective Use of Expert Witnesses, BRIEF, Fall 1987, at 48, 49 (emphasis
added).
321. Stephen E. Nagin, Economic Experts in Antitrust Cases, LITIGATION, Winter 1982, at 36, 37.
322. Thomas V. Harris, A Practitioner's Guide to the Management and Use of Expert Witnesses in
Washington Civil Litigation, 3 U. PUGETSOUND L. REv. 159, 161 (1979).
323. Albert Momjian, Preserving Your Witness's Stellar Testimony: How To Qualify Your Expert to
the Court, FAM. ADVOC., Summer 1983, at 8, 8.
324. Cf. supra Section IV.A (discussing understanding and epistemic competence).
325. Samuel Gross makes a related but slightly different point: "The confident expert witness is less
likely to have been chosen because she is right, than to have been chosen because she is confident whether
or not she is right." Gross, supra note 318, at 1134.
Regress can involve one or more of the selection problems, or one or more
of the competition problems identified in Section IV.C. Recall that the
selection problems are: (1) determining which of the intellectual enterprises
that might yield expert testimony is a science; (2) determining who is a
scientist capable of using her science in a manner that satisfies the standard of
epistemic appraisal and the attendant level of confidence that the practical
reasoner has established; (3) determining which of the intellectual enterprises
that might yield expert testimony is a science that is rationally pertinent to the
case; and (4) in cases in which there is significant doubt occasioned by task
(3), determining who is capable of answering (3) in a way that can identify an
expert scientific discipline capable of satisfying the chosen standard of
epistemic appraisal and the attendant level of confidence. For the purposes of
this discussion, it is not important to determine exactly which of these
selection problems the nonexpert faces, for the regress problem can arise
regarding each one (and several, though perhaps not all, combinations of
them).
The basic problem of competition is how a nonexpert can rationally decide
which of the competing experts (whose competition is intra-disciplinary or
extra-disciplinary, actual or implied) to believe when the nonexpert is not
competent to assess the substantive merits of the experts' competing
arguments. When experts testify to contrary or contradictory propositions, the
nonexpert must decide whom to believe on the scientific issue. But, ex
hypothesi, the nonexpert does not have sufficient competence in the expert
discipline to be able to make the choice on substantive grounds, so on what
rational basis can the nonexpert make that choice?
A solution to these related problems commonly offered by both jurists and
philosophers is to maintain that nonexperts can and do acquire KJB from
experts by relying on credentials. Kenny's solution to the problem of expert
Science is the only source of its own reliability. Anything less than
complete deference to the weight of credible scientific opinion
concerning the reliability of scientific evidence means going outside
science-to the judge or jury . . . to resolve a scientific dispute. The
resulting judgment cannot be scientific and therefore we cannot
honestly speak of the evidence as having "scientific" reliability....
These commentators argue that the more modest task that the credentialist
solution sets for judges331is much better suited to their limited capacities to
understand complex scientific evidence.332 Whereas Daubert requires courts
to judge whether some given evidence is scientifically reliable, what I call the
"Frye solution" is to have judges ask whether scientists think that the evidence
is reliable.
But which credentials indicate membership in the scientific community?
An Ed.D.? A Th.D.? A Ph.D. from a correspondence school? A degree in
"creation science"? Analogously, would a Ph.D. in philosophy from such an
unlikely place as the University of Pittsburgh333be worthy of respect were
one looking for philosophical expert testimony?334 Clearly, in an age in
which formal credentials have significant market value in many different kinds
of markets, the nonexpert needs guidance through the thicket of would-be
experts, wannabe experts, and magic elixir mongers. Here, a new solution
presents itself (actually, once again, it is the old solution relocated): Have the
nonexpert judge or jury consult some kind of "meta-expert" (someone who is
an expert about expertise in a given area) for a list or specification of the
credentials that a nonexpert could reliably use to pick out competent experts
in the scientific field. But then how can the nonexpert rationally identify the
proper "meta-experts"? On what basis is the nonexpert to identify those meta-
experts who have KJB about the proper credentials? Must not the nonexpert
rely on credentials (including reputation) to identify the appropriate meta-
experts as well?
Thus, it seems that the "Frye solution"-ask those with the credentials of
science whether an expert has the credentials of science-threatens to slide into
an epistemically unworkable regress. Using credentials only pushes the inquiry
back a step without resolving the basic problem. If nonexpert judges and juries
are not competent to judge the content of expert information, how are they
going to be competent to judge credentials of those who would give expert
information? If the answer is to ask credentialed "meta-experts" what the
proper credentials are, the regress has begun. Yet the "Frye solution," so
common in one form or another in analyses by jurists and philosophers, cannot
let the regress slide on infinitely if these analysts truly intend to explain how
the nonexpert's use of credentials can serve as a possible or actual means of
acquiring KJB from an expert. Nonexperts certainly cannot indefinitely
continue to ask expert after expert about proper credentials. Somehow, the
regress must be stopped.
Can the nonexpert stop the regress without vicious question begging? In
many-I do not say all-cases, credentials will be of little help, for they will
either reproduce the problem (leading to regress) or cause the nonexpert to
settle on one competing expert without having a good reason (thereby begging
the question). We have seen how the credentializing solution (like the Frye
solution) can lead to regress. Such a solution can also lead to question begging,
as the following example indicates.
McLean v. Arkansas Board of Education335was one of the early federal
creation science cases dealing with the constitutional merits of a statute that
mandated equal classroom time for evolution and "scientific creationism."
Relying on expert testimony, the district judge concluded that "scientific
creationism" could not pass muster under the Establishment Clause because it
335. 529 F. Supp. 1255 (E.D. Ark. 1982), aff'd, 723 F.2d 45 (8th Cir. 1983).
was not science but a religious doctrine that public schools could not
promulgate. But assuming that the judge was not an expert on science (or, for
that matter, philosophy or religion), whom should he have asked about the
identity of the appropriate scientific expert on whether creation science is real
science-a creation scientist or a Darwinian? Either answer begs the
question.336 Moreover, to make matters at the very least somewhat more
difficult for the nonexpert, "creation scientists" are quite careful to proclaim
their own credentials as scientists. Indeed, the very use of the terms 'creation
science' and 'Christian science' are efforts at establishing credentials. Philip
Kitcher criticizes creation scientists for just this kind of "credential
mongering":
One ought to concede to Kitcher that it would be far too quick a skepticism
to conclude from the possible fact of disagreement that no one can ever know
the truth of the matter or have decisively good reasons that overcome other
reasons, and I do not draw that conclusion here. That is, nothing in my
argument denies that there are good, or even decisive, arguments on such
questions as whether creation science is "real" science.
But my current concern is not whether there are compelling
arguments-expert arguments such as might be made by a philosopher of
336. Of course, there are versions of this dilemma that pit traditionalscience (the science of
"established"universitiesand learnedsocieties) against "nontraditional" science more directly.There are
cases in the Americancourts,for example,dealingwith the desireof ChristianScientistparentsnot to allow
their gravely ill childrento receive conventionalmedical care. See, e.g., Newmarkv. Williams, 588 A.2d
1108 (Del. 1990). These cases turnin parton whetherthe child is actuallyreceivingadequatemedicalcare.
Whom should the judge ask about whether ChristianScience healing methods have due regardfor the
traditionalmedical facts, or indeed whetherthe traditionalmedical facts are the only relevantfacts to be
known-the ChristianScientist or a memberof the traditionalmedical establishment?
337. PHILIPKITCHER,ABUSINGSCIENCE:THE CASE AGAINSTCREATIONISM 179 (1982).
338. Id.
339. HENRYM. MORRIS,THE REMARKABLE BIRTHOF PLANETEARTHat back cover (1972), quoted
in KITCHER,supra note 337, at 178-79.
340. See infra Part VII.
341. One example (and there are many like it) is found in the following case, which addressed the
same issue as in Daubert, namely whether Bendectin could cause birth defects:
Have the plaintiffs established by a preponderance of the evidence that ingestion of Bendectin
at therapeutic doses during the period of fetal organogenesis is a proximate cause [i.e. does it
in a natural and continuous sequence produce injuries that would not have otherwise occurred]
of human birth defects? . .. The jury unanimously answered no. Judge Rubin denied a post-trial
motion for j.n.o.v. by the plaintiffs because "[b]oth sides presented testimony of eminently
qualified and highly credible experts who differed in regard to the safety of Bendectin." The
great weight of scientific opinion, as is evidenced by the FDA committee results, sides with the
view that Bendectin use does not increase the risk of having a child with birth defects. Sailing
against the prevailing scientific breeze is the DeLucas' expert Dr. Alan Done, formerly a
Professor of Pharmacology and Pediatrics at Wayne State University School of Medicine, who
continues to hold fast to his position that Bendectin is a teratogen. In spite of his impressive
curriculum vitae, Dr. Done's opinion on this subject has been rejected as inadmissible by
several courts.
DeLuca v. Merrell Dow Pharms., Inc., 911 F.2d 941, 945-46 (3d Cir. 1990) (citations omitted). In a
footnote, the court added:
Dr. Done served as a Special Assistant to the Director for Pediatric Pharmacology of the FDA's
Bureau of Drugs from 1971 to 1975. In this role, Done aided in the provision "of FDA input
on research involving children and fetuses, and development of guidelines for pre-clinical safety
Earth Society phenomenon. Presumably the admission of crank science is, after
all, what Daubert seeks to reduce by having the trial court judge play a
"gatekeeping" role, using his assessment of scientific reliability as a criterion
of admissibility. The skeptic, however, will insist in response: But how often
can a nonexpert justifiably dismiss an expert's credentials as cranky? Even if
the nonexpert's use of credentials could help weed out cranks by weeding out
egregiously uncredentialed putative experts, in a great many cases the
credentials of experts will remain-to the eyes of the nonexpert-evenly
matched.
Let us suppose with the anti-skeptic that there is an epistemically valuable
role for credentials in a nonexpert's assessment of expert testimony. What
might that role be? Coady provides a modest and reasonable answer:
industry.
Id. at 644-45. This is perhapsanotherinstance in which the borderlinedemarcatingthe expert's zone of
competence is blurryand in need of policing. It is also relevantto the question of underdetermination
to
note thatthe Chaulkmajoritycharacterizedthe expertas "anengineerwith expertisein automobilesafety."
Id. at 642.
344. COADY, supra note 185, at 282.
found. In order for the nonexpert to find out which institutions were "leading"
in the proper way, she would have to find an expert already endorsed by one,
thus either begging the question or regressing. Another problem lingers even
after the credentialist solution. It is not clear how that purported solution can
handle cases of intra-disciplinary competition of credentialed experts. Such
competition occurs when two sets of witnesses who purport to be expert in the
same area (e.g., statistics, economics, genetics, epidemiology) and whose
credentials are evenly matched testify to contradictory or inconsistent
propositions. Nor is it clear how credentialism can handle cases of extra-
disciplinary competition of credentialed experts. This type of competition
occurs when two sets of witnesses who do not purport to be expert in the same
area, but whose credentials are evenly matched, offer testimony that is in some
way mutually undermining. Kenny provides a charming example, arguing that
the concept of the "irresistible impulse," brought into the criminal law by
expert psychiatric testimony, is philosophically incoherent and thus unworthy
of any serious credence in a courtroom:
The only remedy for this state of affairs will presumably be for the
prosecution to call a philosopher to testify that there cannot be any
such thing as an irresistible impulse, and therefore the accused cannot
have acted on one, any more than he can have murdered a married
bachelor or stolen a square circle. The desperate nature of this
proposal will, I hope, bring home vividly the indefensibility of the
present state of the law.348
belief. The way through this impasse, I suggest, is by studying with meticulous
care, and rationally reconstructing, the step-by-step reasoning process a
nonexpert judge or juror must use in order to assess expert scientific testimony
in the course of reaching a conclusion in a legal dispute. As we shall see, the
inference process known as abduction plays a critical role in that reasoning
process. And it is some crucial features of abductive inference that will lead
us out of the impasse I have identified. I turn, then, to present a model of the
reasoning process the nonexpert uses to assess expert testimony, explaining the
role of abduction along the way.
There are necessary limits to practical epistemic deference, even when the
nonexpert expressly seeks the guidance of the theoretical expert. The
explanation of "practical priority" in two premises of the standard practical
syllogism will bring out two of the most significant limits. According to a
standard model, adequate for my purposes here, the practical syllogism
Slightly less abstract, a typical "legal syllogism" has this idealized form:
350. The analysis of practicalreasoningcould become more complicatedthan the simple syllogism
in the text reflectswere one to reflectin the model of practicalreasoningthe complete structureof singular
propositions,Classical categoricalsyllogistic logic calls for special treatmentof singularpropositions(e.g.,
"Socratesis a man").On the one hand,as ImmanuelKantobserved,"Logiciansarejustifiedin saying that,
in the employment of judgments in syllogisms, singularjudgments can be treated like those that are
universal."IMMANUELKANT, CRITIQUEOF PURE REASON 107 (NormanKemp Smith trans., Macmillan
1965) (1781). On the other hand, such a treatment,while reflecting the universality of the singular
proposition (by treating the subject term as a unit class), runs the risk of overlooking the singular
proposition's existential import (i.e., the proposition'sassertion that the unit class is not empty). One
solution is to treatthe singularpropositionas the conjunctionof a universalaffirmative(e.g., "All men are
mortal") and a particular affirmative (e.g., "Some men are mortal"). See IRVINGM. CoPI & CARLCOHEN,
INTRODUCTION TO LOGIC 412-14 (9th ed. 1994).
Note also that,accordingto manyphilosophers,defeasibilityis a featureof every practicalsyllogism.
Although defeasibility is not reflected in the simple practicalsyllogism above, I do account for it in the
model of practicalepistemicdeferencepresentedbelow. See, e.g., infraSubsectionVI.C.3 (describingsteps
(7) and (8) in my model).
351. For discussionof this form of the practicalsyllogism (using an example very similarto this one),
see GEORGHENRIK VON WRIGHT, THE VARIETIES OF GOODNESS162 (1963). Other forms of the practical
syllogism are possible. See, e.g., ROBERTAUDI, PRACTICALREASONING17-24 (1989); RAZ,PRACTICAL
REASON, supra note 132, at 17-24; VON WRIGHT,supra, at 160-71. I believe, however, that this one will
suffice for my purposes here.
352. For example, in the syllogism above, premise (2) might be considered either theoretical or
prescriptive, depending on one's account of thick practical concepts. I am inclined to think that thick
practical propositions, like (2), contain two separable components, one prescriptive and one theoretical. That
(1) This jurisdiction must convict all and only the persons who
commit crime X (major premise).353
(2) Jones committed crime X (minor premise).
Therefore,
(3) This jurisdiction must convict Jones.354
debate,however,is beyondthe scope of this Article.For discussionof thick ethical concepts,see BERNARD
WILLIAMS, ETHICS AND THE LIMITS OF PHILOSOPHY128-31 (1985). With obvious minor changes,
Williams's account can be extended beyond the realm of ethics to that of practicalreasoninggenerally.
353. Obviously this is highly idealized. It is possible that there is no actual legal system that even
aspires to this degree of accuracy,much less one that achieves it. It is accepted,and probablyinevitable,
that rules of criminalsubstanceand procedureare both overinclusiveand underinclusive,as measuredby
their background justifications. See P.S. ATIYAH & ROBERTS. SUMMERS,FORM AND SUBSTANCEIN
ANGLO-AMERICANLAW: A COMPARATIVE STUDY OF LEGALREASONING,LEGALTHEORY,AND LEGAL
INSTITUTIONS70-95 (1987); FREDERICKSCHAUER, PLAYING BY THE RULES: A PHILOSOPHICAL
EXAMINATION OF RULE-BASEDDECISION-MAKING IN LAWAND IN LIFE31-34 (1991). In the United States,
when the crime in question is a capital crime, there is under Supreme Court doctrine a demand for
"heightenedreliability"in the process of assessing guilt and makingthe decision to mete out the "ultimate
punishment."But even heightenedreliabilityis not thoughtby advocatesof capitalpunishmentto require
absolute reliability in determiningwho actually committed a capital crime. Some of these advocates
acknowledgethatsome mistakeswill be made, with the resultthatthe state will execute (and has executed)
some innocentpeople. But, these advocatesargue,overinclusivenessand underinclusivenessis a necessary
featureof all rules, and capitalpunishmentis desirableenough that we should toleratethis slippage. Some
even argue for an analogy: The innocentexecuted are like civilian casualties in a "justwar."
354. I assume for the sake of argumenteither that the predicateof the crime (e.g., "murder")is not
a thick practical concept, or, if it is one, that it can be broken down into prescriptiveand descriptive
The warrant for premise (1) is practical, since it states a rule that prescribes
conduct, in this case, the conduct of the legal system in a given jurisdiction.
A proposition like (3) cannot be derived by valid rules of inference from a
proposition like (2) alone (at least when construing (2) as a descriptive
proposition355);some prescriptive proposition like (1) is needed to make the
inference to (3) valid. In this sense, (1), the major premise of this practical
syllogism, is logically prior to (2) in the resulting valid syllogism (although of
course the placement of (1) and (2) vis-A-vis each other in the set of premises
from which (3) is inferred is a matter of logical indifference). I have referred
to this phenomenon of the logic of practical reasoning as "major premise
practical priority," in which the practical major premise is logically prior to the
minor theoretical (descriptive) premise.
Now I want to focus on premise (2). I argue that when a theoretical
premise enters a practical syllogism of the sort previously illustrated (let us
call this the "primary argument"), it is always itself the conclusion of an
independent argument (let us call this the "secondary argument"). That is, (2)
serves double duty in a pair of nested syllogisms. At the "top" of that
independent, secondary argument is an additional practical premise. Put the
same point another way: Every theoretical premise in a primary practical
syllogism is, as it were, the conclusion of a secondary syllogism in which
there is also practical priority. This is the phenomenon I will refer to as "minor
premise practical priority."
Whether or not the practical reasoner is seeking to solicit instruction
from-and to defer epistemically to-a theoretical expert, this separate
syllogism is always enthymematically presupposed by the overall practical
syllogism. In most discussions of the practical syllogism, this separate
syllogism is left wholly enthymematic.356It is the separate argument that
requires several distinct but closely related judgments that the practical
reasoner must make in order to endorse as true the theoretical, descriptive
judgment that will serve as the minor premise of the primary syllogism. These
distinct judgments are reflected in the premises of the secondary argument,
which concludes with the theoretical judgment. Among these closely related
judgments reflected in the secondary argument, two are especially significant:
purposes (or other practical purposes). But here we must be careful, for some
of the "relativistic" theories, to which my own claim here might be likened,
are quite metaphysically suspect. Three more precise claims might be advanced
by the vaguer assertion that "facts are purpose-relative": (1) different facts are
salient from different points of view; (2) facts are actually different from
different points of view; and (3) from different points of view, different levels
of confidence (and possibly also different standards of epistemic appraisal) are
required to conclude that a putative fact is an actual fact.
Claim (1) seems uncontroversial and easily supported. I endorse it. Claim
(2) is fatally metaphysically suspect; it is far too idealist for comfort. Claim (3)
does not go nearly as far as (2) in the direction of questionable metaphysics,
but differs from and makes an epistemically more informative statement than
(1). It is all I will commit myself to here. Thus, taking advantage of the "point
of view" framework established earlier,362 it is in the sense expressed by (3)
that one should understand my point about the proceduralized caution of the
practical legal reasoner and my attendant claim that what the facts are from a
legal point of view is not necessarily what the facts are from a scientific point
of view.
Some legal reasoners are well aware, and as a whole there is in the legal
system increasing awareness, of the nature and importance of these different
points of view. A cogent articulation of this point is found, for example, in
DeLuca v. Merrell Dow Pharmaceuticals, Inc.363That case, decided by the
Third Circuit, dealt with the same issue treated in Daubert, namely whether the
"morning-after" drug Bendectin could have caused the plaintiff's birth defects.
The Third Circuit reversed a trial court judgment that expert testimony by a
well-credentialed epidemiologist was not admissible under the Federal Rules
of Evidence. Having discussed some of the basics of epidemiological analysis,
including the role of the "null hypothesis" in such research,3Mthe court
stated that on remand, the district court judge must keep in mind that the "fact
that a scientific community may require a particular level of assurance for its
own purposes before it will regard a null hypothesis as disproven does not
necessarily mean that expert opinion with somewhat less assurance is not
sufficiently reliable to be helpful in the context of civil litigation."365
Highlighting the difference between the level of epistemic confidence
required from a legal point of view and that required from a scientific point
purposes. Using that method, he could produce the individual judgment that
he ought to meet Williams for lunch. Given a different practical task, governed
and guided by different or additional practical norms, he might well have
concluded that this kind of testimony was not adequate for his purposes.
Consider now a different practical syllogism:
As with every practical syllogism, the major premise establishes criteria whose
satisfaction in a particular case (for a particular politician) it is the job of the
minor premise to ascertain; that is, it is up to the minor premise to feed into
the practical decision some relevant information about the world (information
made relevant by the major premise). Surely for such criteria as the practical
norm (1) establishes, a practical reasoner would want a better warranted
theoretical test than he would for a decision about whether to keep a promise
to meet a friend for lunch.37' That is, although the theoretical "testimony" of
everyday knowledge, the senses, and memory might be sufficiently warranted
for some practical purposes, it will not be adequate for every practical purpose.
Because every practical reasoner must decide the quantity or quality of warrant
that is practically necessary for his decision, even his assertion of a theoretical
premise depends on a practical decision about the quantity or quality of
warrant he needs. That is the feature of practical reasoning I am calling "minor
premise practical priority."The procedural mechanisms in the American courts,
some of them constitutionally grounded, exemplify minor premise practical
priority in the different "burdens of persuasion" that such rules establish for
criminal prosecution (the state must prove guilt "beyond a reasonable
doubt"372)and for civil suit (usually, the plaintiff must prove his claim by
a "preponderance of the evidence"373).
Presented schematically (and in the first person, though obviously it could
be easily adapted to second- or third-person assessments of practical duty), the
practical syllogism about promise keeping looks like this:
(1) All persons who have performed actions 'D have committed
actions 0.
(2) Williams performed actions (D.
Therefore,
(3) Williams has committed actions 0.
Propositions like those represented by the schema in (1) perform two "speech
act" functions. One is to offer stipulative definitional criteria (necessary or
sufficient conditions) for legal concepts; these stipulated criterial propositions
have the form, for actions (D and legal concepts 0, of "All instances of ( are
0," or "To be an instance of 0, an act must be (D," or "An act is an instance
of 0 if and only if it is an instance of (." Consider, for example, the
following criterial proposition, drawn from a state statute, which offers a
stipulative sufficient condition (i.e., the linguistic predicate for the actions ()
for "Driving with Excess Blood Alcohol content" (i.e., the linguistic predicate
for the legal concept 0): "It is unlawful and punishable as provided in ? 28-
692.01 for any person to drive or be in actual physical control of any vehicle
within this state while there is 0.10 or more alcohol concentration in the
person's blood or breath at the time of the alleged offense."374The second
"speech act" function of these stipulative criterial definitions is to give the
definition force of law; the statute begins with the words 'It is unlawful,'
words which have the same effect in context as if the statute had begun, 'It is
hereby declared unlawful.' Usually such definitions are accompanied by some
statement of or reference to the legal effect of performing actions 4; in the
proposition above, note the phrase "punishable as provided in ? 28-692.01."
Although the example above is from a criminal statute (which has since been
amended), the same basic framework of stipulated criterial definitions
mandated with force of law explains definitions in civil law. It also explains
such definitions as they are promulgated in administrative regulations and in
judicial decisions.
Stipulative criterial definitions like proposition (1) are practical legal
propositions375that link the performance of actions 'D to the commission of
actions described by legal concept &. They also serve as major premises in the
practical syllogisms that legal reasoners use to apply the defined legal concepts
to individual cases. My special concern is with instances in which the
nonexpert practical reasoner solicits evidence from a scientific expert in order
to adopt and endorse a minor premise in the practical syllogism. Continuing
the example of the stipulated definition of "Driving with Excess Blood Alcohol
Content," the syllogism fashioned by the practical nonexpert judge or jury
considering a case in which Williams, a defendant, was charged under this
statutory proposition is as follows:
374. ARIZ. REv. STAT. ANN. ? 28-692(B) (West 1989) (amended 1993).
375. On some positivist views, these are not practical but theoretical propositions. See supra note 3.
My analysis of epistemic deference and its rational structure does not depend on accepting or rejecting such
views. If legal propositions are theoretical, then what I am calling "minor premise practical priority" could
be reframed as something like "minor premise priority."
It is common for a jury or judge that is applying the legal concept specified
in the major premise, (1), to call on expert scientific testimony in order to
establish the minor premise, (2). As in the case law applying the variety of
"driving under the influence" provisions that appear in criminal statutes clearly
reflects, there are many ways in which expert scientific evidence can be both
relevant and material to the outcome of a case. Experts might be called upon
to determine the blood alcohol content of an arrested driver at some time after
arrest, or to establish what his blood alcohol content was at the time of arrest
based on an extrapolation from his blood alcohol content at the time of testing
(which is often more than an hour after arrest). Testimony on these issues
might also involve testimony about the scientific reliability of the methods
used to test blood alcohol content or to "relate back" the content at the time
of testing to the content at the time of arrest.376
In a case in which the nonexpert judge or jury solicits expert scientific
information in order to apply a legal concept like "driving with Excess Blood
Alcohol content," the nonexpert reasoner is seeking expert advice in order to
decide which minor premise to endorse-i.e., to determine whether to accept
or reject the prosecution contention that
376. To takejust one of (at least) hundredsof possible case law examples, in State ex rel. McDougall
v. Albrecht, 811 P.2d 791 (Ariz. Ct. App. 1991), the court held that a defendant'sfailure to pass field
sobrietytests, coupled with his speeding and failureto stop at a red light, providedsufficient evidence for
the admission of his blood alcohol level at the time of testing, which was significantlyafter the time of
arrest.This evidence was admissible,held the court, because the evidence of speeding, of failure to stop,
and of failure to pass field sobrietytests constitutedsufficientevidence for the expert to "relate. . . back"
the blood alcohol content at the time of testing to that at the time of arrest.Id. at 795. The court also
rejected some of the expert testimony in this case. The expert used evidence of the field sobriety test,
coupled with the evidence of the post-arrestblood alcohol content,to concludethattherewas a 67% chance
that Williams had a blood alcohol content greaterthan 0.10%. See id. at 793. Rejecting the admissibility
of this particularcalculation,based solely on the post-arrestblood alcohol content and the failure to pass
field sobriety tests, the court stated that the expert's "characterizationof the field sobriety tests was
misleading in that the jury may have given the tests undue significanceas scientific truths,when, in fact,
they measureonly gross neurologicalimpairment."Id. at 795-96. The court continued:"Wehave concern
about the misleadinginfluence [that]such speculativeconclusions unsupportedby controlledexperiments
may have on a jury."Id. at 796 (footnote omitted).
377. As I have already mentioned,this analysis applies just as well to "thick legal concepts" like
murderand reckless endangermentas it does to blood alcohol in excess of 0.10. For thick legal concepts,
the scientific expert testifies to the truthor falsity of the descriptiveevidence.
378. As noted supra Section LB, rules of evidence divide decisionmakinglabor between two types
of practical reasoner-judges and juries. The rules allow the judge to decide which experts, and which
information,is relevantto a given practicaldecision; the jury then hears from those experts that pass that
test. The jury then listens to the screened experts and decides to what extent to credit the testimony in
determiningwhetherthe defendant'sconductsatisfiedthe predicatein question(e.g., "murder").Sometimes
the judge himself is the factfinder,and so the same personperformsboth tasks; while this is quite rarein
381. To anchorthis abstractionwith an example, recall the case of McDougall, in which the Arizona
criminal court ruled inadmissiblethe scientific expert's testimony that there was a 67% chance that the
defendanthad been driving with a 0.10% blood alcohol content. The court stated:
A courtroomis not a researchlaboratory.The fate of a defendantin a criminal prosecution
should not hang on its ability to successfully rebutscientificevidence which bears an "auraof
special reliabilityand trustworthiness,"although,in realitythe witness is testifyingon the basis
of an unprovedhypothesisin an isolated experimentwhich has yet to gain generalacceptance
in the field.
McDougall, 811 P.2d at 796 (quotingUnited States v. Brown, 557 F.2d 541, 556 (6th Cir. 1977)). In the
terms of my analysis, the Arizonacourt decided that the scientific methodthe expert had used to arriveat
the 67% figure did not produce judgments that were epistemically satisfactoryfor the practical legal
purposeof effecting a just conviction of a criminaldefendant.I discuss the normativeconstraintsinvolved
in this kind of decision in PartVII.
use of the process, and not the process itself, to which the nonexpert
defers.382One could, I suppose, consider the overall process to include both
the scientific techniques deployed and the person deploying them, but keeping
them separate seems to allow for more targeted diagnoses of failures and
successes.
There are two distinct terms of epistemic valuation that must be carefully
distinguished in (1). One is what I shall refer to as the level of confidence,
labeled by the variable L to indicate that different practical reasoners will set
different required levels of confidence. The other is what I shall refer to as the
standard of epistemic appraisal, by whose metric the level of confidence is
measured. Because, as I will explain, different standards (and attendant levels
of confidence) are possible, practical reasoners must also choose one or
another from among the possibilities (in a moment, I explain why I refer here
to practical reasoners and not just to one practical reasoner). In step (1), the
practical reasoners must make a decision about, and adopt, both a standard of
epistemic appraisal and a level of confidence that is measured by that standard.
I refer to practical reasoners as the decisionmakers in step (1) because
here, as in other areas of legal epistemology, we must be sensitive to the
division of labor among legislature, judge, and jury. The practical reasoners
principally responsible for setting the standard of epistemic appraisal and level
of confidence are legal officials, like legislatures and judges. These officials
reflect their choices about standards of appraisal in rules of evidence and
procedure, jury instructions, and other such devices. Note, however, that
different jurisdictions, different courts within a jurisdiction, or even different
judges within the same court, will make different decisions on the issue. It is
in that way that a "choice" must be made among distinct "possible" standards
of epistemic appraisal.
In what sense must these practical authorities "choose" from among
different possible standards of epistemic appraisal, and in what sense are
several such standards "possible"? Here yet another distinction is important,
a distinction between two senses in which the practical authority might make
a commitment to a standard of epistemic appraisal (and corresponding level of
confidence).
One is a "thick" commitment to a deep epistemological theory-that is, a
full-blown theoretical commitment to the truth of a particular epistemological
theory. Such commitments are clearly made by some evidence scholars and
some judges regarding the question of how best to explain the kinds of
epistemic judgments that judges and juries make when they evaluate evidence.
The leading debate on this issue among evidence jurists is whether a
factfinder's judgments are best explained in probabilistic terms or instead in
382. See supra Section III.A (explaining the distinction between believing a person and believing a
proposition).
nonprobabilistic ones. The debate has tended to focus on the question of what
kind of reasoning process a juror or judge is using when she "weighs"
evidence and arrives at a belief on the basis of that weighing; is she
performing a probabilistic calculation (perhaps tacitly) or using some other
kind of rational cognitive processing? Evidential "probabilists" answer this
question in the affirmative.383This debate among evidence theorists parallels,
and often draws on, similar debates in general epistemology (where the
champions of probabilism are often found in the ranks of reliabilists)384and
philosophy of science. A "thick" theoretical commitment by a practical
reasoning authority to a probabilistic theory of evidential judgment can be
reflected in judicial and legislative rules of evidence and procedure, advisory
committee notes, and jury instructions, as well as in other ways. I shall play
out some of this debate with an example just below. First, however, I should
offer a word about the oddity or perhaps even the implausibility of claiming
that legal officials commit themselves and their jurisdictions to "thick"
epistemological theories concerning the nature of evidential assessment.
In this area of law, as in many others, there is an intellectual division of
labor between "high theory" workers and the appliers and administrators of
theory-motivated doctrines. The paradigm for this division of labor is the
common law itself. In that system, some judges, scholars, and lawyers take the
lead in organizing, systematizing, analyzing, rationalizing, and revising
doctrines and the theories that motivate them (e.g., theories of justice and
equity in contract, tort, constitutional, and property law; theories of mind and
motivation in the criminal law; economic theories throughout public and
private law). These are the Holmeses, the Cardozos, the Brandeises, the
Learned Hands, the Posners, and the Corbins, as well as innumerable scholars.
These jurists organize and reorganize whole lines of cases, propose values to
explain and criticize and motivate changes in common law doctrines. These
"high theory" jurists can indeed quite plausibly be seen as making thick
theoretical commitments to metaphysical and epistemological theories of the
sort seen in probabilistic accounts of factfinding judgments. But of course not
all jurists, and certainly not all judges, make or even attempt to make deep
theoretical commitments of this sort. Many defer epistemologically to their
high-theory brethren, administering doctrines articulated by the high theorists,
but without engaging in sophisticated high theory themselves. These judges
tend only to administer the doctrines that high theorists create for the law's
epistemology. They tend to make only the incremental changes that are
inevitable in the face of gaps, conflicts, and ambiguities that attend any system
of laws. Quite often they deploy the resources of analogy to make these
incremental changes, not least in using analogy-warranting rationales
383. Some of the classic argumentsin this debate are cited and discussed below. See infra note 385.
384. See, e.g., ALVIN I. GOLDMAN, EPISTEMOLOGY AND COGNITION (1986); NozICK, supra note 5.
385. I offer one version of an example familiarin the pro- and anti-probabilistliterature.In a seminal
article,LaurenceTribeoffers the "bluebus"hypotheticalto illustrateproblemswith probabilismin a civil
case. In this hypothetical,the plaintiff seeks recoveryafter being struckby a blue bus in a town in which
four-fifthsof the blue buses are operatedby the defendant.See LaurenceH. Tribe, Trialby Mathematics:
Precision and Ritual in the Legal Process, 84 HARv.L. REV. 1329, 1340-41 (1971). L. JonathanCohen
offers the "gate crasher"hypotheticalto raise some of the same issues. Suppose one thousandpeople are
seated in seats at the rodeo, but only 499 have paid. Payment was in cash, and there is no other proof
regardingwhetherany given individualpaid. Can the rodeo owner collect from (or win a civil or criminal
action against)a randomlychosen person?Can he collect againstevery personin the rodeo?Cohen argues
no. See L. JONATHAN COHEN, THE PROBABLE AND THE PROVABLE 75-81 (1977). CharlesNesson offers
a famous example in the criminalsetting. Suppose that in a prisonyard, thereis clear evidence that 24 out
of 25 prisonersparticipatedin the murderof a guard. There is no other evidence regardingany of the
individual prisoners. Can one prisoner of the 25, randomly chosen, be convicted of murder on this
evidence? Nesson argues no. See CharlesR. Nesson, ReasonableDoubt and Permissive Inferences: The
Valueof Complexity,92 HARV. L. REV. 1187, 1192-99 (1979).
Relying on the expert testimony, the jury finds the defendant liable.
This court (I assume) both "thickly" and "thinly" endorses a subjective
probabilistic interpretation of the "preponderance of the evidence" burden of
proof.387 On this interpretation, the burden of proof is measured by a
probability that reflects not the "objective" relative frequency of the event (the
fatal crash with this particular defendant's vehicle) in repeated trials-the crash
is, after all, a unique event. Instead, according to the subjective probabilistic
interpretation, a factfinder's judgment that a given factual claim is supported
by a preponderance of the evidence reflects a rational juror's willingness to
bet, given even odds, that the event was more likely to have occurred than not.
In the terms I offered above, subjective probability is the standard of epistemic
appraisal that the court has directed the jury to use. The jury's specified level
of confidence is greater than 50%. This example thus illustrates my claim
about the exact types of epistemic "decision" a practical reasoner must make
in step (1) of the overall process of deferring epistemically to a scientific
expert. The nonexpert practical reasoner must decide both what standard of
epistemic appraisal to use and what specific level of confidence, as measured
by that standard, is required for his practical purposes. In my example, the
judge, perhaps guided by a legislative rule, decides to use a subjective
probabilistic standard with a level of confidence of greater than 50%.
A jurist's adherence to a probabilistic explanation of burdens of proof can
lead that jurist (judge, legislator, or scholar) to adopt a probabilistic standard
of epistemic appraisal. As a "thick" theoretical explanation of long-existing
practice with burdens of proof in legal systems, the probabilistic explanation
does indeed have significant explanatory virtues. One of those virtues is its
capacity elegantly to account for the different burdens of proof that courts (and
legislatures) impose on plaintiff or prosecutor for different kinds of action.388
386. I have amalgamated this example of a jury instruction from CHARLES T. MCCORMICK,
MCCORMICK'SHANDBOOKOF THE LAW OF EVIDENCE794 (Edward W. Cleary ed., 2d ed. 1972); and
Davies v. Taylor, 1974 App. Cas. 207, 219 (Eng.).
387. Some "thickly theoretically" inclined courts do indeed view the preponderance of the evidence
standard this way. One British court, for example, asserted that "the concept of proof on balance of
probabilities, which can be restated as the burden of showing odds of at least 51 to 49 that such and such
has taken place or is so." Davies, 1974 App. Cas. at 219.
388. An official commission comment on the California rules of evidence discusses different burdens
of proof in this way:
Usually, the burden of proof requires a party to convince the trier of fact that the existence of
a particular fact is more probable than its nonexistence-a degree of proof usually described
389. Moss-Am., Inc. v. Fair Employment Practices Comm'n, 317 N.E.2d 343, 351 (Ill. App. Ct. 1974).
A similar standard of epistemic appraisal and level of confidence is used in Livanovitch v. Livanovitch, 131
A. 799 (Vt. 1926), in which an appellate court held that the trial court properly instructed the jury regarding
the requirements of the preponderance of evidence test with this charge: "If . .. you are more inclined to
believe from the evidence that he did so deliver the bonds to the defendant, even though your belief is only
the slightest degree greater than that he did not, your verdict should be for the plaintiff." Id. at 800.
One finds many similar statements by courts and other official bodies and
commentators.391Anti-probabilists maintain that even these apparently overt
references to probabilistic judgments are best interpreted as using the language
of probability to convey a nonprobabalistic concept. For example, Charles
Nesson (a leading anti-probabilist) argues that probabilistic terminology in
standards of proof are best understood as expressing political-moral ideals, not
mathematizable calculations:
One final note about step (1). The consequent of (1) speaks of judgments
true for given practical purposes. This phrase is best understood not as the
claim that facts are actually different from different points of view, but rather
as the claim that different points of view can require different levels of
confidence and different standards of epistemic appraisal to conclude that a
putative fact is a fact for the aims at hand. Premise (1) focuses on the
deferring practical reasoner's point of view.
Step (2) is a premise that unpacks the judgment that practical reasoners
implicitly make when they adjudge something to be true for their purposes.
Step (3) presents the principle that allows the practical reasoner to move, in the
inferential chain, from the conclusion that he ought to infer a judgment
(because it is the result of an expert's scientific process that satisfies L, the
level of confidence of the appropriate standard of epistemic appraisal that the
practical reasoner has specified) to the judgment itself. The judgment thus
inferred is in the right form to serve as the minor premise of the primary
practical syllogism. Because the inference of j from the conclusion that the
practical reasoner ought to inferj is so closely linked to the idea of truth for
given practical purposes, we might call this the "principle of practical purpose
rationality."
In step (4), the practical reasoner must assess whether the judgments that
the expert offers in testimony as the product of his scientific process, namely
P, satisfy the level of confidence that is referred to in step (1), namely L.
Again, the simple example is of a jury whose chosen standard of epistemic
appraisal is subjective probability, and whose chosen level of confidence is
greater than 50%. This practical reasoner looks to the expert to specify the
level of probabilistic confidence the evidence warrants. If that level is 40%,
then for that jury L is not satisfied. For any number greater than 50%, L would
be satisfied. Step (4) reflects a practical reasoner's judgment that L is satisfied.
The practical reasoner looks to the expert for statements that produce the
inference of step (5). In those statements, the expert tells the practical reasoner
that the expert's scientific process P-already adjudged in Step (1) to meet the
requirements of L-actually produces a given judgment. For example, the
expert might testify: "The method I used to relate back the data from the
defendant's blood alcohol level at the time of testing to his level at the time
of arrest shows that there was a 67% chance that he was driving with a 0.10%
level."393
Step (6) is true by (1), (4), and (5). Step (7) is true by (2) and (6). Step (8)
is a new premise. It reflects the fact that, in the setting of practical epistemic
393. For a brief discussion of a case in which an expert offered this testimony,see supra note 376.
(legal) point of view: the problem of selection of the particular expert and the
expert scientific discipline and the related problem of competition among
experts.
The problems of selection and competition are formidable, and one or
more of them is faced by every nonexpert reasoner who solicits scientific
information from experts. No model of the process of practical epistemic
deference can be adequate if it does not reflect the rational decision procedures
nonexperts use to resolve these problems. In this way, the model offered above
is deficient in its explanation. To remedy the deficiency, I must return to the
inference form of abduction and explain its crucial role in practical epistemic
deference.
Therefore,
where E)is some explanandum, cDsome explanatory hypothesis (that itself has
a conditional logical structure), and '4 -> e' the proposition that e would
follow from or be explained by 4 if indeed 4 were true or otherwise
adequately warranted. The assertion of 4 in the conclusion of an abduction
marks the fact that the rational abducing reasoner has settled tentatively on 4
397. Paul Thagardargues that abductionis betterunderstoodas an inferenceto the best explanation
of 9 by cDthan as an inference that 9 follows deductively from (D. See Paul R. Thagard,The Unity of
Peirce's Theoryof Hypothesis, 13 TRANSACriONS PEIRCE SOC'Y 112, 116-17 (1977). Thagard'sargument
is persuasive.Althoughin the text I sometimes treatabductiveinferencein the standardPeirceanmanner,
i.e., relying on a premise '( -> 9,' I do think the relationof ( and 9 is that the ( advancedis, in the
judgment of the abductivereasoner,the best availableexplanationof 9.
398. The following sums up in greaterschematic detail the two types of analogical rule abduction:
Wherey,, Y2,Y3, . .y.n are "target"items;x,, x2, x3, . . . x, are "source"items; F,, F2, F3, . . . F"are shared
characteristics;and H,, H2, H3, . . . Hn are inferredcharacteristics,the task of analogy-warrantingrule
abductionis to "discover,"for some items xi and yi, and some characteristicsFi and Hi, a rule of the form
"if thereis anything[in the jurisdiction]thathas F and also has H, then everything[in thejurisdiction]that
has F also has H"-when a premise stating"x is an F andx is an H" is partof the argument,this abduced
rule in turnentails a rule of the form "All F are H." Disanalogy-warranting rule abductioninvolves much
the same structure, with the following changes. In addition to target, source, shared, and inferred
characteristics,G,, G2, G3, . . . Gnare unsharedcharacteristicsthat the source item(s) has, but the target
item(s) does not. The task of disanalogy-warranting rule abductionis to "discover,"for some items xi and
yi, and some characteristicsFi, Gi, and Hi, a rule of the form "by itself, the presenceof F in an item is not
a sufficient condition of H, but the presence of F and not-G arejointly sufficient conditionsfor H." Note
that reasonersabduce disanalogy-warranting rules when there is some prima facie reason to believe that
the compareditems xi andyi do, by virtueof sharingcharacteristicsFi, also sharethe inferredcharacteristics
Hi, even though the reasoner's ultimate conclusion is that only x, and not also y, has the inferred
characteristic.See generally Brewer,supra note 15.
P
if T then (If P then Q)
Therefore,
T,
where T is a plausible theory of the case as well as a "valid" legal rule of the
jurisdiction, one that links the facts a plaintiff claims he can prove to a remedy
he desires in that jurisdiction; P is the set of facts the plaintiff thinks he can
prove (or the judge thinks the plaintiff might be able to prove); Q is the
remedy the plaintiff desires (or the judge thinks the plaintiff might desire). The
reasoner's task in legal rule abduction is to "abduce" the legal rule (the legal
theory, i.e., I) that makes "legal sense" of the facts of the case. As with all
401. An example will help. In Searightv. New Jersey,412 F. Supp.413 (D.N.J. 1976), a troubledman
went to court, representinghimself and complainingthat the state of New Jersey more than a dozen years
earlierinjectedhim with a radiumelectricbeam as the resultof which he heardvoices talkingto him inside
of his brain.He came into federalcourt,althoughit was doubtfulwhetherthe federalcourthadjurisdiction
over his case since therewas neitherclear federalquestionjurisdictionnor diversityjurisdiction.Moreover,
the state statuteof limitationson his tortclaim had run.Yet thereis a rule that requiresa judge to consider
all reasonable,plausible grounds for a cause of action before dismissing the claim. In effect, this rule
requiresthe judge to try to abduce the best legal rule thatmight be adducedto explain the facts of the case.
With a sneering tone unbefittinga judge, this federaljudge did indeed abduce several possible federal
questiontheoriesof recoveryfor the troubledplaintiff.The judge firstconsideredwhetherfederal statutory
civil rights law might afford him a remedy (no, because the plaintiff must first bring the action in state
court when it does not "riseto a constitutionallevel," and this case, in the judge's view, it did not so rise).
Here is the sneering part:The judge then concluded that the facts taken as true (the judge is requiredto
assume that the facts pleaded are true at this stage of litigation) show at most "unlicensed radio
transmission" by someone, id. at 414, but this was within the sole jurisdiction of the Federal
CommunicationsCommission,and so the case did, after all, have to be dismissed.
The judge's best effort to abduce a legal rule that would "explain"this litigant'scase from a legal
point of view in a way that would allow the case to proceed failed to produce such an explanation.In
schematicform, the abductionin Searightlooks like this: Plaintiffclaims P, that while he was in custody,
defendant injected him with a radiumbeam, that this was unlawful under some relevant overall legal
theory, T, and consequentlegal rule, If P then Q (that is, the plaintiffclaims that a valid legal rule in the
jurisdiction is one of the form T, -> (P -> Q), and that the judge's abductivetask is to try to discover
whetherthere really is such a rule in the jurisdiction);and that he was therebyentitled to legal remedy Q,
i.e., money damages of $12 million. The judge's abductive task is to discover, if possible, some legal
theory and correspondingrule that might yield a remedy.Two "abduced"candidatesfor testing:(1) (T. -4
(P -4 Q?)); (2) (T2 -+ (P -+ Q?)); where T, = violation of civil rights law; and T2= violation of FCC
regulations.The judge then works to confirmor disconfirmP-and in this case disconfirmseach candidate
T, and T2.
402. Brown v. Board of Educ., 347 U.S. 483 (1954).
403. See supra Section I.B.
Equal Protection Clause and its attendant doctrines (often the abduction of
legal rules requires the court to resolve vagueness, and often vagueness is
resolved by the use of exemplary reasoning),4'04the Court granted the
plaintiff the remedy sought.405 In the underlying Daubert case,40 the
factfinder (ultimately, the Ninth Circuit Court of Appeals) abduced a factual
explanatory hypothesis regarding the existence of the plaintiff's birth defects.
Having abduced the factual explanation that the defendant's drug caused that
injury, but then having disconfirmed that explanation, the court applied the tort
law (products liability law) it had already discerned and confirmed in legal rule
abduction to give the defendant the victory.407In both Brown and the Ninth
Circuit's final Daubert opinion, the factfinder turned to scientific experts to
abduce explanations of the facts alleged in the complaint.408
Recall that I came back to the topic of abduction having reached an
impasse in thinking about how the nonexpert practical reasoner can go about
resolving selection, competition, and underdetermination problems in a
legitimate manner, when it seems that such resolution can be achieved only by
a reasoner who has the degree of epistemic competence that a nonexpert, ex
hypothesi, does not have.409How can abduction help us here? In the main,
it will help by revealing to a greater level of analytical detail than the
oversimplified model offered in Section VI.C just what it is that the nonexpert
reasoner must do to perform selection tasks in the face of competition by the
experts.
Abduction guides practical epistemic deference in several interconnected
ways. The judge must first abduce and confirm that there is a legal theory
valid in the jurisdiction that could give the complainant the remedy desired if
the complainant can prove the facts asserted. The reasoner (judge or judge plus
jury) must then hear the proof of the facts and decide whether the facts are as
alleged. This task, as argued in the previous section, requires that the reasoner
both abduce and then confirm or disconfirm an explanation of the facts from
a legal point of view. Sometimes this leads the practical reasoner to consult a
scientific expert, depending on the nature of the theory of the case the lawyers
and the judge have already abduced using legal rule abduction.
404. In the context of legal reasoning,analogy-warrantingrule abductionis a special type of legal rule
abduction.
405. See Brown, 347 U.S. at 495.
406. Daubertv. MerrellDow Pharms.,Inc., 727 F. Supp. 570 (S.D. Cal. 1989).
407. See supra Section I.B.
408. The process by which this scientific informationis absorbedinto the practicalreasoner'soverall
reasoning, which I have called "minor premise practical priority,"is outlined supra Section VI.B. It
involves the practicalreasoner(court or legislature,sometimes dividing labor with a jury) adoptingsome
standardof epistemic appraisal,some attendantlevel of confidence, and then relying on it in soliciting
expert information from scientific experts whose disciplines the practical reasoner has judged to be
rationallypertinentto the case at hand.
409. See supra Section V.D.
Most of the reasons for the additional components of (1) are offered in the
discussion just above it. One point worth mentioning here is that the judgment
in (1)(c) reflects an understanding of abductive inference as an inference
among live competitor explanations. This is perhaps implicit in the original
Peircean formulation, but it becomes more explicit-and rightly so-in recent
treatments.410The abductive model offered in the artificial intelligence work
done by John Josephson, for example, expressly treats abductive inference as
a choice among competing explanations:
410. Thagard'sargumentis much to the same effect. See Thagard,supra note 397.
Josephson's criteria (4) and (6) cohere especially well with observations
and arguments I have made throughout this Article. Criterion (4) reflects the
importance within the theory of abductive inference of recognizing what I have
referred to as implied competition. It is especially useful to keep implied
competition in mind as we seek to explain and understand practical epistemic
deference, since the practical reasoner cannot make a cogent judgment simply
by confining her judgment to the experts that the lawyers happen to offer.
Though this is a tricky matter, I am strongly inclined to the view that rational
abductive inference requires that the reasoner make some judgment about other
expert (or nonexpert) disciplines that might offer superior competing
explanatory accounts of the data.
Criterion (5) calls attention to the importance of setting a level of
confidence that is appropriate to the type of case presented.413Josephson's
model is also friendly to my contention that nonprobabilistic standards of
414. He writes:
It has been suggested that we should use mathematicalprobabilitiesto help us choose
among explanatoryhypotheses .... If suitable knowledge of probabilitiesis available, the
mathematical theory of probabilitiescan, in principle, guide our abductive evaluation of
explanatoryhypotheses to determinewhich is best. However, in practice it seems that rough
qualitativeconfidence levels on the hypothesesare enough to supportabductions,which then
produce rough qualitative confidence levels for their conclusions .... [Flor the most part
numericalconfidenceestimatesare unavailableand unnecessaryfor reasoning.People are good
abductivereasonerswithoutclose estimates of confidence.
Josephson,supra note 411, at 26-27.
tasks in a manner that is legitimate from the practical point of view of the
legal system.
To articulate that doubt, three steps remain for this Article. First, I
conclude my earlier discussion of the problems of selection and competition
by bringing this more complex model to bear on it. Second, I show that, on
balance, we have strong reason to doubt that the judgments made in steps (1)
and (4) can be made in a manner that is not arbitrary from an epistemic point
of view. Finally, in Part VII, I show that, from a legal point of view, an
epistemically arbitraryjudgment in the process of practical epistemic deference
is not legitimate.
We have already wrestled with conflicting intuitions about a nonexpert's
ability to acquire KJB from experts in the face of problems of selection and
competition.415 It seemed on the one hand that credentials must be sufficient
to enable KJB to arise from practical epistemic deference, but it also seemed
that the use of credentials was subject to forceful challenge insofar as such use
occasioned regress, question begging, and underdetermination. How can
abduction help illuminate this problem?
First, keep in mind that we do not expect that the nonexpert can acquire
KJB from the expert based on second guessing the substantive judgment of the
expert.416Also, keep in mind that we are assuming sincerity and good faith
on the part of the competing experts.417Thus the nonexpert is attempting to
discover which discipline to select and which expert (among competing
experts, actual or implied) to believe on the basis of the credentials (including
the reputation) of sincere experts. What is it that could get this judgment about
credentials, and about credentials as an index to warranted expert beliefs about
the world, off the ground? The nonexpert must consult his own experience,
memory, and prior judgments; where else can he begin? "[W]hat every juror
ought to do in arriving at a verdict," as one court aptly explains, is
use all his experience, his knowledge of human nature, his knowledge
of human events, past and present, his knowledge of the motives
which influence and control human action, and test the evidence in the
case according to such knowledge and render his verdict accordingly.
A juror who did not do this would be remiss in his duty. The trial
judge in considering the verdict must do the same, or fail in the
discharge of that function which the law has laid upon him.418
This means that what the practical reasoner (judge or judge plus jury) must
bring to the table regarding credentials is some explanatory judgment about
the relation between credentials and scientific expertise. In modem society,
419. I should acknowledge that my approachto the question of the reasoner'sexperience with the
success of credentialsand extrapolationtherefromdraws its energy from a moderateempiricistapproach.
Detailed discussionof why I am attractedto thatapproachis beyondthe scope of the presentwork. I would
begin by defending an empiricistaccount with the kinds of modificationscogently suggested by Fricker.
See Fricker,supra note 239.
explains the pattern of successes and failures with prior credentialed experts
as purveyors of KJB about the world.
I assume that this abductive inference can be folded into judgment (1)(c)
in the complex model, but it could be exploded and analyzed into its own
distinct set of steps. Also, I should explain that every inductive generalization
relies on abductive inference to generate the categories to be tested and
confirmed or disconfirmed by observation. The reason for this partakes of an
observation also relied on in my discussion of analogy elsewhere:420Every
item has an indefinite number of features, from which some enormously
narrowing selection must be made to get to the point of applying some method
like John Stuart Mill's methods of confirmation or disconfirmation. A white
swan is also a feathered creature, a biped, a fleshy creature, a carbon-based
creature, a noncarnivorous creature, a creature with at least one limb, a
creature without gills, a creature that weighs less than the earth, and a creature
that travels more slowly than the speed of light. She who would like to
confirm some truth about swans, such as that they are all white, or that most
of them are white, must select from this welter of characteristics and place
those characteristics selected into an explanatory pattern that is ready-made for
observation, verification, and falsification. That selection is abductive
inference.42' The upshot of this is that no nonexpert can inductively
generalize from experience with credentialed experts without relying on a
logically prior step of abduction.
It is difficult to see how the nonexpert has a large enough base of
experiences with experts to make good plausible abductive-cum-inductive
inferences about the epistemic "warrantingness" of credentials. Even a
successful experience with a doctor may not be best explained by the fact that
he went to a good medical school; maybe a midwife or a witch doctor would
have done as well because the ailment was psychosomatic and responded to
a placebo effect.422Indeed, in a skeptical mood, one might well undermine,
or at least raise serious doubts about, virtually every conclusion a nonexpert
makes about the KJB-producing capacity of credentials. But even in a less
skeptical mood, we should acknowledge that a nonexpert's base of extra-
judicial, pre-cameral experience with credentialed experts is likely to be small,
and some significant portion of it is likely to be shaky.
Finally, even apart from the adequacy of the base of data on which the
nonexpert would rely in abducing a hypothesis about credentials, there is the
far more daunting problem of confirmation or disconfirmation of whatever
hypothesis is abduced. All abductions require confirmation or disconfirmation,
423. See the discussion of Laudan'sreticularaccount of scientific inquiry,which I track here. See
supra Section II.B.
which scientific expert to believe than one would by tossing a coin. That is,
when a nonexpert is faced with competing testimony by roughly equally well-
credentialed experts, and that nonexpert does manage to acquire a true belief
about the scientific matter at hand, we have no reason to believe that the true
belief was arrived at other than by accident.
There is enormous complexity among competing theories of knowledge,
but for all the very significant differences among them, in this they seem to
converge: A method of acquiring belief that produces only accidentally true
beliefs is epistemically arbitrary and incapable of producing KJB. It is hard to
improve upon Bernard Williams's succinct statement of this view:
Time to sum up. I have argued that reliance on the credentials of (even)
sincere competing experts requires the nonexpert to abduce and to confirm or
disconfirm a hypothesis about the KJB-producing capacity of credentials as
signals, but that the nonexpert's lack of epistemic competence will prevent him
from executing the first step in the chain of practical epistemic deference in a
nonarbitrary manner, at least when the "underdetermination condition" is
satisfied, that is, when roughly equally well-credentialed experts offer
testimony that competes at the level of theory, method, or application.
Moreover, competition by such experts occurs in a fairly large percentage of
cases of scientific testimony-especially since there is large room for
disagreement about application even when the basic theory and method are not
in dispute among the relevant experts. The defect in the first step will cascade
through the rest of the steps (2) to (10), rendering the whole chain arbitrary,
from an epistemic point of view, when the "underdeterminationcondition" is
met. The final question for us is: What if anything has the legal system to say
about practical epistemic deference that is epistemically arbitrary?
425. B.A.O. Williams, Knowledge and Reasons, in PROBLEMS IN THE THEORY OF KNOWLEDGE 1, 5
(G.H. von Wright ed., 1972). In the omitted parts of this passage, Williams firmly commits himself to an
externalist approach to knowledge.
[N]ot only is it not necessary that the knower be able to support or ground his true belief by
reference to other propositions, but it is not necessary that he be in any special state with regard
to this belief at all, at least at the level of what he can consciously rehearse.
Id. Elsewhere, the paper flirts with a causal account. I would subscribe to neither epistemological view, but
I think virtually all theories would reject the merely accidentally true belief as either justified belief or
knowledge.
The court concludes that "due process precludes trial by jury when a jury
is unable to perform this task with a reasonable understanding of the evidence
and the legal rules."433 The court went on to elucidate the connection
between this right to rational comprehension by the legal decisionmaker and
rule-of-law values like predictability and notice:
The court also addressed the question of what values the legal system might
injure in cases to which the complexity exception applied by choosing not to
allow the kind of community input that the constitutional jury trial right was
designed to secure. The central values often mentioned in connection with the
jury trial right-values powerful enough, in the district court's judgment, to
lead it to reject the idea of a complexity exception-are the jury's function as
a check on judicial power, and the jury's ability to modify and conform the
law to, and suffuse the law with, community values (so-called jury equity),
thereby lending the law a communitarian legitimacy it might not otherwise
have. Assessing these countervailing values reflected in the Seventh
Amendment, the court of appeals delivered something of a coup de grace
debater's point:
One cogent reason for overturning the verdict of a jury is that the
verdict is based on conclusions that are physically impossible. "[A]
verdict should be set aside '[w]here testimony is thus in conflict with
indisputable physical facts, the facts demonstrate that the testimony is
either intentionally or unintentionally untrue, and leave no real
question of conflict of evidence for the jury concerning which
reasonable minds could reasonably differ.' . . ..
Scientific evidence is relevant to a determination of what is
physically impossible. In Roma v. Thames River Specialties Co., this
court held that the trial judge "would have failed in his duty" if he
had not set aside the verdict when "the laws of mechanics, as testified
to and uncontradicted, tended to prove [the claimant's] story
impossible." In Jump v. Ensign-Bickford Co. the trial court properly
set aside the verdict when expert scientific testimony indicated that it
was physically impossible for a fuse to burn as fast as the claimant
had alleged, and this court could "find in the evidence no reasonable
ground which would have justified the jury in disregarding that
evidence."436
Similarly, in an opinion perhaps signaling that the U.S. Supreme Court may
be amenable to something like a complexity exception, Justice Souter declared
that, when a case requires the legal decisionmaker to interpret and comprehend
complex technical patents, the decision is to be made by the judge, not the
jury. He reasoned:
These cases suggest a strong commitment among leading jurists to the idea
that factfinding, including factfinding regarding matters that are the special
epistemic province of expert scientists, must be conducted in a coherent and
rational manner in order that this epistemic process meet the normative
requirements of a legal system that operates to grant or deprive people of life,
liberty, and property. Reflecting on these and other such statements by judges
and other jurists, we may sense a commitment, immanent in the broad
materials that constitute authoritative law (U.S. law, at least), to what we may
call the practical norm of intellectual due process. In re Japanese Electronic
Products Antitrust Litigation is especially fertile here, with its suggestion that
the epistemic process of comprehension of theoretical complexities is a
mandate of the decidedly practical norm of the Due Process Clause. Though
there are, to be sure, many features of due process that do not specifically
"sound" epistemic, that case reveals that some distinctively practical norms do
have meaningful epistemic consequences. Much philosophical work remains
to be done to explicate this emerging rule-of-law norm. Recognition of
intellectual due process as a practical norm in the family of rule-of-law norms
has only just begun-partly because the startling advances in scientific
methods-coupled with the striking increases in the technological complexity
of society and the laws that arise to govern and guide it, is also a relatively
recent socio-epistemic phenomenon.
437. Markmanv. Westview Instruments,Inc., 116 S. Ct. 1384, 1396 (1996) (citationsomitted).From
an epistemic point of view, Markman'ssolution suffers from the same problemthatafflicts In Re Japanese
ProductsAntitrustLitigation:A technically nonexpertjudge is not in a decisively betterposition than a
technically nonexpertjury.
The burdenis on the person who claims that the requirementsof intellectual
due process can be satisfiedon a large scale by takingthe decisions out of the
hands of nonexpertjuries and leaving them in the hands of judges. Carrying
thatburdenof proofwould of coursecall for a proceduresignificantlydifferent
from that of Daubert itself, for Daubert is still willing to turn over many
ultimatedecisions, even in cases in which the underdetermination conditionis
satisfied, to nonexpertswhom we have no reason to believe are sufficiently
competentin the expertdisciplineto meet the requirementsof intellectualdue
process.
I have spoken of remaining empirical questions and of burdens of
empiricalproof. There are also importantconceptualdetails thatremainto be
worked out for the two-hat solution. What kind of training should the
experts-or expertly trainedjudges-get? One can get a clear sense of the
training requiredto have basic competence in biology, genetics, statistics,
economics, or epidemiology,but how scientificallyspecializedis it feasible to
allow the two-hat-wearinglegal decisionmakerto be? Even the heuristic
analogy of the mathematicianmay breakdown, since that field, like virtually
all fields in the empiricaland demonstrativesciences, is becoming intensely
specialized. Will scientific discipline become so specialized that it ceases to
make sense to talk about general epistemic competence even within a
discipline? And if that problemlooms for singulardisciplines, what hope is
there for resolving problems of extra-disciplinarycompetition in a manner
consistentwith the suasionsof intellectualdue process?Still anotherquestion
is, how much training is enough? To the level of a Ph.D? An M.A.? Are
formal degrees good signals at all? Still another question involves the
democraticlegitimacyof the two-hatsolution.Rule by technocrat-kingshas its
dangers,just as does rule by epistemicallyunrulymobs. Is therea feasible and
meaningfulway in which a responsiblepolity can deliberateand endorsethe
trainingprogramsand institutionalschemes that would implementthe "two-
hat" solution and achieve a reasonabledegree of intellectualdue process?
These are deep anddifficultquestions.But few topics, I hazardto say, will
be more importantto the health of the polity and its citizens than the close
investigation of how the law ought-from legal, moral, and other closely
relatedpracticalpoints of view-to keep up with science.
VIII. CONCLUSION
Though its steps have been long, the argumentpresentedin this Article is
not too difficult to summarize. I have argued that there is a structured
reasoningprocess that a nonexpertjudge or jury must use in an effort to take
accountof scientificexperttestimonyin the courseof reachinga legal decision
aboutliability (in the civil setting)or guilt (in the criminalsetting).When one
attends carefully to the precise steps of the reasoningprocess, one sees that
there are crucial steps that a nonexpert judge or jury is, in a great many
instances, not capable of performing in an epistemically nonarbitrarymanner.
Specifically, when competing scientific experts are, for all the nonexpert
knows, fairly evenly matched in credentials, reputation, and demeanor, and
when no generally accessible rational criteria (such as self-contradiction by an
expert witness) break the "tie" (i.e., when what I have called the
"underdetermination condition" is satisfied), then a nonexpert is not capable
of choosing among the competing experts in an epistemically nonarbitraryway.
I have also sought to show that epistemic nonarbitrariness is a necessary
condition of legitimacy, as expressed in the norm of intellectual due process.
This norm, an emerging rule-of-law norm, immanent in both decided cases and
various analyses of jurists and philosophers, will be increasingly important as
scientific expert testimony comes to be used in a greater and greater percentage
of cases.441When the conditions of this norm are not satisfied, decisions by
nonexperts, even in light of relevant scientific expert testimony, lack epistemic
legitimacy, and therefore lack the kind of practical-cum-moral legitimacy that
legal systems do and ought to demand.
What is to be done if the relevance of scientific information to legal
decisions continues to grow, while nonexperts are so often incapable of
legitimately incorporating that information into their decisions? Nothing in this
Article suggests that a nonexpert judge cannot become sufficiently
epistemically competent, even without the formal training of a scientist.
Perhaps some judges, by virtue of background or repeat "on the bench"
experience with scientific evidence, will become sufficiently epistemically
competent to render decisions about scientific expert testimony that are
epistemically legitimate and that meet the demands of intellectual due process.
Daubert itself calls upon judges to be more active as "gatekeepers" in
screening out unreliable science. But Daubert's solution to the problem of
legitimately assessing expert scientific testimony seems a poor one. First, given
the press of other judicial business, it seems unlikely that a significant
percentage of judges either already have, or will find the time to acquire, the
kind of scientific competence that legitimate, intellectually "duly processed"
decisionmaking requires. That is, unless judges are routinely and systematically
trained in scientific theories and methods, Daubert does not offer a promising
overall solution to the problem. Also, under Daubert, even when a judge is
sufficiently competent, that competence could yield a duly processed,
legitimate decision only when the judge decides not to admit some proffered
scientific testimony. But in a great many other cases, the judge will admit
competing scientific evidence, and allow the nonexpert, noncompetent jury to
In Justice Breyer's view, given this challenge, judges should more actively
solicit scientific information in order to perform their Daubert-mandated role
of "gatekeepers" vigilant against junk science, for example by using court
appointed experts,443 appointing special masters or specially trained law
clerks, or using pretrial conferences to narrow the scientific issues."4 But,
for reasons suggested above, this solution also fails to meet the needs of
intellectual due process for any judge who is himself not epistemically
competent in scientific methods and theories.445For the judge is not capable
of making an epistemically legitimate decision about which special master, law
clerk, or court-appointed expert to consult.
The only solution (actually, it is a family of solutions) I see requires that
one and the same legal decisionmaker wear two hats, the hat of epistemic
competence and the hat of practical legitimacy. That is, whether it is a
scientifically trained judge or juror or agency administrator, the same person
who has legal authority must also have epistemic competence in relevant
scientific disciplines. In an age in which culture will increasingly take
advantage of the massive intellectual power of science, this is not too high a
price for the legal system to pay to satisfy its own just intellectual aspirations.
442. Id. Joiner held that, even underDaubert, the properstandardof review for decisions about the
admissibility of scientific evidence was "abuseof discretion,"regardlessof whether the districtjudge's
decision was to admit or exclude the evidence, and regardlessof whether that decision was "outcome
determinative."See id. at 515 (majorityopinion).
443. See FED. R. EvID. 706.
444. See Joiner, 118 S. Ct. at 520-21 (Breyer,J., concurring).
445. Like the philosopherAnthonyKenny,Justice Breyeroffers an "extra-cameral" approachto the
problem.I discuss this approachand its problemsabove. See supra notes 286-293 and accompanyingtext.