Upcoming and ongoing
Upcoming and ongoing
Upcoming and ongoing
Publications
[Abstract]
Abstract: Bounded rationality gets a bad rap in epistemology. It is argued that theories of bounded rationality are overly context-sensitive; conventionalist; or dependent on ordinary language. In this paper, I have three aims. The first is to set out and motivate an approach to bounded rationality in epistemology inspired by traditional theories of bounded rationality in cognitive science. My second aim is to show how this approach can answer recent challenges raised for theories of bounded rationality. My third aim is to clarify the role of rational ideals in bounded rationality.
[Abstract]
Abstract: A new wave of evidentialist theorizing concedes that evidentialism may be extensionally incorrect as an account of all-things-considered rational belief. Nevertheless, these newer evidentialists maintain that there is an importantly distinct type of epistemic rationality about which evidentialism may be the correct account. I argue that natural ways of developing the newer evidentialist position face opposite problems. One version, due to David Christensen (forthcoming), may correctly describe what rationality requires, but does not entail the existence of a distinctively epistemic type of rationality. Another version, due to Barry Maguire and Jack Woods (forthcoming), characterizes a normative concept that is both distinct and epistemic, but struggles to explain why this concept should be classified as a type of rationality. I conclude that the newer evidentialist strategy of extensional compromise may be less favorable to evidentialism than previously supposed.
General-purpose institutional decisionmaking heuristics
British Journal for the Philosophy of Science (forthcoming).
[Abstract]
Abstract: Recent work in judgment and decisionmaking has stressed that institutions, like individuals, often rely on decisionmaking heuristics. But most of the institutional decisionmaking heuristics studied to date are highly firm- and industry-specific. This contrasts to the individual case, in which many heuristics are general-purpose rules suitable for a wide range of decision problems. Are there also general-purpose heuristics for institutional decisionmaking? In this paper, I argue that a number of methods recently developed for decisionmaking under deep uncertainty have a good claim to be understood as general-purpose decisionmaking heuristics suitable for a broad range of institutional decision problems.
The accuracy-coherence tradeoff in cognition.
British Journal for the Philosophy of Science (forthcoming).
[Abstract]
Abstract: I argue that bounded agents face a systematic accuracy-coherence tradeoff in cognition. Agents must choose whether to structure their cognition in ways likely to promote coherence or accuracy. I illustrate the accuracy-coherence tradeoff by showing how it arises out of at least two component tradeoffs: a coherence-complexity tradeoff between coherence and cognitive complexity, and a coherence-variety tradeoff between coherence and strategic variety. These tradeoffs give rise to an accuracy-coherence tradeoff because privileging coherence over complexity or strategic variety often leads to a corresponding reduction in accuracy. I conclude with a discussion of two normative consequences for the study of bounded rationality: the importance of procedural rationality and the role of coherence in theories of bounded rationality.
High risk, low reward: A challenge to the astronomical
value of existential risk mitigation
Philosophy and Public Affairs 51.4 (2023): 373-412.
[Abstract]
[Resources]
Abstract: Many philosophers defend two claims: the astronomical value thesis that it is astronomically important to mitigate existential risks to humanity, and existential risk pessimism, the claim that humanity faces high levels of existential risk. It is natural to think that existential risk pessimism supports the astronomical value thesis. In this paper, I argue that precisely the opposite is true. Across a range of assumptions, existential risk pessimism significantly reduces the value of existential risk mitigation, so much so that pessimism threatens to falsify the astronomical value thesis. I argue that the best way to reconcile existential risk pessimism with the astronomical value thesis relies on a questionable empirical assumption. I conclude by drawing out philosophical implications of this discussion, including a transformed understanding of the demandingness objection to consequentialism, reduced prospects for ethical longtermism, and a diminished moral importance of existential risk mitigation.
Summary: Global Priorities Institute Paper Summaries.
Talk: EAGxCambridge (full); EAGxOxford (short).
Blog: Reflective Altruism.
Podcast: Critiques of EA.
Discussion: EA Forum.
[Abstract]
Abstract: Epistemic nihilism for inquiry is the claim that there are no epistemic norms of inquiry. Epistemic nihilism was once the received stance towards inquiry, and I argue that it should be taken seriously again. My argument is that the same considerations which led us away from epistemic nihilism in the case of belief not only cannot refute epistemic nihilism for inquiry, but in fact may well support it. These include the argument from non-existence that there are no non-epistemic reasons for belief; the linguistic argument that epistemic norms of belief are needed to capture the semantics of ordinary epistemic talk; and the argument from theoretical roles that epistemic norms are needed to play key theoretical roles for rational belief. I conclude by sketching an alternative Gibbardian picture on which norms of inquiry are all-things-considered norms governing action.
Abstract: My aim in this paper is to develop a unified solution to two paradoxes of bounded rationality. The first is the regress problem that incorporating cognitive bounds into models of rational decisionmaking generates a regress of higher-order decision problems. The second is the problem of rational irrationality: it sometimes seems rational for bounded agents to act irrationally on the basis of rational deliberation. I review two strategies which have been brought to bear on these problems: the way of weakening which responds by weakening rational norms, and the way of indirection which responds by letting the rationality of behavior be determined by the rationality of the deliberative processes which produced it. Then I propose and defend a third way to confront the paradoxes: the way of level separation.
Tough enough? Robust satisficing as a decision norm for
long-term policy analysis (w/Andreas Mogensen)
Synthese 200 (2022): 1-26.
[Abstract]
Abstract: This paper aims to open a dialogue between philosophers working in decision theory and operations researchers and engineers working on decision-making under deep uncertainty (DMDU). Specifically, we assess the recommendation to follow a norm of robust satisficing when making decisions under deep uncertainty in the context of decision analyses that rely on the tools of Robust Decision Making (RDM) developed by Robert Lempert and colleagues at RAND. We discuss two challenges for robust satisficing: whether the norm might derive its plausibility from an implicit appeal to probabilistic representations of uncertainty of the kind that deep uncertainty is supposed to preclude; and whether there is adequate justification for adopting a satisficing norm, as opposed to an optimizing norm that is sensitive to considerations of robustness. We discuss decision-theoretic and voting-theoretic motivations for robust satisficing, and use these motivations to select among candidate formulations of the robust satisficing norm.
[Abstract]
Abstract: The zetetic turn in epistemology raises three questions about epistemic and zetetic norms. First, there is the relationship question: what is the relationship between epistemic and zetetic norms? Are some epistemic norms zetetic norms, or are epistemic and zetetic norms distinct? Second, there is the tension question: are traditional epistemic norms in tension with plausible zetetic norms? Third, there is the reaction question: how should theorists react to a tension between epistemic and zetetic norms? Drawing on an analogy to practical philosophy, I develop a focal point view to resolve these motivating questions. On the focal point view, traditional epistemic norms and zetetic norms answer different types of normative questions. There is nevertheless a familiar type of evaluative tension between traditional epistemic norms and zetetic norms, but this tension is an unavoidable feature of the normative landscape and not a sign that traditional epistemic norms need revision. But if traditional epistemic norms are not zetetic norms, then in what sense is zetetic epistemology a project for epistemologists? I conclude by articulating a sense in which some nontraditional epistemic norms are zetetic norms, and in which zetetic epistemology is an important part of the study of theoretical rationality.
Abstract: Recent objections to epistemic permissivism have a metaepistemic flavor. Impermissivists argue that their view best accounts for connections between rationality, planning and deference. Impermissivism is also taken to best explain the value of rational belief and normative assessment. These objections pose a series of metaepistemic explanatory challenges for permissivism. In this paper, I illustrate how permissivists might meet their explanatory burdens by developing two permissivist metaepistemic views which fare well against the explanatory challenges.
Work in progress - Bounded rationality and inquiry
Abstract: Traditional discussions of bias in large language models focus on a conception of bias closely tied to unfairness, especially as affecting marginalized groups. Recent work raises the novel possibility of assessing the outputs of large language models for a range of cognitive biases familiar from research in judgment and decisionmaking. My aim in this paper is to draw two lessons from recent discussions of cognitive bias in large language models: cautious optimism about the prevalence of bias in current models coupled with an anti-Panglossian willingness to concede the existence of some genuine biases and work to reduce them. I draw out philosophical implications of this discussion for the rationality of human cognitive biases as well as the role of unrepresentative data in driving model biases.
Abstract: I argue that bounded agents face a systematic complexity-coherence tradeoff in cognition. Agents must choose whether to structure their cognition in more complex ways, or in ways more likely to promote coherence. I illustrate the complexity-coherence tradeoff by examining three types of complexity: procedural complexity, informational complexity, and state complexity. In each case, I show how feasible strategies for increasing complexity along the relevant dimension often come at the expense of a heightened vulnerability to incoherence. I discuss normative and descriptive implications of the complexity-coherence tradeoff, including a novel challenge to coherence-based theories of bounded rationality, renewed support for the rationality of heuristic cognition, and a deepening of traditional challenges to dual-process theories of cognition.
[Abstract]
Abstract: Informing others about the world is typically regarded as a helpful act. In this paper, I study agents who conduct experiments to gather information about the world, committing in advance to fully disclose the nature of the experiment together with all experimental findings. While this appears to be a benign activity, I characterize a type of exploitative informing that is possible even within this restricted setup. I show how exploitative informants use public experiments to predictably manipulate interlocutors’ beliefs and actions to their own advantage. I discuss epistemic and practical grounds on which it may be permissible for agents to resist acts of exploitative informing, then conclude by discussing implications for epistemic injustice and duties to gather evidence.
[Abstract]
Abstract: My aim in this paper is to develop an account of rational inquiry for bounded agents. I argue that an account should meet three minimal criteria. First, it should be tradeoff-sensitive, saying how scarce cognitive and non-cognitive resources are to be allocated within the course of a single inquiry, between competing inquiries, and between inquiry and other activities. Second, it should be stakes-sensitive, saying why more resources should typically be invested in our most important inquiries. And third, it should explain the irrationality of many instances of stereotyping, despite the superficial resemblance of stereotyping to cases of rational heuristic inquiry. I argue that we cannot meet these criteria by extending traditional accounts of rational belief or by applying existing philosophical accounts of bounded rationality. I develop a reason-responsiveness consequentialist view of rational inquiry for bounded agents and argue that this view fares well by the lights of the minimal criteria.
[Abstract]
Abstract: Epistemologists have recently proposed a number of norms governing rational inquiry. My aim in this paper is to unify and explain recently proposed norms of inquiry by developing a general account of the conditions under which inquiries are rational, analogous to theories such as evidentialism and reliabilism for rational belief. I begin with a reason-responsiveness conception of rationality as responding correctly to possessed normative reasons. I extend this account with a series of claims about the normative reasons for inquiry that we possess. I apply the account to shed light on two classes of norms that have featured prominently in recent discussions: norms of clutter avoidance forbidding agents from engaging in trivial inquiries, and norms of logical non-omniscience governing properties such as the deductive closure and consistency of an agent's belief state. I conclude with a discussion of the sense in which norms of inquiry should be regarded as epistemic norms.
Abstract: Epistemology has taken a zetetic turn from the study of belief towards the study of inquiry. Several decades ago, theories of bounded rationality took a procedural turn from attitudes towards the processes of inquiry that produce them. What is the relationship between the zetetic and procedural turns? In this paper, I argue that we should treat the zetetic turn in epistemology as part of a broader procedural turn in the study of bounded rationality. I use this claim to motivate and clarify the zetetic turn in epistemology, as well as to reveal the need for a second zetetic turn within practical philosophy.
Inquiry under bounds, research monograph under
contract with Oxford University Press
[Abstract]
About this book: Herbert Simon held that the fundamental turn in the study of bounded rationality is the turn from substantive to procedural rationality. Theories of substantive rationality begin with normative questions about attitudes: what should we prefer, intend or believe? By contrast, theories of procedural rationality begin with normative questions about processes of inquiry: how should we determine what to prefer, intend or believe? If Simon was right, then the central task for theories of bounded rationality is to develop an account of rational inquiry for bounded agents. We need, that is, a theory of inquiry under bounds.
Inquiry under bounds takes as its starting point a five-point bounded rationality program inspired by recent work in cognitive science. To elaborate and defend that program, I argue, we need an account of rational inquiry for bounded agents. Inquiry under bounds develops an account of rational inquiry for bounded agents: the reason-responsiveness consequentialist view. I use this account to clarify and defend key insights from the bounded tradition as well as to shed light on recent controversies in the epistemology of inquiry.
Work in progress - Global priorities research
[Abstract]
Abstract: The singularity hypothesis is a radical hypothesis about the future of artificial intelligence on which self-improving artificial agents will quickly become orders of magnitude more intelligent than the average human. Despite the ambitiousness of its claims, the singularity hypothesis has been defended at length by leading philosophers and artificial intelligence researchers. In this paper, I argue that the singularity hypothesis rests on implausible growth assumptions. I show how leading philosophical defenses of the singularity hypothesis (Chalmers 2010, Bostrom 2014) fail to overcome the case for skepticism. I conclude by drawing out philosophical implications of this discussion for our understanding of consciousness, personal identity, digital minds, existential risk, and ethical longtermism.
[Abstract]
Abstract: Longtermists have recently argued that it is overwhelmingly important to do what we can to mitigate existential risks to humanity. I consider three mistakes that are often made in calculating the value of existential risk mitigation: focusing on cumulative risk rather than period risk; ignoring background risk; and neglecting population dynamics. I show how correcting these mistakes pushes the value of existential risk mitigation substantially below leading estimates, potentially low enough to threaten the normative case for existential risk mitigation. I use this discussion to draw four positive lessons for the study of existential risk: the importance of treating existential risk as an intergenerational coordination problem; a surprising dialectical flip in the relevance of background risk levels to the case for existential risk mitigation; renewed importance of population dynamics, including the dynamics of digital minds; and a novel form of the cluelessness challenge to longtermism.
Abstract: Longtermism holds roughly that in many decision situations, the best thing we can do is what is best for the long-term future. The scope question for longtermism asks: how large is the class of decision situations for which longtermism holds? Although longtermism was initially developed to describe the situation of cause-neutral philanthropic decisionmaking, it is increasingly suggested that longtermism holds in many or most decision problems that humans face. By contrast, I suggest that the scope of longtermism may be more restricted than commonly supposed. After specifying my target, swamping axiological strong longtermism (swamping ASL), I give two arguments for the rarity thesis that the options needed to vindicate swamping ASL in a given decision problem are rare. I use the rarity thesis to pose two challenges to the scope of longtermism: the area challenge that swamping ASL often fails when we restrict our attention to specific cause areas, and the challenge from option unawareness that swamping ASL may fail when decision problems are modified to incorporate agents' limited awareness of the options available to them.
Essays on longtermism (w/Hilary Greaves and Jacob
Barrett), edited book, under contract with Oxford
University Press
[Abstract]
About this book: Longtermism is a philosophical and philanthropic paradigm which urges that the best thing we can do right now is often determined by the effects of our actions on the long-term future. This open-access collection will bring together leading philosophers, economists, and other scholars to interrogate, critique, defend, and apply the longtermism paradigm.
[Abstract]
Abstract: By the lights of traditional normative theories, human inquiry is substantially irrational. Humans regularly violate normative constraints set out by logic, probability theory, and decision theory. Traditional normative theories blame the agent, taking these findings to show that humans are irrational. By contrast, I suggest it is often better to blame the theory. Many seeming irrationalities are instances of rational inquiry by bounded agents. To defend this claim, I develop a consequentialist account of rational inquiry and metacognition. This view explains the value of rationality, accounts for duties to gather evidence, and is our best hope for vindicating empirically demonstrated biases as instances of rational inquiry. I apply this account of rational inquiry to clarify and ground a collection of normative claims that arise in scientific theorizing about bounded rationality.
Work in progress - Miscellaneous
Abstract: I argue that there are two distinct deontic roles for unpossessed evidence. First, we sometimes have duties to gather evidence that we do not possess. And second, evidence that we fail to gather may nonetheless bear on how we now ought to act. I argue that subjectivist deontic theories perform well on the first role, but poorly on the second. I propose a way for subjectivists to capture the second role by taking two steps towards objectivism: an information-sensitive account of deontic modals on which the relevant body of evidence is the evidence that agents should have had. I propose and reject two accounts of the notion of evidence that agents should have had, then sketch a third way to make progress in understanding this notion.
Nearly ready (email for drafts)