Words or numbers? Communicating probability in intelligence analysis

Dhami, Mandeep K. ORCID: https://orcid.org/0000-0001-6157-3142 and Mandel, David R. (2020) Words or numbers? Communicating probability in intelligence analysis. American Psychologist . ISSN 0003-066X (Published online first) (doi:10.1037/amp0000637)

[img]
Preview
PDF - Final accepted version (with author's formatting)
Download (732kB) | Preview

Abstract

Intelligence analysis is fundamentally an exercise in expert judgment made under conditions of uncertainty. These judgments are used to inform consequential decisions. Following the major intelligence failure that led to the 2003 war in Iraq, intelligence organizations implemented policies for communicating probability in their assessments. Virtually all chose to convey probability using standardized linguistic lexicons in which an ordered set of select probability terms (e.g., highly likely) is associated with numeric ranges (e.g., 80-90%). We review the benefits and drawbacks of this approach, drawing on psychological research on probability communication and studies that have examined the effectiveness of standardized lexicons. We further discuss how numeric probabilities can overcome many of the shortcomings of linguistic probabilities. Numeric probabilities are not without drawbacks (e.g., they are more difficult to elicit and may be misunderstood by receivers with poor numeracy). However, these drawbacks can be ameliorated with training and practice, whereas the pitfalls of linguistic probabilities are endemic to the approach. We propose that, on balance, the benefits of using numeric probabilities outweigh their drawbacks. Given the enormous costs associated with intelligence failure, the intelligence community should reconsider its reliance on using linguistic probabilities to convey probability in intelligence assessments. Our discussion also has implications for probability communication in other domains such as climate science.

Item Type: Article
Research Areas: A. > School of Science and Technology > Psychology
Item ID: 29655
Notes on copyright: ©American Psychological Association, 2020. This paper is not the copy of record and may not exactly replicate the authoritative document published in the APA journal. Please do not copy or cite without author's permission. The final article is available, upon publication, at: https://doi.org/10.1037/amp0000637
Useful Links:
Depositing User: Mandeep Dhami
Date Deposited: 14 Apr 2020 08:21
Last Modified: 15 Aug 2020 17:04
URI: https://eprints.mdx.ac.uk/id/eprint/29655

Actions (login required)

Edit Item Edit Item

Full text downloads (NB count will be zero if no full text documents are attached to the record)

Downloads per month over the past year