Cognitive reflection test: whom, how, when

Branas-Garza, Pablo, Lenkei, Balint and Kujal, Praveen ORCID logoORCID: (2019) Cognitive reflection test: whom, how, when. Journal of Behavioral and Experimental Economics, 82 , 101455. pp. 1-18. ISSN 2214-8043 [Article]

PDF - Final accepted version (with author's formatting)
Available under License Creative Commons Attribution-NonCommercial-NoDerivatives 4.0.

Download (1MB) | Preview


The use of the Cognitive Reflection Test as a covariate to explain behavior in Economics and Psychology experiments has significantly increased in the past few years. Experiments have shown its usefulness in predicting behavior. However, little is known about if the test is gender biased, whether incentives matter or how different implementation procedures impact outcomes. Here we report the results of a meta-study of 118 Cognitive Reflection Test studies comprising of 44,558 participants across 21 countries. We find that there is a negative correlation between being female and the overall, and individual, correct answers to CRT questions. Monetary incentives do not impact performance. Regarding implementation procedures, taking the test at the end of the experiment negatively impacts performance. Students perform better compared to non-students. We obtain mixed evidence on whether the sequence of questions matters. Finally, we find that computerized tests marginally improve results.

Item Type: Article
Research Areas: A. > Business School > Economics
Item ID: 27257
Notes on copyright: © 2019. This author's accepted manuscript version is made available under the CC-BY-NC-ND 4.0 license
Useful Links:
Depositing User: Praveen Kujal
Date Deposited: 29 Jul 2019 14:12
Last Modified: 29 Nov 2022 18:51

Actions (login required)

View Item View Item


Activity Overview
6 month trend
6 month trend

Additional statistics are available via IRStats2.