Do humans produce the speed-accuracy trade-off that maximizes reward rate?

Bogacz R
Hu PT
Holmes P
Cohen JD
Scientific Abstract

In this paper we investigate trade-offs between speed and accuracy that are produced by humans when confronted with a sequence of choices between two alternatives. We assume that the choice process is described by the drift diffusion model, in which the speed-accuracy trade-off is primarily controlled by the value of the decision threshold. We test the hypothesis that participants choose the decision threshold that maximizes reward rate, defined as an average number of rewards per unit of time. In particular, we test four predictions derived on the basis of this hypothesis in two behavioural experiments. The data from all participants of our experiments provide support only for some of the predictions, and on average the participants are slower and more accurate than predicted by reward rate maximization. However, when we limit our analysis to subgroups of 30-50% of participants who earned the highest overall rewards, all the predictions are satisfied by the data. This suggests that a substantial subset of participants do select decision thresholds that maximize reward rate. We also discuss possible reasons why the remaining participants select thresholds higher than optimal, including the possibility that participants optimize a combination of reward rate and accuracy or that they compensate for the influence of timing uncertainty, or both.

Citation

2010.Q J Exp Psychol (Hove), 63(5):863-91.

More Like This
Publication
Herz DM, Tan H, Brittain JS, Fischer P, Cheeran B, Green AL, Fitzgerald J, Aziz TZ, Ashkan K, Little S, Foltynie T, Limousin P, Zrinzo L, Bogacz R, Brown P
2017. eLife, 6:e21481
Unit Publication
Publication
Mikhael JG, Bogacz R

2016.PLoS Comput. Biol., 12(9):e1005062.

Unit Publication
Publication
Song Y, Lukasiewicz T, Xu Z, Bogacz R
2020. Adv Neural Inf Process Syst, 33:22566-22579.
Unit Publication
Publication
Barron HC, Reeve HM, Koolschijn RS, Perestenko PV, Shpektor A, Nili H, Rothaermel R, Campo-Urriza N, O'Reilly JX, Bannerman DM, Behrens TE, Dupret D
2020. Cell, 183(1):228-243.e21.
Unit Publication
Publication
Tinkhauser G, Pogosyan A, Tan H, Herz DM, Kühn AA, Brown P
2017. Brain, 140(11):2968-2981.
Unit Publication