UNIGE document Professional Article
previous document  unige:75430  next document
add to browser collection

Using Bayesian hierarchical parameter estimation to assess the generalizability of cognitive models of choice

Pachur, Thorsten
Published in Psychonomic Bulletin & Review (PB&R). 2015, vol. 22, no. 2, p. 391-407
Abstract To be useful, cognitive models with fitted parameters should show generalizability across time and allow accurate predictions of future observations. It has been proposed that hierarchical procedures yield better estimates of model parameters than do nonhierarchical, independent approaches, because the formers' estimates for individuals within a group can mutually inform each other. Here, we examine Bayesian hierarchical approaches to evaluating model generalizability in the context of two prominent models of risky choice—cumulative prospect theory (Tversky & Kahneman, 1992) and the transfer-of-attention-exchange model (Birnbaum & Chavez, 1997). Using empirical data of risky choices collected for each individual at two time points, we compared the use of hierarchical versus independent, nonhierarchical Bayesian estimation techniques to assess two aspects of model generalizability: parameter stability (across time) and predictive accuracy. The relative performance of hierarchical versus independent estimation varied across the different measures of generalizability. The hierarchical approach improved parameter stability (in terms of a lower absolute discrepancy of parameter values across time) and predictive accuracy (in terms of deviance; i.e., likelihood). With respect to test–retest correlations and posterior predictive accuracy, however, the hierarchical approach did not outperform the independent approach. Further analyses suggested that this was due to strong correlations between some parameters within both models. Such intercorrelations make it difficult to identify and interpret single parameters and can induce high degrees of shrinkage in hierarchical models. Similar findings may also occur in the context of other cognitive models of choice.
Keywords Bayesian inferenceParameter estimationBayesian modelingDecision makingMath modelingModel evaluation
Note The online version of this article contains supplementary material: http://scheibehenne.de/ScheibehennePachur2014.onlineSupplement.pdf
Full text
(ISO format)
SCHEIBEHENNE, Benjamin, PACHUR, Thorsten. Using Bayesian hierarchical parameter estimation to assess the generalizability of cognitive models of choice. In: Psychonomic Bulletin & Review (PB&R), 2015, vol. 22, n° 2, p. 391-407. doi: 10.3758/s13423-014-0684-4 https://archive-ouverte.unige.ch/unige:75430

550 hits



Deposited on : 2015-09-28

Export document
Format :
Citation style :