A multilevel signal detection theory approach to unconscious processing research
Rey-Sáez, R., Franco-Martínez, A., Vadillo, M. A., & Garre-Frutos, F.
PsyArXivPreprint
Abstract
To test for unconscious processing, researchers typically compare measures of a stimulus's influence on behavior with measures of awareness of that stimulus. Three common hypotheses are often tested: whether influence is significant while awareness is not (group-level dissociation), whether both measures are independent across participants (correlation), or whether influence persists when awareness is extrapolated to be zero (regression intercept). Conventional analyses suffer from three well-known methodological limitations: First, both measures often differ in scale and number of trials, complicating meaningful comparisons of their relative sensitivities. Second, analyses based on participant-level sensitivities ignore measurement error, which attenuates correlations and inflates regression intercepts, leading to misleading evidence for unconscious processing. Third, the correlation hypothesis requires evidence of null association, but conventional significance tests provide limited evidence for the absence of an effect. To address these problems, we introduce a multilevel signal detection theory (SDT) model that jointly analyzes trial-level responses from both measures and allows all three hypotheses to be tested directly while accounting for measurement error. The model supports both frequentist and Bayesian estimation, allowing researchers to run non-superiority tests and quantify evidence for null hypotheses using Bayes factors. We illustrate this approach through reanalyses of three published studies on unconscious processing. The {uSDT} R package provides an accessible way to fit the joint multilevel SDT model and evaluate all three hypotheses more rigorously.
