Experiments in Daily Life: When Causal Within-Person Effects Do (Not) Translate Into Between-Person Differences

Andreas B. Neubauer, Peter Koval, Michael J. Zyphur, Ellen L. Hamaker

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Intensive longitudinal designs allow researchers to study the dynamics of psychological processes in daily life. Yet, because these methods are usually observational, they do not allow strong causal inferences. A promising solution is to incorporate (micro-)randomized interventions within intensive longitudinal designs to uncover within-person (Wp) causal effects. However, it remains unclear whether (or how) the resulting Wp causal effects translate into between-person (Bp) differences in outcomes. In this work, we show analytically and using simulated data that Wp causal effects translate into Bp differences if there are no counteracting forces that modulate this cross-level translation. Three possible counteracting forces that we consider here are (a) contextual effects, (b) correlated random effects, and (c) cross-level interactions. We illustrate these principles using empirical data from a 10-day microrandomized mindfulness intervention study (n = 91), in which participants were randomized to complete a treatment or control task at each occasion. We conclude by providing recommendations regarding the design of microrandomized experiments in intensive longitudinal designs, as well as the statistical analyses of data resulting from these designs.
Original languageEnglish
Number of pages22
JournalPsychological Methods
DOIs
Publication statusE-pub ahead of print - Mar 2025

Bibliographical note

Publisher Copyright:
© 2025 American Psychological Association

Funding

This work was supported by a grant from the German Research Foundation (DFG; NE 2480/1\u20131) awarded to Andreas B. Neubauer, and a Discovery Early Career Researcher Award (DE190100203) from the Australian Research Council awarded to Peter Koval. Part of this research was presented at the 52nd Conference of the German Psychological Society 2022 in Hildesheim and at the Conference of the Society for Ambulatory Assessment 2024 in Ann Arbor, Michigan, United States. The authors have no conflicts of interest to declare. Data and the full analysis code to reproduce the results reported in this work can be retrieved from the accompanying repository on the Open Science Framework (https://osf.io/nt9bc/). This study was not preregistered.

FundersFunder number
Open Science Framework
Australian Research Council
Deutsche ForschungsgemeinschaftDE190100203, NE 2480/1–1

    Keywords

    • Ambulatory assessment
    • Experience sampling
    • Experiment
    • Intensive longitudinal data
    • Mindfulness

    Fingerprint

    Dive into the research topics of 'Experiments in Daily Life: When Causal Within-Person Effects Do (Not) Translate Into Between-Person Differences'. Together they form a unique fingerprint.

    Cite this