How Much Data Should I Request? Balancing Richness and Compliance in Digital Trace Data Donations

Digital trace “data donation” studies offer researchers a unique opportunity to collect high-quality behavioral data, but decisions about the scope of requested data can impact both dataset richness and participant compliance. This paper examines the tradeoffs between requesting larger data packages, which include more extensive historical records, and participants’ willingness to donate. In a randomized experiment with Facebook and Instagram data donations, we compare a control condition where participants are asked to request the default 1-year data period to a treatment condition in which they are asked to request data for their entire account history. We analyze how different request sizes affect (1) participants’ compliance rates and (2) the characteristics of the data resulting from these different requests. We find that participants asked to request more data are less likely to complete the task. However, we propose that this is not primarily due to heightened privacy concerns, but rather because these data packages are significantly larger and therefore take longer for the platforms to deliver. This additional time to deliver data packages results in increased attrition. In terms of the effects on the data itself, we show that decisions about the time-span of the data impacts not only the volume of data requested, but also has implications for measurement validity, as the temporal window fundamentally redefines what key constructs represent, potentially transforming intended static indicators into narrow snapshots of recent behavior. We provide guidance for researchers navigating these decisions, considering both the benefits of richer longitudinal data and the risks of reduced participation.