ESRA logo

ESRA 2023 Glance Program


All time references are in CEST

Public perceptions on using novel digital data sources and collection methods

Session Organisers Dr Frederic Gerdon (Mannheim Centre for European Social Research (MZES), University of Mannheim)
Dr Ruben Bach (Mannheim Centre for European Social Research (MZES), University of Mannheim)
Professor Christoph Kern (Ludwig-Maximilians-Universität Munich, University of Mannheim, University of Maryland)
Ms Daria Szafran (Mannheim Centre for European Social Research (MZES), University of Mannheim)
TimeTuesday 18 July, 09:00 - 10:30
Room

Public perceptions on data sources and collection methods are a valuable resource to learn about potential novel or unexpected ethical issues pertaining to researchers’ data uses. These perceptions are all the more relevant for novel (digital) sources and methods for which ethical standards might need to be developed or adapted in response to rapid technical advances. Such relatively novel sources or methods include, among others, smartphone sensor data, GPS data, data collected from APIs, data donations from social media, and web scraping data. A particular challenge are data collection methods that seek to substitute or “augment” data from human respondents with outputs generated with large language models (LLMs). Potential problems that individuals may perceive with these and other data sources and methods particularly include concerns about privacy and data security, but also, among others, about equity and validity.

To enhance ethical reflections of how we researchers work with novel data sources, ethical frameworks and empirical findings on public perceptions will be essential. Such knowledge and reflection not only might lead to improvements in consent rates among study participants and data quality, but also assist in maintaining trust in social science in the long run.

Thus, in this session, we aim to gather researchers who investigate public perceptions on novel data collection sources and methods as outlined above. We welcome submissions that broadly deal with any of the following or closely related topics:
• Surveys (proposed, ongoing, or completed) on public perceptions (or attitudes, preferences, selective participation, etc.) relating to novel data sources and collection methods
• Conceptualizations and operationalizations of perception-related constructs, such as “acceptance”, “perceived legitimacy”, etc.
• Outlines or frameworks of respondent-related ethical challenges of specific data sources and methods
• Empirical applications using novel data sources and methods that involved the consideration of public perceptions

Keywords: public opinion, attitudes, research ethics, novel data sources

Papers

How Effective are Trust-Enhancement Measures at Boosting Participation in Digital Data Collection in Surveys?

Dr Caroline Roberts (University of Lausanne) - Presenting Author
Dr Marc Asensio Manjon (University of Lausanne)
Ms Morgane Gafner (University of Lausanne)

Increasing use of digital data collection tools for academic surveys and the production of official statistics now requires participants to share different types of sensitive personal data over different online platforms, via different modes of data capture. This proliferation of new methods – in the context of digitalisation more generally - has resulted in growing concerns about data security and privacy, and declining trust, with negative impacts on willingness to participate. Finding ways to increase trust in digital data collection is paramount for ensuring researchers can capitalise on the potential these methods offer for gathering new forms of data, in more efficient ways. In this study, we report on the results of experiments conducted in a probability-based, multi-wave online survey of the general population, designed to boost participation by testing ways to build digital trust. Specifically, we report on the effectivness of sending an infographic postcard presenting preliminary results from wave 1 on subsequent retention rates and assess whether its effects are moderated or mediated by relational digital trust. Few studies have tested the effect of providing feedback on survey findings to participants, and evidence about its effectiveness is mixed. The postcard was hypothesised to positively influence wave 2 participation via relational trust by emphasising transparency with respect to the use of survey data. Preliminary results indicate that wave 1 respondents who received the infographic indeed responded at higher rates at wave 2 than those who did not receive the postcard. The analysis will be extended to investigate whether how positive impacts on response rates relate to different trust components. The results will inform recommendations about how to motivate participation in surveys based on digital data collection methods.


The effect of control in data collection processes on the willingness to participate in app-based data collection

Mr Thijs Carrière (Utrecht University) - Presenting Author
Dr Bella Struminskaya (Utrecht University)

In social and behavioral sciences, researchers increasingly use technologically advanced data collection methods, such as mobile apps and sensors. Such methods can replace and improve data collection compared to traditional surveys. These methods also deal with low study participation rates, for example caused by privacy concerns. Providing participants with control over the data collection process can mitigate privacy concerns and increase participation rates. Prior studies confirm the positive effect of control in the data collection process on both hypothetical willingness to share data and actual participation in app-based studies. However, the mechanisms behind control increasing participation rates and what ways to best implement control features in app-based data collection are yet to be understood. Our study addresses the question what app-features provide participants with control over the data collection process.

To understand what features of apps influence willingness to participate, we conducted a vignette study in December 2024 in the Centerpanel, a former-probability, online panel in the Netherlands. We randomly assigned panel members to two groups which varied the presentation of the study. Participants were presented with a hypothetical study that uses app-based data collection. Both groups received a study description and a mockup picture of a study app. In their description and mock-up, the experimental group received control features, such as the option for data deletion, data overview, and pausing data collection. The control group received a description and mockup without any of these features. We investigate whether control leads to higher willingness to share data, and through which mechanisms. We will test the leverage-saliency theory to see whether effects of control are larger for people that find control important. The results of this study advance the understanding of control features in data collection and might inform researchers when designing study apps.