Survey experiments with hard-to-survey populations: Solutions or new challenges? |
|
| Coordinator 1 | Mr Randy Stache (BAMF Research Centre) |
| Coordinator 2 | Dr Laura Peitz (BAMF Research Centre) |
| Coordinator 3 | Mr Armin Kuechler (Bielefeld University) |
Populations such as the homeless, elderly, irregular migrants, LGBTQIA+ individuals, victims of violence, and stigmatized people (e.g., individuals living with HIV or disabilities) are frequently underrepresented in general population surveys because they are particularly hard to reach. To address this issue, methodologies like respondent-driven-sampling and social media targeting have been developed.
However, reaching such populations is just the first hurdle; successfully conducting surveys with these groups presents additional complexities: Researchers are often interested in precisely those sensitive topics that make the groups difficult to reach, leading to low trust in the survey process and a higher social desirability bias or non-response to certain questions. Additionally, marginalized individuals may encounter difficulties with traditional survey frameworks due to factors such as low education, language barriers, or illiteracy, making it challenging for them to appropriately respond to questions or given formats. Health issues may further undermine survey quality.
Survey experiments, including factorial surveys and conjoint analyses, are increasingly used to tackle these challenges. In surveys with conventional populations, these methods were able to reduce social desirability through indirect questioning and were comprehensible to the participants due to their holistic design. However, there is limited research on the effectiveness of these experiments when working with hard-to-survey populations. Do these methods enhance comprehension and response quality? Can they effectively minimize social desirability bias and non-response? How do they compare to traditional direct questioning techniques? How can survey experiments be adapted to reflect the specific contexts and experiences of specific hard-to-survey populations?
This session will explore these questions, examining benefits and limitations of survey experiments within the context of hard-to-survey populations. In doing so, we aim to advance methodological approaches and improve the quality and inclusivity of survey research for often-overlooked research groups.