All time references are in CEST
Using Internet Surveys in Cross-National Research |
|
Session Organiser | Dr Tom W Smith (NORC at the University of Chicago) |
Time | Friday 21 July, 09:00 - 10:30 |
Room | U6-01f |
Pushed by the rising costs of traditional modes (face-to-face, telephone) and the COVID pandemic, there is ever increasing use of internet-based surveys in both national and cross-national research. The use internationally is especially challenging given the varying levels of internet availability, the different levels of familiarity with doing surveys on-line, and the various sample frames that can be employed for drawing internet samples across countries. This session will examine the use of internet surveys cross-nationally and consider such issues as 1) how can cross-national comparability be maximized, 2) the use of one-time internet surveys vs. employing internet panels, 3) the comparability of internet surveys to surveys using other modes and in particular the reliable measurement of trends over time when traditional modes are replaced by internet modes, and 4) the variation that occurs due to the devices used to access the internet and complete surveys (e.g. smartphone vs. lap/desktops). Research will draw on the European Social Survey, the International Social Survey Program, and other cross-national studies.
Keywords: Cross-national survey research, Mode, Internet
Ms Elena Babamova (Lifepanel)
Mr Carsten Broich (Lifepanel) - Presenting Author
In online probability panels or mixed mode probability panels it is so far standard to receive the majority of the completions via Email invites. To cover part of the offline population, elements like mail invitations, tablets or calls to landline phones are used additionally. Nevertheless, not much research has been conducted on the effectiveness of email as a major means for online probability panels. Within Lifepanel, members are recruited through phone for which an RDD Dual-Frame is the base for the probability selection. With the majority of the sample recruits coming from mobile phone numbers, it became questionable whether the email address is really required or whether the invites can be pushed to the mobile phone number via SMS or WhatsApp and yield higher response rates. As part of an adaptive design, it was tested to which extent it is possible to predict the most likely choice for response modes based on the demographics and use this knowledge to increase the panel response rates.
Ms Laura Wronski (SurveyMonkey)
Mr Sam Gutierrez (SurveyMonkey) - Presenting Author
Ms Zoe Padgett (SurveyMonkey)
Analyzing metadata from millions of survey responses from the SurveyMonkey platform the past 10 years, we explore trends in the survey-taking experience globally, and across countries and regions. Cross-cultural differences in response distributions have been well-established in the academic literature. In this research, we examine responses to all NPS questions asked in 10 countries around the world to compare how those scores have changed over time and how consistently their country-by-country variation is. This research highlights the changing respondent experience, and the various considerations that survey creators will have to keep in mind when designing questionnaires.