1. Events
  2. 2018
  3. October
  4. Decomposing heterogeneity in response latencies in a face-to-face survey: Interviewer, respondent and question characteristics




Decomposing heterogeneity in response latencies in a face-to-face survey: Interviewer, respondent and question characteristics




Speaker: Patrick Sturgis, University of Southampton

Series: NatCen-ESS ERIC-City methodology seminar series


It is well known that interviewers are key to determining the quality and cost of data collection in household interview surveys. They influence the likelihood that sample members will respond and, therefore, the bias and precision of estimates. They also affect the answers that respondents give in ways that can make them more, or less accurate. These effects have been robustly demonstrated in the existing literature.

In this paper we consider a different and less well studied outcome; the extent to which interviewers affect the time respondents take to answer questions. Because interview length is often used as an indicator of both response quality and fieldwork costs, the answer to this question is consequential. We address this question by linking high volume paradata on response latencies from wave 3 of Understanding Society, a large face-to-face household interview survey, to survey data on interviewers and respondents to understand the causes of variability in response latencies. The linked data file contains over 3 million records and has a complex, hierarchical structure with response latencies nested within the cross-classification of respondents and questions which are themselves nested within the cross-classification of interviewers and areas.

We use a cross-classified mixed-effects location scale model to decompose the joint effects of interviewers, areas, questions, and respondents. We consider how interviewer demographic characteristics and attitudes toward and beliefs about fieldwork practices affect response latencies. We also assess which characteristics of questions and respondents are associated with longer response times. Our approach enables us to identify individual interviewers and questions which make particularly large contributions to variability in response times, which could be used to identify problems and lead to data quality improvements.

Patrick Sturgis is Professor of Research Methodology in the Department of Social Statistics, University of Southampton and Director of the ESRC National Centre for Research Methods. His research focuses on applied quantitative and statistical methods, with a particular specialism in survey design and analysis. He was President of the European Survey Research Association 2011-2015 and has published widely on in leading methodology journals including Journal of the Royal Statistical Society, Public Opinion Quarterly, and Journal of Survey Methods and Statistics. He serves in an advisory capacity on Understanding Society, the European Social Survey, and the British Election Study and is a member of the Advisory Board of the Government Statistical Service. He chaired the BPC/MRS Inquiry into the failure of the 2015 election polls and serves as Specialist Advisor to the House of Lords Select Committee on public opinion and polling.

Share this event

When and where

5.45pm - 7.15pmThursday 11th October 2018

ELG15 Drysdale Building City, University of London Northampton Square London EC1V 0HB United Kingdom

Booking Form

Your call to City University's form service returned an unexpected HTTP status of:404
Please contact our web team and we'll do our best to help you ASAP.