Interviewers often assess after the interview the respondent’s ability and reluctance to participate. Prior research has shown that this evaluation is associated with next-wave response behavior in face-to-face surveys. Our study adds to this research by looking at this association in telephone surveys, where an interviewer typically has less information on which to base an assessment. We looked at next-wave participation, non-contact and refusal, as well as longer-term participation patterns. We found that interviewers were better able to anticipate refusal than non-contact relative to participation, especially in the next wave, but also in the longer term. Our findings confirm that interviewer evaluations – in particular of the respondent’s reluctance to participate – can help predict response at later waves, also after controlling for commonly used predictors of survey nonresponse. In addition to helping to predict nonresponse in the short term, interviewer evaluations provide useful information for a long-term perspective as well, which may be used to improve nonresponse adjustment and in responsive designs in longitudinal surveys.
If the inline PDF is not rendering correctly, you can download the PDF file here.
Barrett, K., M. Sloan, and D. Wright. 2006. “Interviewer Perceptions of Interview Quality”. In Proceedings of the American Statistical Association, Survey Research Methodology Section, 4026–4033. Alexandria, VA: American Statistical Association. Available at: http://www.asasrms.org/Proceedings/y2006/Files/JSM2006-000644.pdf (accessed February 2020).
Block, E.S. and L. Erskine. 2012 “Interviewing by Telephone: Specific Considerations, Opportunities, and Challenges.” International Journal of Qualitative Methods 11(4): 428–445. DOI: https://doi.org/10.1177/160940691201100409.
Casas-Cordero, C., F. Kreuter, Y. Wang, and S. Babey. 2013. “Assessing the Measurement Error Properties of Interviewer Observations of Neighbourhood Characteristics”, Journal of the Royal Statistical Society: Series A 176: 229–249. DOI: https://doi.org/10.1111/j.1467-985X.2012.01065.x.
Chun, A., B. Schouten and J. Wagner. 2017. JOS Special Issue on Responsive and Adaptive Survey Design: “Looking Back to See Forward-Editorial”. Journal of Official Statistics 33(3): 571–577. DOI: http://dx.doi.org/10.1515/JOS-2017-0027.
Couper, M.P. and M.B. Ofstedal. 2009 “Keeping in Contact with mobile Sample Members.” In Methodology of Longitudinal Surveys, edited by P. Lynn, 183–203. New York: Wiley.
Eckman, S., J. Sinibaldi, and A. Möntmann-Hertz. 2013. “Can Interviewers effectively rate the Likelihood of Cases to cooperate?” Public Opinion Quarterly 77(2): 561–573. DOI: https://doi.org/10.1093/poq/nft012.
Feldman, J.J., H. Hyman, and C.W. Hart. 1951. “A Field Study of Interviewer Effects on the Quality of Survey Data.” Public Opinion Quarterly 15(4): 734–761. DOI: https://doi.org/10.1086/266357.
Groves, R.M., F.J. Fowler, M.P. Couper, J.M. Lepkowski, E. Singer, and R. Tourangeau. 2009. Survey Methodology. 2nd Ed., Wiley Series in Survey Methods. Hoboken, NJ: John Wiley & Sons.
Groves, R.M. and S.G. Heeringa. 2006. “Responsive Design for Household Surveys: Tools for actively controlling Survey Errors and Costs.” Journal of the Royal Statistical Society: Series A (Statistics in Society) 169(3): 439–457. DOI: https://doi.org/10.1111/j.1467-985X.2006.00423.x.
Kalton, G., J. Lepkowski, G.E. Montanari, and D. Maligalig. 1990. Characteristics of second Wave Nonrespondents in a Panel Survey. In Proceedings of the American Statistical Association, Survey Research Methodology Section, 462–467. Alexandria, VA: American Statistical Association.
Kaminska, O., A.L. McCutcheon, and J. Billiet. 2010. “Satisficing among reluctant Respondents in a Cross-National Context.” Public Opinion Quarterly 74(5): 956–984. DOI: https://doi.org/10.1093/poq/nfq062.
Kirchner, A., K. Olson, and J.D. Smyth. 2017. “Do Interviewer Postsurvey Evaluations of Respondents’ Engagement measure who Respondents are or what they do?” A Behavior coding Study. Public Opinion Quarterly: DOI: https://doi.org/10.1093/poq/nfx026.
Lemay, M. 2009. Understanding the Mechanism of Panel Attrition. Unpublished Doctoral thesis, University of Maryland, College Park, MD, U.S.A.
Lepkowski, J.M. and M.P. Couper. 2002. “Nonresponse in the second Wave of longitudinal Household Surveys.” In Survey nonresponse, edited by R.M. Groves, D.A. Dillman, J.L. Eltinge, and R.J. Little, 259–272. New York: Wiley.
Plewis, I., L. Calderwood, and T Mostafa. 2017. “Can Interviewer Observations of the Interview Predict future Response?” Methods, data, analyses 11(1): 29–44. DOI: https://doi.org/10.12758/mda.2016.010.
Tillmann, R., M. Voorpostel, U. Kuhn, F. Lebert, V-A. Ryser, O. Lipps, B. Wernli, and E. Antal. 2016. “The Swiss Household Panel Study: Observing social Change since 1999.” Longitudinal and Life Course Studies 7(1): 64–78. DOI: http://dx.doi.org/10.14301/llcs.v7i1.360.