Survey Nonresponse Trends and Fieldwork Effort in the 21st Century: Results of an International Study across Countries and Surveys

AAPOR (American Association of Public Opinion Research) Task Force on Survey Refusals. 2014. Current Knowledge and Considerations Regarding Survey Refusals. Available at: http://www.aapor.org/AAPOR_Main/media/MainSiteFiles/RefusalTF_FINAL090814.pdf (accessed 20 January 2020).Search in Google Scholar

AAPOR: American Association of Public Opinion Research. 2016. Standard Definitions, Final Dispositions of Case Codes and Outcome Rates for Surveys. Available at: https://www.aapor.org/AAPOR_Main/media/publications/Standard-Definitions20169theditionfinal.pdf (accessed 28 April 2020).Search in Google Scholar

Atrostic, B.K., N. Bates, G. Burt, and A. Silberstein. 2001. “Nonresponse in US Government Household Surveys: Consistent Measures, Recent Trends, and New Insights.” Journal of Official Statistics 17: 209–226. Available at: https://www.scb.se/contentassets/ca21efb41fee47d293bbee5bf7be7fb3/nonresponse-in-u.s.-government-household-surveys-consistent-measures-recent-trends-and-new-insights.pdf (accessed 28 April 2020).Search in Google Scholar

Bethlehem, J., F. Cobben, and B. Schouten. 2011. Handbook of Nonresponse in Household Surveys. New York: Wiley. DOI: https://doi.org/10.1002/9780470891056.10.1002/9780470891056Search in Google Scholar

Beullens, K., G. Loosveldt, C. Vandenplas, and I. Stoop. 2018. “Response Rates in The European Social Survey: Increasing, Decreasing, or a Matter of Fieldwork Efforts?” Survey Methods: Insights from the Field. DOI: https://doi.org/10.13094/SMIF-2018-00003.Search in Google Scholar

Biemer, P.P. and L.E. Lyberg. 2003. Introduction to Survey Quality. New York: Wiley. DOI: https://doi.org/10.1002/0471458740.10.1002/0471458740Search in Google Scholar

Bradburn, N. 1992. “A Response to the Nonresponse Problem: Presidential Address AAPOR.” Public Opinion Quarterly 56: 391–387. DOI: https://doi.org/10.1093/poq/56.3.391.10.1093/poq/56.3.391Search in Google Scholar

Brehm, J. 1993. The Phantom Respondents: Opinion Surveys and Political Representation. Ann Arbor: The University of Michigan Press. DOI: https://doi.org/10.3998/mpub.9690285.10.3998/mpub.9690285Search in Google Scholar

Brick, J.M. 2013. “Unit Nonresponse and Weighting Adjustments: A Critical Review.” Journal of Official Statistics 29: 329–352. DOI: https://doi.org/10.2478/jos-2013-0026.10.2478/jos-2013-0026Search in Google Scholar

Chun, A.Y., S.G. Heeringa, and B. Schouten. 2018. “Responsive and Adaptive Design for Survey Optimization.” Journal of Official Statistics 34: 581–597. DOI: https://doi.org/10.2478/jos-2018-0028.10.2478/jos-2018-0028Search in Google Scholar

Curtin, R., S. Presser, and E. Singer. 2005. “Changes in Telephone Survey Nonresponse Over the Past Quarter Century.” Public Opinion Quarterly 69: 87–98. DOI: https://doi.org/10.1093/poq/nfi002.10.1093/poq/nfi002Search in Google Scholar

De Heer, W. 1999. “International Response Trends: Results of An International Survey.” Journal of Official Statistics 15: 129–142. Available at: https://www.scb.se/contentassets/ca21efb41fee47d293bbee5bf7be7fb3/international-response-trends-results-ofan-international-survey.pdf (accessed 14 February 2020).Search in Google Scholar

De Leeuw, E.D. 2018. “Mixed-Mode: Past, Present, and Future”. Survey Research Methods, 17: 75–89. Available at: https://ojs.ub.uni-konstanz.de/srm/article/view/7402/6582 (accessed 20 January 2020).Search in Google Scholar

De Leeuw, E., and W. De Heer. 2002. “Trends in Household Survey Nonresponse: A Longitudinal and International Comparison.” In Survey Nonresponse, Edited by R.M. Groves, D.A. Dillman, J.L. Eltinge, R.J.A. Little, 41–54. New York: Wiley.Search in Google Scholar

De Leeuw, E., J. Hox, and A. Luiten. 2018. “International Nonresponse Trends Across Countries and Years: An Analysis of 36 Years of Labor Force Survey Data.” Survey Methods: Insights from the Field. Available at: https://surveyinsights.org/?p=10452 (accessed 28 April 2020).Search in Google Scholar

De Leeuw, E., J. Hox, H. Silber, B. Struminskaya, and C. Vis. 2019. “Development of An International Survey Attitude Scale: Measurement Equivalance, Reliability, and Predictive Validity.” Measurement Instruments for the Social Sciences,1:9. DOI: https://doi.org/10.1186/s42409-019-0012-x.10.1186/s42409-019-0012-xSearch in Google Scholar

Dillman, D.A. 2017. “The Promise and Challenges of Pushing Respondents to the Web in Mixed-Mode Surveys.” Survey Methodology. Statistics Canada, Catalogue No. 12–001–X, Vol. 43, No. 1. Available at: http://www.statcan.gc.ca/pub/12-001-x/2017001/article/14836-eng.htm (accessed 5 May 2020).Search in Google Scholar

Dillman, D.A. 1978. Mail and Telephone Surveys; the Total Design Method. New York: Wiley.Search in Google Scholar

Dillman, D.A., J. L. Eltinge, R.M. Groves, and R.J.A. Little. 2002. “Survey nonresponse in design, data collection, and analysis”. In Survey Nonresponse, Edited by R.M. Groves, D.A. Dillman, J.L. Eltinge, and R.J.A. Little: 3–26. New York: Wiley.Search in Google Scholar

Dillman, D.A., J.D. Smyth, and L.M. Christian. 2014. Internet, Phone, Mail, and Mixed-Mode Surveys. The Tailored Design Method, Fourth Edition. New York: Wiley.Search in Google Scholar

Dutwin D. and P.J. Lavrakas. 2017. Trends in Telephone Outcomes, Appendix D to the Future of US General Population Telephone Survey Research AAPOR Task Force Report 2017. Available at: https://www.aapor.org/Education-Resources/Reports/The-Future-Of-U-S-General-Population-Telephone-Sur.aspx?utm_source=link_news-v9&utm_campaign_item_225143&utm_medium=copy (accessed 14 February 2020).Search in Google Scholar

Groves, R. 1989. Survey Errors and Survey Costs. New York: Wiley. DOI: https://doi.org/10.1002/0471725277.10.1002/0471725277Search in Google Scholar

Groves, R.M. and M.P. Couper. 1998. Nonresponse in Household Survey Interviews. New York: Wiley. DOI: https://doi.org/10.1002/9781118490082.10.1002/9781118490082Search in Google Scholar

Groves, R.M., F.J. Fowler, M.P. Couper, J.M. Lepkowski, E. Singer, and R. Tourangeau. 2004. Survey Methodology, Second Edition. New York: Wiley.Search in Google Scholar

Guilford, J.P. and B. Fruchter. 1978. Fundamental Statistics in Psychology and Education. New York, London: McGraw-Hill.Search in Google Scholar

Harris-Kojetin, B.A. and C. Tucker. 1999. “Exploring the Relations of Economic and Political Conditions With Refusal Rates to a Government Survey.” Journal of Official Statistics 15: 167–184. Available at: https://www.scb.se/contentassets/ca21efb41-fee47d293bbee5bf7be7fb3/exploring-the-relation-of-economic-and-political-conditions-with-refusal-rates-to-a-government-survey.pdf (accessed 14 April 2020).Search in Google Scholar

Hox, J.J. and E.D. De Leeuw. 1994. “A Comparison of Nonresponse in Mail, Telephone, and Face-to-face Surveys; Applying Multilevel Models to Meta-Analysis.” Quality and Quantity 28: 329-344. DOI: https://doi.org/10.1007/BF01097014.10.1007/BF01097014Search in Google Scholar

Hox, J., M. Moerbeek, and R. Van De Schoot. 2018. Multilevel Analysis. Techniques and Applications. New York, London: Routledge. DOI: https://doi.org/10.4324/9781315650982.10.4324/9781315650982Search in Google Scholar

Larsen, L.J, J. Fane Lineback, and B.M. Reist 2020 “Continuing to Explore the Relation between Economic and Political Factors and Government Survey Refusal Rates: 1960–2015”. Journal of Official Statistics, this issue.10.2478/jos-2020-0026Search in Google Scholar

Lavrakas, P.J., M.W. Traugott, C. Kennedy, A.L. Holbrook, E.D. De Leeuw, and B.T. West. 2019. Experimental Methods in Survey Research. Techniques That Combine Random Sampling With Random Assignment. New York: Wiley. DOI: https://doi.org/10.1002/9781119083771.10.1002/9781119083771Search in Google Scholar

Loosveldt, G. 2019. Valedictory Address. Leuven: KU Leuven, November 15, 2019. Available at: https://soc.kuleuven.be/fsw/nieuws/emeritaat-geert-loosveldt (accessed June 2020).Search in Google Scholar

Loosveldt, G. and D. Joye. 2016. “Defining and Assessing Survey Climate.” In The Sage Handbook of Survey Methodology, Edited by C. Wolf, D. Joye, T.W. Smith, and Y-C Fu, 67-76. Los Angeles: Sage. DOI: https://doi.org/10.4135/9781473957893.n27.10.4135/9781473957893.n27Search in Google Scholar

Luiten, A., E. de Leeuw, B. Schouten, and J. Hox. 2016. “First Results of the (new) International Questionnaire on Nonresponse: Response of the LFS.” Paper Presented at International Workshop of Household Survey Nonresponse, Oslo, Norway, 31-8/1-9, 2016. Available at: https://www.nonresponse.org/uploadi/editor/DnD148714714898539LuiteneaInternationalQuestionnaire.docx (accessed June 2020).Search in Google Scholar

Marken, S. 2018. Still Listening: The State of Telephone Surveys. Gallup. Available at: https://news.gallup.com/opinion/methodology/225143/listening-state-telephone-surveys.aspx (accessed 14 July 2019).Search in Google Scholar

Muthén, L.K. and B.O. Muthén. 2017. Mplus User’s Guide. Eight Edition. Los Angeles, CA: Muthén & Muthén.Search in Google Scholar

Pew Research. 2012. Assessing the Representativeness of Public Opinion Surveys. Available at: https://www.people-press.org/2012/05/15/assessing-the-representativeness-of-public-opinion-surveys/ (accessed 28 April 2020).Search in Google Scholar

Schouten, B., N. Shlomo, and C. Skinner. 2011. “Indicators for Monitoring and Improving Representativeness of Response.” Journal of Official Statistics. Available at: https://www.scb.se/contentassets/ca21efb41fee47d293bbee5bf7be7fb3/indicators-for-monitoring-and-improving-representativeness-of-response.pdf (accessed 28 April 2020).Search in Google Scholar

Singer, E. 2002. “The Use of Incentives to Reduce Nonresponse in Household Surveys.” In Survey Nonresponse, Edited by R.M. Groves, D.A. Dillman, J.L. Eltinge, and R.J.A. Little, 163–178. New York: Wiley.Search in Google Scholar

Singer, E. and C. Ye. 2013. “The Use and Effects of Incentives in Surveys”. The Annals of the American Academy of Political and Social Science 645: 112–141. DOI: https://doi.org/10.1177/0002716212458082.10.1177/0002716212458082Search in Google Scholar

Steeh, C. 1981. “Trends in Nonresponse Rates, 1952-1979.” Public Opinion Quarterly 45: 40–57. DOI: https://doi.org/10.1086/268633.10.1086/268633Search in Google Scholar

Stoop, I. 2005. The Hunt for the Last Respondent. The Hague: Social and Cultural Planning Office. Available at: https://www.scp.nl/english/Publications/Publications_-by_year/Publications_2005/The_Hunt_for_the_Last_Respondent (accessed 14 February 2020).Search in Google Scholar

Stoop, I. 2016. “Unit Nonresponse“. In The Sage Handbook of Survey Methodology, Edited by C. Wolf, D. Joye, T.W. Smith, and Y-C Fu, 409-424. Los Angeles: Sage. DOI: https://doi.org/10.4135/9781473957893.n27.10.4135/9781473957893.n27Search in Google Scholar

Stoop, I., J. Billiet, A. Koch, and R. Fitzgerald. 2010. Improving Survey Response: Lessons Learned from the European Social Survey. Chichester: Wiley. DOI: https://doi.org/10.1002/9780470688335.10.1002/9780470688335Search in Google Scholar

Tabachnick, B.G., and L. Fidell. 2013. Using Multivariate Statistics. Boston, MA: Pearson.Search in Google Scholar

Tourangeau, R., J.M. Brick, S. Lohr, and J. Li. 2016. “Adaptive and Responsive Survey Designs: A Review and Assessment.” Journal of the Royal Statistical Society, Series A. 180: 203 223. DOI: https://doi.org/10.1111/rssa.12186.10.1111/rssa.12186Search in Google Scholar

Vehovar, V. 1999. “Field Substitution and Unit Nonresponse”. Journal of Official Statistics, 15: 333–550. Available at: https://www.scb.se/contentassets/ca21efb41-fee47d293bbee5bf7be7fb3/field-substitution-and-unit-nonresponse.pdf (accessed 28 April 2020).Search in Google Scholar

Williams, D. and J.M. Brick. 2018. “Trends in US Face-to-Face Household Survey Nonresponse and Level of Effort”. Journal of Survey Statistics and Methodology 6: 186–211. DOI: https://doi.org/10.1093/jssam/smx019.10.1093/jssam/smx019Search in Google Scholar