Adaptive Design Strategies for Nonresponse Follow-Up in Economic Surveys

Open access


The U.S. Census Bureau is investigating nonrespondent subsampling strategies for use in the 2017 Economic Census. In previous research, we developed an optimized allocation procedure for subsampling nonrespondents that selects larger systematic samples in domains with lower initial response. This article expands on our previous research by exploring improvements to the optimal allocation method; we investigate refinements to the previous procedure that incorporate measures of respondent balance with respect to the original sample. The revised allocation procedures have simultaneous objectives of allocating high proportions of sample in domains that indicate potential nonresponse bias and of equalizing response rates across domains. We examine the effects of the alternative allocation approaches on Horvitz-Thompson estimates via a simulation study using data from the 2014 Annual Survey of Manufactures.

Andridge, R.R. and R.J.A. Little. 2011. “Proxy Pattern-Mixture Analysis for Survey Nonresponse.” Journal of Official Statistics 27: 153–180. Available at:

Andridge, R.R. and K.J. Thompson. 2015. “Using the Fraction of Missing Information to Identify Auxiliary Variables for Imputation Procedures via Proxy Pattern-Mixture Models.” International Statistical Review 83(3): 472–492. Doi:

Baker, R., J.K. Brick, N.A. Bates, M. Battaglia, M.P. Couper, J.A. Dever, K.J. Gile, and R. Tourangeau. 2013. “Summary Report of the AAPOR Task Force on Non-Probability Sampling.” Journal of Survey Statistics and Methodology 1(2): 90–137.

Groves, R.M. and S.G. Heeringa. 2006. “Responsive Design for Household Surveys: Tools for Actively Controlling Survey Errors and Costs.” Journal of the Royal Statistical Society Series A 169: 439–457. Doi:

Hansen, M.H. and W.N. Hurwitz. 1946. “The Problem of Non-Response in Sample Surveys.” Journal of the American Statistical Association 41: 517–529.

Kaputa, S.J., L. Bechtel, K.J. Thompson, and D. Whitehead. 2014. “Strategies for Subsampling Nonrespondents for Economic Programs.” In Proceedings of the Section on Survey Research Methods, August 6, 2014. Alexandria, VA: American Statistical Association.

Little, R.J. and S. Vartivarian. 2005. “Does Weighting for Nonresponse Increase the Variance of Survey Means?” Survey Methodology 31(2): 161–168.

Lohr, S.L. 2010. Sampling: Design and Analysis (2nd Edition). Boston, MA: Brooks/Cole.

Marquette, E., M. Kornbau, and J. Toribio. 2015. “Testing Contact Strategies to Improve Response in the 2012 Economic Census.” In Proceedings of the Section on Government Statistics: American Statistical Association, August 10, 2015. Alexandria, VA: American Statistical Association.

Peytcheva, E. and R.M. Groves. 2009. “Using Variation in Response Rates of Demographic Subgroups as Evidence of Nonresponse Bias in Survey Estimates.” Journal of Official Statistics 25: 193–201.

Phipps, P. and D. Toth. 2012. “Analyzing Establishment Nonresponse Using an Interpretable Regression Tree Model with Linked Administrative Data.” The Annals of Applied Statistics 6(2): 772–794. Doi:

Särndal, C.E. 2011. “The 2010 Morris Hansen Lecture: Dealing with Survey Nonresponse in Data Collection in Estimation.” Journal of Official Statistics 27: 1–21.

Särndal, C. and P. Lundquist. 2014. “Accuracy in Estimation with Nonresponse: A Function of Degree of Imbalance and Degree of Explanation.” Journal of Survey Statistics and Methodology 2(4): 361–3087.

Särndal, C., B. Swensson, and J. Wretman. 1992. Model Assisted Survey Sampling, New York: Springer Verlag.

Schouten, B., M. Calinescu, and A. Luiten. 2013. “Optimizing Quality of Response through Adaptive Survey Designs.” Survey Methodology 39(2): 29–58.

Thompson, K.J. and S. Kaputa. 2017. Investigating Adaptive Nonresponse Follow-up Strategies for Small Businesses through Embedded Experiments. Journal of Official Statistics. Doi:

Thompson, K.J. and B.E. Oliver. 2012. “Response Rates in Business Surveys: Going Beyond the Usual Performance Measure.” Journal of Official Statistics 28: 221–237. Available at:

Wagner, J. 2012. “A Comparison of Alternative Indicators for the Risk of Nonresponse Bias.” Public Opinion Quarterly 76(3): 555–575. Doi:

Wilson, T., J. McCarthy, and A. Dau. 2016. Adaptive Design in an Establishment Survey: Targeting, Applying and Measuring ‘Optimal’ Data Collection Procedures in the Agricultural Resource Management Survey. Proceedings of the Fifth International Conference on Establishment Surveys.

Journal of Official Statistics

The Journal of Statistics Sweden

Journal Information

IMPACT FACTOR 2017: 0.662
5-year IMPACT FACTOR: 1.113

CiteScore 2017: 0.74

SCImago Journal Rank (SJR) 2017: 1.158
Source Normalized Impact per Paper (SNIP) 2017: 0.860


All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 138 138 41
PDF Downloads 74 74 38