Evaluating the Efficiency of Methods to Recruit Asian Research Participants

Open access


Few empirical studies have evaluated the efficiency of recruitment methods to recruit non- English-speaking research participants. We attempt to fill this research gap by conducting a systematic evaluation using recruitment data from a large cognitive testing study that pretested the translations of the American Community Survey. In our study we contacted 1,084 Chinese and Korean speakers to identify those who spoke little or no English. We measured the efficiency of the recruitment methods (newspaper advertisements, flyers, online communication, and word of mouth) using four criteria: time spent, outreach capacity, screener completion, and eligibility rate. We also examined differences in recruitment efficiencies by recruiters and sublanguage groups. Among the recruitment methods examined, newspaper advertisements were most efficient in reaching a larger number of Asians while using the least amount of recruiters’ time. For recruiting non-English speakers, word of mouth by recruiters with strong ties to the ethnic community worked best.

Appel, L.J., Vollmer, W.M., Obarznek, E., Aicher, K.M., Conlin, P.R., Kennedy, B.M., Chaleston, J.B., Reams, P.M., and the DASH Collaborative Research Group (1999). Collaborative Research Group Recruitment and Baseline Characteristics of Participants in the Dietary Approaches to Stop Hypertension Trial. Journal of the American Dietetic Association, 99, S69-S75, DOI: http://www.dx.doi.org/10.1016/ S0002-8223(99)00419-8.

Area´n, P.A., and Gallagher-Thompson, D. (1996). Issues and Recommendations for the Recruitment and Retention of Older Ethnic Minority Adults into Clinical Research. Journal of Consulting and Clinical Psychology, 64, 875-880.

Berrigan, D., Forsyth, B.H., Helba, C., Levin, K., Norberg, A., and Willis, G. (2010).

Cognitive Testing of Physical Activity and Acculturation Questions in Recent and Long-Term Latino Immigrants. BioMed Central Public Health, 10(481). Available at: http://www.biomedcentral.com/content/pdf/1471-2458-10-481.pdf (accessed March 2012).

Bistricky, S.L., Mackin, R.S., Chu, J.P., and Arean, P.A. (2010). Recruitment of African Americans and Asian Americans with Late Life Depression and Mild Cognitive Impairment. American Journal of Geriatric Psychiatry, 18, 734-742.

Coleman, E.A., Tyll, L., LaCroix, A.Z., Allen, C., Leveille, S.G., Wallace, J.I., Buchner, D.M., Grothaus, L.C., and Wagner, E.H. (1997). Recruiting African- American Older Adults for a Community Based Health Promotion Intervention: Which Methods Are Effective? American Journal of Preventive Medicine, 13, 51-56.

Flanagin, A.J., and Metzger, M.J. (2000). Perceptions of Internet Information Credibility. Journalism and Mass Communication Quarterly, 73, 515-540.

Forsyth, B.H., Kudela, M.S., Levin, K., Lawrence, D., and Willis, G. (2007). Methods for Translating an English-Language Survey Questionnaire on Tobacco Use into Mandarin, Cantonese, Korean and Vietnamese. Field Methods, 19, 264-283.

Fujimoto, W.Y. (1998). Community Involvement and Minority Participation in Clinical Research. Diabetes Spectrum, 11, 161-166.

Gilliss, C.L., Lee, K.A., Gutierrez, Y., Taylor, D., Beyene, Y., Neuhaus, J., and Murrell, N. (2001). Recruitment and Retention of Healthy Minority Women into Community-based Longitudinal Research. Journal of Women’s Health Gender Based Medicine, 10, 77-85, DOI: http://www.dx.doi.org/10.1089/152460901750067142.

Gorelick, P.B., Richardson, D., Hudson, E., Perry, C., Robinson, D., Brown, N., and Harris, Y. (1996). Establishing a Community Network for Recruitment of African Americans into a Clinical Trial. The African American Antiplatelet Stroke Prevention Study (AAASPS) Experience. Journal of the National Medical Association, 88, 701-704.

Harris, K.J., Ahluwalia, J.S., Catley, D., Okuyemi, K.S., Mayo, M.S., and Resnicow, K. (2003). Successful Recruitment of Minorities into Clinical Trials: The Kick It at Swope Project. Nicotine Tobacco Research, 5, 575-584.

Holcombe, R.F., Jacobson, J., Li, A., and Moinpour, C.M. (1999). Inclusion of African Americans in Oncology Clinical Trials. American Journal of Clinical Oncology, 22, 18-21.

Hughes, C., Peterson, S., Ramirez, A., Gallion, K., McDonald, P.G., Skinner, C.S., and Bowen, D. (2004). Minority Recruitment in Hereditary Breast Cancer Research. Cancer Epidemiology Biomarkers Prevention, 13, 1146-1155.

Kim, J., and Zapata, J. (2012). 2010 Census Language Program Assessment Report. 2010 Census Planning Memoranda Series, No. 204. Washington, DC: U.S. Census Bureau. Available at: http://www.census.gov/2010census/pdf/2010_Census_Language_Program_Assessment.pdf (accessed March 2013).

Koo, M., and Skinner, H. (2005). Challenges of Internet Recruitment: A Case Study with Disappointing Results. Journal of Medical Internet Research, 7, E6, DOI: http://www.dx.doi.org/10.2196/jmir.7.1.e6.

Lau, A., and Gallagher-Thompson, D. (2002). Ethnic Minority Older Adults in Clinical and Research Programs: Issues and Recommendations. The Behavior Therapist, 25, 10-11.

Lai, G.Y., Gary, T.L., Tilburt, J., Bolen, S., Baffid, C., Wilson, R.F., Howerton, M.W., Gibbson, M.C., Tanpitukpongsee, T.P., Powe, N.R., Bass, E.B., and Ford, J.G. (2006). Effectiveness of Strategies to Recruit Underrepresented Populations into Cancer Clinical Trials. Clinical Trials, 3, 133-141. DOI: http://dx.doi.org/10.1191/1740774506cn143oa.

Liu, L., Sha, M., and Park, H. (2013). Exploring the efficiency and utility of methods to recruit non-English speaking qualitative research participants. Survey Practice, 6(3), 1-8. Available at: http://www.surveypractice.org/index.php/SurveyPractice (accessed December 2013).

Markus, H.R., and Kitayama, S. (1991). Culture and the Self: Implications for Cognition, Emotion, and Motivation. Psychological Review, 20, 568-579.

Maxwell, A.E., Bastani, R., Vida, P., and Warda, S. (2005). Strategies to Recruit and Retain Older Filipino-American Immigrants for a Cancer Screening Study. Journal of Community Health, 30, 167-179. DOI: http://www.dx.doi.org/10.1007/s10900-004-1956-0.

McLean, C., and Campbell, C. (2003). Locating Research Informants in a Multi-ethnic Community: Ethnic Identities, Social Networks and Recruitment Methods. Ethnicity and Health, 8, 41-61.

Pan, Y., Landreth, A., Hinsdale, M., Park, H., and Schoua-Glusberg, A. (2007). Methodology for Cognitive Testing of Translations in Multiple Languages. In Proceedings of the Section on Survey Research Methods, Annual Conference of the American Association, 3801-3808 (Alexandria, VA, July 29-August 2, 2007).

Park, H., Liu, L., and Sha, M. (2011). Do Different Recruitment Methods Reach Different People? Annual Conference of the American Association (Phoenix, AZ, May 12-15, 2011).

Reed, P.S., Foley, K.L., Hatch, J., and Mutran, E.J. (2003). Recruitment of Older African Americans for Survey Research: A Process Evaluation of Community and Church-based Strategy in the Durham Elders Project. The Gerontologist, 43, 52-61. DOI: http://www.dx.doi.org/10.1093/geront/43.1.52.

Sha, M., McAvinchey, G., Reed, L., Rodriguez, S., and Carter, G. (2010). Respondent Recruitment, Interviewing, and Training: Lessons Learned From a Spanish Language Cognitive Interviewing Project. In Proceedings of the Section on Survey Research Methods, Annual Conference of the American Association, 6372-6381 (Alexandria VA, May 13-16, 2010).

Stoy, D.B., Curtis, R.C., Dameworth, K.S., Dowdy, A.A., Hegland, J., Levin, J.A., and Sousoulas, B.G. (1995). The Successful Recruitment of Elderly Black Subjects in a Clinical Trial: The CRISP Experience. Cholesterol Reduction in Seniors Program. Journal of the National Medical Association, 87, 280-287.

The DPP Research Group (2002). The Diabetes Prevention Program: Recruitment Methods and Results. Controlled Clinical Trials, 23, 157-171. DOI: http://www.dx.doi.org/10.1016/S0197-2456(01)00184-2.

Wellens, T. (1994). The Cognitive Evaluation of the Nativity Questions for the Current Population Survey. In Proceedings of the Section on Survey Research Methods, Annual Conference of the American Association, 1204-1209 (Alexandria, VA, May 11-15, 1994).

Wisdom, K., Neighbors, K., Williams, V.H., Havstad, S.L., and Tilley, B.C. (2002). Recruitment of African Americans with Type 2 Diabetes to a Randomized Controlled Trial Using Three Sources. Ethnic Health, 7, 267-278.

Yancey, A.K., Ortega, A.N., and Kumanyika, S.K. (2006). Effective Recruitment and Retention of Minority Research Participants. Annual Review of Public Health, 27, 1-28, DOI: http://www.dx.doi.org/10.1146/annurev.publhealth.27.021405.102113.

Yuan, Y.M., Wake, V., Park, H., and Nguyen, L. (2009). Conducting Cognitive Interviews with Linguistically Isolated Asian Populations. Presented in the 43rd International Field Directors and Technologies conference (Delray Beach, FL, May 17-20, 2009).

Journal of Official Statistics

The Journal of Statistics Sweden

Journal Information

IMPACT FACTOR 2017: 0.662
5-year IMPACT FACTOR: 1.113

CiteScore 2016: 0.63

SCImago Journal Rank (SJR) 2016: 0.710
Source Normalized Impact per Paper (SNIP) 2016: 0.975


All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 33 33 22
PDF Downloads 8 8 4