Classifying Open-Ended Reports: Factors Affecting the Reliability of Occupation Codes

Andrews, M. 2005. “Who is Being Heard? Response Bias in Open-Ended Responses in a Large Government Employee Survey.” In Proceedings of the Section on Survey Research Methods: American Statistical Association, August, Minneapolis, MN, 3760-3766.Search in Google Scholar

Anker, R. 1998. Gender and Jobs: Sex Segregation of Occupations in the World. Geneva: International Labour Office.Search in Google Scholar

Barsalou, L.W. 1985. “Ideals, Central Tendency and Frequency of Instantiation as Determinants of Graded Structure in Categories.” Journal of Experimental Psychology: Learning, Memory and Cognition 11: 629-654.Search in Google Scholar

Biemer, P.P. and L.E. Lyberg. 2003. Introduction to Survey Quality. New York: Wiley.10.1002/0471458740Search in Google Scholar

Bjerk, D. 2007. “The Differing Nature of Black-White Wage Inequality Across Occupational Sectors.” The Journal of Human Resources 42: 398-434. Doi: http://dx.doi.org/10.3368/jhr.XLII.2.398.10.3368/jhr.XLII.2.398Search in Google Scholar

Bureau of Labor Statistics. 2014. “Revising the Standard Occupational Classification.” Working Paper. Available at: http://www.bls.gov/soc/revising_the_standard_occupational_classification_2018.pdf (accessed September 11, 2015).Search in Google Scholar

Bushnell, D. 1995. “Computer Assisted Occupation Coding.” Working Paper. Available at: http://www.blaiseusers.org/1995/papers/bushne95.pdf (accessed September 11, 2015).Search in Google Scholar

Campanelli, P.C., K. Thomson, N. Moon, and T. Staples. 1997. “The Quality of Occupational Coding in the United Kingdom.” In Survey Measurement and Process Quality, edited by L. Lyberg, P. Biemer, M. Collins, E. de Leeuw, and C. Dippo, 437-457. Hoboken, NJ: Wiley-Interscience.10.1002/9781118490013.ch19Search in Google Scholar

Cantor, D. and J. Esposito. 1992. “Evaluating Interviewer Style for Collecting Industry and Occupation Information.” In Proceedings of the Section on Survey Research Methods, August, Boston, MA, 661-666.Search in Google Scholar

Cawley, J.C. and G.T. Homce. 2003. “Occupational Electrical Injuries in the United States, 1992-1998, and Recommendations for Safety Research.” Journal of Safety Research 34: 241-248. Doi: http://dx.doi.org/10.1016/S0022-4375(03)00028-8.10.1016/S0022-4375(03)00028-8Search in Google Scholar

Couper, M.P. and F.G. Conrad. 1996. “Collecting Data to Facilitate the Classification of Occupations Using a Skill-Based Approach.” Paper presented at Fourth International Social Science Methodology Conference, July, Essex, UK. Ericsson, A. and H. Simon. 1993. Protocol Analysis: Verbal Reports as Data, rev. ed. Cambridge, MA: MIT Press.Search in Google Scholar

Esuli, A. and F. Sebastiani. 2010. “Machines that Learn to Code Open-Ended Survey Data.” International Journal of Market Research, 52: 775-800. Doi: http://dx.doi.org/10.2501/S147078531020165X.10.2501/S147078531020165XSearch in Google Scholar

Grice, H.P. 1975. “Logic and Conversation.” In Syntax and Semantics: Volume 3, Speech Acts, edited by P. Cole and J.L. Morgan, 41-58. New York: Academic Press.10.1163/9789004368811_003Search in Google Scholar

Hak, T. and T. Bernts. 1996. “Coder Training: Theoretical Training or Practical Socialization?” Qualitative Sociology 19: 479-501. Doi: http://dx.doi.org/10.1007/BF02393420.10.1007/BF02393420Search in Google Scholar

Hammond, S.K., G. Sorensen, R. Youngstrom, and J.K. Ockene. 1995. “Occupational Exposure to Environmental Tobacco Smoke.” Journal of the American Medical Association 274: 956-960. Doi: http://dx.doi.org/10.1001/jama.1995.03530120048040.10.1001/jama.1995.03530120048040Search in Google Scholar

Heywood, J.S. and P.L. O’Halloran. 2005. “Racial Earnings Differentials and Performance Pay.” The Journal of Human Resources 40: 435-452. Doi: http://dx.doi.org/10.3368/jhr.XL.2.435.10.3368/jhr.XL.2.435Search in Google Scholar

Israel, G.D. 2010. “Effects of Answer Space Size on Responses to Open-Ended Questions in Mail Surveys.” Journal of Official Statistics 26: 271-285. Jones, N.A. and J. Bullock. 2012. “The Two or More Races Population: 2010.” 2010Search in Google Scholar

Census Briefs. Available at: https://www.census.gov/prod/cen2010/briefs/c2010br-13.pdf (accessed April 10, 2015).Search in Google Scholar

Kauppinen, T., J. Toikkanen, D. Pedersen, R. Young, W. Ahrens, P. Boffetta, J. Hansen, H. Kromhout, J.M. Blasco, D. Mirabelli, V. Orden-Rivera, B. Pannett, N. Plato, A. Savela, R. Vincent, and M. Kogevinas. 2000. “Occupational Exposure to Carcinogens in the European Union.” Occupational and Environmental Medicine 57: 10-18. Doi: http://dx.doi.org/10.1136/oem.57.1.10.10.1136/oem.57.1.10173985910711264Search in Google Scholar

Kromhout, H., E. Symanski, and S.M. Rappaport. 1993. “A Comprehensive Evaluation of Within- and Between-Worker Components of Occupational Exposure to Chemical Agents.” The Annals of Occupational Hygiene 37: 253-270. Doi: http://dx.doi.org/10.1093/annhyg/37.3.253.10.1093/annhyg/37.3.253Search in Google Scholar

Kunda, Z. and K.C. Oleson. 1995. “Maintaining Stereotypes in the Face of Disconfirmation: Constructing Grounds for Subtyping Deviants.” Journal of Personality and Social Psychology 68: 565-579. Doi: http://dx.doi.org/10.1037/0022-3514.68.4.565.10.1037/0022-3514.68.4.565Search in Google Scholar

Layne, L.A. 2004. “Occupational Injury Mortality Surveillance in the United States: An Examination of Census Counts from Two Different Surveillance Systems, 1992-1997.” American Journal of Industrial Medicine 45: 1-13. Doi: http://dx.doi.org/10.1002/ajim.10308.10.1002/ajim.10308Search in Google Scholar

Lettau, M.K. 2003. “New Estimates for Wage Rate Inequality Using the Employment Cost Index.” The Journal of Human Resources 38: 792-805. Doi: http://dx.doi.org/10.3368/jhr.XXXVIII.4.792.10.3368/jhr.XXXVIII.4.792Search in Google Scholar

Lyberg, L. and P. Dean. 1992. Automated Coding of Survey Responses: An International Review. R&D Reports, No. 2. Stockholm, Sweden: Statistics Sweden.Search in Google Scholar

Lyberg, L. and D. Kasprzyk. 1997. “Some Aspects of Post-Survey Processing.” In Survey Measurement and Process Quality, edited by L. Lyberg, P. Biemer, M. Collins, E. De Leeuw, C. Dippo, N. Schwarz, and D. Trewin, 353-370. New York: Wiley.10.1002/9781118490013.ch15Search in Google Scholar

Martin, J., D. Bushnell, P. Campanelli, and R. Thomas. 1995. “A Comparison of Interviewer and Office Coding of Occupations.” In Proceedings of the Section on Survey Research Methods: American Statistical Association, August, Orlando, FL, 1122-1127.Search in Google Scholar

Macchia, S. and M. D’Orazio. 2001. “A System to Monitor the Quality of Automated Coding of Textual Answers to Open Questions.” Research in Official Statistics 4: 7-21.Search in Google Scholar

Moscarini, G. and K. Thomsson. 2007. “Occupational and Job Mobility in the US.” The Scandinavian Journal of Economics 109: 807-836. Doi: http://dx.doi.org/10.1111/j.1467-9442.2007.00510.x.10.1111/j.1467-9442.2007.00510.xSearch in Google Scholar

Norman, D.A. 1981. “Categorization of Action Slips.” Psychological Review 88: 1-15. Doi: http://dx.doi.org/10.1037/0033-295X.88.1.1.10.1037/0033-295X.88.1.1Search in Google Scholar

Reichard, A.A. and L.L. Jackson. 2010. “Occupational Injuries among Emergency Responders.” American Journal of Industrial Medicine 53: 1-11. Doi: http://dx.doi.org/10.1002/ajim.20772.10.1002/ajim.20772Search in Google Scholar

Rosch, E., C.B. Mervis, W.D. Gray, D.M. Johnson, and P. Boyes-Braem. 1976. “Basic Objects in Natural Categories.” Cognitive Psychology 8: 382-439. Doi: http://dx.doi.org/10.1016/0010-0285(76)90013-X.10.1016/0010-0285(76)90013-XSearch in Google Scholar

Rosenthal, N. 1992. “Evaluating the 1990 Projections of Occupational Employment.” Monthly Labor Review 115: 32-48.Search in Google Scholar

Shniper, L. 2005. “Occupational Mobility, January 2004.” Monthly Labor Review 128: 30-35.Search in Google Scholar

Smyth, J.D., D.A. Dillman, L.M. Christian, and M. Mcbride. 2009. “Open-Ended Questions in Web Surveys: Can Increasing the Size of Answer Boxes and Providing Extra Verbal Instructions Improve Response Quality?” Public Opinion Quarterly 73: 325-337. Doi: http://dx.doi.org/10.1093/poq/nfp029.10.1093/poq/nfp029Search in Google Scholar

Sturgis, P. 2004. “The Effect of Coding Error on Time Use Survey Estimates.” Journal of Official Statistics 20: 467-480.Search in Google Scholar

Sudman, S., N. Bradburn, and N. Schwarz. 1996. Thinking About Answers: The Application of Cognitive Processes to Survey Methodology. San Francisco: Jossey-Bass Publishers.Search in Google Scholar

Tourangeau, R., L. Rips, and K. Rasinski. 2000. The Psychology of Survey Response. Cambridge: Cambridge University Press.10.1017/CBO9780511819322Search in Google Scholar

Tversky, A. and D. Kahneman. 1974. “Judgment Under Uncertainty: Heuristics and Biases.” Science 185: 1124-1131. Doi: http://dx.doi.org/10.1126/science.185.4157.1124.10.1126/science.185.4157.112417835457Search in Google Scholar

Tversky, A. and D. Kahneman. 1983. “Extensional Versus Intuitive Reasoning: The Conjunction Fallacy in Probability Judgment.” Psychological Review 90: 293-315. Doi: http://dx.doi.org/10.1037/0033-295X.90.4.293.10.1037/0033-295X.90.4.293Search in Google Scholar

U.S. Census Bureau. 2013. Current Population Survey Interviewing Manual. Available at: http://www.census.gov/prod/techdoc/cps/CPS_Manual_June2013.pdf (accessed September 11, 2015).Search in Google Scholar

U.S. Census Bureau. 2014. Current Population Survey (CPS) and American Community Survey (ACS): Coding Instructions for 2007/2010/2012 Industry and Occupation (I&O) Coding. Revision 2. October 1, 2014.Search in Google Scholar

Westat/AIR. 1989. Research on Industry and Occupation Questions in the Current Population Survey. Final Report to the Bureau of Labor Statistics. Washington, DC: Westat, Inc. and American Institutes for Research. Search in Google Scholar