The growing body of creativity research has raised several challenging issues with regard to the measurement of this construct. This paper aims to provide a review of current challenging methodological issues related to measuring creativity. Five methodological issues are discussed: selecting measurement instruments, sampling, testing conditions, psychometric properties and domain-generality/specificity of creativity. This paper reveals that there remain a number of unresolved issues and serious questions surrounding the measurement of creativity. Research gaps and suggestions for future research are discussed.
*Baer, J. (2016). Domain specificity of creativity. San Diego, CA: Elsevier Academic Press.
*Baer, J., & Kaufman, J. C. (2005). Bridging generality and specificity: The Amusement Park Theoretical (APT) model of creativity. Roeper Review, 27, 158-163.
*Baer, J., & McKool, S. S. (2009). Assessing creativity using the consensual assessment technique. In C. S. Schreiner (Ed.), Handbook of research on assessment technologies, methods, and applications in higher education (pp. 65-77). Hershey, PA: IGI Global.
*Barbot, B., Besançon, M., & Lubart, T. I. (2011). Assessing creativity in the classroom. The Open Education Journal, 4, 124-132. doi:
*Barbot, B., Besançon, M., & Lubart, T. I. (2016). The generality-specificity of creativity: Exploring the structure of creative potential with EPoC. Learning and Individual Differences, 52, 178-187. doi:
Batey, M., Chamorro-Premuzic, T., & Furnham, A. (2010). Individual differences in ideational behavior: Can the big five and psychometric intelligence predict creativity scores? Creativity Research Journal, 22, 90-97. doi:
*Busse, T. V., Blum, P. & Gutride, M. (1972). Testing conditions and the measurement preschool children of creative abilities in lower-class. Multivariate Behavioral Research, 7, 287-298.
*Chand, I., & Runco, M. A. (1993). Problem finding skills as components in the creative process. Personality and Individual Differences, 14, 155-162.
*Channon, C. E. (1974). The effect of regime on divergent thinking scores. British Journal of Educational Psychology, 44, 89-91.
*Chen, C., Himsel, A., Kasof, J., Greenberger, E., & Dmitrieva, J. (2006). Boundless creativity: Evidence for the domain generality of individual differences in creativity. The Journal of Creative Behavior, 40, 179-199.
*Chen, C., Kasof, J., Himsel, A., Dmitrieva, J., Dong, Q., & Xue, G. (2005). Effects of explicit instruction to “be creative” across domains and cultures. The Journal of Creative Behavior, 39, 889-1009.
*Chermahini, S. A., Hickendorff, M., & Hommel, B. (2012). Development and validity of a Dutch version of the Remote Associates Task: An item-response theory approach. Thinking Skills and Creativity, 7, 177-186. doi:
Cheung, P. C., & Lau, S. (2010). Gender differences in the creativity of Hong Kong school children: Comparison by using the new electronic Wallach-Kogan Creativity Tests. Creativity Research Journal, 22, 194- 199. doi:
*Chua, R. Y., & Iyengar, S. S. (2008). Creativity as a matter of choice: Prior experience and task instruction as boundary conditions for the positive effect of choice on creativity. The Journal of Creative Behavior, 42, 164-180. doi:
*Clapham, M. M. (1998). Structure of the figural forms A and B of the Torrance Tests of Creative Thinking. Educational and Psychological Measurement, 58, 275-283.
*Clapham, M. M. (2004). The convergent validity of the Torrance Tests of Creative Thinking and creativity interest inventories. Educational and Psychological Measurement, 64, 828-841.
*Cramond, B., Matthews-Morgan, J., Bandalos, D., & Zuo, L. (2005). A report on the 40- year follow-up of the Torrance Tests of Creative Thinking: Alive and well in the new millennium. Gifted Child Quarterly, 49, 283-291.
*Cropley, A. J. (1972). Originality scores under timed and untimed conditions. Australian Journal of Psychology, 24, 31-36.
*Cropley, A. J. (2000). Defining and measuring creativity: Are creativity tests worth using? Roeper Review, 23, 72-79.
*Dansky, J. L., & Silverman, I. W. (1973). Effects of play on associative fluency in preschool- aged children. Developmental Psychology, 9, 38-43.
Darvishi, Z., & Pakdaman, S. (2012). Fourth grade slump in creativity: Development of creativity in primary school children. GSTF International Journal of Law and Social Sciences, 1, 40-48.
*Davis, G. A., & Belcher, T. L. (1971). How shall creativity be measured? Torrance Tests, RAT, Alpha Biographical, and IQ. The Journal of Creative Behavior, 5, 153-161.
*Dentler, R. A., & Mackler, B. (1964). Originality: Some social and personal determinants. Behavioral Science, 9, 1-7.
*Dewing, K. (1970). The reliability and validity of selected tests of creative thinking in a sample of seventh-grade West Australian children. British Journal of Educational Psychology, 40, 35-42.
*Diakidoy, I. N., & Spanoudis, G. (2002). Domain specificity in creativity testing: A comparison of performance on a general divergent-thinking test and a parallel, content- specific test. The Journal of Creative Behavior, 36, 41-61.
*Dollinger, S. J., Burke, P. A., & Gump, N. W. (2007). Creativity and values. Creativity Research Journal, 19, 91-103.
*Domino, G. (1994). Assessment of creativity with the ACL: An empirical comparison of four scales. Creativity Research Journal, 7, 21-33.
*Dow, G. T., & Mayer, R. E. (2004). Teaching students to solve insight problems: Evidence for domain specificity in creativity training. Creativity Research Journal, 16, 389-398.
*Drwal, R. L. (1973). The influence of psychological stress upon creative thinking. Polish Psychological Bulletin, 4, 125-129.
Dziedziewicz, D., Gajda, A., & Karwowski, M. (2014). Developing children’s intercultural competence and creativity. Thinking Skills and Creativity, 13, 32-42. doi:
*Hocevar, D. (1976). Dimensionality of creativity. Psychological Reports, 39 (3), 869-870.
*Hocevar, D. (1979). The unidimensional nature of creative thinking in fifth grade children. Child Study Journal, 9, 273-278.
*Hocevar, D. (1981). Measurement of creativity: Review and critique. Journal of Personality Assessment, 45, 450-464.
*Hocevar, D., & Bachelor, P. (1989). A taxonomy and critique of measurements used in the study of creativity. In J. A. Glover, R. R. Ronning, & C. R. Reynolds (Eds.), Handbook of creativity (pp. 53-75). New York: Plenum Press.
*Hong, E., & Milgram, R. M. (2010). Creative thinking ability: Domain generality and specificity. Creativity Research Journal, 22, 272-287. doi:
*Kelly, J. R., & McGrath, J. E. (1985). Effects of time limits and task types on task performance and interaction of four-person groups. Journal of Personality and Social Psychology, 49, 395-407.
Kilgour, M. (2006). Improving the creative process: Analysis of the effects of divergent thinking techniques and domain specific knowledge on creativity. International Journal of Business and Society, 7, 79-107.
*Kim, K. H. (2006). Is creativity unidimensional or multidimensional? Analyses of the Torrance Tests of Creative Thinking. Creativity Research Journal, 18, 251-259.
*Kim, K. H., Cramond, B., & Bandalos, D. L. (2006). The latent structure and measurement invariance of scores on the Torrance Tests of Creative Thinking-figural. Educational and Psychological Measurement, 66, 459-477.
*Kogan, N., & Morgan, F. T. (1969). Task and motivational influences on the assessment of creative and intellectual ability in children. Genetic Psychology Monographs, 80, 91-127.
*Kogan, N., & Pankove, E. (1974). Long-term predictive validity of divergent-thinking tests: Some negative evidence. Journal of Educational Psychology, 66, 802-810.
*Krumm, G., Aranguren, M., Filippetti, V. A., & Lemos, V. (2014). Factor structure of the Torrance Tests of Creative Thinking verbal form B in a Spanish-speaking population. The Journal of Creative Behavior, 50, 150-164. doi:
*Krumm, G., Lemos, V., & Filippetti, V. A. (2014). Factor structure of the Torrance Tests of Creative Thinking figural form B in Spanish-speaking children: Measurement invariance across gender. Creativity Research Journal, 26, 72-81. doi:
Lubart, T. I. (2001). Models of the creative process: Past, present and future. Creativity Research Journal, 13, 295-308.
*Lubart, T. I., & Guignard, J. (2004). The generality-specificity of creativity: A multivariate approach. In R. J. Sternberg, E. L. Grigorenko, & J. L. Singer (Eds.), Creativity: From potential to realization (pp. 43-56). Washington, DC: American Psychological Association.
*Milgram, R. M., & Milgram, N. A. (1976a). Creative thinking and creative performance in Israeli students. Journal of Educational Psychology, 68, 255-259.
*Milgram, R. M., & Milgram, N. A. (1976b). Group versus individual administration in the measurement of creative thinking in gifted and nongifted children. Child Development, 47, 563-565.
*Mohamed, A., Maker, J., & Lubart, T. (2012). Exploring the domain specificity of creativity in children: The relationship between a non-verbal creative production test and creative problem-solving activities. Turkish Journal of Giftedness and Education, 2, 84-101.
*Mouchiroud, C., & Lubart, T. (2001). Children's original thinking: An empirical examination of alternative measures derived from divergent thinking tasks. The Journal of Genetic Psychology, 162, 382-401.
Mumford, M. D., & Gustafson, S. B. (1988). Creativity syndrome: Integration, application and innovation. Psychological Bulletin, 103, 27-43.
*Nakano, T. C., Primi, R., Ribeiro, W. J., & Almeida, L. S. (2016). Multidimensional assessment of giftedness: Criterion validity of battery of intelligence and creativity measures in predicting arts and academic talents. Anales de Psicología, 32, 628-637. doi:
Niu, W., & Sternberg, R. J. (2003). Societal and school influences on student creativity: The case of China. Psychology in the Schools, 40, 103-114.
Nusbaum, E. C., & Silvia, P. J. (2011). Are intelligence and creativity really so different? Fluid intelligence, executive processes, and strategy use in divergent thinking. Intelligence, 39, 36-45. doi:
*Nusbaum, E. C., Silvia, P. J., & Beaty, R. E. (2014). Ready, set, create: What instructing people to “be creative” reveals about the meaning and mechanisms of divergent thinking. Psychology of Aesthetics, Creativity, and the Arts, 8, 423-432. doi:
*O’Hara, L. A., & Sternberg, R. J. (2000-2001). It doesn’t hurt to ask: Effects of instructions to be creative, practical, or analytical on essay-writing performance and their interaction with students’ thinking styles. Creativity Research Journal, 13, 197-210.
*Palmiero, M., Nori, R., Aloisi, V., Ferrara, M., & Piccardi, L. (2015). Domain-specificity of creativity: A study on the relationship between visual creativity and visual mental imagery. Frontiers in Psychology, 6, 1-8. doi:
*Plucker, J. A. (1998). Beware of simple conclusions: The case for content generality of creativity. Creativity Research Journal, 11, 179-182.
*Plucker, J. A. (1999a). Is the proof in the pudding? Reanalyses of Torrance's (1958 to present) longitudinal data. Creativity Research Journal, 12, 103-114.
*Plucker, J. A. (1999b). Reanalyses of student responses to creativity checklists: Evidence of content generality. The Journal of Creative Behavior, 33, 126-137.
*Plucker, J. A. (2004). Generalization of creativity across domains: Examination of the method effect hypothesis. The Journal of Creative Behavior, 38, 1-12.
*Plucker, J. A., & Beghetto, R. A. (2004). Why creativity is domain general, why it looks domain specific, and why the distinction does not matter. In R. J. Sternberg, E. L. Grigorenko, & J. L. Singer (Eds.), Creativity: From potential to realization (pp. 153-167). Washington, DC: American Psychological Association.
*Plucker, J. A., Beghetto, R. A., & Dow, G. T. (2004). Why isn’t creativity more important to educational psychologists? Potentials, pitfalls, and future directions in creativity research. Educational Psychologist, 39, 83-96.
*Plucker, J. A., & Makel, M. C. (2010). Assessment of creativity. In J. Kaufman, & R. J. Sternberg (Eds.), The Cambridge handbook of creativity. New York: Cambridge University Press.
*Plucker, J. A., & Renzulli, J. S. (1999). Psychometric approaches to the study of creativity. In R. J. Sternberg (Ed.). Handbook of human creativity (pp. 35-60). New York: Cambridge University Press.
*Primi, R. (2014). Divergent productions of metaphors: Combining many-facet Rasch measurement and cognitive psychology in the assessment of creativity. Psychology of Aesthetics, Creativity, and the Arts, 8, 461-474. doi:
*Plucker, J. A., & Runco, M. A. (1998). The death of creativity measurement directions in creativity assessment has been greatly exaggerated: Current issues, recent advances, and future. Roeper Review, 21, 36-39. doi:
*Reiter-Palmon, R., Robinson-Morral, E. J., Kaufman, J. C., & Santo, J. B. (2012). Evaluation of self-perceptions of creativity: Is it a useful criterion? Creativity Research Journal, 24, 107-114. doi:
*Runco, M. A. (1984). Teachers' judgments of creativity and social validation of divergent thinking tests. Perceptual and Motor Skills, 59, 711-717.
*Runco, M. A. (1985). Reliability and convergent validity of ideational flexibility as a function of academic achievement. Perceptual and Motor Skills, 61, 1075-1081.
*Runco, M. A. (1986a). Divergent thinking and creative performance in gifted and nongifted children. Educational and Psychological Measurement, 46, 375-384.
*Runco, M. A. (1986b). Maximal performance on divergent thinking tests by gifted, talented, and nongifted children. Psychology in the Schools, 23, 308-315.
*Runco, M. A. (1987). The generality of creative performance in gifted and nongifted children. Gifted Child Quarterly, 31, 121-125.
*Runco, M. A., & Albert, R. S. (1985). The reliability and validity of ideational originality in the divergent thinking of academically gifted and nongifted children. Educational and Psychological Measurement, 45, 483-501.
*Runco, M. A., Millar, G., Acar, S., & Cramond, B. (2010). Torrance Tests of Creative Thinking as predictors of personal and public achievement: A fifty year follow up. Creativity Research Journal, 22, 361-368. doi:
*Sandlund, E. S., Linnarud, M., & Norlander, T. (2001). Effects of stress versus flotation- REST relaxation on creativity and literacy skills in advanced English as a Second Language (ESL) composition. International Journal of Language & Communication, 15, 95-113.
Sawyer, R. K. (2006). Explaining creativity: The science of human innovation. New York: Oxford University Press.
Sayed, E. M., & Mohamed, A. H. H. (2013). Gender differences in divergent thinking: Use of the Test of Creative Thinking-Drawing Production on an Egyptian sample. Creativity Research Journal, 25, 222-227. doi:
*Silvia, P. J., Kaufman, J. C., & Pretz, J. E. (2009). Is creativity domain-specific? Latent class models of creative accomplishments and creative self-descriptions. Psychology of Aesthetics, Creativity, and the Arts, 3, 139-148. doi:
*Silvia, P. J., Winterstein, B. P., Willse, J. T., Barona, C. M., Cram, J. T., Hess, K. I., Martinez, J. L., & Richard, C. A. (2008). Assessing creativity with divergent thinking tasks: Exploring the reliability and validity of new subjective scoring methods. Psychology of Aesthetics, Creativity, and the Arts, 2, 68-85. doi:
Simonton, D. K. (2003). Expertise, competence, and creative ability: The perplexing complexities. In R. J. Sternberg, & E. L. Grigorenko (Eds.), The psychology of abilities, competencies, and expertise (pp. 213-239). New York: Cambridge University Press.
*Smith, K. L. R., Michael, W. B., & Hocevar, D. (1990). Performance on creativity measures with examination-taking instructions intended to induce high or low levels of test anxiety. Creativity Research Journal, 3, 265-280.
Soroa, G., Balluerka, N., Hommel, B., & Aritzeta, A. (2015). Assessing interactions between cognition, emotion, and motivation in creativity: The construction and validation of EDICOS. Thinking Skills and Creativity, 17, 45-58. doi:
*Sternberg, R. J. (1989). Domain-generality versus domain-specificity: The life and impending death of a false dichotomy. Merrill-Palmer Quarterly, 35, 115-130.
Sternberg, R. J., & Lubart, T. I. (1995). Defying the crowd: Cultivating creativity in a culture of conformity. New York: Free Press.
*Torrance, E. P. (1969). Curiosity of gifted children and performances on timed and untimed tests of creativity. Gifted Child Quarterly, 13, 155-158.
*Torrance, E. P., & Haensly, P. A. (2003). Assessment of creativity in children and adolescents. In C. R. Reynoolds, & R. W. Kamphaus (Eds.) Handbook of psychological and educational assessment of children: Intelligence, aptitude and achievement (2nd ed.) (pp. 584-607). New York: The Guildford Press.
*Treffinger, D. J., Renzulli, J., & Feldhusen, J. (1971). Problems in the assessment of creative thinking. The Journal of Creative Behavior, 5, 104-112.
*Treffinger, D. J., Young, G. C., Selby, E. C., & Shepardson, C. (2002). Assessing creativity: A guide for educators. Sarasota: Center for Creative Learning.
*Van Mondfrans, A. P., Feldhusen, J. F., Treffinger, D. J., & Ferris, D. R. (1971). The effects of instructions and response time on divergent thinking test scores. Psychology in the Schools, 8, 65-71.
*Vernon, P. E. (1971). Effects of administration and scoring on divergent thinking tests. British Journal of Educational Psychology, 41, 245-257.
*Wallach, M. A., & Kogan, N. (1965). Modes of thinking in young children: A study of the creativity intelligence distinction. New York: Holt, Rinehart & Winston.
*Wang, C., Ho, H., Cheng, C., & Cheng, Y. (2014). Application of the Rasch model to the measurement of creativity: The Creative Achievement Questionnaire. Creativity Research Journal, 26, 62-71. doi: