The comparison of several factorial structures of the Cornell Critical Thinking Test Level Z
DOI:
https://doi.org/10.24193/subbpsyped.2024.1.01Keywords:
critical thinking, undergraduate students, confirmatory factor analysis, measurement invarianceAbstract
The Cornell Critical Thinking Test (CCTT) level Z is a broadly applied instrument for the measurement of undergraduate, gifted students’ and adults’ critical thinking abilities, however, there is a lack of studies in the literature investigating its factorial structure. The test developers emphasize the interpretation of the test results as a general critical thinking factor, including different cognitive abilities, but also highlight the overlap between the items of the subfactors. The aim of the study is the investigation of internal consistency, the comparison of different factorial structures (unidimensional, correlated, and hierarchical models), and gender invariance testing of the CCTT level Z. Hungarian-speaking undergraduate students participated in the study (N = 825). For the confirmatory factor analysis (CFA) the Mplus version 8.7, with weighted least squares mean and variance adjusted estimation was used. Measurement invariance of the test across genders was analyzed using Muthén’s two-step procedure for dichotomous data. The results indicated that the correlated four-factor and second-order structures of the test exceeded the acceptable model fit criteria. Post hoc inspection was conducted on the second-order four-factor model, indicating a shortened 22-item version of the test (with a general critical thinking factor, including four subfactors: deduction, meaning and fallacies, induction, assumption identification) with excellent fit indices [χ2 (203) = 259.309, CFI = .967, TLI = .963, RMSEA = .018, SRMR = .056]. Configural and scalar invariance of the abbreviated Hungarian version of the test across genders were confirmed.References
Aiyub, Suryadi, D., Fatimah, S., & Kusnandi. (2021). Investigation of Watson-Glaser critical thinking skills of junior high school students in solving mathematical problems. Journal of Physics: Conference Series, 1806(1), 012090. https://doi.org/10.1088/1742-6596/1806/1/012090
Akpur, U. (2020). Critical, Reflective, Creative Thinking and Their Reflections on Academic Achievement. Thinking Skills and Creativity, 37, 100683. https://doi.org/10.1016/j.tsc.2020.100683
Alias, A., Mohtar, L. E., Ayop, S. K., & Rahim, F. R. (2022). A Systematic Review on Instruments to Assess Critical Thinking & Problem-Solving Skills. EDUCATUM Journal of Science, Mathematics and Technology, 9, 38-47. https://doi.org/10.37134/ejsmt.vol9.sp.5.2022
Awang, Z. (2012). Research methodology and data analysis. Penerbit Universiti Teknologi MARA Press.
Bataineh, R. F., & Zghoul, L. H. (2006). Jordanian TEFL Graduate Students’ Use of Critical Thinking Skills (as Measured by the Cornell Critical Thinking Test, Level Z). International Journal of Bilingual Education and Bilingualism, 9(1), 33–50. https://doi.org/10.1080/13670050608668629
Beavers, E., Orange, A., & Kirkwood, D. (2017). Fostering critical and reflective thinking in an authentic learning situation. Journal of Early Childhood Teacher Education, 38(1), 3–18. https://doi.org/10.1080/10901027.2016.1274693
Bezanilla, M. J., Fernández-Nogueira, D., Poblete, M., & Galindo-Domínguez, H. (2019). Methodologies for teaching-learning critical thinking in higher education: The teacher’s view. Thinking Skills and Creativity, 33, 100584. https://doi.org/10.1016/j.tsc.2019.100584
Boran, M., & Karakuş, F. (2022). The Mediator Role of Critical Thinking Disposition in the Relationship between Perceived Problem-Solving Skills and Metacognitive Awareness of Gifted and Talented Students. Participatory Educational Research, 9(1), 61–72. https://doi.org/10.17275/per.22.4.9.1
Butler, H. A., Dwyer, C. P., Hogan, M. J., Franco, A., Rivas, S. F., Saiz, C., & Almeida, L. S. (2012). The Halpern Critical Thinking Assessment and real-world outcomes: Cross-national applications. Thinking Skills and Creativity, 7(2), 112–121. https://doi.org/10.1016/j.tsc.2012.04.001
Chen, F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504. https://doi.org/10.1080/10705510701301834
Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10, 1-9.
Crosta, L., & Banda, V. (2022). Are young graduates ready for the job market of the future? The study of the Italian case. GiLE Journal of Skills Development, 2(1), 26–43. https://doi.org/10.52398/gjsd.2022.v2.i1.pp26-43
Cruz, G., Nascimento, M. M., & Dominguez, C. (2019). With a little help from my peers: Professional development of higher education teachers to teach critical thinking. Revista Lusófona de Educação, 44, 141–157. https://doi.org/10.24140/issn.1645-7250.rle44.09
Culver, K. C., Braxton, J., & Pascarella, E. (2019). Does teaching rigorously really enhance undergraduates’ intellectual development? The relationship of academic rigor with critical thinking skills and lifelong learning motivations. Higher Education, 78(4), 611–627. https://doi.org/10.1007/s10734-019-00361-z
D’Alessio, F. A., Avolio, B. E., & Charles, V. (2019). Studying the impact of critical thinking on the academic performance of executive MBA students. Thinking Skills and Creativity, 31, 275–283. https://doi.org/10.1016/j.tsc.2019.02.002
Danial, M., Sawal, M., & Nurlaela (2018). Development of Chemistry Instructional Tools and Its Effect on Critical Thinking Skills, Metacognition, and Concept Mastery of Students. Journal of Physics: Conference Series, 1028, 012041. https://doi.org/10.1088/1742-6596/1028/1/012041
Deliligka, A., & Calfoglou, C. (2022). Using poetry to foster Critical Thinking and Metacognition in a Primary School EFL context. Research Papers in Language Teaching and Learning, 12(1), 167-187.
Ennis, R. H. (2018). Critical Thinking Across the Curriculum: A Vision. Topoi, 37(1), 165–184. https://doi.org/10.1007/s11245-016-9401-4
Ennis, R. H., Millman, J., & Tomko, T. N. (2005). Cornell critical thinking tests, level X & level Z. Manual (5th ed.). Midwest Publications.
Ennis, R. H., & Weir, E. (1985). The Ennis-Weir Critical Thinking Essay Test. Midwest Publications
Ericson, J. D. (2022). Mapping the Relationship Between Critical Thinking and Design Thinking. Journal of the Knowledge Economy, 13(1), 406–429. https://doi.org/10.1007/s13132-021-00733-w
Eshmirzaeva, M. A. (2020). Personality-oriented Approach to Education and Modern Pedagogical Technologies. European Journal of Research and Reflection in Educational Sciences, 8(8), 25-30.
Evans, C. (2020). Measuring Student Success Skills: A Review of the Literature on Critical Thinking. National Center for the Improvement of Educational Assessment.
Facione, P. A. (1990a). Critical thinking: A statement of expert consensus for purposes of educational assessment and instruction. The California Academic Press.
Facione, P. A. (1990b). The California Critical Thinking Skills Test—College Level Technical Report #1 Experimental Validation and Content Validity. California Academic Press.
Fatmawati, A., Zubaidah, S., Mahanal, S., & Sutopo. (2019). Critical Thinking, Creative Thinking, and Learning Achievement: How They are Related. Journal of Physics: Conference Series, 1417, 012070. https://doi.org/10.1088/1742-6596/1417/1/012070
Fitriana, L. D., Fuad, Y., & Ekawati, R. (2018). Student’s Critical Thinking in Solving Open-Ended Problems Based on Their Personality Type. Journal of Physics: Conference Series, 947, 012007. https://doi.org/10.1088/1742-6596/947/1/012007
Franco, A., Marques Vieira, R., & Tenreiro-Vieira, C. (2018). Educating for critical thinking in university: The criticality of critical thinking in education and everyday life. Journal for Communication Studies, 11(2), 131-144.
Frost, P., Donahue, P., Goeben, K., Connor, M., Cheong, H. S., & Schroeder, A. (2019). An examination of the potential lingering effects of smartphone use on cognition. Applied Cognitive Psychology, 33(6), 1055–1067. https://doi.org/10.1002/acp.3546
Ghanizadeh, A. (2017). The interplay between reflective thinking, critical thinking, self-monitoring, and academic achievement in higher education. Higher Education, 74(1), 101–114. https://doi.org/10.1007/s10734-016-0031-y
Gunawardena, M., & Wilson, K. (2021). Scaffolding students’ critical thinking: A process not an end game. Thinking Skills and Creativity, 41, 100848. https://doi.org/10.1016/j.tsc.2021.100848
Haber, J. (2020). Critical Thinking. MIT Press.
Halpern, D. F. (1997). Critical thinking across the curriculum: A brief edition of thought and knowledge. Lawrence Erlbaum Associates.
Halpern, D. F. & Sternberg, R. J. (2019). An Introduction to Critical Thinking: Maybe It Will Change Your Life. In R. J. Sternberg & D. F. Halpern (Eds.), Critical Thinking in Psychology (pp. 1-9). Cambridge University Press. https://doi.org/10.1017/9781108684354
Harman, R., & Lee, D. (2009). The role of shame and self-critical thinking in the development and maintenance of current threat in post-traumatic stress disorder. Clinical Psychology & Psychotherapy, 17(1), 13-24. https://doi.org/10.1002/cpp.636
Heidari, K. (2020). Critical thinking and EFL learners’ performance on textually-explicit, textually-implicit, and script-based reading items. Thinking Skills and Creativity, 37, 100703. https://doi.org/10.1016/j.tsc.2020.100703
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Ibrahim, I., Akmal, N., & Marwan, M. (2021). Problem-based Learning and Student Critical Thinking to Improve Learning Achievement at Private Universities in Aceh. AL-ISHLAH: Jurnal Pendidikan, 13(2), 1142–1151. https://doi.org/10.35445/alishlah.v13i2.698
Imperio, A., Kleine Staarman, J., & Basso, D. (2020). Relevance of the socio-cultural perspective in the discussion about critical thinking. Journal of Theories and Research in Education, 15, 1-19. https://doi.org/10.6092/ISSN.1970-2221/9882
Işiklar, S., & Abali-Öztürk, Y. (2022). The effect of philosophy for children (P4C) curriculum on critical thinking through philosophical inquiry and problem solving skills. International Journal of Contemporary Educational Research. 9(1), 130-142. https://doi.org/10.33200/ijcer.942575
Janssen, E. M., Mainhard, T., Buisman, R. S. M., Verkoeijen, P. P. J. L., Heijltjes, A. E. G., van Peppen, L. M., & van Gog, T. (2019). Training higher education teachers’ critical thinking and attitudes towards teaching it. Contemporary Educational Psychology, 58, 310–322. https://doi.org/10.1016/j.cedpsych.2019.03.007
Jebreen, I., & Nabot, A. (2021). An analysis of job advertisements for software engineering employability skills and knowledge: Jordan as a case study. Asia -Pacific Journal of Science and Technology, 26(4), APST-26-04-16.
Jin, M., & Ji, C. (2021). The correlation of metacognitive ability, self‐directed learning ability and critical thinking in nursing students: A cross‐sectional study. Nursing Open, 8(2), 936–945. https://doi.org/10.1002/nop2.702
Kline, R. B. (2015). Principles and practice of structural equation modeling (4th ed.). Guilford Press.
Kusumoto, Y. (2018). Enhancing critical thinking through active learning. Language Learning in Higher Education, 8(1), 45–63. https://doi.org/10.1515/cercles-2018-0003
Leach, S. M., Immekus, J. C., French, B. F., & Hand, B. (2020). The factorial validity of the Cornell Critical Thinking Tests: A multi-analytic approach. Thinking Skills and Creativity, 37, 100676. https://doi.org/10.1016/j.tsc.2020.100676
Ling, M. K. D., & Loh, S. C. (2020). Relationship of creativity and critical thinking to pattern recognition among Singapore private school students. The Journal of Educational Research, 113(1), 59–76. https://doi.org/10.1080/00220671.2020.1716203
Marthaliakirana, A. D., Suwono, H., Saefi, M., & Gofur, A. (2022). Problem-based learning with metacognitive prompts for enhancing argumentation and critical thinking of secondary school students. Eurasia Journal of Mathematics, Science and Technology Education, 18(9), em2148. https://doi.org/10.29333/ejmste/12304
Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93(3), 568–592. https://doi.org/10.1037/0021-9010.93.3.568
Merma-Molina, G., Gavilán-Martín, D., Baena-Morales, S., & Urrea-Solano, M. (2022). Critical Thinking and Effective Personality in the Framework of Education for Sustainable Development. Education Sciences, 12(1), 28. https://doi.org/10.3390/educsci12010028
Moreira, H., & Canavarro, M. C. (2018). The Association Between Self-Critical Rumination and Parenting Stress: The Mediating Role of Mindful Parenting. Journal of Child and Family Studies, 27(7), 2265–2275. https://doi.org/10.1007/s10826-018-1072-x
Moroz, M., & Dunkley, D. M. (2019). Self-critical perfectionism, experiential avoidance, and depressive and anxious symptoms over two years: A three-wave longitudinal study. Behaviour Research and Therapy, 112, 18–27. https://doi.org/10.1016/j.brat.2018.11.006
Muhammad Raflee, S. S., & Halim, L. (2021). The Effectiveness of Critical Thinking in Improving Skills in KBAT Problem Solving. Jurnal Pendidikan Sains Dan Matematik Malaysia, 11(1), 60-76. https://doi.org/10.37134/jpsmm.vol11.1.6.2021
Mujanah, S., Ardiana, I. D. K. R., Nugroho, R., Candraningrat, C., Fianto, A. Y. A., & Arif, D. (2022). Critical thinking and creativity of MSMEs in improving business performance during the covid-19 pandemic. Uncertain Supply Chain Management, 10(1), 19–28. https://doi.org/10.5267/j.uscm.2021.10.014
Murtadho, F. (2021). Metacognitive and critical thinking practices in developing EFL students’ argumentative writing skills. Indonesian Journal of Applied Linguistics, 10(3). https://doi.org/10.17509/ijal.v10i3.31752
Muthén, B., du Toit, S. H. C., & Spisic, D. (1997). Robust inference using weighted least squares and quadratic estimating equation in latent variable modeling with categorical and continuous outcomes. Unpublished manuscript.
Muthén, L. K. (2013, January 28). Multigroup ESEM [3:21 pm]. Message posted to http://www.statmodel.com/discussion/messages/11/5581.html?1492019681.
Muthén, L. K., & Muthén, B. O. (2017). Mplus User’s Guide (8th ed.). Muthén & Muthén.
Muthén, L. K., & Muthén, B. O. (2021). Mplus (version 8.7) [Computer software]. Muthén & Muthén.
Ng, S.-Y., Cheung, K., & Cheng, H.-L. (2022). Critical Thinking Cognitive Skills and Their Associated Factors in Chinese Community College Students in Hong Kong. Sustainability, 14(3), 1127. https://doi.org/10.3390/su14031127
Okolie, U. C., Igwe, P. A., Mong, I. K., Nwosu, H. E., Kanu, C., & Ojemuyide, C. C. (2022). Enhancing students’ critical thinking skills through engagement with innovative pedagogical practices in Global South. Higher Education Research & Development, 41(4), 1184–1198. https://doi.org/10.1080/07294360.2021.1896482
Renatovna, A. G., & Renatovna, A. S. (2021). Pedagogical and psychological conditions of preparing students for social relations on the basis of the development of critical thinking. Psychology and Education Journal, 58(2), 4889–4902. https://doi.org/10.17762/pae.v58i2.2886
Saleh, S. E. (2019). CRITICAL THINKING AS A 21st CENTURY SKILL: CONCEPTIONS, IMPLEMENTATION AND CHALLENGES IN THE EFL CLASSROOM. European Journal of Foreign Language Teaching, 4(1), 1-16. https://doi.org/10.5281/ZENODO.2542838
Sari, D. M. M., & Wardhani, A. K. (2020). Critical thinking as learning and innovation skill in the 21st century. Journal of English Language and Pedagogy, 3(2), 27–34. https://doi.org/10.36597/jelp.v3i2.8778
Saud, W. I. (2020). The Relationship between Critical Thinking and Translation Ability of EFL Undergraduate Students. International Journal of Social Sciences and Educational Studies, 7(3), 19-28. https://doi.org/10.23918/ijsses.v7i3p19
Shahzadi, U., Nimmi, & Khan, I. (2020). Exploring the Relationship between Critical Thinking Skills and Academic Achievement. Sir Syed Journal of Education & Social Research, 3(1), 236–242. https://doi.org/10.36902/sjesr-vol3-iss1-2020(236-242)
Sholihah, T. M., & Lastariwati, B. (2020). Problem based learning to increase competence of critical thinking and problem solving. Journal of Education and Learning (EduLearn), 14(1), 148–154. https://doi.org/10.11591/edulearn.v14i1.13772
Song, Y., Lee, Y., & Lee, J. (2022). Mediating effects of self-directed learning on the relationship between critical thinking and problem-solving in student nurses attending online classes: A cross-sectional descriptive study. Nurse Education Today, 109. 105227. https://doi.org/10.1016/j.nedt.2021.105227
Teng, W., Ma, C., Pahlevansharif, S., & Turner, J. J. (2019). Graduate readiness for the employment market of the 4th industrial revolution: The development of soft employability skills. Education + Training, 61(5), 590–604. https://doi.org/10.1108/ET-07-2018-0154
Toker, S., & Akbay, T. (2022). A comparison of recursive and nonrecursive models of attitude towards problem-based learning, disposition to critical thinking, and creative thinking in a computer literacy course for preservice teachers. Education and Information Technologies, 27(5), 6715–6751. https://doi.org/10.1007/s10639-022-10906-y
van der Zanden, P. J. A. C., Denessen, E., Cillessen, A. H. N., & Meijer, P. C. (2019). Patterns of success: First-year student success in multiple domains. Studies in Higher Education, 44(11), 2081–2095. https://doi.org/10.1080/03075079.2018.1493097
Verburgh, A., François, S., Elen, J., & Janssen, R. (2013). The Assessment of Critical Thinking Critically Assessed in Higher Education: A Validation Study of the CCTT and the HCTA. Education Research International, 2013, 1–13. https://doi.org/10.1155/2013/198920
Wakelin, K. E., Perman, G., & Simonds, L. M. (2022). Effectiveness of self‐compassion‐related interventions for reducing self‐criticism: A systematic review and meta‐analysis. Clinical Psychology & Psychotherapy, 29(1), 1–25. https://doi.org/10.1002/cpp.2586
Watson, G., & Glaser, E. M. (1980). Watson-Glaser Critical Thinking Appraisal. Psychological Corporation.
Watson, G., & Glaser, E. M. (2010). Watson-Glaser II: Technical manual and user’s guide. Pearson.
Werner, P. H. (1991). The Ennis-Weir Critical Thinking Essay Test: An Instrument for Testing and Teaching. Journal of Reading, 34(6), 494-495.
Yuan, R., Liao, W., Wang, Z., Kong, J., & Zhang, Y. (2022). How do English-as-a-foreign-language (EFL) teachers perceive and engage with critical thinking: A systematic review from 2010 to 2020. Thinking Skills and Creativity, 43, 101002. https://doi.org/10.1016/j.tsc.2022.101002
Živković, S. (2016). A Model of Critical Thinking as an Important Attribute for Success in the 21st Century. Procedia - Social and Behavioral Sciences, 232, 102–108. https://doi.org/10.1016/j.sbspro.2016.10.034
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Studia Universitatis Babeș-Bolyai Psychologia-Paedagogia
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
