Evaluating Instrument Reliability and Validity in Art and Design Education Research: A Pilot Study on Creative Self-Efficacy in Xi’an, China
Keywords:
Creative Self-Efficacy, Instrument Validation, Experiential Learning Theory, Art and Design Education, Cross-Cultural AdaptationAbstract
This article presents the pilot testing phase of a broader study that investigates the factors influencing creative self-efficacy among art and design undergraduates in public universities in Xi’an, China. The aim of this pilot test was to assess the reliability and validity of a newly designed research instrument based on Kolb’s Experiential Learning Theory and Bandura's concept of self-efficacy. The instrument was tested on a sample of 50 students, evaluating item clarity, internal consistency, construct validity, and discriminant validity. Findings revealed high reliability (Cronbach's alpha > 0.80), strong composite reliability, adequate convergent and discriminant validity, and highlighted areas for item refinement. This validation process supports the integrity of the tool and underscores the importance of culturally contextualized validation procedures in art and design education research.
References
J. W. Creswell and J. D. Creswell, Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, 5th ed. Thousand Oaks, CA: Sage Publications, 2018.
P. Tierney and S. M. Farmer, “Creative self-efficacy: Its potential antecedents and relationship to creative performance,” Acad. Manage. J., vol. 45, no. 6, pp. 1137–1148, Dec. 2002.
M. Karwowski, I. Lebuda, E. Wi?niewska, and J. Gralewski, “Creative self-efficacy scale: A critical review and validation,” J. Creat. Behav., vol. 53, no. 1, pp. 47–61, Mar. 2019.
Q. Guo, X. Li, and Y. Wang, “Applying experiential learning in design courses: A Chinese context,” Int. J. Art Des. Educ., vol. 35, no. 3, pp. 278–290, 2016.
L. Zhang and X. Zhou, “Measuring creative confidence among Chinese university students: A dual-theoretical approach,” Asia Pac. Educ. Rev., vol. 21, no. 3, pp. 311–325, 2020.
A. Tella and B. Mast, “Experiential learning and creative development: A study in Nigerian tertiary institutions,” J. Educ. Pract., vol. 8, no. 9, pp. 150–159, 2017.
M. Asad, I. Ahmad, and M. Nadeem, “Experiential learning in art education: Localizing creativity measurement tools in South Asia,” Art Educ. Rev., vol. 73, no. 2, pp. 120–135, 2021.
F. J. R. Van de Vijver and K. Leung, Methods and Data Analysis for Cross-Cultural Research. Thousand Oaks, CA: Sage Publications, 1997.
J. C. Nunnally and I. H. Bernstein, Psychometric Theory, 3rd ed. New York, NY: McGraw-Hill, 1994.
R. F. DeVellis, Scale Development: Theory and Applications, 4th ed. Thousand Oaks, CA: Sage Publications, 2017.
J. F. Hair, G. T. M. Hult, C. M. Ringle, and M. Sarstedt, A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM), 2nd ed. Thousand Oaks, CA: Sage Publications, 2019.
C. Fornell and D. F. Larcker, “Evaluating structural equation models with unobservable variables and measurement error,” J. Mark. Res., vol. 18, no. 1, pp. 39–50, Feb. 1981.
J. Henseler, C. M. Ringle, and M. Sarstedt, “A new criterion for assessing discriminant validity in variance-based structural equation modeling,” J. Acad. Mark. Sci., vol. 43, no. 1, pp. 115–135, 2015.
F. J. R. Van de Vijver and K. Leung, “Methods and data analysis for cross-cultural research,” Cross-Cultural Psychology, vol. 1, pp. 257–300, 1997.
A. Y. Kolb and D. A. Kolb, “Experiential learning theory as a guide for education practitioners,” Experiential Learning Rev., vol. 20, no. 1, pp. 4–44, 2017.
Q. Guo, X. Li, and Y. Wang, “Applying experiential learning in design courses: A Chinese context,” Int. J. Art Des. Educ., vol. 35, no. 3, pp. 278–290, 2016.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 International Journal of Sciences: Basic and Applied Research (IJSBAR)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors who submit papers with this journal agree to the following terms.
