Design and Validation of an Instrument to Evaluate the Innovative Competence Profile of University Teachers
Keywords:
Innovation, Teacher assessment, Higher education, Teaching competencies, Competence profile
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Abstract
There is not much research that attempts to define, design methodological proposals and validate tools for the study of the innovative competence profile of university teachers. The present work aims to prepare a technically and theoretically sound questionnaire to assess it, which includes the technical characteristics necessary for any good measurement instrument, especially the validation of the construct. In this sense, after designing and developing the content validity through expert judgment, it was applied to 1,404 professors from universities in Bolivia, Spain and Mexico. Subsequently, its reliability and construct validity were analyzed through Structural Equation Modeling. The results obtained show excellent reliability, both in the total questionnaire and in its dimensions (Cronbach's alpha=0.982) and an EFA (oblique/Promax) of 9 consistent, unipolar and robust factors, with 70.265% of total variance explained. Finally, the CFA gave a fairly parsimonious and highly satisfactory final measurement model (CFI=0.910; RMSEA=0.053; Hoelter=305; PRATIO=0.937). In conclusion, it can be affirmed that we have contributed to the field of science with a valid and reliable questionnaire to measure the innovative competence profile of university teachers.
Downloads
References
Abadía, A. R., Bueno, C., Ubieto-Artur, M. I., Márquez, D., Sabaté, S., Jorba, H. y Pagès, T. (2015). Competencias del buen docente universitario. Opinión de los estudiantes. Revista de Docencia Universitaria, 13(2), 363-390. https://doi.org/10.4995/redu.2015.5453
Area, M. y Adell, J. (2021). Tecnologías digitales y cambio educativo. Una aproximación crítica. REICE. Revista Iberoamericana sobre Calidad, Eficacia y Cambio en Educación, 19(4), 83-96. https://doi.org/10.15366/reice2021.19.4.005
Asbari, M., Purwanto, A., Ong, F., Mustikasiwi, A., Maesaroh, S., Mustofa, M., Hutagalung, D. y Andriyani, Y. (2020). Impact of hard skills, soft skills and organizational culture: Lecturer innovation competencies as mediating. Journal of Education, Psychology and Counseling, 2(1), 101-121.
Aznar-Mas, L., Pérez-Peñalver, M., Montero-Fleta, B., González-Ladrón de Guevara, F., Marín-García, J. y Atarés-Huerta, L. (2016). Indicadores de comportamiento de la competencia de innovación en el ámbito académico y en el profesional: revisión de la literatura. En VVAA., Conference proceedings InRed 2016 (pp. 1257-1268). Universitat Politècnica de València. https://doi.org/10.4995/INRED2016.2016.4389
Berdrow, I. y Evers, F. T. (2010). Bases of competence: an instrument for self and institutional assessment. Assessment & Evaluation in Higher Education, 35(4), 419-434. https://doi.org/10.1080/02602930902862842
Byrne, B. (2016). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Routledge. https://doi.org/10.4324/9781315757421
Cárdenas, C., Farías, G. M. y Méndez, G. (2017). ¿Existe relación entre la gestión administrativa y la innovación educativa?: Un estudio de caso en educación superior. REICE. Revista Iberoamericana sobre Calidad, Eficacia y Cambio en Educación, 15(1), 19-35. https://doi.org/10.15366/reice2017.15.1.002
Castela, B., Ferreira, F., Ferreira, J. y Marques, C. (2018). Assessing the innovation capability of small-and medium-sized enterprises using a non-parametric and integrative approach. Management Decision, 56(6), 1365-1383. https://doi.org/10.1108/MD-02-2017-0156
Chang, Y., Eklund, T., Kantola, J. I. y Vanharanta, H. (2009). International creative tension study of university students in South Korea and Finland. Human Factors and Ergonomics in Manufacturing & Service Industries, 19(6), 528-543. https://doi.org/10.1002/hfm.20182
Chang, Y., Kantola, J. y Vanharanta, H. (2007). A study of creative tension of engineering students in Korea. Human Factors and Ergonomics in Manufacturing & Service Industries, 17(6), 511-520. https://doi.org/10.1002/hfm.20090
Cortada de Kohan, N. C. (1999). Teorías psicométricas y construcción de tests. WorldScientific Publishing Co.
Culot, G., Orzes, G. y Sartor, M. (2019). Integration and scale in the context of Industry 4.0: the evolving shapes of manufacturing value chains. IEEE Engineering Management Review, 47(1), 45-51. https://doi.org/10.1109/EMR.2019.2900652
Cupani, M. (2012). Análisis de ecuaciones estructurales: Conceptos, etapas de desarrollo y un ejemplo de aplicación. Revista Tesis, 2(1), 186-199.
Deroncele-Acosta, A., Medina-Zuta, P., Fernando Goñi-Cruz, F., Román-Cao, E., Montes-Castillo, M. M. y Gallegos-Santiago, E. (2021). Innovación educativa con TIC en universidades latinoamericanas: Estudio multipaís. REICE. Revista Iberoamericana sobre Calidad, Eficacia y Cambio en Educación, 19(4), 145-161. https://doi.org/10.15366/reice2021.19.4.009
Drejer, A. (2001). How can we define and understand competencies and their development? Technovation, 21(3), 135-146. https://doi.org/10.1016/S0166-4972(00)00031-6
Durana, P., Kral, P., Stehel, V., Lazaroiu, G. y Sroka, W. (2019). Quality culture of manufacturing enterprises: A possible way to adaptation to Industry 4.0. Social Sciences, 8(4), 124. https://doi.org/10.3390/socsci8040124
Edwards-Schachter, M., García-Granero, A., Sánchez-Barrioluengo, M., Quesada-Pineda, H. y Amara, N. (2015). Disentangling competences: Interrelationships on creativity, innovation and entrepreneurship. Thinking Skills and Creativity, 16, 27-39. https://doi.org/10.1016/j.tsc.2014.11.006
Fernández, R. M. y Sánchez, A. R. (2017). Adolescencia digitalizada: Una mirada desde la pedagogía. Revista Internacional de Comunicación y Desarrollo, 2(5), 29-31. https://doi.org/10.15304/ricd.2.5.3700
Fernández-Cruz, F. J. y Rodríguez-Legendre, F. J. (2021). The innovation competence profile of teachers in higher education institutions. Innovations in Education and Teaching International. https://doi.org/10.1080/14703297.2021.1905031
Fullan, M. (2020). Learning and the pandemic: What’s next? Prospects, 49(1), 25-28. https://doi.org/10.1007/s11125-020-09502-0
García-Gómez, R. J. y Escudero, J. M. (2021). Innovación educativa. REICE. Revista Iberoamericana sobre Calidad, Eficacia y Cambio en Educación, 19(4), 5-12. https://doi.org/10.15366/reice2021.19.4
García, J. S. y Velásquez, J. R. (2013). Variables para la medición de las capacidades de innovación tecnológica en instituciones universitarias. Revista Ciencias Estratégicas, 22(30), 267-284.
Gunasekaran, A., Subramanian, N. y Ngai, E. (2019). Quality Management in the 21st century enterprises: Research pathway towards Industry 4.0. International Journal of Production Economics, 207, 125-129. https://doi.org/10.1016/j.ijpe.2018.09.005
Hair, J., Black, W., Babin, A. y Anderson, R. (2014). Multivariate data analysis: Pearson new international edition. Pearson.
Haseeb, M., Hussain, H. I., ?lusarczyk, B. y Jermsittiparsert, K. (2019). Industry 4.0: A solution towards technology challenges of sustainable business performance. Social Sciences, 8(5), 154-169. https://doi.org/10.3390/socsci8050154
Hayduk, L. A. (1996). LISREL issues, debates and strategies. JHU Press.
Hendarman, A. F. y Cantner, U. (2018). Soft skills, hard skills, and individual innovativeness. Eurasian Business Review, 8(2), 139-169. https://doi.org/10.1007/s40821-017-0076-6
Iñurrategi, N., Martínez, A. y Muela, A. (2021). Diseño y validación de un cuestionario (CAA) sobre la facilitación del desarrollo de la competencia aprender a aprender en el profesorado Universitario. Anales de Psicología, 37(2), 298-310. https://doi.org/10.6018/analesps.345151
Jiménez-Jiménez, D. y Sanz-Valle, R. (2011). Innovation, organizational learning, and performance. Journal of Business Research, 64(4), 408-417. https://doi.org/10.1016/j.jbusres.2010.09.010
Kantola, J., Karwowski, W. y Vanharanta, H. (2005). Creative tension in occupational work roles: a dualistic view of human competence management methodology based on soft computing. Ergonomia IJE & HF, 27(4), 273-286.
Keinänen, M., Ursin, J. y Nissinen, K. (2018). How to measure students’ innovation competences in higher education: Evaluation of an assessment tool in authentic learning environments. Studies in Educational Evaluation, 58, 30-36. https://doi.org/10.1016/j.stueduc.2018.05.007
Klaeijsen, A., Vermeulen, M. y Martens, R. (2018). Teachers’ innovative behaviour: The importance of basic psychological need satisfaction, intrinsic motivation, and occupational self-efficacy. Scandinavian Journal of Educational Research, 62(5), 769-782. https://doi.org/10.1080/00313831.2017.1306803
Kline, R. B. (2015). Principles and practice of structural equation modeling. Guilford publications.
Lee, H. y Choi, B. (2003). Knowledge management enablers, processes, and organizational performance: An integrative view and empirical examination. Journal of management information systems, 20(1), 179-228. https://doi.org/10.1080/07421222.2003.11045756
Lerouge, C., Newton, S. y Blanton, J. E. (2005). Exploring the systems analyst skill set: Perceptions, preferences, age, and gender. Journal of Computer Information Systems, 45(3), 12-23.
Lévy-Mangin, J. P. y Varela, J. (2006). Modelización con estructuras de covarianzas en ciencias sociales. Netbiblo.
Lund, H. B. y Karlsen, A. (2020). The importance of vocational education institutions in manufacturing regions: adding content to a broad definition of regional innovation systems. Industry and Innovation, 27(6), 660-679. https://doi.org/10.1080/13662716.2019.1616534
Makatsoris, C. (2009). An information and communication technologies–based frame-work for enhancing project management education through competence assessmentand development. Human Factors and Ergonomics in Manufacturing & Service Industries,19(6), 544-567. https://doi.org/10.1002/hfm.20183
Malik, A. (2019). Creating competitive advantage through source basic capital strategic humanity in the industrial age 4.0. International Research Journal of Advanced Engineering and Science, 4(1), 209-215.
Miller, K., Schell, J., Ho, A., Lukoff, B. y Mazur, E. (2015). Response switching and self-efficacy in peer instruction classrooms. Physical Review Special Topics-Physics Education Research, 11(1), art. 010104. https://doi.org/10.1103/PhysRevSTPER.11.010104
Mulaik, S. A., James, L. R., Van Alstine, J., Bennett, N., Lind, S. y Stilwell, C. D. (1989). Evaluation of goodness-of-fit indices for structural equation models. Psychological Bulletin, 105(3), 430-445. https://doi.org/10.1037/0033-2909.105.3.430
Muscio, A. y Ciffolilli, A. (2020). What drives the capacity to integrate Industry 4.0 technologies? Evidence from European R&D projects. Economics of Innovation and New Technology, 29(2), 169-183. https://doi.org/10.1080/10438599.2019.1597413
NPDL. (2020). La educación reimaginada: El futuro del aprendizaje. Unesco.
Pagés, T., Hernández, C., Abadía, A. R., Bueno, C., Ubieto-Artur, I., Márquez Cebrián, M., Sabaté Diaz, S. y Jorba Noguera, H. (2016). La innovación como competencia docente en la universidad: innovación orientada a la mejora de aprendizaje. Aloma. Revista de Psicologia i Ciències de l'Educació, 34(1), 33-43. https://doi.org/10.51698/aloma.2016.34.1.33-43
Parida, V., Sjödin, D. y Reim, W. (2019). Reviewing literature on digitalization, business model innovation, and sustainable industry: Past achievements and future promises. Sustainability, 11(2), 391. https://doi.org/10.3390/su11020391
Pérez-Peñalver, M. J., Aznar-Mas, L. E. y Montero Fleta, B. (2018). Identification and classification of behavioural indicators to assess innovation competence. Journal of Industrial Engineering and Management, 11(1), 87-115. https://doi.org/10.3926/jiem.2552
Pérez-Peñalver, M. J., Aznar-Mas, L. E. y Watts, F. (2012). To adapt or to die when leaving the university: To promote innovation competence may be the key. En VVAA., Actas del congreso internacional de tecnología, educación y desarrollo (pp. 2731-2736). INTED.
Ramos, G., Chiva, I. y Gómez, M. B. (2017). Las competencias básicas en la nueva generación de estudiantes universitarios: Una experiencia de Innovación. REDU. Revista de Docencia Universitaria, 15(1), 37-55. https://doi.org/10.4995/redu.2017.5909
Remesal, A., Colomina, R., Mauri, T. y Rochera, M. J. (2017). Uso de cuestionarios online con feedback automático para la e-innovación en el alumnado universitario. Comunicar, 51, 51-60. https://doi.org/10.3916/C51-2017-05
Roig-Vila, R. (2017). Investigación en docencia universitaria. Diseñando el futuro a partir de la innovación educativa. Octaedro.
Ruiz-Torres, A. J., Cardoza, G., Kuula, M., Oliver, Y. y Rosa-Polanco, H. (2018). Logistic services in the Caribbean region: An analysis of collaboration, innovation capabilities and process improvement. Academia Revista Latinoamericana de Administración, 31(3), 534-552. https://doi.org/10.1108/ARLA-03-2017-0078
Sangrá, A., Raffaghelli, J. E. y Guitert?Catasús, M. (2019). Learning ecologies through a lens: Ontological, methodological and applicative issues. A systematic review of the literature. British Journal of Educational Technology, 50(4), 1619-1638. https://doi.org/10.1111/bjet.12795
Santoro, G., Vrontis, D., Thrassou, A. y Dezi, L. (2018). The internet of things: Building a knowledge management system for open innovation and knowledge management capacity. Technological Forecasting and Social Change, 136, 347-354. https://doi.org/10.1016/j.techfore.2017.02.034
Teichler, U. (2009). Sistemas comparados de educación superior en Europa: Marcos conceptuales, resultados empíricos y perspectiva de futuro. Octaedro.
Tena, M. (2010). Aprendizaje de la competencia creatividad e innovación en el marco de una titulación adaptada al espacio europeo de educación superior. Formación Universitaria, 3(2), 11-20. https://doi.org/10.4067/S0718-50062010000200003
Torra, I., del Corral, I. D., Pérez, M. J., Valderrama, E., Márquez, M. D., Sabaté, S. y Estebanell, M. (2012). Identificación de competencias docentes que orienten el desarrollo de planes de formación dirigidos a profesorado universitario. REDU, Revista de Docencia Universitaria, 10(2), 21-56. https://doi.org/10.4995/redu.2012.6096
Tourón, J., Martín, D., Navarro-Asencio, E., Pradas, S e Íñigo, V. (2018). Validación de constructo de un instrumento para medir la competencia digital docente de los profesores. Revista Española de Pedagogía, 76 269, 25-54. https://doi.org/10.22550/REP76-1-2018-02
Triadó, X. M., Estebanell, E., Márquez, M. D. y Del Corral, I. (2014). Identificación del perfil competencial docente en educación superior. Evidencias para la elaboración de programas de formación continua del profesorado universitario. Revista Española de Pedagogía, 17(2), 55-76.
Unesco. (2016). Innovación educativa: Herramientas de apoyo para el trabajo docente. Unesco.
Villalón, J. (2017). Las transformaciones de las relaciones laborales ante la digitalización de la economía, Temas Laborales: Revista Andaluza de Trabajo y Bienestar Social, 138, 13-47.
Walder, A. M. (2017). Pedagogical innovation in Canadian higher education: Professors’ perspectives on its effects on teaching and learning. Studies in Educational Evaluation, 54, 71-82. https://doi.org/10.1016/j.stueduc.2016.11.001
Wilson, G., Wesselink, R., Noroozi, O. y Mulder, M. (2015). The current status of teaching staff innovation competence in Ugandan universities: perceptions of managers, teachers, and students. Journal of Higher Education Policy and Management, 37(3), 330-343. https://doi.org/10.1080/1360080X.2015.1034425
Zaragoza, M. C., Díaz-Gibson, J., Caparrós, A. F. y Solé, S. L. (2021). The teacher of the 21st century: Professional competencies in Catalonia today. Educational Studies, 47(2), 217-237. https://doi.org/10.1080/03055698.2019.1686697
Zouaghi, F., Sánchez, M. y Martínez, M. G. (2018). Did the global financial crisis impact firms' innovation performance? The role of internal and external knowledge capabilities in high and low tech industries. Technological Forecasting and Social Change, 132, 92-104. https://doi.org/10.1016/j.techfore.2018.01.011