Vol. 13 No. 1 (2020): Aprendiendo a Evaluar para Aprender en la Educación Superior
Articles

Validation of a Scale to Measure Instructional Quality in Trainers

José Pablo Siqueiros Aguilera
Bio
Martha Olivia Peña Ramos
Bio
Jesús Tánori Quintana
Bio
Jesús Francisco Laborin Álvarez
Bio
Published April 21, 2020

Keywords:

Higher education, Teaching, Teacher evaluation, Measuring instrument, Psychometrics
How to Cite
Siqueiros Aguilera, J. P., Peña Ramos, M. O., Tánori Quintana, J., & Laborin Álvarez, J. F. (2020). Validation of a Scale to Measure Instructional Quality in Trainers. Iberoamerican Journal of Educational Evaluation, 13(1), 239–250. https://doi.org/10.15366/riee2020.13.1.011

Abstract

Quality education is a primary objective for educational policies, especially in higher education. However, it is difficult to conceive of a quality process without a baseline; that is, making an assessment of the current state of the object of study with the use of measuring instruments that assess teacher performance from different perspectives while considering the different actors in the educational process. Therefore, the aim of the present study is to translate, adapt and validate a scale which measures Instructional Quality from the perspective of the student. We worked with a non-probabilistic sample of 278 students from 3 normal schools and a sub-campus of UPN Ciudad Obregón campus in the state of Sonora, Mexico in the 2017-2018 cycle. The procedure for the analysis of the information begins with validation of confirmatory factor analysis, in addition to calculating reliability indexes. The results obtained support the use of the model to measure the construct of Instructional Quality in Sonoran trainers. It is worth mentioning that the values of validity and reliability make the measurement model sustainable.

Downloads

Download data is not yet available.

References

Backhoff, E., Vázquez-Lira, R., Baroja, J. L., Guevara, G. P. y Morán, Y. (2017). México en el proyecto TALIS-PISA: Un estudio exploratorio. Importancia de las escuelas, directores, docentes y estudiantes en el aprendizaje de las matemáticas. Ciudad de México: INEE.

Blömeke, S., Olsen, R. V. y Suhl, U. (2016). Relation of student achievement to the quality of their teachers and instructional quality. En T. Nilsen y J. Gustafsson (Eds.), Teacher Quality, Instructional Quality and Student Outcomes (pp. 21-50). Ginebra: Springer. https://doi.org/10.1007/978-3-319-41252-8_2

Brislin, R. W. (1970). Back-Translation for Cross-Cultural Research. Journal of Cross-Cultural Psychology, 1(3), 185-216. https://doi.org/10.1177/135910457000100301

Brophy, J. (2001). Generic aspects of effective teaching. Tomorrow’s Teachers, 1, 3-45. https://doi.org/10.1016/S0167-8922(00)80004-8

Burns, D. y Darling-Hammond, L. (2014). Teaching around the world: What can TALIS tell us. Stanford Center for Opportunity Policy in Education. Recuperado de https://edpolicy.stanford.edu/sites/default/files/publications/teaching-around-world-what-can-talis-tell-us_3.pdf

Coubergs, C., Struyven, K., Vanthournout, G. y Engels, N. (2017). Measuring teachers’ perceptions about differentiated instruction: The DI-Quest instrument and model. Studies in Educational Evaluation, 53, 41–54. https://doi.org/10.1016/j.stueduc.2017.02.004

CRESON. (2018). Estadísticas y control escolar. Base de datos. Recuperado de http://www.creson.edu.mx/

Downer, J., Stuhlman, M., Schweig, J., Martínez, J. y Ruzek, E. (2015). Measuring effective teacher-student interactions from a student perspective: A multi-level analysis. The Journal of Early Adolescence, 35(5-6), 722-758. https://doi.org/10.1177/0272431614564059

Furr, M. y Bacharach, V. (2014). Psychometrics. An introduction. Nueva York, NY: Sage.

Góngora, E. (2000). El enfrentamiento a los problemas y el papel del control: una visión etnopsicológica en un ecosistema con tradición. Tesis Doctoral. Universidad Autónoma de México, Ciudad de México, México.

González-Vallejos, M. (2018). El estudio del formador latinoamericano: un campo de investigación “en construcción”. Magis, Revista Internacional de Investigación en Educación, 10(21), 35-54. https://doi.org/10.11144/Javeriana.m10-21.eflc

Guo, T. (2017). On Foreign Language Creation and Rootless Back Translation-A Case Study of Snow Flower and the Secret Fan. Journal of Literature and Art Studies, 7(10), 1354-1364. https://doi.org/10.17265/2159-5836/2017.10.017

Hair, J. F., Black, W. C., Babin, B. J. y Anderson, R. E. (2010). Multivariate data analysis. Trenton, NJ: Pearson Prentice Hall.

Holzberger, D., Philipp, A. y Kunter, M. (2013). How teachers’ self-efficacy is related to instructional quality: A longitudinal analysis. Journal of Educational Psychology, 105(3), 774–786. https://doi.org/10.1037/a0032198

INEE. (2018). La educación obligatoria en México. Informe 2018. Ciudad de México: INEE.

Johnson, B. y Christensen, L. (2017). Educational research: quantitative, qualitative and mixed approaches. Thousand Oaks, CA: Sage.

Junker, B. W., Weisberg, Y., Matsumura, L., Crosson, A., Wolf, M., Levison, A. y Resnick, L. (2006). Overview of the instructional quality assessment. Los Angeles, CA: Regents of the University of California. https://doi.org/10.1037/e644942011-001

Klette, K., Blikstad-balas, M. y Roe, A. (2017). Linking Instruction and Student Achievement -Research design for a new generation of classroom studies Å koble undervisning med elevprestasjoner - Forskningsdesign for en ny generasjon klasseromsstudier, 11(3), 1-19. https://doi.org/10.5617/adno.4729

Medrano, V., Ángeles, E. y Morales, M. (2017). La educación normal en México. Elementos para su análisis. Ciudad de México: INEE.

Merrill, M. D. (2002). First principles of instruction. Educational Technology Research and Development, 50(3), 43-59. https://doi.org/10.1007/BF02505024

Merrill, M. D., Barclay, M. y van Schaak, A. (2008). Prescriptive principles for instructional design. Handbook of research on educational communications and technology, Lawrence Erlbaum Associates. Nueva York, NY: Routledge, Taylor and Francis Group.

Morales, P. (2011). El Análisis Factorial en la construcción e interpretación de tests, escalas y cuestionarios. Madrid: Universidad Pontificia Comillas.

Murillo, F. J., Martínez-Garrido, C. y Hernández, R. (2011). Decálogo para una enseñanza eficaz. REICE. Revista Iberoamericana sobre Calidad, Eficacia y Cambio en Educación, 9(1), 7-27.

Nilsen, T. y Gustafsson, J. (2016). Teacher Quality, Instructional Quality and Student Outcomes. Londres: Springer. https://doi.org/10.1007/978-3-319-41252-8

Oviedo, C. y Campo-Arias, A. (1995). Aproximación al uso del coeficiente alfa de Cronbach. Revista Colombiana de Psiquiatría, 34(4), 572-580.

Praetorius, A. K., Pauli, C., Reusser, K., Rakoczy, K. y Klieme, E. (2014). One lesson is all you need? Stability of instructional quality across lessons. Learning and Instruction, 31, 2-12. https://doi.org/10.1016/j.learninstruc.2013.12.002

Reigeluth, C. (2016). Instructional theory and technology for the new paradigm of education. Revista de Educación a Distancia, 50, 1-18. https://doi.org/10.4324/9781315760933

Reyes-Lagunes, I. (1993). Las redes semánticas naturales, su conceptualización y su uso en la construcción de instrumentos. Revista de Psicología Social y Personalidad, 9, 83-99.

Sälzer, C., Trautwein, U., Lüdtke, O. y Stamm, M. (2012). Predicting adolescent truancy: The importance of distinguishing between different aspects of instructional quality. Learning and Instruction, 22(5), 311-319. https://doi.org/10.1016/j.learninstruc.2011.12.001

Sánchez-Rosas, J. y Esquivel, S. (2016). Instructional Teaching Quality, Task Value, Self-Efficacy, and Boredom: A Model of Attention in Class. Revista de Psicología, 25(2), 1-20. https://doi.org/10.5354/0719-0581.2017.44966

SIBEN. (2018). Matrícula ciclo escolar 2017-2018. Recuperado de http://www.siben.sep.gob.mx/pages/estadisticas_recientes

Slavin, R. (1994). Quality, appropriateness, incentive, and time: A model of instructional effectiveness. International Journal of Educational Research, 21(2), 141-157. https://doi.org/10.1016/0883-0355(94)90029-9

Tejedor, F. (2012). Evaluación del desempeño docente. Revista Iberoamericana de Evaluación Educativa, 5(1e), 319-327.

Vaillant, D. (2004). Construcción de la profesión docente en América Latina: tendencias, temas y debates. Santiago de Chile: PREAL.

Valdés, A., Carlos, A., Wendlandt, T. y Ramírez, M. (2016). Propiedades psicométricas de una escala para medir el manejo de la vergüenza en adolescentes (MOSS-SAST). Acta Colombiana de Psicología, 19(1), 13-34. https://doi.org/10.14718/ACP.2016.19.1.2

Wagner, W., Göllner, R., Helmke, A., Trautwein, U. y Lüdtke, O. (2013). Construct validity of student perceptions of instructional quality is high, but not perfect: Dimensionality and generalizability of domain-independent assessments. Learning and Instruction, 28, 1-11. https://doi.org/10.1016/j.learninstruc.2013.03.003