Methodological Approach for the Evaluation of the Impact of Graduates in the Environment: A Case Study
Keywords:
Evaluation, Impact, Higher education, Educational quality, Social impact
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 Unported License.
Abstract
This article presents a methodological proposal for evaluating the impact of graduates from higher education institutions, based on a case study at a Colombian university. The Graduate Impact Index (GII) was used to measure the university's contribution in four key components: comprehensive training, development of interpersonal skills, social mobility, and improvement of quality of life. The evaluation considers not only the academic impact but also a sociocultural perspective, recognizing the diversity of contexts of the graduates, particularly those in situations of social vulnerability. Surveys were conducted with 956 graduates between 2015 and 2022, employing a simple random sampling method. The results show that the GII reached 72% of the expected value (1), with interpersonal skills and perceptions of university training being determining factors, scoring higher. The challenges of conducting contextualized educational evaluations are discussed, particularly in environments with social, cultural, and economic diversity, and how higher education can act as an agent of social mobility and well-being.
Downloads
References
Aké-Uitz, D. (2022). Instituciones de educación superior como mediadoras de la transmisión intergeneracional de la riqueza en México. El Trimestre Económico, 865-900. https://doi.org/10.20430/ete.v89i355.1426
Anders, J. (2015). Embedding formative assessment to improve pupil attainment: a randomised trial in schools.. https://doi.org/10.1186/isrctn10973392
Arenas, Ó. (2013). De liebres, tortugas y otros engendros: movilidades urbanas y experiencias del espacio público en la Bogotá contemporánea. Revista Colombiana De Antropología, 49(2), 15-40. https://doi.org/10.22380/2539472x62
Atterberry, A., McCallum, D., & Lu, Y. (2021). Interrogating parenting and intergenerational relationships within national and transnational contexts. Current Sociology, 70(6), 801-805. https://doi.org/10.1177/00113921211057608
Burkhardt, H. and Schoenfeld, A. (2018). Assessment in the service of learning: challenges and opportunities or plus ça change, plus c’est la même chose. ZDM, 50(4), 571-585. https://doi.org/10.1007/s11858-018-0937-1
Bavel, J., Moreels, S., Putte, B., & Matthijs, K. (2011). Family size and intergenerational social mobility during the fertility transition. Demographic Research, 24, 313-344. https://doi.org/10.4054/demres.2011.24.14
Barbera, E. (2016). Aportaciones de la tecnología a la e-evaluación. Revista De Educación a Distancia (Red), (50). https://doi.org/10.6018/red/50/4
Black, P., & Wiliam, D. (1998). Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan, 80(2), 139-148. doi:10.1177/003172171009200119
Black, S., Devereux, P., & Salvanes, K. (2005). The more the merrier? the effect of family size and birth order on children's education*. The Quarterly Journal of Economics, 120(2), 669-700. https://doi.org/10.1162/0033553053970179
Boado, M. and Fachelli, S. (2020). Un contraste sobre la movilidad social intergeneracional en Buenos Aires y Montevideo. Estudios Sociológicos De El Colegio De México, 38(114). https://doi.org/10.24201/es.2020v38n114.1867
Carreño, S. and Darío, L. (2016). Impacto en la población beneficiaria de 0 a 17 años del programa de comedores comunitarios como eje fundamental de la política de seguridad alimentaria en bogotá durante el período 2004-2015.. https://doi.org/10.15332/tg.mae.2020.0686
Carter, M. (2009). Visible learning: a synthesis of over 800 meta?analyses relating to achievement. Educational Psychology, 29(7), 867-869. https://doi.org/10.1080/01443410903415150
Castellanos, G. (2018). "pobreza y movilidad social educativa en Guatemala. el ascensor social camina lentamente.". Podium, 33, 45-54. https://doi.org/10.31095/podium.2018.33.5
Concha, C. (2009). Sujetos rurales que por primera generación acceden a la universidad y su dinámica de movilidad social en la región del maule. Calidad en La Educación, (30), 122. https://doi.org/10.31619/caledu.n30.175
Corvalán, A., Brevis, H., & Huiliñir-Curío, V. (2020). La movilidad en su ambiente: prácticas y experiencias de movilidad cotidiana mapuche-williche en contextos rurales. evidencias desde la comuna de puyehue, región de los lagos, chile. Diálogo Andino, (62), 5-17. https://doi.org/10.4067/s0719-26812020000200005
Cheng, P. and Yu, L. (2019). The impact of entrepreneurship on the income mobility of farmers' families. https://doi.org/10.2991/ichssd-19.2019.83
Davidovitch, N. and Yavich, R. (2015). Technology-related involvement: the effect of the mashov system on parent involvement in israeli junior highs. Journal of International Education Research (Jier), 11(4), 243-252.
Deary, I., Taylor, M., Hart, C., Wilson, V., Smith, G., Blane, D., … & Starr, J. (2005). Intergenerational social mobility and mid-life status attainment: influences of childhood intelligence, childhood social factors, and education. Intelligence, 33(5), 455-472. https://doi.org/10.1016/j.intell.2005.06.003
Escribà, A. (2006). Family structure, occupational attainment and intragenerational social mobility in spain. Revista Internacional De Sociología, LXIV(45). https://doi.org/10.3989/ris.2006.i45.19
Fraile, I., Cuenca, E., Larramona, G., & Oliveira, A. (2017). El aprendizaje servicio como un proceso de innovación y generación de talento - [learning and service as a process of innovation and generation of talent].. https://doi.org/10.26754/cinaic.2017.000001_077
González Morales, A., & Del Pozo Sánchez, F. (2015). Un acercamiento teórico al impacto educacional y su evaluación. Revista Varela, 15(40), 10–22. Recuperado a partir dehttps://revistavarela.uclv.edu.cu/index.php/rv/article/view/217
Haveman, R. and Smeeding, T. (2006). The role of higher education in social mobility. The Future of Children, 16(2), 125-150. https://doi.org/10.1353/foc.2006.0015
Hernández, A., Betancort, H., & Alamo, M. (2010). Competencias interpersonales y bienestar del profesor. Psicologí a Educativa, 16(2), 107-114. https://doi.org/10.5093/ed2010v16n2a2
Jia, J., Li, Y., Lu, X., Ning, Y., Christakis, N., & Jia, J. (2021). Triadic embeddedness structure in family networks predicts mobile communication response to a sudden natural disaster. Nature Communications, 12(1). https://doi.org/10.1038/s41467-021-24606-7
Kantis, H., Federico, J., & Girandola, M. (2020). Tensiones y desafíos en la evaluación del impacto de las políticas de emprendimiento. Tec Empresarial, 15(1), 36-55. https://doi.org/10.18845/te.v15i1.5392
González E., Martá J., Velásquez N., Lozano M., y Garcia M (2021). El sistema interno de aseguramiento de la calidad y la gobernanza en la Universidad Santo Tomás. Recuperado de: https://repository.usta.edu.co/bitstream/handle/11634/34629/Obracompleta.2021Gonzalezedurado.pdf?sequence=1&isAllowed=y
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81-112. doi:10.3102/003465430298487
Lambert, C. (2013). Developing learning at st mary’s secondary school, uk. Gifted Education International, 30(1), 47-57. https://doi.org/10.1177/0261429413480422
Lulu, M. and Zhao, C. (2020). An analysis of the role of higher education opportunity expansion in social stratification. Journal of Educational Theory and Management, 4(2), 38. https://doi.org/10.26549/jetm.v4i2.5374
McPherson, G., Blackwell, J., & Hattie, J. (2022). Feedback in music performance teaching. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.891025
Power, J. (2019). The influence of task difficulty on engagement, performance
Martí Chávez, Y., Montero Padrón, B., & Sánchez González, K. (2018). La función social de la educación: referentes teóricos actuales. Conrado, 14(63), 259-267.
Mata, C. and Hernández, K. (2015). Evaluación de impacto de la implementación de transferencias monetarias condicionadas para educación secundaria en costa rica (avancemos). Revista De Ciencias Económicas, 33(1), 9. https://doi.org/10.15517/rce.v33i1.19964
Marzano, R. J. (2006). Classroom assessment and grading that work. Educational Leadership, 63(3), 85-87.
Ministerio de Educación Nacional. (2019). Decreto 1330. Disponible en:
Neelsen, J. (1975). Education and social mobility. Comparative Education Review, 19(1), 129-143. https://doi.org/10.1086/445813
Pfeffer, F. and Hertel, F. (2015). How has educational expansion shaped social mobility trends in the united states?. Social Forces, 94(1), 143-180. https://doi.org/10.1093/sf/sov045
Roberts, S. and Dunbar, R. (2010). Communication in social networks: effects of kinship, network size, and emotional closeness. Personal Relationships, 18(3), 439-452. https://doi.org/10.1111/j.1475-6811.2010.01310.x
Rodríguez, J. and González-Terán, Á. (2019). Progresos educativos intergeneracionales: un análisis para colombia. Revista De Métodos Cuantitativos Para La Economía Y La Empresa, 28, 143-159. https://doi.org/10.46661/revmetodoscuanteconempresa.3173
Romero, N., Guajardo, J., Solis, M., & Andrade, H. (2019). Validez predictiva de las competencias socioemocionales sobre la resiliencia en adolescentes mexicanos. Diversitas, 15(1), 87-99. https://doi.org/10.15332/s1794-9998.2019.0001.07
Segrera, F. (2008). Tendencias de la educación superior en el mundo y en américa latina y el caribe. Avaliação Revista Da Avaliação Da Educação Superior (Campinas), 13(2), 267-291. https://doi.org/10.1590/s1414-40772008000200003
Shu, W., Xiao, Y., Zhang, K., Pei, J., Rokpelnis, K., & Wang, X. (2022). How does education affect intergenerational income mobility in chinese society?. Review of Development Economics, 26(2), 774-792. https://doi.org/10.1111/rode.12863
Tarazona, L., Patiño, N., & Patiño, N. (2016). Interpretación extensiva del acoso laboral en colombia. Academia & Derecho, (12), 87-122. https://doi.org/10.18041/2215-8944/academia.12.319
Tironi, M. (2011). Building infrastructure for mobility: the case of self-service bicycle programs in paris. Athenea Digital Revista De Pensamiento E Investigación Social, 11(1), 41. https://doi.org/10.5565/rev/athenead/v11n1.824
Tobler, K. (2000). Keeley probes as a tool for uncovering student ideas: how do teachers use formative assessment probes to plan and adapt instruction?.. https://doi.org/10.15760/etd.2646
Vercauteren, D. Feedback in new zealand classrooms: do students get the message?.. https://doi.org/10.26686/wgtn.16922935
Torrado, L., Cardona, N., & Casallas, N. (2020). Impacto de la investigación dentro del proceso de formación profesional. Cultura Educación Y Sociedad, 11(2), 145-160. https://doi.org/10.17981/cultedusoc.11.2.2020.09
Torche, F. (2014). Movilidad intergeneracional y desigualdad: el caso latinoamericano. Annual Review of Sociology, 40(1), S2-1-S2-25. https://doi.org/10.1146/annurev-soc-062215-092006
Uceda, O. and Chero, L. (2022). Percepción y prácticas evaluativas de los docentes universitarios. Revista De La Universidad Del Zulia, 13(38), 747-762. https://doi.org/10.46925//rdluz.38.41