External Evaluation of School in Portugal: essay on rationality and meaning
Keywords:
External Evaluation of School, Educational Evaluation, Science, Ethics
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Abstract
Evaluation is a process that aggregates different dimensions of an object. In education, and due to the characteristics that underlie the Social Sciences, educational evaluation is developed based on a critical analysis of the process and qualitative and quantitative results, justifying the deliberative process of studying the object with epistemological and scientific foundations, which consider the context characteristics as one of the main variables to observe. The evaluation process is complex and, therefore, demanding for the creation of criteria and, consequently, of the assumption of results that provide data on the state of the policies, processes, and practices in education. This difficulty should not be a justification for laissez-faire but be a promoter of the debate around evaluation that allows the construction of educational evaluation standards close to educational practices, processes, and policies in education and respectful of their contexts. The purpose of this essay is to reflect on the educational evaluation processes in the Portuguese context, focused on the analysis of the experience of the External Evaluation of Schools (EES).
Downloads
References
Altrichter, H. e Kemethofer, D. (2015). Does accountability pressure through school inspections promote school improvement? School Effectiveness and School Improvement, 26(1), 32-56. doi: 10.1080/09243453.2014.927369
Barreira, C., Bidarra, M. G. e Vaz-Rebelo, M. P. (Org.) (2016). Estudos sobre avaliação externa de escolas. Porto: Porto Editora.
Bazzul, J. (2017) The 'subject of ethics' and educational research OR Ethics or politics? Yes please! Educational Philosophy and Theory, 49(10), 995-1005. doi: 10.1080/00131857.2016.1270184
Bergh, A. e Wahlström, N. (2018). Conflicting goals of educational action: a study of teacher agency from a transactional realism perspective. The Curriculum Journal, 29(1), 134-149. doi: 10.1080/09585176.2017.1400449
Bonner, S. M., Rivera, C. T. e Chen, P. P. (2018). Standards and assessment: coherence from the teacher's perspective. Education Assessment, Evaluation and Accountability, 30(1), 71-92. doi: 10.1007/s11092-017-9272-2
Building Evidence in Education. (s/d). Generating Evidence in the Education Sector. Disponível em https://bit.ly/3hWCS2L
Calado, J. (2016). A ciência como ética. XXI, Ter opinião, 6, 3-16.
Coburn, C. E. (2016). What's policy go to do with it? How the structure - agency debate can illuminate policy implementation. American Journal of Education, 132(3), 465-475. doi: 10.1086/685847
Correia, A. P. (2016). A avaliação das escolas: efeitos da avaliação externa nas dinâmicas de autoavaliação da escola (Tese de Doutoramento, Universidade de Évora, Portugal). Disponível em http://hdl.handle.net/10174/18552
Correia, S. (2012). Dispositivo de Autoavaliação de Escola: entre a lógica do controlo e a lógica da regulação (Tese de Doutoramento, Universidade do Minho, Braga, Portugal). Disponível em http://hdl.handle.net/1822/19723
Ehren, M. C. M., Gustafsson, J. E., Altrichter, H., Skedsmo, G., Kemethofer, D. e Huber, S. G. (2015). Comparing effects and side effects of different school inspection systems across Europe. Comparative Education, 51(3), 275-400. doi: 10.1080/03050068.2015.1045769
Ehren, M. C. e Visscher, A. J. (2006). Towards a theory on the impact of school inspection. British Journal of Educational Studies, 54(1), 51-72. doi: 10.1111/j.1467-8527.2006.00333.x
Ehren, M. C., Altrichter, H., McNamara, G. e O'Hara, J. (2013). Impact of school inspections on improvement of schools-describing assumptions on causal mechanisms in six European countries. Educational Assessment Evaluation and Accountability, 25(1), 3-43. doi: 10.1007/s11092-012-9156-4
Eteläpelto, A., Vähäsantanen, K., Hökkä, P. e Paloniemi, S. (2013). What is agency? Conceptualizing professional agency at work. Educational Research Review, 10, 45-65. doi: 10.1016/j.edurev.2013.05.001
Figueiredo, C. (2017). Avaliação de escolas: políticas, conceitos, processos e impactos. (Tese de Doutoramento, Universidade do Porto). Disponível em https://bit.ly/2V9AjR9
Foucault, M. (1982). The subject and power. Critical Inquiry, 8, 777-795. https://doi.org/10.1086/448181
Foucault, M. (1997). On the genealogy of ethics: An overview of a work in progress. In P. Rabinow (Eds.), Ethics: Subjectivity and truth (Essential Works of Foucault, 1954-1984, Vol. 1) (pp. 253-280). New York, NY: The New Press.
Gomes, S. (2014). Autoavaliação em escolas do Alentejo. Constrangimentos e oportunidades (Tese de Doutoramento, Universidade de Évora, Portugal). Disponível em http://hdl.handle.net/10174/15920
Gorard, S. (Ed.). (2020). Getting Evidence into Education Evaluating the Routes to Policy and Practice. London: Routledge. https://doi.org/10.4324/9780429290343
Gustafsson, J. E., Ehren, M. C. M., Conyngham, G., McNamara, G., Altrichter, H. e O'Hara, J. (2015). From inspection to quality: Ways in which school inspection influences change in schools. Studies in Educational Evaluation, 47, 47-57. doi: 10.1016/j.stueduc.2015.07.002
Hargreaves, A. e Fullan, M. (2012). Professional capital: Transforming teaching in every school. New York: Teachers College Press.
Hult, A. e Edström, C. (2016). Teacher ambivalence towards school evaluation: promoting and ruining teacher professionalism. Education Inquiry, 7(3), 305-325. doi: 10.3402/edui.v7.30200 https://doi.org/10.3402/edui.v7.30200
Imants, J. e Van der Wal, M. M. (2019). A model of teacher agency in professional development and school reform. Journal of Curriculum Studies, 52(1), 1-14. doi: 10.1080/00220272.2019.1604809
Inspeção Geral da Educação e Ciência. (2008). Avaliação Externa das Escolas - Ciclos de Avaliação. Disponível em https://bit.ly/3dp3iXf
Inspeção Geral da Educação e Ciência. (2019). Terceiro Ciclo da Avaliação Externa das Escolas - Metodologia. Disponível em https://bit.ly/37T7YUl
Jones, K. L., Tymms, P., Kemethofer, D., O'Hara, J., McNamara, G., Huber, S., Myrberg, E., Skedsmo, G. e Greger, D. (2017). The unintended consequences of inspection: the prevalence of inspection side-effects in Austria, the Czech Republic, England, Ireland, the Netherlands, Sweden, and Switzerland. Oxford Review of Education, 43, 1-18. doi: 10.1080/03054985.2017.1352499
Kemethofer, D., Gustafsson, J. e Altrichter, H. (2017). Comparing effects of school inspections in Sweden and Austria. Education Assessment, Evaluation and Accountability, 29(4), 319-337. doi: 10.1007/s11092-017-9265-1
Leijen, Ä., Pedaste, M. e Lepp, L. (2019). Teacher agency following the ecological model: how it is achieved and how it could be strengthened by different types of reflection. British Journal of Educational Studies, 1(16). doi: 10.1080/00071005.2019.1672855
Merton, R. K. (1973). The normative structure of science. Em N.W. Storer (Ed.), The sociology of science: Theoretical and empirical investigations (pp. 267-278). Chicago: University of Chicago Press.
Pacheco, J. A., Morgado J. C. e Sousa, J. (Eds.). (2020). Avaliação institucional: perspetivas teórico-conceptuais. Porto: Porto Editora.
Morris, M. (2003). Ethical Considerations in Evaluation. Em T. Kellaghan & D. L. Stufflebeam (Eds.), International Handbook of Educational Evaluation (pp. 303-327). Dordrecht: Kluwer Academic Publishers. https://doi.org/10.1007/978-94-010-0309-4_19
Oliveira, D. (2017). Qualidade da educação em Portugal: o papel da avaliação externa de escolas. (Tese de Doutoramento, Universidade de Aveiro). Aveiro: Universidade de Aveiro.
Pacheco, J. A. (2016). Resultados globais do Projeto. In C. Barreira, M. Bidarra, & M. Vaz-Rebelo (Org.), Estudos sobre Avaliação Externa de Escolas (pp. 262-271). Porto: Porto Editora.
Pacheco, J. A. (Org.). (2014). Avaliação Externa de Escolas: Quadro Teórico/Conceptual. Porto: Porto Editora.
Pascual, J. (2019). Innovación Educativa: Un proceso construido sobre relaciones de poder. Revista Educación, Política y Sociedad, 4(2), 9-30.
Penninckx, M. (2017). Effects and side effects of school inspections: a general framework. Studies in Educational Evaluation, 52, 1-11. doi: 10.1016/j.stueduc.2016.06.006
Penninckx, M. e Vanhoof, J. (2015). Insights gained by schools and emotional consequences of school inspections. School Leadership and Management, 35(5), 477-501. doi: 10.1080/13632434.2015.1107036
Priestley, M., Biesta, G. J. J. e Robinson, S. (2015). Teacher Agency: An Ecological Approach. London: Bloomsbury Academic.
Quintelier, A., Vanhoof, J. e De Maeyer, S. (2018). Understanding the influence of teachers' cognitive and effective responses upon school inspection feedback acceptance. Education Assessment, Evaluation and Accountability, 30(4), 399-431. doi: 10.1007/s11092-018-9286-4
Russell, B. (2009). Bertrand Russell Autobiography. New York: Routledge. https://doi.org/10.4324/9780203875452
Sampaio, M. (2018). Avaliação externa de escolas e programa TEIP: que lugar(es) para a justiça social? (Tese de Doutoramento, Universidade do Porto). Disponível em https://bit.ly/2Nki4nA
Shah, H. (2020). Global problems need social science. Nature, 577(16), 295. doi: 10.1038/d41586-020-00064-x
Silvestre, M. J. (2013). Avaliação das escolas. Avaliação nas escolas. (Tese de Doutoramento, Universidade de Évora, Portugal). Disponível em https://bit.ly/2Yp0rt7
Sousa, J. (2019). Conceptualizar o currículo da educação pré-escolar no contexto da Avaliação Externa das Escolas em Portugal (Tese de Doutoramento, Universidade do Minho). Braga: Universidade do Minho. Disponível em https://bit.ly/31fKBDb
Stake, R. (2006). Evaluación comprensiva y evaluación basada en estándares. Barcelona: Graó.
Stufflebeam, D. L. (2003). Professional Standards and Principles for Evaluations. In T. Kellaghan & D. L. Stufflebeam (Eds.), International Handbook of Educational Evaluation (pp. 279-302). Dordrecht: Kluwer Academic Publishers. https://doi.org/10.1007/978-94-010-0309-4_18
Vincent-Lancrin, S., Urgel, J., Kar, S. e Jacotin, G. (2019). Measuring Innovation in Education 2019: What Has Changed in the Classroom?. Paris: OECD Publishing. https://doi.org/10.1787/9789264311671-en
Vo, A. T. e Christie, C.A. (2018). Where impact measurement meets evaluation: tensions, challenges, and opportunities. American Journal of Evaluation, 39(2), 383-388. doi: 10.1177/1098214018778813
Warren, A. N. e Ward, N. A. (2017). 'This is my new normal': teachers' accounts of evaluation policy at local school board meetings. Journal of Education Policy, 33(6), 840-860. https://doi.org/10.1080/02680939.2017.1390164
Worthen, B. R. e Sanders, J. R. (1987). Educational Evaluation. New York: Longman.