FROM CERTIFICATES TO PERFORMANCE: A PARADIGM SHIFT AND ITS CONSEQUENCES FOR HIGHER EDUCATION RESEARCH
Mots-clés :
Bologna process, Copenhagen process, educational certificates, European dimension, evidence-based policy, paradigm shift, performance-based assessmentRésumé
Against the backdrop of recent social and technological developments, the relationship between the educational system and the employment system has also changed. The “lifelong learning” paradigm is now firmly established within the field of educational research. In this article, we argue that empirical researchers have shifted using certificates to capture educational attainment, focusing instead on competence and performance. We define “performance” as the ability to react adequately and flexibly to new situations within job-related contexts. This paper thus aims to describe the shifting research paradigm in the context of political agenda-setting and presents some examples from different disciplinary perspectives to illustrate the potential of interdisciplinary research. Interdisciplinary, collaborative research, we suggest, shows great potential for providing empirical evidence to measure the consequences—intended and unintended—of political reforms in higher education. Even though our arguments and implications are formulated from the perspective of the German education and science system, their essence can also be applied to other national contexts.
Téléchargements
Références
Aguinis, H. and Bradley, KJ. (2014). Best Practice Recommendations for Designing and Implementing Experimental Vignette Methodology Studies. Organizational Research Methods, 17(4), 351-371.
Allen, J. and van der Velden, R. (2001). Educational mismatches versus skill mismatches: effects on wages, job satisfaction, and on-the-job search. Oxford Economic Papers, 3, 434-452.
Allen, J. and van der Velden, R. (2005). The Role of Self-Assessment in Measuring Skills. Maastricht University: REFLEX Working Paper 2.
Allen, J. and van der Velden, R. (2011). The Flexible Professional in the Knowledge Society. New Challenges for Higher Education. Heidelberg: Springer.
Allmendinger, J. and von den Driesch, E. (2014). Social inequalities in Europe: facing the challenge (No. P 2014-005). WZB Discussion Paper.
Almeida, F., Duarte Santos, J. and Augusto Monteiro, J. (2020). The Challenges and Opportunities in the Digitalization of Companies in a Post-COVID-19 World. IEEE Engineering Management Review, 48, 97-103. doi: 10.1109/EMR.2020.3013206.
Altbach, P. G. (2015). AHELO: the Myth of Measurement and Comparability. International Higher Education, 82, 2-3.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education [AERA, APA & NCME] (2014). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
Ante, C. (2016). The Europeanisation of Vocational Education and Training. Contributions to Political Science. Springer.
Auspurg, K. and Hinz, T. (2015). Factorial Survey Experiments. Thousand Oaks, CA: SAGE, Series: Quantitative Applications in the Social Sciences.
Baethge, M. and Winther, E. (2015). ASCOT Kompetenzmessung in der Berufsbildung – Ansatz, Ergebnisse und Perspektiven der BMBF Forschungsinitiative. Retrieved from http://ascot-vet.net/_media/1_ASCOT_Impulsvortrag_Winther_Baethge.pdf. Accessed 28 Oct 2017.
Becker, G. S. (1993 [1964]). Human Capital. A Theoretical and Empirical Analysis with Special Reference to Education. Chicago: The University of Chicago Press.
Biesta, G. J. (2010). Why ‘what works’ still won’t work: From evidence-based education to value-based education. Studies in philosophy and education, 29, 491-503.
Blömeke S., Gustafson J.-E. and Shavelson, R. (2015). Beyond dichotomies: Competence viewed as a continuum. Zeitschrift für Psychologie, 223, 3-13.
BMBF (2016). Bildungsoffensive für die digitale Wissensgesellschaft. Strategie des Bildungsministeriums für Bildung und Forschung. Retrieved from https://www.bmbf.de/pub/Bildungsoffensive_fuer_die_digitale_Wissensgesellschaft.pdf. (09.07.2018).
Blossfeld, H-.P., Roßbach, H.-G. and von Maurice, J. (2011). Education as a Lifelong Process. The German National Educational Panel Study (NEPS). Wiesbaden: VS Verlag für Sozialwissenschaften.
Bologna Declaration (1999). Joint declaration of the European Ministers of Education, 19. Juni 1999, Bologna. Retrieved from http://www.ehea.info/cid100210/ministerial-conference-bologna-1999.html (09.07.2018).
Braun, E. and Mishra, S. (2016). Which tool for what assessment? In J. Huisman and M. Tight (Eds), Theory and Method in Higher Education Research (pp 47-68). Emerald Group: Bingley.
Braun, E., Schwabe, U. and Klein, D. (2018). Performance-Based Tests: Using Role Plays to Assess Communication Skills. In S. McGrath, M. Mulder, J. Papier and R. Suart (Eds.), Handbook of Vocational Education and Training. Cham: Springer.
Braun, E., Weiß, T. and Seidel, T. (2014). Lernumwelten in der Hochschule. In T. Seidel and A. Krapp (Eds.), Pädagogische Psychologie (pp 433-454). Beltz Juventa.
Breen, R. and Jonsson, J. O. (2005). Inequality of Opportunity in Comparative Perspective: Recent Research on Educational Attainment and Social Mobility. Annual Review of Sociology, 31, 223-243.
Breen, R., Luijkx, R., Müller, W. and Pollak, R. (2010). Long-term Trends in Educational Inequality in Europe: Class Inequalities and Gender Differences. American Journal of Sociology, 114, 1475-1521.
Broucker, B., De Wit, K., Verhoeven, J.C. and Leišyt?, L. (2019). Higher Education System Reform. An International Comparison after Twenty Years of Bologna. Brill: Sense Publishers.
Chan, R. Y., Brown, G. T. L. and Ludlow, L. H. (2014). What is the purpose of higher education? A comparison of institutional and student perspectives on the goals and purposes of completing a bachelor's degree in the 21st century. The American Education Research Association (AERA) Annual Conference. Philadelphia, The United State of America.
Chapman, J. D. and Aspin, D. N. (2013). A problem-solving approach to addressing current global challenges in education. British Journal of Educational Studies, 61, 49-62.
Chernikova, O., Heitzmann, N., Stadler, M., Holzberger, D., Seidel, T. and Fischer, F. (2020). Simulation-Based Learning in Higher Education: A Meta-Analysis. Review of Educational Research, 90(4), 499-541.
Coates, H. (2005). The value of student engagement for higher education quality assurance. Quality in higher education, 11(1), 25-36.
Coates, H. (2016). The market for learning: Leading transparent higher education. Springer.
Coates, H. and Richardson, S. (2012). An international assessment of bachelor degree graduates’ learning outcomes. Higher Education Management and Policy, 23, 51-69.
Colardyn, D. and Bjornavold, J. (2004). Validation of Formal, Non?Formal and Informal Learning: policy and practices in EU Member States 1. European journal of education, 39, 69-89.
Copenhagen Declaration (2002). Declaration of the European Ministers of Vocational Education and Training, and the European Commission, convened in Copenhagen on 29 and 30 November 2002, on enhanced European cooperation in vocational education and training “The Copenhagen Declaration”. Retrieved from https://europass.cedefop.europa.eu/sites/default/files/copenhagen-en.pdf (09.07.2018).
Eiszler, C. F. (2002). College students' evaluations of teaching and grade inflation. Research in Higher Education, 43, 483-501.
Enders, J., De Boer, H., File, J., Jongbloed, B. and Westerheijden, D. (2011). Reform of higher education in Europe. In: Reform of higher education in Europe (pp 1-10). Brill: Sense Publishers.
European Council (2000): Presidency Conclusions. Retrieved from http://www.europarl.europa.eu/summits/lis1_en.htm (19.02.2019).
Eurostat (2018): Retrieved from https://ec.europa.eu/eurostat/statistics-explained/index.php/Tertiary_education_statistics (19.02.2019).
Falkenstern, A., Schwabe, U., Walz, K. and Braun, E. (2020). The Research Group Performance-Based Assessment of Communication in KoKoHs. In O. Zlatkin-Troitschanskaia, H. Pant, M. Toepper and C. Lautenbach (Eds.), Student Learning in German Higher Education (pp 301-314). Wiesbaden: Springer VS.
Farkas, G., England, P., Vicknair, K. and Kilbourne, B. S. (1997). Cognitive Skill, Skill Demand of Jobs, and Earnings among Young European American, African American, and Mexican American Workers. Social Forces, 75, 913-938.
Frank, D. J. and Meyer, J. W. (2007). University expansion and the knowledge society. Theory and society, 36, 287-311.
Frazis, H. (2002). Human Capital, Signaling, and the Pattern of Returns to Education. Oxford Economic Papers, 54, 298-320.
Gebel, M. (2009). Wage Effects of Education: The Impact of Educational Expansion in Germany. In A. Hadjar and R. Becker (Eds.), Expected and Unexpected Consequences of the Educational Expansion in Europe and the US. Theoretical Approaches and Empirical Findings in Comparative Perspective (pp 261-270). Bern: Haupt Verlag.
Green, F. (2012). Employee Involvement, Technology and Evolution in Job Skills: A Task-Based Analysis. ILR Review, 65, 36–67.
Grusky, D. B. (2008). Social Stratification: Class, Race, and Gender in Sociological Perspective. Boulder: Westview Press.
Hadjar, A. and Becker, R. (2009). Expected and Unexpected Consequences of the Educational Expansion in Europe and the US. Bern/Stuttgart/Wien: Haupt.
Hanushek, E. A., Schwerdt, G., Wiederhold, S. and Woesmann, L. (2015). Returns to skills around the world: Evidence from PIAAC. European Economic Review, 73, 103-130.
Hanushek, E. A. and Woessmann, L. (2008). The role of cognitive skills in economic development. Journal of Economic Literature, 46, 607-668.
Harmsen, R. and Braband, G. (2019). The OECD and Higher Education Policy: Agenda-Setting, Organizational Dynamics and the Construction of Convening Authority. Higher Education Policy: Retrieved from https://doi.org/10.1057/s41307-019-00153-1.
Harper, S. (2014). Economic and Social Implications of Aging Societies. Science, 346, 587-595.
Hattie, J. (2015). The applicability of Visible Learning to higher education. Scholarship of Teaching and Learning in Psychology, 1, 79.
Heijke, H., Meng, C. and Ris, C. (2003). Fitting to the job: the role of generic and vocational competencies in adjustment and performance. Labour Economics, 10, 215-229.
Höhn C., Mai R. and Micheel F. (2008). Demographic Change in Germany. In I. Hamm., H. Seitz. and M. Werding (Eds), Demographic Change in Germany (pp 9-33). Springer, Berlin, Heidelberg.
Hu, S. (2005). Special Issue: Beyond Grade Inflation: Grading Problems in Higher Education. ASHE Higher Education Report 30.
Huisman, J., Meek, L. and Wood, F. (2007). Institutional diversity in higher education: A cross?national and longitudinal analysis. Higher Education Quarterly, 61, 563-577.
Hüther, O. and Krücken, G. (2018). Higher Education in Germany—Recent Developments in an International Perspective. Cham: Springer International Publishing AG.
Hyytinen, H., Toom, A. and Shavelson, R. J. (2019). Enhancing Scientific Thinking Through the Development of Critical Thinking in Higher Education. In M. Murtonen and K. Balloo (Eds.), Redefining Scientific Thinking for Higher Education (pp. 59–78). Springer.
Jaudzims, S. (2013). Learning Outcomes – Paradigmenwechsel in der Hochschullehre. Hamburg: Verlag Dr. Kovac.
Johnson, V. E. (2006). Grade inflation: A crisis in college education. Springer Science & Business Media.
Kane, M. T. (2001). Current concerns in validity theory. Journal of Educational Measurement, 38, 319–342.
Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50, 1-73.
Karseth, B. (2006). Curriculum restructuring in higher education after the Bologna Process: A new pedagogic regime?. Revista española de educación comparada, 12, 255–284.
Kearney, M. L. and Huisman, J. (2007). Main transformations, challenges and emerging patterns in higher education systems. Higher Education Policy, 20, 361-363.
Krücken, G., Kosmützky, A. and Torka, M. (2007). Towards a multiversity?: Universities between global trends and national traditions. Bielefeld: transcript.
Krücken, G. (2014). Higher Education Reforms and Unintended Consequences: A Research Agenda. Studies in Higher Education, 39, 1439-1450.
Kyndt, E., Dochy, F. and Nijs, H. (2009). Learning conditions for non-formal and informal workplace learning. Journal of Workplace Learning, 21, 369-383.
Liebeskind, U. (2019). Institutionen der Hochschulbildung. In O. Köller, M. Hasselhorn, F. W. Hesse, K. Maaz, J. Schrader, H. Solga, C. K. Spieß and K. Zimmer (Eds), Das Bildungswesen in Deutschland. Bestand und Potenziale (pp 599-628). Bad Heilbrunn: Julius Klinkhardt.
Liefner, I. (2003). Funding, resource allocation, and performance in higher education systems. Higher education, 46, 469-489.
Lievens, F. and . Sackett, P. R. (2006). Video-based versus written situational judgment tests: A comparison in terms of predictive validity. Journal of Applied Psychology, 91 (5), 1181–1188.
Lievens, F and Sackett, P. R. (2012). The validity of interpersonal skills assessment via situational judgement tests for predicting academic success and job performance. Applied Psychology., 97 (2), 460–468.
Lochner, L. (2004). Education, Work, and Crime: A Human Capital Approach. International Economic Review, 45, 811-843.
MacCann, C., Matthews, G., Zeidner, M. and Roberts, R. D. (2003). Psychological assessment of emotional intelligence: A review of self-report and performance-based testing. The International Journal of Organizational Analysis, 11, 247-274.
Marginson, S. (2016). The worldwide trend to high participation higher education: Dynamics of social stratification in inclusive systems. Higher Education, 72, 413-434.
Martin, J. P. (2018). Skills for the 21st Century: Findings and Policy Lessons from the OECD Survey of Adult Skills. IZA Policy Paper No. 138.
Masten, A. S. and Coatsworth, J. D. (1998). The development of competence in favorable and unfavorable environments. American Psychologist, 53, 205-220.
McIntosh, S. and Vignoles, A. (2001). Measuring and Assessing the Impact of Basic Skills on Labour Market Outcomes. Oxford Economic Papers, 3, 453-481.
Meng, C. (2018). EUROGRADUATE Pilot Survey. Design and Implementation of a Pilot European Graduate Survey. Overview of the Project. Retrieved from https://www.eurograduate.eu/download_files/eurograduate_project_overview.pdf (27.05.2020)
Merton, R. K. (1936). The Unanticipated Consequences of Purposive Social Action. American Sociological Review, 1, 894-904.
Messick, S. (1995). Validity of Psychological Assessment. Validation of Inferences from Persons‘ Responses and Performances as Scientific Inquiry into Score Meaning. American Psychologist, 50, 741-749.
Meyer, H. D. and Benavot, A. (Eds.). (2013). PISA, power, and policy: The emergence of global educational governance. Oxford Studies: Symposium Books Ltd.
Mincer, J. (1974). Schooling, Experience, and Earnings. Cambridge: National Bureau of Economic Research.
Mirowsky, J. and Ross, C. E. (1998). Education, Personal Control, Lifestyle and Health: A Human Capital Hypothesis. Research on Aging, 20, 415-449.
Mühleck, K., Meng, C., Oelker, S., Unger, M., Lizzi, R., Maurer, S., Rimac, I., Rutjes, H. and Wessling, K. (2020). EUROGRADUATE Pilot Survey. Technical assessment and feasibility of a full rollout. Luxembourg: Publications Office of the European Union.
Mühleck, K. and Oelker, S. (2020). How does higher education foster active citizenship? Qualities of higher education and the political participation of graduates. In S. Noorda, P. Scoot and M. Vukasovic (Eds.), Bologna Process Beyond 2020: Fundamental Values of the EHEA (pp. 331-338). Bologna: Bononia University Press.
OECD (2001). Lifelong Learning for All: Policy Directions. Retrieved from http://www.oecd.org/officialdocuments/publicdisplaydocumentpdf/?cote=DEELSA/ED/CERI/CD(2000)12/PART1/REV2&docLanguage=En (19.02.2019).
OECD (2018). Education at a Glance 2018: OECD Indicators, OECD Publishing, Paris. Retrieved from https://doi.org/10.1787/eag-2018-en (19.02.2019).
OECD (2019). Getting Skills Right: Future-Ready Adult Learning Systems. OECD Publishing, Paris. Retrieved from https://www.oecd-ilibrary.org/education/getting-skills-right-future-ready-adult-learning-systems_9789264311756-en (19.02.2019).
OECD (2020). Education at a Glance 2020. OECD Indicators. Paris.
Oldekop, J.A., Horner, R., Hulme, D., Adhikari, R., Agarwal, B., Alford, M., Bakewell, O., Banks, N., Barrientos, S., Bastia,, T., Bebbington, A. J., Das, U., Dimova, R., Duncombe, R., Enns, C., Fielding, D., Foster, C., Foster, T., Frederiksen, T., Gao, P., Gillespie, T., Heeks, R., Hickey, S., Hess, M., Jepson, N., Karamchedu, A., Kothari, U., Krishnan, A., Lavers, T., Mamman, A., Mitlin, D., Tabrizi, N. M., Müller, T. R., Nadvi, K., Pasquali, G., Pritchard, R., Pruce, K., Rees, C., Renken, J., Savoia, A., Schindler, S., Surmeier, A., Tampubolon, G., Tyce, M., Unnikrishnan, V., Zhang, Y.-F. (2020). COVID-19 and the case for global development, World Development, 134, 105044.
Olsen, J. P. (2007). The institutional dynamics of the European university. In P. Maassen and J. P. Olsen (Eds.), University dynamics and European integration (pp. 25-54). Springer, Dordrecht.
Orr, D., Gwosc, C. and Netz, N. (2011). Social and Economic Conditions of Student Life in Europe: Synopsis of indicators-Final report-Eurostudent IV 2008-2011. W. Bertelsmann Verlag.
Park, H. and Kyei, P. (2011). Literacy Gaps by Educational Attainment: A Cross-National Analysis. Social Forces, 89, 879-904.
Plake, B. S. and Wise, L. L. (2014). What is the role and importance of the revised AERA, APA, NCME Standards for Educational and Psychological Testing?. Educational Measurement: Issues and Practice, 33, 4-12.
Powell, J., Bernhard, N. and Graf, L. (2012). The Emergent European Model in Skill Formation: Comparing Higher Education and Vocational Training in the Bologna and Copenhagen Processes. Sociology of Education, 85, 240-258.
Power, M. (1999). The Audit Society. Rituals of Verification. Oxford: Oxford Scholarship.
Psacharopoulos, G and Patrinos, H. A. (2004). Returns to investment in education: a further update. Education Economics, 12, 111-134.
Quality Standards Working Group (2015). Quality standards for the development, application, and evaluation of measurement instruments in social science survey research (No. 245). Working Paper Series des Rates für Sozial-und Wirtschaftsdaten.
Protsch, P. and Solga, H. (2019). Das berufliche Bildungssystem in Deutschland. In O. Köller, M. Hasselhorn, F. W. Hesse, K. Maaz, J. Schrader, H. Solga, C. K. Spieß and K. Zimmer (Eds), Das Bildungswesen in Deutschland. Bestand und Potenziale (pp 565-594). Bad Heilbrunn: Julius Klinkhardt.
Rychen, D. S. (2001). Overview. In D. S. Rychen and L. H. Salganik (Eds.), Defining and Selection Key Competencies. Seattle (pp 1ff). Hogrefe & Huber.
Salas-Velasco, M. (2021). Mapping the (mis)match of university degrees in the graduate labor market. Journal of Labour Market Research 55, 14.
Savaget, P. and Acero, L. (2018). Plurality in Understanding of Innovation, Sociotechnical Progress and Sustainable Development: An Analysis of OECD Expert Narratives. Public Understanding of Science, 27, 611-628.
Schofer, E. and Meyer, J. (2005). The Worldwide Expansion of Higher Education in the Twentieth Century. American Sociological Review, 70, 898-920.
Schubert, F. and Becker, R. (2010). Social Inequality of Reading Literacy. A Longitudinal Analysis with Cross-Sectional Data of PIRLS 2001 and PISA 2000 Utilizing the Pairwise Matching Procedure. Research in Social Stratification and Mobility, 28, 109-133.
Schuetze, H. and Slowey, M. (2013). Higher Education and Lifelong Learning: International Perspectives on Change. Routledge.
Shavelson, R., Baxter, G. and Pine, J. (1991). Performance Assessment in Science. Applied Measurement in Education, 4, 347-362.
Shavit, Y. and Blossfeld, H.-P. (1993). Persistent Inequality. Changing Educational Attainment in Thirteen Countries. Boulder: Westview Press.
Shavit, Y., Arum, R. and Gamoran, A. (2007). Stratification in Higher Education. A Comparative Study. Stanford: Stanford University Press.
Sinharay, S., Rijmen, F., Choi, S. and Dorans, N. J. (2014). The revised standards and its role in research on educational measurement. Educational Measurement: Issues and Practice, 33, 36-38.
Skulmowski, A. and Rey, G. D. (2020). COVID-19 as an accelerator for digitalization at a German university: Establishing hybrid campuses in times of crisis. Human Behavior and Emerging Technologies; 2, 212–216.
Slavin, R. E. (2002). Evidence-based education policies: Transforming educational practice and research. Educational Researcher, 31, 15-21.
Spence, M. A. (1981 [1974]). Market Signaling: Informational Transfer in Hiring and Related Screening Processes. Cambridge: Harvard University Press.
Suleman, F. (2016). Employability skills of higher education graduates: Little consensus on a much-discussed subject. Procedia-Social and Behavioral Sciences, 228, 169-174.
Tam, M. (2001). Measuring quality and performance in higher education. Quality in Higher Education, 7, 47-54.
Trilling, B. and Fadel, C. (2012). 21st century skills: Learning for life in our times. John Wiley & Sons.
Trow, M. (2007). Reflections on the transition from elite to mass to universal access: Forms and phases of higher education in modern societies since WWII. International handbook of higher education (pp. 243-280). Springer, Dordrecht.
Trubek, D. M., Cottrell, P. and Nance, M. (2005). „Soft Law“, „Hard Law“, and European Integration: Toward a Theory of Hybridity. New York: School of Law. Jean Monnet Working Paper 02. Retrieved from http://centers.law.nyu.edu/jeanmonnet/papers/05/050201.pdf. (22.08.2011).
Weinert, F. E. (2001). Concept of Competence: A Conceptual Clarification. In D. S. Rychen and L. H. Salganik (Eds.), Defining and Selecting Key Competencies (pp 45-65). Seattle: Hogrefe & Huber.
Weiss, A. (1995). Human Capital vs. Signaling Explanations of Wages. Journal of Economic Perspectives, 9, 133-154.
Wessling, K. and van der Velden, R. (2021). Flexibility in educational systems - Concept, indicators, and directions for future research. ROA. ROA Research Memoranda No. 002.
Winther, E., Seeber, S. and Wuttke, E. (Eds) (2016). Kompetenzmodell in der beruflichen Bildung. Themenheft Unterrichtswissenschaft, 44, 106–203.
Wissenschaftsrat (2015). Empfehlungen zum Verhältnis von Hochschulbildung und Arbeitsmarkt, Bielefeld, Drs. 4925-15.
Zavale, N. C. and Schneijderberg, C. (2020). Mapping the field of research on African higher education: a review of 6483 publications from 1980 to 2019. Higher Education.
Zlatkin-Troitschanskaia, O., Shavelson, R. J. and Kuhn, C. (2015). The international state of research on measurement of competency in higher education. Studies in Higher Education, 40, 393-411.