Using the “most significant change” technique to evaluate the teaching competence and psycho-emotional development of prospective teachers during the teaching practicum

Scientific publication - Journal Article uoadl:3397851 25 Read counter

Unit:
Department of Theology
Title:
Using the “most significant change” technique to evaluate the teaching competence and psycho-emotional development of prospective teachers during the teaching practicum
Languages of Item:
English
Abstract:
Purpose
This paper presents the results of empirical research on the effects of teaching practice on student teachers’ teaching competence and psycho-emotional development using the “most significant change” narrative investigative technique.

Design/methodology/approach
Following a qualitative research approach, the study was conducted during the academic year 2021–2022 in two phases (January and May) with the participation of 73 student teachers of the Department of Theology at the National and Kapodistrian University of Athens (NKUA) during their mentored teaching practice. Student teachers’ narratives were collected and analysed using the most significant change technique (Davies and Dart, 2005). Content analysis was conducted with the contribution of seven independent judges.

Findings
The results indicate that the Teaching Practice course with the guidance of mentors has a direct and positive effect on student teachers’ teaching competence. Mentors also seem to have a positive effect on student teachers’ psycho-emotional development. The research also confirms the reliability of the most significant change narrative technique for investigating the effect of related educational interventions.

Originality/value
The study empirically validates the usefulness and potential of the investigative narrative most significant change technique for evaluating the effects of teaching practice on student teachers’ professional development with the guidance of experienced mentor teachers. The results of the study also have implications for the design and evaluation of teacher practice programmes.
Publication year:
2024
Authors:
Marios Koukounaras-Liagkis,
Evdokia Karavas,
Manolis Papaioannou
Journal:
International Journal of Mentoring and Coaching in Education
Publisher:
Emerald
Volume:
ahead-of-print
Number:
ahead-of-print
Pages:
ahead-of-print
Keywords:
teaching practices, student teachers, mentor teachers, teaching, most significant change
Main subject category:
Education - Sport science
Official URL (Publisher):
DOI:
10.1108/ijmce-04-2023-0037
References:
Aderibigbe, S., Gray, D.S., and Colucci-Gray, L. (2018), "Understanding the nature of mentoring experiences between teachers and student teachers", International Journal of Mentoring and Coaching in Education, Vol. 7 No. 1, pp. 54-71. https://doi.org/10.1108/IJMCE-04-2017-0028
Ambrosetti, A., and Dekkers, J. (2010), "The Interconnectedness of the Roles of Mentors and Mentees in Pre-service Teacher Education Mentoring Relationships", Australian Journal of Teacher Education, Vol. 35 No. 6, pp. 42-55. http://dx.doi.org/10.14221/ajte.2010v35n6.3
Andrews, M., Squire, C., and Tamboukou, M. (Eds.), (2013), Doing Narrative Research (2nd ed.). London: Sage.
Botha, C.S. (2021), "Turning Windows into Mirrors: Digital Stories as a Teaching Strategy to Explore the Apprenticeship of Observation in Pre-Service Teachers", International Journal of Learning, Teaching and Educational Research, Vol. 20 No. 11, pp. 1-16. https://doi.org/10.26803/ijlter.20.11.1
Brondyk, S., and Searby, L. (2013), "Best practices in mentoring: complexities and possibilities", International Journal of Mentoring and Coaching in Education, Vol. 2 No. 3, pp. 189-203. https://doi.org/10.1108/IJMCE-07-2013-0040
Chan, E.Y. (2012), "The Transforming Power of Narrative in Teacher Education", Australian Journal of Teacher Education, Vol. 37 No. 3, pp. 111-127. http://dx.doi.org/10.14221/ajte.2012v37n3.4
Charisma, D., and Nurmalasari, P. (2020), "An Investigation of Student Teachers' Anxiety Related to the Teaching Practicum", Journal of English Language, Literature, and Teaching, Vol. 5 No. 1, pp. 15-20. https://doi.org/10.32528/ellite.v5i1.3205
Choy, S., and Lidstone, J. (2013), "Evaluating leadership development using the Most Significant Change", Studies in Educational Evaluation, Vol. 39, pp. 218–224. http://dx.doi.org/10.1016/j.stueduc.2013.09.001
Cohen, E., Hoz, R., and Kaplan, H. (2013), "The practicum in preservice teacher education: a review of empirical studies", Teaching Education, Vol. 24 No. 4, pp. 345-380. https://doi.org/10.1080/10476210.2012.711815
Dart, J., and Davies, R. (2003), "A Dialogical, Story-Based Evaluation Tool: The Most Significant Change Technique", American Journal of Evaluation, Vol. 24 No. 2, pp. 137-155. https://doi.org/10.1177/109821400302400202
Davies, R. (1998), "An evolutionary approach to facilitating organisational learning: An experiment by the Christian Commission for Development in Bangladesh", Impact Assessment and Project Appraisal, Vol. 16 No. 3, pp. 243-250. https://doi.org/10.1080/14615517.1998.10590213
Davies, R., and Dart, J. (2005), "The ‘Most Significant Change’ (MSC) Technique. A Guide to Its Use”, available at: https://mande.co.uk/special-issues/most-significant-changemsc/(accessed 10 January 2023)
Dwyer, R., Davis, I., and emerald, e. (Eds.), (2017), "Narrative Research in Practice. Stories from the Field". Springer, available at: https://doi.org/10.1007/978-981-10-1579-3 (accessed 20 March 2023)
Ellis, N., Alonzo, D., and Nguyen, H. (2020), "Elements of a quality pre-service teacher mentor: A literature review", Teaching and Teacher Education, Vol. 92, 103072. https://doi.org/10.1016/j.tate.2020.103072
Golombek, P.R., and Johnson, K.E. (2004), "Narrative inquiry as a mediational space: examining emotional and cognitive dissonance in second-language teachers' development", Teachers and Teaching: theory and practice, Vol. 10 No. 3, pp. 307- 327. https://doi.org/10.1080/1354060042000204388
Green, C.A., Tindall-Ford, S.K., and Eady, M.J. (2019), "School-university partnerships in Australia: a systematic literature review", Asia-Pacific Journal of Teacher Education, Vol. 48 No. 4, pp. 403-435. https://doi.org/10.1080/1359866X.2019.1651822
Heck, D., and Sweeney, T.-A. (2013), "Using most significant change stories to document the impact of the teaching teachers for the future project: An Australian teacher education story", Australian Educational Computing, Vol. 27 No. 3, pp. 36-47.
Henning, J.E., Rice, L.J., Dani, D.E., Weade, G., and McKeny, T. (2017), "Teachers’ perceptions of their most significant change: source, impact, and process", Teacher Development, Vol. 21 No. 3, pp. 388-403. https://doi.org/10.1080/13664530.2016.1243570
Hobson, A.J. (2016), "Judgementoring and how to avert it: Introducing ONSIDE Mentoring for beginning teachers", International Journal of Mentoring and Coaching in Education, Vol. 5 No. 2, pp. 87-110. https://doi.org/10.1108/IJMCE-03-2016-0024
Hobson, A.J. (2020), "ONSIDE Mentoring: A Framework for Supporting Professional Learning, Development, and Well-Being", in Irby, B.J., Boswell, J.N., Sea, L.J., Searby, L.J., Kochan, F., Garza, R., and Abdelrahman N. (Eds.), The Wiley International Handbook of Mentoring: Paradigms, Practices, Programs, and Possibilities, pp. 521-545. https://doi.org/10.1002/9781119142973.ch32
Hoffman, J.V., Wetzel, M., Maloch, B., Greeter, E., Taylor, L., DeJulio, S., and Vlach, S. (2015), "What can we learn from studying the coaching interactions between cooperating teachers and preservice teachers? A literature review", Teaching and Teacher Education, Vol. 52, pp. 99-112. https://doi.org/10.1016/j.tate.2015.09.004
Hudson, P. (2013), "Mentoring as professional development: ‘growth for both’ mentor and mentee", Professional Development in Education, Vol. 39 No. 5, pp. 771-783. https://doi.org/10.1080/19415257.2012.749415
Hudson, P. (2016), "Forming the Mentor-Mentee Relationship", Mentoring & Tutoring: Partnership in Learning, Vol. 24 No. 1, pp. 30-43. https://doi.org/10.1080/13611267.2016.1163637
Izadinia, M. (2013), "A review of research on student teachers' professional identity. British Educational Research Journal", Vol. 39 No. 4, pp. 694–713. https://doi.org/10.1080/01411926.2012.679614
Izadinia, M. (2015a), "Talking the Talk and Walking the Walk: Pre-service Teachers’ Evaluation of their Mentors", Vol. 23 No. 4, pp. 341-353. https://doi.org/10.1080/13611267.2015.1096550
Izadinia, M. (2015b), "Student teachers’ and mentor teachers’ perceptions and expectations of a mentoring relationship: do they match or clash?", Professional Development in Education, Vol. 42 No. 3, pp. 387-402. http://dx.doi.org/10.1080/19415257.2014.994136
Izadinia, M. (2018), "Mentor Teachers. Contributions to the Development of Preservice Teachers’ Identity", in Schutz, P., Hong, J. and Cross Francis D. (Eds.), Research on Teacher Identity, Springer, pp. 109-119.
Johnson, K.E., and Golombek, P. R. (2011), "The Transformative Power of Narrative in Second Language Teacher Education", Tesol Quarterly, Vol. 45 No. 3, pp. 486-509. https://doi.org/10.5054/tq.2011.256797
Karavas, Ε. (2006), "The teacher as trainer" [Ο εκπαιδευτικός της Δευτεροβάθμιας ως εκπαιδευτής], in Zouganeli, K., and Dimitraskou A. (Eds.), Proceedings of Panhellenic Conference of the Pedagogical Institute in cooperation with the National and Kapodistrian University of Athens. Foreign Languages in Public Compulsory Education (31 March to 2 April 2006), Athens, pp. 151-159. Πανελλήνιο Συνέδριο του Παιδαγωγικού Ινστιτούτου σε συνεργασία με το Εθνικό και Καποδιστριακό Πανεπιστήμιο Αθηνών. Οι Ξένες Γλώσσες στη Δημόσια Υποχρεωτική Εκπαίδευση (31 Μαρτίου - 2 Απριλίου 2006). Πρακτικά. Αθήνα, pp. 151-159.
Karavas, E. (2008), Mentoring Student Teachers of English: A Handbook, Dendrinos, B. and Karavas (Eds.), Athens: RCEL.
Karavas, E., and Drossou K., M. (2010), "How amenable are student teacher beliefs to change? A study of EFL student teacher beliefs before and after teaching practice", in Psaltou-Joycey, A. and Mattheoudakis M. (Eds.), Proceedings of the 14th International Conference of the Greek Applied Linguistics Association: Advances in Research on Language Acquisition and Teaching: Selected Papers, Thessaloniki, Greek Applied Linguistics Association, pp. 261-276.
Kargatzi, E. (2022), "The attitudes and perceptions of Religious Education Teachers for the evaluation of the intended learning outcomes via the 'Most Significant Change' technique" [Οι αντιλήψεις και οι στάσεις των θεολόγων για την αξιολόγηση των μαθησιακών αποτελεσμάτων μέσω της τεχνικής της «Πιο Σημαντικής Αλλαγής» (Most Significant Change)], ΕλΘΕ (Ελληνική Έκδοση για τη Θρησκευτική Εκπαίδευση) / GjRE (Greek Journal of Religious Education), Vol. 5 No. 2, pp. 65-90. https://doi.org/10.30457/050220225
Keinemans, S., Kanne, M., and De Jonge, E. (2020), "In Search of a Research Strategy: Evaluation of an Ethics Program for Social Professionals Using Elements of the Most Significant Change Approach", Forum: Qualitative Social Research, Vol. 21 No. 1, Art. 7. https://doi.org/10.17169/fqs-21.1.3282
Köksal, D., and Genç, G. (2019), "Learning while teaching: Student teachers’ reflections on their teaching practicum", Journal of Language and Linguistic Studies, Vol. 15 No. 3, pp. 895-913. https://doi.org/10.17263/jlls.631531
Koukounaras Liagkis, M. (2022), "The Socio-Pedagogical Dynamics of Religious Knowledge in Religious Education: A Participatory Action-Research in Greek Secondary Schools on Understanding Diversity", Religions, Vol. 13 No. 5, pp. 395. https://doi.org/10.3390/rel13050395
Koukounaras Liagkis, M., and Papaioannou, M. (2023), "The use of narratives in evaluation of prospective teachers' education outcomes - The “Most Significant Change” technique" [Η χρήση αφηγήσεων στην αξιολόγηση αποτελεσμάτων της εκπαίδευσης των υποψηφίων εκπαιδευτικών - Η τεχνική της "πιο σημαντικής αλλαγής"], Έρευνα στην Εκπαίδευση, Vol. 12 No. 1, pp. 98-117. https://doi.org/10.12681/hjre.34064
Koukounaras Liagkis, M., Papaioannou, M., and Apostolaki, E.-A. (2021), "Student Teachers’ relationship with the Mentors and self-efficacy within Practicum" [H σχέση με τον/την μέντορα και η αυτο-αποτελεσματικότητα των φοιτητών/φοιτητριών του Τμήματος Θεολογίας Αθήνας στην πρακτική άσκηση στο σχολείο], Έρευνα στην Εκπαίδευση, Vol. 10 No. 1, pp. 229-246. https://doi.org/10.12681/hjre.27824
Koukounaras Liagkis, M., and Potamousi, I. (2019), "The “Most Significant Change” Technique: Research on the Evaluation of Theatre in Education (TiE) Programmes", in Koukounaras Liagkis, M. and Giannouli B. (Eds.), Theatre/Drama and Performing Arts in Education: Utopia or Necessity?, Athens, Hellenic Theatre/Drama Education Network, pp. 290-295.
La Paro, K.M., Lippard, C., Fusaro, M., and Cook, G. (2020), "Relationships in early practicum experiences: positive and negative aspects and associations with practicum students’ characteristics and teaching efficacy", Journal of Early Childhood Teacher Education, Vol. 41 No. 4, pp. 338-358. https://doi.org/10.1080/10901027.2019.1668889
La Paro, K.M., Van Schagen, A., King, E., and Lippard, C. (2018), "A Systems Perspective on Practicum Experiences in Early Childhood Teacher Education: Focus on Interprofessional Relationships", Early Childhood Education Journal, Vol. 46, pp. 365- 375. https://doi.org/10.1007/s10643-017-0872-8
Law 3848 (2010), “Upgrading the role of the teacher - establishing evaluation rules and meritocracy in education and other provisions” [Αναβάθμιση του ρόλου του εκπαιδευτικού - καθιέρωση κανόνων αξιολόγησης και αξιοκρατίας στην εκπαίδευση και λοιπές διατάξεις], Official Government Gazette, Vol. 71 No 1, 19.05.2010, article 2.
Law 4547 (2018), “Reorganization of primary and secondary education support structures and other provisions” [Αναδιοργάνωση των δομών υποστήριξης της πρωτοβάθμιας και δευτεροβάθμιας εκπαίδευσης και άλλες διατάξεις], Official Government Gazette Issue, Vol. 102 No 1, 12.06.2018, article 111.
Lawson, T., Çakmak, M., Gündüz, M., and Busher, H. (2015), "Research on teaching practicum – a systematic review", European Journal of Teacher Education, Vol. 38 No. 3, pp. 392-407. https://doi.org/10.1080/02619768.2014.994060
Liou, Y.-H., Daly, A.J., Canrinus, E.T., Forbes, C.A., Moolenaar, N.M., Cornelissen, F., . . . Hsiao, J. (2016), "Mapping the social side of pre-service teachers: connecting closeness, trust, and efficacy with performance", Teachers and Teaching, Vol. 23 No. 6, pp. 635-657. http://dx.doi.org/10.1080/13540602.2016.1218329
Livingston, K., and Assunção-Flores, M. (2017), "Trends in teacher education: a review of papers published in the European journal of teacher education over 40 years", European Journal of Teacher Education, Vol. 40 No. 5, pp. 551-560. https://doi.org/10.1080/02619768.2017.1387970
Manning, C., and Hobson, A.J. (2017), "Judgemental and developmental mentoring in further education initial teacher education in England: mentor and mentee perspectives", Research in Post-Compulsory Education, Vol. 22 No. 4, pp. 574-595. https://doi.org/10.1080/13596748.2017.1381377
Matsko, K.-K., Ronfeldt, M., Greene Nolan, H., Klugman, J., Reininger, M., and Brockman, S. L. (2020), "Cooperating Teacher as Model and Coach: What Leads to Student Teachers’ Perceptions of Preparedness?:, Journal of Teacher Education, Vol. 71 No. 1, pp. 41-62. https://doi.org/10.1177/0022487118791992
Poulou, M. (2007), "Personal Teaching Efficacy and Its Sources: Student teachers’ perceptions", Educational Psychology, Vol. 27 No. 2, pp. 191-218. https://doi.org/10.1080/01443410601066693
Pulvermacher, Y., and Lefstein, A. (2016), "Narrative representations of practice: What and how can student teachers learn from them?", Teaching and Teacher Education, Vol. 55, pp. 255-266. http://dx.doi.org/10.1016/j.tate.2016.01.013
Rajuan, M., Beijaard, D., and Verloop, N. (2007), "The role of the cooperating teacher: bridging the gap between the expectations of cooperating teachers and student teachers", Mentoring & Tutoring: Partnership in Learning, Vol. 15 No. 3, pp. 223-242. https://doi.org/10.1080/13611260701201703
Tonkin, K., Silver, H., Pimentel, J., Chomat, A., Sarmiento, I., Belaid, L., . . . Andersson, N. (2021), "How beneficiaries see complex health interventions: a practice review of the Most Significant Change in ten countries", Archives of Public Health, Vol. 79 No. 18, pp. 1-8. https://doi.org/10.1186/s13690-021-00536-0
Tsafos, V. (2014), "The Reflective Perspective of Narrative in Educational Action Research", in Rauch, F., Schuster, A., Stern, T., Pribila, M. and Townsend A. (Eds.), Promoting Change through Action Research, Rotterdam, Sense Publishers, pp. 135-145. https://doi.org/10.1007/978-94-6209-803-9_12
Van Schagen Johnson, A., La Paro, K.M., and Crosby, D.A. (2017), "Early Practicum Experiences: Preservice Early Childhood Students’ Perceptions and Sense of Efficacy", Early Childhood Education Journal, Vol. 45, pp. 229-236. https://doi.org/10.1007/s10643-016-0771-4
van Velzen, C., Volman, M., Brekelmans, M., and White, S. (2012), "Guided work-based learning: Sharing practical teaching knowledge with student teachers", Teaching and Teacher Education, Vol. 28 No. 2, pp. 229-239. https://doi.org/10.1016/j.tate.2011.09.011
Veenstra, M., and Hidayati, N. (2023), “The Most Significant Change Technique’s True Potential: Empowerment & Participation”, available at: https://thesra. org.uk/SRA/SRA/Blog/TheMostSignificantChangeTechnique%E2%80%99sTruePot entialEmpowermentParticipation.aspx (accessed 11 July 2023)
White, S., and Forgasz, R. (2016), "The Practicum: The Place of Experience?", in Loughran, J. and Hamilton M. (Eds.), International Handbook of Teacher Education, Singapore, Springer, pp.231-266). https://doi.org/10.1007/978-981-10-0366-0_6
Wilder, L., and Walpole, M. (2008), "Measuring social impacts in conservation: experience of using the Most Significant Change method", Oryx, Vol. 42 No. 4, pp. 529-538. https://doi.org/10.1017/S0030605307000671
Yee Mok, S., and Staub, F.C. (2021), "Does coaching, mentoring, and supervision matter for pre-service teachers’ planning skills and clarity of instruction? A meta-analysis of (quasi-)experimental studies", Teaching and Teacher Education, Vol. 107, 103484. https://doi.org/10.1016/j.tate.2021.103484
The digital material of the item is not available.