BRIEF REPORTS

Leadership Development in Graduate Medical Education: A Pilot Study of Implementation of a Validated Self-assessment Instrument

Sonja Van Hala, MD, MPH | Eliza Taylor, MPH, BS, CHES | Susan Cochella, MD, MPH

Fam Med. 2024;56(6):387-392.

DOI: 10.22454/FamMed.2024.477519

Return to Issue

Abstract

Background and Objectives: Graduate medical education programs need leadership assessments and curricula to engage residents and advance their leadership skills. The Foundational Healthcare Leadership Self-assessment (FHLS) is a validated 21-item self-assessment of leadership skills residents need to be effective team leaders in health care settings. It generates a composite score along five foundational leadership domains: accountability, collaboration, communication, team management, and self-management. Our objective was to determine whether a leadership curriculum, using the FHLS as an educational tool to support self-assessment, self-directed learning, and reflective practice, promotes self-awareness and engagement in leadership development.

Methods: We conducted a qualitative pilot study in the University of Utah Family Medicine Residency Program, integrating the FHLS into our residency’s longitudinal leadership curriculum using coaching, self-directed learning, and reflective practice. Family medicine residents completed the FHLS prior to their leadership rotation. Faculty met with each resident during their rotation using a coaching paradigm based on data from the FHLS to inform leadership self-awareness. Residents identified a leadership domain for self-improvement, selected resources for self-study, and submitted a written reflection. We conducted qualitative content analysis on the reflections for evidence of self-awareness and engagement in leadership development.

Results: Residents completed 27 leadership rotations between May 2019 and April 2020, generating 21 reflections. Qualitative content analysis of resident reflections grouped by FHLS leadership domains identified evidence of impact on the residents’ leadership development.

Conclusions: This qualitative pilot study supports the usefulness of the FHLS within a residency leadership curriculum to promote self-awareness and engagement in leadership development.

INTRODUCTION

National organizations are calling for leadership training so that physicians can be better prepared to lead teams, affect change, and transform health care systems.1-5 Calls for leadership development recommend training for all residents during early formative years. 6, 7 Graduate medical education programs need leadership assessments and curricula to engage residents and advance their leadership skills. 2, 821

Systematic reviews of physician leadership development programs show a gap in educational tools that address personal growth and self-awareness.8, 21, 22 Self-awareness is “both internal (the characteristics we ascribe to ourselves) and external (how we believe others see and react to us).”23 Self-awareness is fundamental to leadership and requires self-assessment.8, 18, 22, 24, 25 As Andrade et al noted, “The purposes of self-assessment are to identify areas of strength and weakness in one’s work in order to make improvements and promote learning.” 26 Based on the conceptual frameworks of self-directed learning27 and reflective practice,28 we theorize that physicians who commit to leadership self-assessment, self-directed study, and reflection will develop leadership self-awareness and engage in self-improvement of leadership skills.

In a previous publication29 we shared our validation of a formative self-assessment instrument for early-career physicians, specifically residents, called the Foundational Healthcare Leadership Self-assessment (FHLS). The FHLS is a 21-item self-assessment that generates scores on 5 foundational leadership domains: accountability, collaboration, communication, team management, and self-management (Appendix 1). The FHLS promotes self-awareness and professional growth by identifying a learner’s self-assessed stronger and weaker leadership domains. The FHLS is the only validated instrument of its kind.

Leadership curricula based on the FHLS are lacking in the medical education literature. Our objective was to determine whether a leadership curriculum, using the FHLS as an educational tool to support self-assessment, self-directed learning, and reflective practice, promotes self-awareness and engagement in leadership development.

METHODS

We conducted a qualitative pilot study in the University of Utah Family Medicine Residency Program (UUFMRP), integrating the FHLS into our residency’s longitudinal leadership curriculum.

UUFMRP is a 10-10-10 program that commits 8 weeks total to leadership rotations, spread throughout residency. The intent is to cultivate leadership early in residency and to advance those skills longitudinally as residents progress through residency. UUFMRP incorporated the FHLS into our residency’s longitudinal leadership curriculum from May 2019 to April 2020 using coaching, self-study, and reflection as key elements.27, 28, 30, 31 Residents completed the FHLS in the first half of the academic year and again at the end of the academic year.

During the pilot period, one faculty member (S.V.H.) met with every resident who was scheduled for any leadership rotation and conducted a one-on-one leadership skills coaching session. Using a coaching paradigm, faculty explored the resident’s prior leadership experience and self-assessed strengths and weaknesses that informed the FHLS results in each leadership domain (accountability, collaboration, communication, team management, self-management; Figure 1). Using the FHLS low-scoring domains, the faculty member and resident selected a leadership domain to target with self-study during the leadership rotation using resources from our curated leadership library. After completing the self-study, residents were asked to submit a written reflection responding to the following prompts: describe the resources you used, what you learned, and how you would apply that new knowledge. Written narratives provide qualitative data on the perspectives and ideas of participants’ learning. 32, 33 Residents were not asked to comment about their enjoyment or the perceived value of the experience, and submitting a reflection was not compulsory.

We hypothesized that resident written reflections would demonstrate self-awareness and engagement in learning around the leadership domains of the FHLS. One author (S.V.H.) collected, collated, deidentified, and organized the reflections by the FHLS leadership domains at the conclusion of the pilot for post hoc analysis. We analyzed the reflection data using qualitative content analysis. 34 Two authors (E.T., S.C.) independently reviewed the reflections to identify evidence of self-awareness and engagement in each leadership domain. Next, authors (E.T., S.C.) discussed the findings iteratively until agreement was achieved.

This study was deemed exempt by the University of Utah Institutional Review Board (IRB_00077940).

RESULTS

Residents completed 27 independent leadership rotations between May 2019 and April 2020 during the pilot study. During the study period, five residents completed rotations in both second and third year. The FHLS domains selected by residents for self-study were broadly distributed (team management 33%, self-management 26%, collaboration 22%, and communication 15%), with the exception of accountability, chosen by one resident (Table 1). Among senior residents, communication and self-management were selected most frequently (29%, 29%), while junior residents most commonly selected team management (40%). Following the leadership rotation, residents submitted 21 reflections. Of the 21 reflections, five residents completed two separate reflections (representing 10 total)—one reflection for each longitudinal leadership rotation. The remaining reflections (11) were single reflections. The reflections ranged from brief paragraphs to two pages in length and were generally received within days of completing the rotation.

Qualitative Findings

Reflections showed evidence of impact on the residents’ self-awareness and engagement in leadership development. Most residents (21 of 27) elected to complete written reflections during their leadership rotation (Table 1). Several submitted long, thoughtful, and complex reflections. Reflections included vocabulary and concepts residents learned in their self-study, with descriptions of their desired behavior change for self-improvement, as evidence of leadership development. We identified exemplar quotes for each FHLS leadership domain that show self-awareness and engagement in learning (Table 2). Additionally, we compiled a list of the leadership library resources residents selected for self-study (Appendix 2).

Perceived Value of the Curriculum to Residents

Several reflections included unsolicited remarks on the curriculum design. A third-year resident wrote, “I really like how these papers prompted reflection on my own leadership skills and gave specific ways to improve and things to work on.” Another (second-year resident) stated, “I do really like the personalized leadership project. . . . This model of teaching leadership is very effective.”

DISCUSSION

Faculty coaching, self-study, and reflection, using the FHLS instrument as an educational tool, promoted exploration and growth of residents’ leadership skills, as demonstrated by concepts and application described in residents’ reflections.

A majority of residents completed a self-study and submitted a written reflection, thereby demonstrating engagement in personal leadership development. The reflections contained evidence of self-awareness as residents explored new perspectives, skills, thoughts, and behaviors. The most commonly selected leadership domain for self-study was team management, and this was predominantly among second-year residents, which corresponds with the progression into more senior roles on inpatient services. Because most residents had high scores in accountability, that domain was selected only once, which mirrors the overall high expectations of oneself common among individuals in health professions.

This study had several limitations. The FHLS instrument informed the educational focus of leadership self-study, which could miss other components of leadership not included in the assessment. This pilot was conducted at one institution among family medicine residents in one program. The curriculum used a faculty coaching paradigm, which may be difficult for other programs to reproduce. The FHLS lacks external validity. Further study of FHLS implementation is needed across diverse graduate medical education programs and within different structures of leadership curricula.

CONCLUSION

This qualitative pilot study supports the usefulness of the FHLS within a residency leadership curriculum to promote self-awareness and engagement in leadership development.

Funding/Support

This work was supported in part by the Health Studies Fund, Department of Family and Preventive Medicine, University of Utah School of Medicine.

Acknowledgments

The authors thank Dr Lisa Gren and Dr Caren Frost for providing valuable feedback on prior drafts.

References

  1. Eden J, Berwick D, Wilensky G, eds. Graduate Medical Education That Meets the Nation’s Health Needs. National Academies Press; 2014. Accessed June 22, 2021. https://www.ncbi.nlm.nih.gov/books/NBK248020/#sec_000024
  2. Jardine D, Correa R, Schultz H, et al. The Need for a Leadership Curriculum for Residents. J Grad Med Ed. 2015;7(2):307-309. doi:10.4300/JGME-07-02-31
  3. Interprofessional Education Collaborative. Core Competencies for Interprofessional Collaborative Practice: 2016 Update. IPEC; 2016.
  4. Accreditation Council for Graduate Medical Education. Family Medicine Milestones. ACGME; 2019. Accessed March 2023. https://www.acgme.org/globalassets/PDFs/Milestones/FamilyMedicineMilestones.pdf
  5. The Accreditation Council on Graduate Medical Education. Internal Medicine Milestones. ACGME; 2020. Accessed March 2023. https://www.acgme.org/globalassets/pdfs/milestones/internalmedicinemilestones.pdf
  6. True MW, Folaron I, Colburn JA, Wardian JL, Hawley-Molloy JS, Hartzell JD. Leadership training in graduate medical education: time for a requirement? Mil Med. 2020;185(1-2):e11-e16. doi:10.1093/milmed/usz140
  7. Blumenthal DM, Bernard K, Bohnen J, Bohmer R. Addressing the leadership gap in medicine: residents’ need for systematic leadership development training. Acad Med. 2012;87(4):513-522. doi:10.1097/ACM.0b013e31824a0c47
  8. Sadowski B, Cantrell S, Barelski A, O’Malley PG, Hartzell JD. Leadership training in graduate medical education: a systematic review. J Grad Med Educ. 2018;10(2):134-148. doi:10.4300/JGME-D-17-00194.1
  9. Verma AA, Bohnen JD. Bridging the leadership development gap: recommendations for medical education. Acad Med. 2012;87(5):549-550. doi:10.1097/ACM.0b013e31824d550e
  10. Accreditation Council on Graduate Medical Education and the Council of Review Committee Residents—Leadership Subcommittee. Leadership Development Curriculum for Chief Residents in Medicine. ACGME; 2015.
  11. Buckingham M. Leadership development in the age of the algorithm. Harv Bus Rev. 2012;90(6):86-92,94,144.
  12. Flood SC. Using qualitative self-evaluation in rating physician performance. Fam Pract Manag. 1998;5(5):22-24,27-30,33-34.
  13. Gillam S. Teaching doctors in training about management and leadership. BMJ. 2011;343:d5672. doi:10.1136/bmj.d5672
  14. Jortberg BT, Fernald DH, Dickinson LM, et al. Curriculum redesign for teaching the PCMH in Colorado family medicine residency programs. Fam Med. 2014;46(1):11-18. https://www.stfm.org/familymedicine/vol46issue1/Jortberg11
  15. Rosenman ED, Shandro JR, Ilgen JS, Harper AL, Fernandez R. Leadership training in health care action teams: a systematic review. Acad Med. 2014;89(9):1,295-1,306. doi:10.1097/ACM.0000000000000413
  16. Mintz LJ, Stoller JK. A systematic review of physician leadership and emotional intelligence. J Grad Med Educ. 2014;6(1):21-31. doi:10.4300/JGME-D-13-00012.1
  17. Straus SE, Soobiah C, Levinson W. The impact of leadership training programs on physicians in academic medical centers: a systematic review. Acad Med. 2013;88(5):710-723. doi:10.1097/ACM.0b013e31828af493
  18. Stoller JK. Developing physician-leaders: a call to action. J Gen Intern Med. 2009;24(7):876-878. doi:10.1007/s11606-009-1007-8
  19. Stoller JK. Developing physician-leaders: key competencies and available programs. J Health Adm Educ. 2008;25(4):307-328.
  20. Webb AMB, Tsipis NE, McClellan TR, et al. A first step toward understanding best practices in leadership training in undergraduate medical education: a systematic review. Acad Med. 2014;89(11):1,563-1,570. doi:10.1097/ACM.0000000000000502
  21. Tsen LC, Borus JF, Nadelson CC, Seely EW, Haas A, Fuhlbrigge AL. The development, implementation, and assessment of an innovative faculty mentoring leadership program. Acad Med. 2012;87(12):1,757-1,761. doi:10.1097/ACM.0b013e3182712cff
  22. Frich JC, Brewster AL, Cherlin EJ, Bradley EH. Leadership development programs for physicians: a systematic review. J Gen Intern Med. 2015;30(5):656-674. doi:10.1007/s11606-014-3141-1
  23. London M, Sessa VI, Shelley LA. Developing self-awareness: learning processes for self- and interpersonal growth. Annu Rev Organ Psychol Organ Behav. 2023;10(1):261-288. doi:10.1146/annurev-orgpsych-120920-044531
  24. Hartzell JD, Clyne B, Robinson R, Shah K, Wolf SJ, Servey JT. Tips for teaching leadership in graduate medical education. The Pharos; 2019;summer:34-40.
  25. Carden J, Jones RJ, Passmore J. Defining self-awareness in the context of adult development: a systematic literature review. J Manage Educ. 2022;46(1):140-177. doi:10.1177/1052562921990065
  26. Andrade H, Valtcheva A. Promoting learning and achievement through self-assessment. Theory Pract. 2009;48(1):12-19. doi:10.1080/00405840802577544
  27. Knowles MS. Self-Directed Learning: A Guide for Learners and Techers. Association Press; 1975.
  28. Schon DA. The Reflective Practitioner: How Professionals Think in Action. Basic Books; 1983.
  29. Van Hala S, Cochella S, Jaggi R, et al. Development and validation of the foundational healthcare leadership self-assessment. Fam Med. 2018;50(4):262-268. doi:10.22454/FamMed.2018.835145
  30. Lyons MD, Oyler J, Iossi K, Merriam S. Leadership experiences of internal medicine residents: a needs assessment for leadership curricula. J Healthc Leadersh. 2022;14:155-161. doi:10.2147/JHL.S376089
  31. Steckler NA, Rawlins DB, Williamson PR, Suchman AL. Preparing to lead change: an innovative curriculum integrating theory, group skills and authentic presence. Healthcare (Amst). 2016;4(4):247-251. doi:10.1016/j.hjdsi.2015.10.005
  32. Hanson JL, Balmer DF, Giardino AP. Qualitative research methods for medical educators. Acad Pediatr. 2011;11(5):375-386. doi:10.1016/j.acap.2011.05.001
  33. Bleakley A. Stories as data, data as stories: making sense of narrative inquiry in clinical education. Med Educ. 2005;39(5):534-540. doi:10.1111/j.1365-2929.2005.02126.x
  34. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107-115. doi:10.1111/j.1365-2648.2007.04569.x

Lead Author

Sonja Van Hala, MD, MPH

Affiliations: Department of Family and Preventive Medicine, University of Utah, Salt Lake City, UT

Co-Authors

Eliza Taylor, MPH, BS, CHES - Department of Family and Preventive Medicine, University of Utah, Salt Lake City, UT

Susan Cochella, MD, MPH - Department of Family and Preventive Medicine, University of Utah, Salt Lake City, UT

Corresponding Author

Sonja Van Hala, MD, MPH

Correspondence: Department of Family and Preventive Medicine, University of Utah, Salt Lake City, UT

Email: sonja.vanhala@hsc.utah.edu

Fetching other articles...

Loading the comment form...

Submitting your comment...

There are no comments for this article.

Downloads & Info

Share

Related Content