Introduction: There are no established family medicine (FM) residency-level global health objectives or curricula for program directors who want to offer ethical and meaningful global health experiences to residents. We sought to develop and evaluate a toolkit of resources that family medicine educators can use to improve residents’ knowledge of this important aspect of family practice.
Methods: We reviewed and categorized peer-reviewed and grey literature publications and global health curricula from FM and non-FM residency programs related to clinical topics, standards of global health practice and partnerships, decolonization, and others. The toolkit uses six standard Accreditation Council for Graduate Medical Education (ACGME) competencies to organize learning objectives, content areas, and resources. Resources were further categorized based on complexity, cost, and time. We developed the toolkit with a focus on patient safety and ethical engagement with global partners. We evaluated the toolkit using an online survey of global health educators from inside and outside the United States.
Results: The toolkit was vetted by the Society of Teachers of Family Medicine Board of Directors and published as an open-access resource on the STFM website (https://stfm.org/teachingresources/curriculum/globalhealthtoolkit/overview/).
The toolkit had 1,446 unique views in the 18 months after it was published. Most global health educators surveyed found the toolkit to be appropriate for resident-level education and ethically sound. Respondents indicated that they would most likely use the toolkit to improve an existing global health experience or track.
Conclusion: A novel toolkit provides resources curated and presented by topic, complexity, and estimated cost that residency programs can use to create or augment global health offerings. Educators can use resources and associated learning objectives presented using standard ACGME competencies to connect knowledge, skills, and attitudes gained through global health education to their residents’ overall learning needs.
More than 30% of learners engage in global health work during training.1–3 Many family medicine (FM) residencies offer or want to offer ethical and meaningful global health experiences. These experiences prepare residents for, and are associated with, future practice in underserved areas including in the United States.1,3–5
Global health experiences during training have been shown to improve physical examination skills and residents’ awareness of cost-effective medicine and social determinants of health.1,4,6 Despite these benefits, there are no universally accepted, residency-level global health objectives or curricula.7–9 In addition, it is critical that residencies and trainees are intentional in decolonizing global health partnerships and prioritizing bidirectional benefits.10–12 Important work to date covers topics such as travel safety, WEIGHT (Working Group on Ethics Guidelines for Global Health Training) guidelines, SUGARPREP (Simulation Use for Global Away Rotations Preparation), neglected tropical diseases, working with interpreters, partnership building, and guidelines for activities using global health principles applied locally (“g-local” activities) such as working with refugees. However, these resources are scattered.10,13–22
Our goal was to improve the quality and ethical standards of global health experiences by creating a toolkit of objectives and resources aimed toward being:
- Ethical;
- Reasonable (regarding time commitment, knowledge, and skills required);
- Achievable primarily within US residency programs (not requiring specific off-site or low resource time/clinical experience, etc);
- Adaptable based on faculty/residency/resident partnerships, interests, and available resources;
- Mapped to ACGME milestones; and
- Available at no cost to users.
The toolkit (available at https://stfm.org/teachingresources/curriculum/globalhealthtoolkit/overview/) was developed using an iterative process. We selected basic and advanced learning objectives, with corresponding resources, and then reviewed and modified them through several virtual meetings and conference presentations (2019-2021). Based on this early work, the STFM Foundation awarded funds for toolkit development in 2021. We categorized learning objectives and resources into Accreditation Council for Graduate Medical Education (ACGME) standard competencies. One author (C.B.) further categorized resources based on estimated cost and length of time to complete. The objectives and resource choices were refined in meetings with stakeholders. The toolkit was pilot tested by two authors (L.B. and C.B.) in their respective residency programs while creating global health tracks/electives. The final toolkit, including an implementation guide was uploaded to the STFM website in 2023.
Examples of toolkit resources include publications on specific topics (eg, management of malaria),23 standards of global health practice (eg, ethical short term experiences in global health),24 websites (eg, CareRef),25 curricula from global health programs (eg, SUGARPREP),26 and other practical resources. The implementation guide emphasizes the importance of global health decolonization (a movement aimed at addressing historical and ongoing power imbalances, working toward equity, collaboration, and centering the priorities of marginalized communities globally) and ethical global health practice including the understanding that:
- Visitors/learners divert attention and resources from patient care in all settings that could affect patient safety and health system integrity in resource-limited settings;
- Participation in direct clinical care is only one means by which resident physicians can develop knowledge, skills, and attitudes; and
- Not all competencies may apply to all residency-level global health tracks or elective experiences.
Evaluation of the toolkit was done through an online survey, with invitations sent in a snowball fashion to personal and professional global health educator contacts of authors, stakeholders, and attendees of STFM and American Academy of Family Physicians (AAFP) conference presentations in 2021-2023. Consent was implied by voluntary participation in the survey. The full survey is shown in Appendix A. STFM hosts the toolkit website and provides data on the number of unique views of the toolkit to the authors. This project was determined by University of Wisconsin Health Sciences and Minimal Risk Research IRB to constitute a program evaluation activity and thus exempt from further review.
The toolkit was reviewed and endorsed by the STFM Advisory Board and executive director/chief executive officer. The toolkit and implementation guide were published on the STFM website where it is freely available. The toolkit had 1,446 unique views from January 1, 2023 – July 28, 2024. Fifteen global health educators from both inside and outside the United States responded to the online survey that was distributed widely to global health educators and conference participants. Responses were tabulated without statistical analysis. We did not have sufficient qualitative data to perform a formal qualitative analysis.
Most global health educators surveyed found the toolkit objectives and topics to be both appropriate for resident-level education and ethically sound. Respondents indicated that they would most likely use the toolkit to improve or create a global health experience or track. Other anticipated uses were to update pretravel preparation activities, and/or evaluation process or skills training (Table 1). Table 2 summarizes the free text survey responses, including comments about the objectives, recommendations for additional content and resources, and general feedback on the toolkit.
The two pilot tests showed that the toolkit was easy to use and greatly reduced the time and effort otherwise needed to create a new global health track/elective in their residency programs. The toolkit provided a streamlined approach to allow for educational and logistical planning. Furthermore, the testers indicated the mapping of toolkit objectives to core ACGME Milestones was helpful to show relevance to their program directors and support global health track implementation.
Limitations
The survey had a small number of responses and this may limit the generalizability of the results. We further emphasize that the survey results represent expert opinion rather than broad user data. Improvements could be made by embedding a real-time feedback tool into the toolkit’s website to allow broader data collection. Additionally, the toolkit would benefit from further evaluation and comments, especially from global partners of US residency programs to ensure that the topics and approaches are respectful, ethical, accurate, and necessary to support ongoing partnerships. Additional testing of the toolkit in multiple residency programs would provide valuable information on its strengths and weaknesses.
This novel toolkit provides resources curated and presented by topic, complexity, and estimated cost that residency programs can use to create, augment, or expand their global health offerings. Educators can use the resources and associated learning objectives presented using the standard ACGME competencies to easily connect the knowledge, skills, and attitudes gained through global health education to their residents’ overall learning needs.
While the formal evaluation of the toolkit was limited in scope and results may not be generalizable, most respondents found the toolkit to be appropriate for resident-level education and ethically sound. The toolkit has been accessed over 1,400 times since launch in early 2023, demonstrating the large interest in this topic and applicability of the toolkit. Next steps include embedding a virtual survey into the STFM Toolkit website to gather broader evaluation from users and establishing the process for annual content review to maintain relevance, ethical standards, and applicability.
Acknowledgments
Financial support: The toolkit development was financially supported by the STFM Project Fund.
Presentations: Idea and draft toolkit were presented at the AAFP Global Health Summit (2019, 2021, 2023) and the STFM Annual Spring Conference (2020, 2022, 2023).
Disclaimers: Dr Gossa reports that the opinions and assertions expressed herein are those of the author(s) and do not necessarily reflect the official policy or position of the Uniformed Services University or the Department of Defense
Dr Ballard declares that the opinions and assertions expressed herein are those of the author(s) and do not necessarily reflect the official policy or position of Eglin Air Force Base, United States Air Force, or the Department of Defense.
References
- Thompson MJ, Huntington MK, Hunt DD, Pinsky LE, Brodie JJ. Educational effects of international health electives on U.S. and Canadian medical students and residents: a literature review. Acad Med. 2003;78(3):342-347. doi:10.1097/00001888-200303000-00023
- Aldulaimi S, McCurry V. Ethical considerations when sending medical trainees abroad for global health experiences. Ann Glob Health. 2017;83(2):356-358. doi:10.1016/j.aogh.2017.03.001
- Hernandez R, Sevilla Martir JF, Van Durme DJ, et al. Global health in family medicine residency programs: a nationwide survey of us residency directors: A CERA study. Fam Med. 2016;48(7):532-537.
- Drain PK, Holmes KK, Skeff KM, Hall TL, Gardner P. Global health training and international clinical rotations during residency: current status, needs, and opportunities. Acad Med. 2009;84(3):320-325. doi:10.1097/ACM.0b013e3181970a37
- Liaw W, Bazemore A, Xierali I, Walden J, Diller P. Impact of global health experiences during residency on graduate practice location: a multisite cohort study. J Grad Med Educ. 2014;6(3):451-456. doi:10.4300/JGME-D-13-00352.1
- Lu PM, Park EE, Rabin TL, et al. Impact of global health electives on us medical residents: a systematic review. Ann Glob Health. 2018;84(4):692-703. doi:10.29024/aogh.2379
- Redwood-Campbell L, Pakes B, Rouleau K, et al. Developing a curriculum framework for global health in family medicine: emerging principles, competencies, and educational approaches. BMC Med Educ. 2011;11(1):46. doi:10.1186/1472-6920-11-46
- Porter M, Mims L, Garven C, Gavin J, Carek P, Diaz V. International health experiences in family medicine residency training. Fam Med. 2016;48(2):114-120.
- Bills CB, Ahn J. Global health and graduate medical education: a systematic review of the literature. J Grad Med Educ. 2016;8(5):685-691. doi:10.4300/JGME-D-15-00774.1
- Crump JA, Sugarman J; Working Group on Ethics Guidelines for Global Health Training (WEIGHT). Ethics and best practice guidelines for training experiences in global health. Am J Trop Med Hyg. 2010;83(6):1178-1182. doi:10.4269/ajtmh.2010.10-0527
- Chang KZ, Gracey K, Lamparello B, Nandawula B, Pandhi N; Global Health Training Collaborations. Global health training collaborations: lessons learned and best practices. Am J Trop Med Hyg. 2021;106(2):412-418. doi:10.4269/ajtmh.21-0193
- Prasad S, Aldrink M, Compton B, et al. Global health partnerships and the Brocher Declaration: principles for ethical short-term engagements in global health. Ann Glob Health. 2022;88(1):31. doi:10.5334/aogh.3577
- Edwards M, Dalvie N, Kellett A, Peluso MJ, Rohrbaugh RM. Managing the unpredictable: recommendations to improve trainee safety during global health away electives. Ann Glob Health. 2022;88(1):86. doi:10.5334/aogh.3874
- Pitt MB, Cooper MT Jr, Hagen S, et al. Making a case for simulation in global health: a multi-institutional, multi-disciplinary collaboration to expand sugar beyond pediatrics. Pediatrics. 2018;141(1_MeetingAbstract):470. doi:10.1542/peds.141.1MA5.470
- Pirrocco F, Goodman I, Pitt MB. Leveraging peer teaching for global health elective preparation: implementation of a resident-led global health simulation curriculum. Global Pediatric Health. 2019;6:2333794X19851108. doi:10.1177/2333794X19851108
- Sridhar S, Alizadeh F, Ratner L, et al. Learning to walk the walk: incorporating praxis for decolonization in global health education. Glob Public Health. 2023;18(1):2193834. doi:10.1080/17441692.2023.2193834
- St Clair NE, Pitt MB, Bakeera-Kitaka S, et al; Global Health Task Force of the American Board of Pediatrics. Global health: preparation for working in resource-limited settings. Pediatrics. 2017;140(5):e20163783. doi:10.1542/peds.2016-3783
- Chris B, Singh S, Sudarshi D. Neglected tropical diseases, conflict, and the right to health. In: The Causes and Impacts of Neglected Tropical and Zoonotic Diseases: Opportunities for Integrated Intervention Strategies.National Academies Press; 2011, https://www.ncbi.nlm.nih.gov/books/NBK62508/. Accessed September 23, 2024.
- Gantz L, Pak-Gorstein S, Gutierrez JR, Noor Z, Shah S. Immigrant and refugee health curricula in US-based medical training: a scoping review to inform integration into pediatric residency programs. Acad Pediatr. 2024;24(5S):103-111. doi:10.1016/j.acap.2023.05.022
- Nakanjako D, Kendall D, Sewankambo NK, et al. Building and sustaining effective partnerships for training the next generation of global health leaders. Ann Glob Health. 2021;87(1):66. doi:10.5334/aogh.3214
- Crump JA, Sugarman J. Ethical considerations for short-term experiences by trainees in global health. JAMA. 2008;300(12):1456-1458. doi:10.1001/jama.300.12.1456
- DeCamp M, Lehmann LS, Jaeel P, Horwitch C; ACP Ethics, Professionalism and Human Rights Committee. Ethical obligations regarding short-term global health clinical experiences: an american college of physicians position paper. Ann Intern Med. 2018;168(9):651-657. doi:10.7326/M17-3361
- Centers for Disease Control and Prevention. Malaria. CDC Yellow Book 2024. Accessed September 23, 2024. https://wwwnc.cdc.gov/travel/yellowbook/2024/infections-diseases/malaria
- Stanford University Center for Global Health and the Johns Hopkins University Berman Institute of Bioethics. Ethical Challenges in Short-Term Global Health Training. Accessed September 23, 2024. http://ethicsandglobalhealth.org/
- Minnesota Department of Health. CareRef. Accessed September 23, 2024. https://careref.web.health.state.mn.us/
- SUGARPREP. Accessed September 23, 2024. https://sugarprep.org/
There are no comments for this article.