BRIEF REPORTS

Recommended Elements of a Musculoskeletal Course for Fourth-Year Medical Students: A Modified Delphi Consensus

Jordan Knox, MD | Stephen M. Carek, MD | Rajalakshmi Cheerla, MD | Susan Cochella, MD, MPH | Alexei O. DeCastro, MD | Jason W. Deck, MD | Sherilyn DeStefano, MD | Jennifer Hartmark-Hill, MD | Michael Petrizzi, MD | Dan Sepdeham, MD | Irvin Sulapas, MD | James Wilcox, MD | Matthew W. Wise, DO | Velyn Wu, MD

Fam Med.

Published: 11/11/2024 | DOI: 10.22454/FamMed.2024.219090

Abstract

Background and Objectives: A recognized gap exists between primary care physicians’ training in musculoskeletal (MSK) medicine and the burden of MSK complaints in primary care. Family medicine interns often lack adequate baseline MSK physical exam skills, which prompted a proposal to introduce a fourth-year preceptorship to reinforce MSK education. The aim of this study was to prioritize the most important elements to include in this new clinical rotation.

Methods: We employed a three-round, modified Delphi method to derive consensus. Eleven panelists with experience and expertise in MSK training, medical education, or both generated a list of 118 elements. Each panelist then ranked each element by level of importance, and we reviewed the results. The ranking process was repeated two more times with a goal of achieving consensus.

Results: Seventy-seven curricular elements (topics, skills, experiences) achieved consensus recommendation by being ranked either “fairly important” or “very important” for inclusion in the curriculum. Twenty-eight items were unanimously ranked “very important,” 42 received a mix of “very important” and “fairly important” rankings, and seven received unanimous ranking of “fairly important.” Three items were unanimously ranked “neither important nor unimportant.”

Conclusions: Longitudinal repetition of physical exam skills, reinforcement of relevant anatomy, and incorporation of specific frameworks for approaching MSK care are important components. Physical examination of the shoulder, knee, back, and hip are especially meaningful clinically.

INTRODUCTION

A widely recognized mismatch exists between the burden of musculoskeletal (MSK) concerns in the primary care setting and the adequacy of training provided to primary care physicians to manage those concerns. 1-5 A recent Council of Academic Family Medicine Educational Research Alliance study suggested that most family medicine interns begin residency with inadequate MSK physical exam skills, 6 a finding consistent with previous reports that 80% of medical school graduates were deficient in basic MSK medicine. 7 Preclinical MSK education does not improve MSK knowledge assessed at the time of graduation, 8 but primary care MSK rotations can be as effective as orthopedic rotations for training emergency medicine residents. 9 A fourth-year MSK rotation might increase medical school graduates’ competence.

Competency-based training10, 11 requires recurrent, meaningful experiences. The American Medical Society for Sports Medicine has reimagined MSK training in undergraduate medical education (UME), focusing on domains of competence and entrustable professional activities (EPAs). 12 MSK education should be longitudinal, emphasizing basic exam skills in preclinical years with additional sports medicine training in years three and four. 13 To address clinical deficiencies, clinical training opportunities can be redesigned, 14 and outpatient exposure alone can improve trainees’ confidence and willingness to provide care. 15 Inspired by the flexible curriculum outline for family medicine subinternships,16 this study aimed to identify the elements of a meaningful educational experience in MSK medicine for fourth-year medical students.

The Delphi technique is an established method to derive consensus, and modified methods have been used previously in curricular development. 17-19 We employed the modified technique of three rounds, foregoing statistical stability analysis and aiming to achieve consensus regarding which elements should be included in a fourth-year medical student MSK course.

METHODS

A group within the Society of Teachers of Family Medicine Musculoskeletal and Sports Medicine Education Collaborative identified and invited panelists based on prior involvement in scholarly work on similar topics, academic reputation, and experience with curriculum development. Recruitment was by direct invitation from the lead author. A description of the panel’s composition appears in Table 1.

We solicited ideas by telephone and email communication (see online Appendix for outreach email) for components and learning objectives of a meaningful fourth-year elective. The lead author coded these responses and identified latent themes to organize the elements. 20, 21 Themes with sorted elements were submitted for member checking, 22 and the participants confirmed the following categories prior to beginning the Delphi ranking: scheduling, learning objectives, technical skills, and clinical entities. The institutional review board deemed approval for this study unnecessary.

An initial list of 103 items was submitted to the panelists via electronic survey. The panelists were instructed to “rate the importance of incorporating each item into the elective” using a 5-point Likert scale (5, very important; 4, fairly important; 3, undecided; 2, fairly unimportant; 1, not important).

Three total rounds of ranking were completed, with no attrition among the panelists. Between rounds, we used statistical analysis to determine the mean and mode of each item, which were provided as feedback to the panelists, along with added elements for consideration and comments in round 2. Panelists were instructed to rate each item with a goal of achieving consensus. For the final round, only items that had not yet achieved consensus or recommendation for inclusion were included, along with the mean, mode, and comments. The schematic of the process appears in Figure 1.

Consensus for the purpose of this group was defined as an item receiving unanimous ranking from all participants. Recommendation for inclusion in the curriculum required an item to receive scores of 4 or 5 from all participants (fairly important or very important, respectively); a unanimous score was not required.

RESULTS

The panel generated 118 curricular elements for consideration: 39 reached consensus, and 78 were recommended for inclusion. One element was later deemed redundant and eliminated. The elements for consideration are listed in Table 2. A total of 28 items received a unanimous ranking of 5, indicating very important elements to include in a fourth-year MSK preceptorship. Another 42 items received mixed rankings of 4 or 5, indicating that all panelists found these items to be at least fairly important. Seven items received a unanimous ranking of 4, with all panelists agreeing these items were fairly important; and 3 items received a unanimous ranking of 3 (undecided). For another 37 elements, the panel could not agree on their importance after 3 rounds.

DISCUSSION

This study provides a valuable resource for family medicine educators aiming to enhance MSK medicine training in UME. Despite recent outlines of EPAs in sports medicine for UME,12 the curriculum remains broad. This study distills the subject into specific, clinically observable, and attainable mini-EPAs, serving as a framework to address MSK insufficiencies prior to medical school graduation. While extensive, this list can be personalized based on students’ strengths and weaknesses, promoting a learner-centered and growth mindset-driven educational model. The list is designed to be used in creating a fourth-year elective or in redesigning fourth-year family medicine internships, preinternship boot camps, and residency transition courses, and adds value to family medicine education by bringing educators’ attention to the unmet need in the competency-based medical education framework: integrating UME and graduate medical education (GME) curricula to foster clinical competency in MSK medicine.

The consensus curricular elements include clinical anatomy review, particularly the shoulder and knee, and emphasize a systematic and differential-informed approach to evaluation and management of MSK issues seen by family physicians. Key recommendations include longitudinal practice of physical exam skills at the bedside, reinforcement of relevant anatomy, specific frameworks for MSK medical care, and a consensus-driven selection of high-yield clinical entities from which to choose.

For validity and expertise,23 we included members of the group that revised the American Academy of Family Physicians reprint on MSK education topics 24 to derive the most useful elements for graduating medical students. To balance potential bias, curriculum design experts without specialized sports medicine training were included. The specific mention of the shoulder, knee, back, and hip examinations by the expert panel is worth noting. Interestingly, the hip exam was ranked very important, despite no proposals for differential diagnoses of hip pain, indicating a possible bias in the panel’s expertise.

The panelists strongly recommended time in a primary care MSK clinic for repeated, supervised physical exam practice. This repetition of numerous joint examinations, in conjunction with anatomy review and structured workshops, should help learners review, reinforce, and expand their knowledge as intended within a spiral curriculum. This approach, based on constructivist educational theory that active learning connects new knowledge to preexisting knowledge, 25 has shown improved physical exam skills in preclinical medical education;26 and the clinical context of this experience should associate a catalog of diagnostic entities with those physical exam findings.

While the modified Delphi technique classically involves real-time discussion, this project was conducted asynchronously via telephone and email. Nevertheless, the panel agreed on the inclusion of a substantial number of curricular components. Future studies should explore how to implement these recommendations, particularly without an integrated sports medicine fellowship, and assess the outcomes of a curriculum targeting these elements.

This study adds novel perspectives to family medicine education by preparing soon-to-be GME trainees to confidently practice MSK medicine, reducing reliance on specialists and improving health care utilization. Implementing MSK-focused educational experiences with real patients and real pathology, rather than standardized patients, could close the gap between MSK knowledge and required competence for GME settings.

Acknowledgments

Authors Jordan Knox, Stephen Carek, Rajalakshmi Cheerla, Alexei DeCastro, Jason W. Deck, Sherilyn DeStefano, Michael Petrizzi, Dan Sepdeham, Irvin Sulapas, James Wilcox, Matthew W. Wise, and Velyn Wu are members of the Society of Teachers of Family Medicine Musculoskeletal and Sports Medicine Educational Collaborative.

Author Jennifer Hartmark-Hill is a member of the Society of Teachers of Family Medicine Medical Student Education Collaborative.

Author Susan Cochella is a member of the Society of Teachers of Family Medicine Family Medicine Clerkship Core Curriculum Task Force.

References

  1. Craton N, Matheson GO. Training and clinical competency in musculoskeletal medicine. identifying the problem. Sports Med. 1993;15(5):328-337. doi:10.2165/00007256-199315050-00004
  2. Skelley NW, Tanaka MJ, Skelley LM, LaPorte DM. Medical student musculoskeletal education: an institutional survey. J Bone Joint Surg Am. 2012;94(19):e146. doi:10.2106/JBJS.K.01286
  3. Al Maini M, Al Weshahi Y, Foster HE, et al. A global perspective on the challenges and opportunities in learning about rheumatic and musculoskeletal diseases in undergraduate medical education: white paper by the World Forum on Rheumatic and Musculoskeletal Diseases (WFRMD). Clin Rheumatol. 2020;39(3):627-642. doi:10.1007/s10067-019-04544-y
  4. Wang T, Xiong G, Lu L, Bernstein J, Ladd A. Musculoskeletal education in medical schools: a survey in California and review of literature. Med Sci Educ. 2021;31(1):131-136. doi:10.1007/s40670-020-01144-3
  5. McDaniel CM, Forlenza EM, Kessler MW. Effect of shortened preclinical curriculum on medical student musculoskeletal knowledge and confidence: an institutional survey. J Surg Educ. 2020;77(6):1,414-1,421. doi:10.1016/j.jsurg.2020.04.011
  6. Wu V, Goto K, Carek S, et al. Family Medicine Musculoskeletal Medicine Education: A CERA Study. Fam Med. 2022;54(5):369-375. doi:10.22454/FamMed.2022.975755
  7. Freedman KB, Bernstein J. Educational deficiencies in musculoskeletal medicine. J Bone Joint Surg Am. 2002;84(4):604-608. doi:10.2106/00004623-200204000-00015
  8. Khorsand D, Khwaja A, Schmale GA. Early musculoskeletal classroom education confers little advantage to medical student knowledge and competency in the absence of clinical experiences: a retrospective comparison study. BMC Med Educ. 2018;18:46. doi:10.1186/s12909-018-1157-7
  9. Denq W, Fox JD, Lane A, et al. Impact of sports medicine and orthopedic surgery rotations on musculoskeletal knowledge in residency. Cureus. 2021;13(3):e14211. doi:10.7759/cureus.14211
  10. Saultz J. Competency-based education in family medicine residency education. Fam Med. 2021;53(7):590-592. doi:10.22454/FamMed.2021.816448
  11. Danilovich N, Kitto S, Price DW, Campbell C, Hodgson A, Hendry P. Implementing competency-based medical education in family medicine: a narrative review of current trends in assessment. Fam Med. 2021;53(1):9-22. doi:10.22454/FamMed.2021.453158
  12. Ferderber M, Wilson K, Buchanan BK, et al. Sports medicine curricular recommendations for undergraduate medical education. Curr Sports Med Rep. 2023;22(5):172-180. doi:10.1249/JSR.0000000000001064
  13. Sabesan VJ, Schrotenboer A, Habeck J, et al. Musculoskeletal education in medical schools: a survey of allopathic and osteopathic medical students. J Am Acad Orthop Surg Glob Res Rev. 2018;2(6):e019. doi:10.5435/JAAOSGlobal-D-18-00019
  14. Orner CA, Soin SP, Mahmood B, Gorczyca JT, Nicandri GT, DiGiovanni BF. Increasing the educational value of the orthopaedic subinternship: the design and implementation of a fourth-year medical student curriculum. J Am Acad Orthop Surg Glob Res Rev. 2021;5(1):e20.00240. doi:10.5435/JAAOSGlobal-D-20-00240
  15. Amidon J, Taylor SS, Hinton S. Practice impact of a dedicated LGBTQ+ clinical exposure during residency. PRiMER. 2023;7:24. doi:10.22454/PRiMER.2023.329607
  16. Walters E, Sairenji T. STFM task force releases a standardized family medicine sub-internship curriculum. Ann Fam Med. 2022;20(3):289-290. doi:10.1370/afm.2839
  17. Clayton R, Perera R, Burge S. Defining the dermatological content of the undergraduate medical curriculum: a modified Delphi study. Br J Dermatol. 2006;155(1):137-144. doi:10.1111/j.1365-2133.2006.07190.x
  18. Wattanapisit A, Petchuay P, Wattanapisit S, Tuangratananon T. Developing a training programme in physical activity counselling for undergraduate medical curricula: a nationwide Delphi study. BMJ Open. 2019;9(8):e030425. doi:10.1136/bmjopen-2019-030425
  19. Asif I, Thornton JS, Carek S, et al. Exercise medicine and physical activity promotion: core curricula for US medical schools, residencies and sports medicine fellowships: developed by the American Medical Society for Sports Medicine and endorsed by the Canadian Academy of Sport and Exercise Medicine. Br J Sports Med. 2022;56(7):369-375. doi:10.1136/bjsports-2021-104819
  20. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77-101. doi:10.1191/1478088706qp063oa
  21. Jnanathapaswi SG. Thematic analysis & coding: an overview of the qualitative paradigm. In: An Introduction to Social Science Research. APH Publishing; 2021:98-105. doi:10.6084/m9.figshare.17159249.
  22. McKim, C. Meaningful member-checking: a structured approach to member-checking. Am J Qualitative Res. 2023;7(2):41-52.
  23. ChatGPT. Why ChatGPT should not be used to write academic scientific manuscripts for publication. Ann Fam Med. 2023;2958. doi:10.1370/afm.2982
  24. American Academy of Family Physicians. Recommended curriculum guidelines for family medicine residents: musculoskeletal and sports medicine. [AAFP Reprint No. 265]. Revised October 2021. Accessed December 5, 2023. https://www.aafp.org/content/dam/AAFP/documents/medical_education_residency/program_directors/Reprint265_Musculo.pdf
  25. Dennick R. Constructivism: reflections on twenty five years teaching the constructivist approach in medical education. Int J Med Educ. 2016;7:200-205. doi:10.5116/ijme.5763.de11
  26. Yu JC, Guo Q, Hodgson CS. Deconstructing the joint examination: a novel approach to teaching introductory musculoskeletal physical examination skills for medical students. MedEdPORTAL. 2020;16:10945. doi:10.15766/mep_2374-8265.10945

Lead Author

Jordan Knox, MD

Affiliations: Department of Family and Preventive Medicine, University of Utah, Salt Lake City, UT

Co-Authors

Stephen M. Carek, MD - Department of Family Medicine, University of South Carolina School of Medicine Greenville, Greenville, SC

Rajalakshmi Cheerla, MD - Department of Family and Preventive Medicine, University of Arkansas for Medical Sciences, Little Rock, AR

Susan Cochella, MD, MPH - Department of Family and Preventive Medicine, University of Utah, Salt Lake City, UT

Alexei O. DeCastro, MD - Department of Family Medicine, Medical University of South Carolina, Charleston, SC

Jason W. Deck, MD - Department of Family and Community Medicine, University of Oklahoma School of Community Medicine, Tulsa, OK

Sherilyn DeStefano, MD - Department of Family Medicine, Oregon Health & Science University, Portland, OR

Jennifer Hartmark-Hill, MD - Department of Family Community and Preventive Medicine, University of Arizona College of Medicine, Phoenix, AZ

Michael Petrizzi, MD - Department of Family Medicine and Population Health, Virginia Commonwealth University, Richmond, VA

Dan Sepdeham, MD - Department of Family and Community Medicine, UT Southwestern Medical Center, Dallas, TX | UTHealth Houston, Houston, TX

Irvin Sulapas, MD - UTHealth Houston, Houston, TX

James Wilcox, MD - Department of Family Medicine, Indiana University School of Medicine, Indianapolis, IN

Matthew W. Wise, DO - Department of Family and Community Medicine, UT Southwestern Medical Center, Dallas, TX

Velyn Wu, MD - Department of Community Health and Family Medicine, University of Florida, Gainesville, FL

Corresponding Author

Jordan Knox, MD

Correspondence: Department of Family and Preventive Medicine, University of Utah, Salt Lake City, UT

Email: jordan.knox@hsc.utah.edu

Fetching other articles...

Loading the comment form...

Submitting your comment...

There are no comments for this article.

Downloads & Info

Share

Related Content

Tags

Searching for articles...