Background and Objectives: In 2014, family medicine residency programs began to integrate point-of-care ultrasound (POCUS) into training, although very few had an established POCUS curriculum. This study aimed to evaluate the resources, barriers, and scope of POCUS training in family medicine residencies 5 years after its inception.
Methods: Questions regarding current training and use of POCUS were included in the 2019 Council of Academic Family Medicine Educational Research Alliance (CERA) survey of family medicine residency program directors, and results compared to similar questions on the 2014 CERA survey.
Results: POCUS is becoming a core component of family medicine training programs, with 53% of program directors reporting establishing or an established core curriculum. Only 11% of program directors have no current plans to add POCUS training to their program, compared to 41% in 2014. Despite this increase in training, the reported clinical use of POCUS remains uncommon. Only 27% of programs use six of the eight surveyed POCUS modalities more than once per year. The top three barriers to including POCUS in residency training in 2019 have not changed since 2014, and are (1) a lack of trained faculty, (2) limited access to equipment, and (3) discomfort with interpreting images without radiologist review.
Conclusions: Training in POCUS has increased in family medicine residencies over the last 5 years, although practical use of this technology in the clinical setting may be lagging behind. Further research should explore how POCUS can improve outcomes and reduce costs in the primary care setting to better inform training for this technology.
Point-of-care ultrasound (POCUS) refers to clinician-performed, bedside ultrasound examinations that follow defined protocols to answer specific clinical questions. Applications for POCUS are wide ranging and can be used across multiple medical specialties, including family medicine.1-7 Many applications have data to support their use in primary care, such as abdominal ultrasound for the presence of abdominal aortic aneurysm, cardiac ultrasound for estimation of ejection fraction, and vascular ultrasound for assessment of volume status.8-11 With growing evidence for POCUS in primary care, many educational institutions including family medicine residency programs have integrated ultrasound education into their curricula.12
Questions included in the 2014 Council of Academic Family Medicine Educational Research Alliance (CERA) survey of family medicine residency program directors sought to investigate the status of POCUS training in family medicine residency programs. At the time, data suggested that only 2.2% of family medicine residencies had an established curriculum, but 29% of respondents indicated that they had started a program within the past year and 11.2% were in the process of developing a POCUS curriculum.13
POCUS training continues to develop and formalize. Professional organizations such as the American Academy of Family Physicians now encourage every family medicine residency program to include POCUS training,14 and have developed curriculum guidelines for family medicine residents.15 Medical school POCUS curriculum integration continues to grow with more than 180 medical schools around the world reporting POCUS curriculum to the American Institute of Ultrasound in Medicine, compared to approximately 20 in 2014.16 Data also suggest that medical students with ultrasound training in school consider ultrasound training opportunities when selecting a residency program.17
It is not currently known how these recent advancements in research and curriculum development have affected POCUS training across family medicine residency programs. Through a follow-up CERA survey, we sought to explore the updated status of POCUS training in family medicine by examining how ultrasound is being utilized across family medicine residencies, and understand potential barriers to POCUS use in the specialty.
We developed a series of questions building on a previous survey completed in 2014.13 The previous study investigated program directors’ perceptions of likely future use of POCUS, along with curricula, attitudes, and barriers to implementation. This new inquiry investigates the family medicine program directors’ perceptions of current use of POCUS, as well as revisiting curricula and barriers to training regarding POCUS in family medicine residency programs. We left questions regarding curricula and barriers largely unchanged to allow direct comparisons between years. We modified questions regarding current use of POCUS to better investigate current use in 2019, rather than ask directors to estimate likelihood of future use (2014). By consensus among the authors, we determined seven of the most common uses of POCUS in 2014. One additional modality (lung ultrasound) was added to the 2019 survey.
This set of questions was included as part of a larger omnibus survey conducted by the Council of Academic Family Medicine Educational Research Alliance (CERA). The methodology of the CERA Program Director Survey has previously been described in detail.18 The CERA Steering Committee evaluated questions for consistency with the overall subproject aim, readability, and existing evidence of reliability and validity. Family medicine educators who were not part of the target population pretested the survey. Questions were modified following pretesting for flow, timing, and readability. The American Academy of Family Physicians Institutional Review Board approved the project in May 2019. Data were collected from May 2019 to July 2019.
The sampling frame for the survey was all Accreditation Council for Graduate Medical Education-accredited US family medicine residency program directors as identified by the Association of Family Medicine Residency Directors. Email invitations to participate were delivered with the survey utilizing the online program Survey Monkey. Seven follow-up emails to encourage nonrespondents to participate were sent after the initial email invitation.
Analysis
This analysis compares the results of similar CERA surveys distributed in 2014 and 2019. Survey responses were aggregated and coded using SAS 9.4. Differences in these proportions between the two survey years were estimated using Wald c2 analysis with an a of 0.05. For perceived barriers, respondents were able to rank their top three responses. The first ranked response received a score of 3, the scored ranked response received a rank of 2, and the third ranked response received a score of 1. We then summed these weighted scores and sorted them from highest to lowest, with the highest scores indicating those responses more commonly cited and ranked highly by the respondents, with the differences in the relative ranks from the previous survey noted.
The 2019 CERA Program Directors 2019 received responses from 261 out of 616 surveys sent for an overall response rate of 42.4%. While this includes a higher total number of responses, it is a small percentage reduction from the 2014 survey’s response rate of 50%.
Current Prevalence of Practice and Curricula
POCUS training in family medicine residency programs has generally expanded and matured between 2014 and 2019, albeit with some notable challenges. The results of overall POCUS training are summarized in Table 1. POCUS is increasingly a core part of family medicine training, with percentage of programs “in the process of establishing a core POCUS curriculum” tripling from 12% in 2014 to 38% in 2019 (P<.05). The percentage of respondents reporting an established curriculum also tripled from 2% in 2014 to 6% in 2019 (P<.001). On the other end of the scale, the percentage of programs that “had no plans to establish POCUS training” dropped significantly from 41% in 2014 to 11% in 2019 (P<.0001). In a subgroup analysis, programs with fewer than 31 residents were more likely to have no plans to establish POCUS training (P<.05), as were community-based programs, (P<.05). Table 2 reports the responses relating to curricular components of POCUS training. Notably, all curricular components increased significantly over the 5-year period. The 2019 survey specified which type of faculty provided supervision of POCUS images, and found family medicine residents have their ultrasound images reviewed more commonly by family medicine faculty than faculty in departments of radiology or emergency medicine.
Current Perceptions of Use
The 2014 survey took seven different modalities of POCUS and asked program directors to estimate the likelihood of use, “in their graduates’ future practices.” The 2019 study asked program directors to estimate the frequency of use of these modalities “in their current practice,” so the results are not directly comparable between years. Table 3 summarizes the 2019 results of program directors responding that physicians in their programs currently use these modalities either once per week, once per month, or once per year. While all modalities are used at least occasionally by some programs, most programs report infrequent use. In fact, six of the eight modalities we surveyed were rated as never used by over 73% of program directors.
Perceived Barriers
The three most significant barriers to pursuing training did not change in order between 2014 and 2019, and remain a lack of trained faculty, limited access to equipment, and discomfort with interpreting images without radiologist review (Table 4). The second-tier obstacles did change in rank. Notably, financial issues such as time required to perform the exam during a busy clinic and insurance reimbursements were reported more frequently as problems, while restrictive hospital policies and inadequate learner interest were listed less often.
Graduate Competency
While the other questions focussed on the training program as a whole, program directors were also asked about the percentage of graduates from their program over the past 3 years who are competent to perform POCUS. The results are shown in Figure 1. Only 10 program directors out of 261 responding reported that over half of their graduates are competent to use point-of-care ultrasound in a clinical setting.
POCUS training has substantially expanded in family medicine residencies over the last 5 years, but it still faces significant barriers to clinical implementation. Nearly two-thirds of programs now report either having core curricula or elective opportunities in POCUS. Of the remaining 31% who have not yet begun establishing POCUS as part of their curriculum, two-thirds of them are considering adding it. Additionally, training experiences have become more formalized, with inclusion of ultrasound images during didactic sessions, faculty review of ultrasound images, and use of required ultrasound logs roughly doubling over this period.
While training in POCUS continues to grow, the current clinical use of POCUS modalities remains comparatively low in residencies. Only 10 of 261 program directors believe that a majority of their graduates are competent to use POCUS. Of eight possible POCUS modalities, procedural guidance is the only one that a majority of program directors report physicians in their practice use at least annually. Conversely, at least 75% of directors report their physicians in their practice use 6 of the 8 modalities less than once a year.
The surveyed barriers to inclusion of POCUS training into residency programs explains some of the discrepancy between training and actual use. These barriers appear to be significant impediments: in 2014 a total of 40% of respondents indicated they were in the process of establishing training, or had done so within the last year. Based on this response, we would have expected at least 40% of responders having an established curriculum in 2019. However, in 2019 only 6% of programs reported an established curriculum, suggesting that implementing a truly effective curriculum turned out to be more challenging than was expected in 2014. It is also possible that since criteria for POCUS curricula have been more formally described and widely circulated,15 some program directors may have felt their existing curricula did not meet the bar of being “established.”
The discrepancy between the growth of POCUS training and limited growth in clinical use suggests there are barriers not only to implementing POCUS training, but also barriers to incorporating this new technology into clinical primary care. Many uses of POCUS were developed for the acute care setting such as emergency rooms or hospital settings, and may not be as appropriate for ambulatory settings. Ambulatory settings have somewhat different patient characteristics, emphases, and billing processes that affect the utility of this new technology. For example, family physicians working in a rural emergency department (ED) will find POCUS an invaluable tool for evaluating a patient with right upper-quadrant pain. In such cases, POCUS would likely clarify the diagnosis more quickly than calling in a sonography technician after hours. When these clinicians compare the alternatives of POCUS versus a formal radiology ultrasound, POCUS will more likely improve patient flow through the ED and improve the efficiency of care. In contrast, family physicians in an ambulatory clinic evaluating patients with right upper-quadrant pain will probably find POCUS to be more time consuming and less efficient than the alternative of ordering an outpatient ultrasound. Such ambulatory clinicians would rightly want to know how the time spent performing POCUS would be reimbursed and whether or not this new process would improve the patient’s outcome.
While the top three barriers to POCUS training did not change since 2014, our surveyed barriers in the second tier reported increased concerns regarding financial reimbursements, clinic efficiency, and demonstration of improved patient outcomes. Perhaps the top three barriers persist because uncertain financial incentives and inadequately proven patient outcomes prevent faculty from investing time in learning POCUS, and prevent clinics from investing money in purchasing equipment.
If financial and outcome concerns are the barriers behind the barriers, studies demonstrating improved outcomes or cost savings for POCUS in a primary care setting would be valuable toward broader implementation and training. This need for more studies of POCUS and patient-oriented outcomes was highlighted in two excellent recently published literature reviews.6-7 One of the reviews6 listed multiple POCUS uses and studies, but despite 72 curated references, could only generate one A-level recommendation for POCUS use using the Strength of Recommendation Taxonomy.19 Financial impact studies are also sorely needed. The other review7 referenced three articles that found lower health costs with primary care ultrasound, although the economic reviews were reportedly limited and the referenced articles were published in 2002 or earlier.
Financial barriers to individual physicians and clinics stem from uncertainties in reimbursements for POCUS. Not all insurers recognize POCUS as a reimbursable service. Those that do require documentation of medical necessity, permanent storage of images, and a written report.20 Clarifying and simplifying billing regulations and practices will be important to widely implement POCUS in an ambulatory setting. Technological upgrades are likely to increase POCUS ease of use through improved portability, shortened boot-up times, enhanced image clarity, and simplified image transfer to the electronic medical records. These advancements may accelerate POCUS uptake by clinicians.
As patient-oriented evidence increases and financial barriers are addressed, an increasing number of faculty and residents will likely become proficient at using POCUS in multiple settings. Family physicians have a broad level of training and often perform a wide variety of procedures, however often any single procedure may be uncommon. Maintaining skills in ultrasound for infrequently used modalities is another question that will need to be addressed over time. Studies providing insight on effectively maintaining and improving skills over time will become important.
Interest in POCUS is unlikely to disappear. Ultrasound devices are becoming more affordable, more portable, and are beginning to incorporate more user-friendly technology including artificial intelligence. In addition, this growing interest in POCUS is not limited to family medicine residencies in the United States. As of 2018, 71% of Canadian family medicine residency programs were either currently offering POCUS training or were planning to introduce it to their programs. The Canadian residency directors also identified several of the same barriers reported by US family medicine residency directors. Over half (57%) of the Canadian program directors identified a lack of adequate equipment, lack of instructors, and lack of available time in the curriculum.21 It is notable that despite very different health care systems in the United States and Canada, residency directors in both countries report growing interest in POCUS and are hampered by some of the same barriers.
The promise of POCUS is not to convert primary care clinicians into full-time sonographers, but to enable primary care clinicians to use this new technology as proficiently as they currently use their stethoscopes. The question, “Can family physicians be trained to perform POCUS?” has been answered affirmatively by multiple studies, and likely drives our survey’s documented growth in POCUS training during residency. The question, “How should family physicians ideally use POCUS,” is not as well resolved, and may explain the more limited clinical use reported here. We need further investigations on how POCUS can improve patients’ outcomes in primary care settings, and we need analyses of the positive or negative impacts of POCUS on health care costs. These investigations will help clarify the best uses for POCUS and provide the incentives needed to more widely adopt this technology.
Acknowledgments
Financial Support: The 2019 Council of Academic Family Medicine Educational Research Alliance (CERA) Survey provided in-kind support for the survey.
References
- Kendall JL, Hoffenberg SR, Smith RS. History of emergency and critical care ultrasound: the evolution of a new imaging paradigm. Crit Care Med. 2007; 35:5 S126 – S130
- Beaulieu Y, Marik PE. Bedside ultrasonography in the ICU: part 1. Chest. 2005;128(2):881-895. https://doi.org/10.1378/chest.128.2.881
- Levy JA, Noble VE. Bedside ultrasound in pediatric emergency medicine. Pediatrics. 2008;121(5):e1404-e1412. https://doi.org/10.1542/peds.2007-1816
- Kobal SL, Atar S, Siegel RJ. Hand-carried ultrasound improves the bedside cardiovascular examination. Chest. 2004;126(3):693-701. https://doi.org/10.1378/chest.126.3.693
- Russell TC, Crawford PF. Ultrasound in the austere environment: a review of the history, indications, and specifications. Mil Med. 2013;178(1):21-28. https://doi.org/10.7205/MILMED-D-12-00267
- Arnold MJ, Jonas CE, Carter RE. Point-of-care ultrasonography. Am Fam Physician. 2020;101(5):275-285.
- Andersen CA, Holden S, Vela J, Rathleff MS, Jensen MB. Point-of-care ultrasound in general practice: a systematic review. Ann Fam Med. 2019;17(1):61-69. https://doi.org/10.1370/afm.2330
- Mjølstad OC, Snare SR, Folkvord L, et al. Assessment of left ventricular function by GPs using pocket-sized ultrasound. Fam Pract. 2012;29(5):534-540. https://doi.org/10.1093/fampra/cms009
- Brennan JM, Ronan A, Goonewardena S, et al. Handcarried ultrasound measurement of the inferior vena cava for assessment of intravascular volume status in the outpatient hemodialysis clinic. Clin J Am Soc Nephrol. 2006;1(4):749-753. https://doi.org/10.2215/CJN.00310106
- Blois B. Office-based ultrasound screening for abdominal aortic aneurysm. Can Fam Physician. 2012;58(3):e172-e178.
- Spencer KT, Kimura BJ, Korcarz CE, Pellikka PA, Rahko PS, Siegel RJ. Focused cardiac ultrasound: recommendations from the American Society of Echocardiography. J Am Soc Echocardiogr. 2013;26(6):567-581. https://doi.org/10.1016/j.echo.2013.04.001
- Solomon SD, Saldana F. Point-of-care ultrasound in medical education—stop listening and look. N Engl J Med. 2014;370(12):1083-1085. https://doi.org/10.1056/NEJMp1311944
- Hall JW, Holman H, Bornemann P, et al. Point of Care Ultrasound in family medicine Residency Programs: A CERA Study. Fam Med. 2015;47(9):706-711.
- Resolution No. 602 (New York E) - Increase point of care ultrasound (POCUS). Education in Family Medicine. Leawood, KS: Congress of Delegates American Academy of Family Physicians; 2016.
- American Academy of Family Physicians. Recommended Curriculum Guidelines for Family Medicine Residents. AAFP Reprint No. 290D. https://www.aafp.org/dam/AAFP/documents/medical_education_residency/program_directors/Reprint290D_POCUS.pdf. Accessed June 5, 2020.
- American Institute of Ultrasound in Medicine. AIUM Ultrasound in Medical Education Portal. http://meded.aium.org/medical-schools. Accessed March 12, 2020.
- Neri L, Storti E, Lichtenstein D. Toward an ultrasound curriculum for critical care medicine. Crit Care Med. 2007;35(5)(suppl):S290-S304. https://doi.org/10.1097/01.CCM.0000260680.16213.26
- Mainous AG III, Seehusen D, Shokar N. CAFM Educational Research Alliance (CERA) 2011 residency director survey: background, methods, and respondent characteristics. Fam Med. 2012;44(10):691-693.
- Ebell MH, Siwek J, Weiss BD, et al. Strength of recommendation taxonomy (SORT): a patient-centered approach to grading evidence in the medical literature. Am Fam Physician. 2004;69(3):548-556. https://doi.org/10.3122/jabfm.17.1.59
- Fujifilm Sonosite. Ultrasound reimbursement information: primary care. https://www.sonosite.com/sites/default/files/2018-SonoSite-Primary_Care-01082018.pdf. Published January, 2018. Accessed 17 March, 2020.
- Micks T, Braganza D, Peng S, et al. Canadian national survey of point-of-care ultrasound training in family medicine residency programs. Can Fam Physician. 2018;64(10):e462-e467.
There are no comments for this article.