Subtle skills: Using objective structured clinical examinations to assess gastroenterology fellow performance in system based practice milestones

BACKGROUND System based practice(SBP) milestones require trainees to effectively navigate the larger health care system for optimal patient care. In gastroenterology training programs, the assessment of SBP is difficult due to high volume, high acuity inpatient care, as well as inconsistent direct supervision. Nevertheless,structured assessment is required for training programs. We hypothesized that objective structured clinical examination(OSCE) would be an effective tool for assessment of SBP.AIM To develop a novel method for SBP milestone assessment of gastroenterology fellows using the OSCE.METHODS For this observational study, we created 4 OSCE stations: Counseling an impaired colleague, handoff after overnight call, a feeding tube placement discussion, and giving feedback to a medical student on a progress note. Twentysix first year fellows from 7 programs participated. All fellows encountered identical case presentations. Checklists were completed by trained standardized patients who interacted with each fellow participant. A report with individual and composite scores was generated and forwarded to program directors to utilize in formative assessment. Fellows also received immediate feedback from a faculty observer and completed a post-session program evaluation survey.RESULTS Survey response rate was 100%. The average composite score across SBP milestones for all cases were 6.22(SBP1), 4.34(SBP2), 3.35(SBP3), and 6.42(SBP4)out of 9. The lowest composite score was in SBP 3, which asks fellows to advocate for cost effective care. This highest score was in patient care 2, which asks fellows to develop comprehensive management plans. Discrepancies were identified between the fellows’ perceived performance in their self-assessments and Standardized Patient checklist evaluations for each case. Eighty-seven percent of fellows agreed that OSCEs are an important component of their clinical training,and 83% stated that the cases were similar to actual clinical encounters. All participating fellows stated that the immediate feedback was "very useful." One hundred percent of the fellows stated they would incorporate OSCE learning into their clinical practice.CONCLUSION OSCEs may be used for standardized evaluation of SBP milestones. Trainees scored lower on SBP milestones than other more concrete milestones. Training programs should consider OSCEs for assessment of SBP.

Clinical factors associated with hepatitis B screening andvaccination in high-risk adults

BACKGROUND Hepatitis B virus is a viral infection that can lead to acute and/or chronic liver disease, and hepatocellular carcinoma(HCC). Hepatitis B vaccination is 95% effective in preventing infection and the development of chronic liver disease and HCC due to hepatitis B. In 2011, the Centers for Disease Control updated their guidelines recommending that adults at high-risk for hepatitis B infection be vaccinated against hepatitis B including those with diabetes mellitus(DM). We hypothesize that adults at high-risk for hepatitis B infection are not being adequately screened and/or vaccinated for hepatitis B in a large urban healthcare system.AIM To investigate clinical factors associated with Hepatitis B screening and vaccination in patients at high-risk for Hepatitis B infection.METHODS We conducted a retrospective review of 999 patients presenting at a large urban healthcare system from 2012-2017 at high-risk for hepatitis B infection. Patients were considered high-risk for hepatitis B infection based on hepatitis B practice recommendations from the Center for Disease Control. Medical history including hepatitis B serology, concomitant medical diagnoses, demographics, insurance status and social history were extracted from electronic health records.Multivariate logistic regression was used to identify clinical risk factors independently associated with hepatitis B screening and vaccination.RESULTS Among the 999 patients, 556(55.7%) patients were screened for hepatitis B. Of those who were screened, only 242(43.5%) patients were vaccinated against hepatitis B. Multivariate regression analysis revealed end-stage renal disease[odds ratio(OR): 5.122; 2.766-9.483], alcoholic hepatitis(OR: 3.064; 1.020-9.206),and cirrhosis or end-stage liver disease(OR: 1.909; 1.095-3.329); all P < 0.05 were associated with hepatitis B screening, while age(OR: 0.785; 0.680-0.906),insurance status(0.690; 0.558-0.854), history of DM(OR: 0.518; 0.364-0.737), and human immunodeficiency virus(OR: 0.443; 0.273-0.718); all P < 0.05 were instead not associated with hepatitis B screening. Of the adults vaccinated for hepatitis B,multivariate regression analysis revealed age(OR: 0.755; 0.650-0.878) and DM were not associated with hepatitis B vaccination(OR: 0.620; 0.409-0.941) both P <0.05.CONCLUSION Patients at high-risk for hepatitis B are not being adequately screened and/or vaccinated. Improvements in hepatitis B vaccination should be strongly encouraged by all healthcare systems.