247 - Improving Online Faculty Feedback Documentation For Residents

Poster Number: 247
Publication Number: 247.333

Rachita Gupta, Kaiser Permanente - Oakland Medical Center, Oakland, CA, United States; Xing Wang, Kaiser Permanente - Oakland Medical Center, Berkeley, CA, United States; Samuel Backus, Kaiser Permanente - Oakland Medical Center, Oakland, CA, United States; Nami Jhaveri, Kaiser Permanente - Oakland Medical Center, Oakland, CA, United States; Rebecca Chasnovitz, Kaiser Permanente - Oakland Medical Center, Berkeley, CA, United States

Background: Written faculty feedback for residents, while essential for clinical training and growth, is often hampered at Kaiser Permanente’s Pediatric Residency Program by a lack of faculty knowledge of the online feedback documentation process. In spite of efforts made through Plan-Do-Study-Act (PDSA) cycles 1-3, which addressed key barriers to written faculty feedback through the implementation of shorter evaluation forms, a monthly evaluation assignment for faculty to complete, and use of QR codes, documented feedback has remained low.
 

Objective: To increase written faculty feedback on Medtrics, the online graduate medical education platform used at Kaiser 1) prior to the clinical competence committee (CCC) review of resident performance in October of each year (PDSA cycle 4) and 2) during the initial five months of the academic year (July - November), instead of being limited to the CCC review period (PDSA cycle 5).

Design/Methods: PDSA cycle 4 (2020): Each resident emailed the program coordinator and their CCC advisor the list of attending faculty they had worked with. The program coordinator emailed Medtrics feedback form links to each designated attending. The CCC advisors provided email reminders for the faculty to complete the forms prior to the CCC review.PDSA cycle 5 (2021): All pediatric residents were given a QR code linked to a Medtrics feedback form to carry on their ID badges. From July – October 2021, faculty in the core clinical rotations - NICU, PICU, wards, and clinic - were taught how to scan QR codes, download and use the Medtrics app, and submit online evaluations.The aggregate data from 2019 to 2021 was compared using a single factor ANOVA analysis (α = 0.05). An unpaired t-test was used to compare 2020 and 2021 data.
 

Results: Procuring faculty evaluations prior to the CCC review (PDSA cycle 4) led to a 40% increase in evaluations between October 2019 and October 2020 and 2021 (p = 0.015). On average, in October, three evaluations per resident were completed in 2019, four in 2020, and five in 2021 (Figure A). Teaching faculty how to use Medtrics (PDSA cycle 5) led to an 89% increase in online evaluations submitted in the first five months of the academic year (July - November) in 2021 compared to 2020 (p = 0.0095).
 Conclusion(s): Resident, program coordinator, and CCC advisor involvement in training attending faculty on the online feedback documentation process and reminding them to provide feedback during delineated evaluation periods can increase faculty feedback. Future interventions should explore how to sustain a high number of evaluations throughout the academic year.
Rachita Gupta CVRachita Gupta CV 1.4.22.pdf