TY - JOUR
T1 - Aggregated student confidence estimates support continuous quality improvements in a competencies-oriented curriculum
AU - Papa, Frank Joseph
AU - Alexander, Jerry H.
N1 - Publisher Copyright:
© 2019 Author(s) (or their employer(s)). Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.
PY - 2019/3/1
Y1 - 2019/3/1
N2 - Introduction Competencies oriented medical curricula are intended to support the development of those specific tasks likely to improve patient care outcomes. In 2005, our institution developed curricular objectives and instructional activities intended to enable our students to competently perform four specific clinical tasks (diagnose, treat, manage and explain phenomena) for each of approximately 100 common and/or important patient presentations (eg, dyspnoea). However, competencies oriented curricula must also develop outcome metrics aligned with their objectives and instructional activities in order to launch a continuous quality improvement (CQI) programme. This investigation describes how a novel course evaluation methodology produced presentation and task-focused outcome metrics sufficient to support CQIs in our competencies-oriented curriculum. Methods Literature suggests that aggregated, group opinions are much more reliable than individual opinions in a variety of settings, including education. In 2010, we launched a course evaluation methodology using aggregated student self-assessments of their confidence in performing the four tasks trained to in each presentation-focused instructional activity. These aggregated estimates were transformed into a variety of graphic and tabular reports which faculty used to identify, and then remediate, those specific instructional activities associated with suboptimal presentation and task-focused confidence metrics. Results With academic year 2010-2011 serving as a baseline and academic year 2015-2016 as an endpoint, analysis of variance revealed a sustained and statistically significant gain in student confidence across this 6-year study period (p<0.001). Discussion This investigation demonstrated that aggregated, presentation and task-specific confidence estimates enabled faculty to pursue and attain CQIs in a competencies-oriented curriculum. Suggestions for new approaches to confidence-related research are offered.
AB - Introduction Competencies oriented medical curricula are intended to support the development of those specific tasks likely to improve patient care outcomes. In 2005, our institution developed curricular objectives and instructional activities intended to enable our students to competently perform four specific clinical tasks (diagnose, treat, manage and explain phenomena) for each of approximately 100 common and/or important patient presentations (eg, dyspnoea). However, competencies oriented curricula must also develop outcome metrics aligned with their objectives and instructional activities in order to launch a continuous quality improvement (CQI) programme. This investigation describes how a novel course evaluation methodology produced presentation and task-focused outcome metrics sufficient to support CQIs in our competencies-oriented curriculum. Methods Literature suggests that aggregated, group opinions are much more reliable than individual opinions in a variety of settings, including education. In 2010, we launched a course evaluation methodology using aggregated student self-assessments of their confidence in performing the four tasks trained to in each presentation-focused instructional activity. These aggregated estimates were transformed into a variety of graphic and tabular reports which faculty used to identify, and then remediate, those specific instructional activities associated with suboptimal presentation and task-focused confidence metrics. Results With academic year 2010-2011 serving as a baseline and academic year 2015-2016 as an endpoint, analysis of variance revealed a sustained and statistically significant gain in student confidence across this 6-year study period (p<0.001). Discussion This investigation demonstrated that aggregated, presentation and task-specific confidence estimates enabled faculty to pursue and attain CQIs in a competencies-oriented curriculum. Suggestions for new approaches to confidence-related research are offered.
KW - continuous quality improvement
KW - evaluation methodology
KW - medical education
KW - quality improvement methodologies
UR - http://www.scopus.com/inward/record.url?scp=85083755397&partnerID=8YFLogxK
U2 - 10.1136/bmjoq-2018-000398
DO - 10.1136/bmjoq-2018-000398
M3 - Article
C2 - 30997415
AN - SCOPUS:85083755397
VL - 8
JO - BMJ open quality
JF - BMJ open quality
SN - 2399-6641
IS - 1
M1 - e000398
ER -