STUDY OBJECTIVES • To investigate validity and reliability of OSCE grades awarded by Year 6 students during the Year 4 surgical OSCE • To investigate the perceptions and attitudes of Year 6 students towards OSCE examining
University of Auckland MBChB Programme YEAR
PHASE
1 2
Pre-Clinical
3 4 5 6
Clinical
OSCE Grading History-Taking 1. Appropriate and professional manner 2. Logical progression of questions related to presenting complaint 3. Appropriate depth and range of questioning 4. Asks about other important related areas 5. Summary and working diagnosis is succinct and appropriate
OSCE Grading Physical Examination 1. 2. 3. 4. 5.
Appropriate and professional manner Logical progression of the examination Inspection Palpation Percussion and Auscultation
OSCE Grading Year 4 Students are graded against expected standards of a Final-Year Medical Student GRADE
SCORE DEFINITION
Mastery
4
Standard has been fully met
Clear Pass
3
A few minor mistakes/omissions were made
Flagged Pass
2
Some major mistakes and/or important omissions were made
1
Many major and significant mistakes or omissions were made
Fail
Year 4 Surgical OSCE • Externally Valid • Internally Reliable Yu TC, Wheeler BR, Hill AG. “Effectiveness of standardised clerkship teaching across multiple sites.” Journal of Surgical Research, 2011;168:e17-e23.
STUDY PARTICIPANTS • 124 x Year 4 medical students • 28 x Year 6 medical students • 8 x Faculty academic clinicians
Example: Peripheral Vascular Disease Year 4 Surgical OSCE Evaluation Form
I enjoyed being an OSCE Examiner. From my experience today …. a) I learnt new clinical information b) I reviewed my current knowledge c) I learnt how to be a better teacher d) I learnt how to provide feedback
e) I learnt what makes a better OSCE station I will incorporate what I learnt today into my future clinical practice. Participating as an OSCE Examiner has improved my confidence to teach. As an OSCE Examiner, I gained insight into student learning processes. I will volunteer to be an OSCE examiner in the future because …. a) I will enjoy the opportunity to teach and provide feedback b) Of a sense of duty to clinical teaching c) I am likely to improve my clinical knowledge and skills d) I will enjoy the social interactions with students and other examiners
e) Of the great food The Clinical School values my contributions today. My willingness to participate would increase if my contributions were acknowledged by clinical supervising consultants.
STUDY RESULTS Internal Reliability – Cronbach’s alpha coefficients
Acute Abdomen
Peripheral Vascular Disease Surgical Neck
Student Examiners
Faculty Examiners
History-taking
0.80
0.69
Examination
0.80
0.83
History-taking
0.76
0.75
Examination
0.80
0.82
Examination
0.82
0.80
STUDY RESULTS Acute Abdomen: Student vs Faculty Exmainers SE mean
