Dissemination of research findings often takes a long time. However, we are very pleased our research was noticed and published in Ronald Harden's 'Definitive Guide to the OSCE', an important book for those working in the field of medical education (page 147 (ISBN: 978-0-7020-5550-8)).
When Qpercom developed it's unique Observational Management Information System (formerly OMIS, now Observe) in 2007, it very much used a ‘bottom up’ procedure. This is analogous to how module coordinators and exam administrators developed their assessment stations according to the so called ‘check list approach’. This approach is very much focused on ticking the boxes of an item list similar to the lower technology (paper) forms that were used in those days.
Topics: eAssessment, competency based assessment, competency frameworks, competency management system, curriculum mapping, evidence based training, qpercom observe, clinical assessment, osces, qpercom observe feature
On Friday, 26th February 2016, Qpercom participated successfully in the National University of Ireland, Galway (NUIG) School of Medicine’s multi-site Year 4 Objective Structured Clinical Examination (OSCE). New from the previous year’s OSCE was the opening of the Clinical Skills Suites at Sligo General Hospital Medical Academy.
Topics: eAssessment, clinical assessment, osces, objective structured clinical examinations, osce setup, student feedback, multi-examiner assessment, eosces, digital scoring technology, electronic assessment
In December 2015, Winny Setyonugroho defended his thesis 'The Assessment of Communication Skills During OSCEs: Development and Trialed Implementation of a New Standardised Model Using the MAAS-Global Instrument'. According to the external examiner Dr Marc van Nuland:
"This thesis is original in its introduction of a calibration process for OSCE checklist instruments. This certainly is a valuable contribution to the knowledge and scholarship within the domain of medical education. Further on, researching the effect of having a different first language on the results of communication assessment in OSCE is also of special interest. It is valuable that the candidate has tried to explain the observed differences of students with a different first language compared to native English speaking students from the perspective of the Theory of Working Memory."
Unique to Qpercom Observe, the OSCE management information system, are the new Multiple Examiners/Multiple Scenario enhancements. We have frequently read about research empowering the Standardized Patient (SP) to play an important role in examining parts of student’s competence. Only the patient experiences the effects of interpersonal communication, empathy and other aspects that need to be observed and at times marked.
Setyonugroho W, Kennedy KM and Kropmans TJB. "Reliability and validity of OSCE checklists used to assess the communication skills of undergraduate medical students: A systematic review". Patient Education and Counseling, 2015. [5-Year Impact Factor: 2.975] doi:10.1016/j.pec.2015.06.004
A paper on the reliability and validity of OSCE checklists in assessing communication skills by Winny Setyonugroho, Dr Kieran Kennedy and Dr Thomas Kropmans was accepted by Patient Education and Counselling. As part of this research, 250 assessment forms were analysed across four academic terms in order to measure the true caliber of communications skills of OSCE performance. The paper can be accessed via the following link:
Our tech team has successfully overhauled Observe (formerly OMIS) 1.8.5. and are rolling out version 1.9.43 at our home base. Due to the invaluable feedback of clients, module and OSCE coordinators, and other individual users, we have improved Observe functionalities to the maximal standard.