Quality Assurance of High-stakes OSCEs

1 April - 10 May 2024

OSCEs (Objective Structured Clinical Examinations) are frequently being used around the world in high-stakes examinations, such as graduation-level and licensing situations. It is essential that these OSCEs are therefore quality assured, based on contemporary, recognised scientific-based evidence of best practice. This course will be based on the Kane Validity Framework (Kane 2013) and the Ottawa Consensus Statements on Good Assessment (Norcini 2018) and Performance Assessment (Boursicot 2021)

Aim of Course : To provide a structured framework for best practice in quality assuring high-stakes OSCEs

Objectives: participants will learn to

  • Develop understanding of the contemporary principles of QA requirements of conducting a high-stakes OSCE

  • Become familiar with the Kane Validity Model and relevant Ottawa Consensus Statements

  • Scrutinise an OSCE to check if it is designed appropriately, including rationale for choices

  • Establish that blueprints are appropriate for their tests, mapped to the relevant Learning Objectives and demonstrating sufficient sampling • Review appropriateness of scoring schemes

  • Confirm suitable standard setting methods for OSCEs

  • Design an appropriate QA system for the test

  • Create a suitable system of communication and collaboration with examiners, candidates, patients (real and simulated)

The activities in each week/module will vary according to the content.

In some modules, there will be

  1. Pre-recorded voice over presentation(s).

  2. Discussion Board: participants to post questions, outcomes of tasks, comment on other posts. Tutors will engage in discussions asynchronously.

  3. Live chat sessions, so participants can ask questions of the tutors in real time.

  4. Tasks relating to the application of the module content, which can be attempted in groups, or individually. Tutors will feedback via the Discussion Board.

  5. A repository of key literature relating to the topic(s) of the module.

In other modules, there will be

  1. Individual tasks to complete

  2. Live streaming webinars and group activities.

  3. Discussion Board: participants to post questions, outcomes of tasks, comment on other posts. Tutors will engage in discussions asynchronously.

    • Kane Validity Framework

    • Ottawa Consensus Statements

    • Systematic evaluation of OSCEs

    Live Zoom Sessions :

    • 2 & 5 April 2024 (Tuesday & Friday)

    • 1600 - 1700 (SGT) or 0800 - 0900 (BST)

    • Is the OSCE test blueprint appropriately mapped to Learning Objectives

    • Is the OSCE appropriately constructed (testing time, numbers and duration of stations)

    Live Zoom Sessions :

    • 9 & 12 April 2024 (Tuesday & Friday)

    • 1600 - 1700 (SGT) or 0800 - 0900 (BST)

    • Are the scoring schemes appropriately designed

    • Inclusion of real/simulated patient scores

    • Assessing professionalism in an OSCE

    Live Zoom Sessions :

    • 16 & 19 April 2024 (Tuesday & Friday)

    • 1600 - 1700 (SGT) or 0800 - 0900 (BST)

    • Choice of standard setting method

    • Demonstration of how the method is applied

    • Conjunctive and non-conjunctive standards

    • Aggregation of results

    Live Zoom Sessions :

    • 23 & 26 April 2024 (Tuesday & Friday)

    • 1600 - 1700 (SGT) or 0800 - 0900 (BST)

    • Checking on Blueprinting team

    • Station developers, design, creation and review of stations, piloting

    • Examiner and Simulated Patient training

    • Feedback to examiners and SPs

    • Communicating with candidates: preparation, results, feedback

    Live Zoom Sessions :

    • 30 April & 3 May 2024 (Tuesday & Friday)

    • 1600 - 1700 (SGT) or 0800 - 0900 (BST)

    • Designing a system of QA

    • How to produce, understand and use post exam metrics

    • Security of test; data management

    • External examiners

    Live Zoom Sessions :

    • 7 & 10 May 2024 (Tuesday & Friday)

    • 1600 - 1700 (SGT) or 0800 - 0900 (BST)

Fees.

Fees: SGD 2,000 per participant

For every 5 registrations from an institution for one course, the 6th registrant receives a complimentary registration for the same course.

If you are from one of the countries listed on the UN list of Least Developed Countries, you are eligible for a 40% discount - CLICK HERE.

Please contact the course administrator at admin@hpac.sg , to register. Please note that payments via Telegraphic Transfer and credit card transactions will incur an administrative tax fee.

HPAC does not make any income from these fees as they are levied by the respective service providers.

Sign Up!
  • Professor Katharine Boursicot

    Professor Katharine Boursicot

    Managing Director
    HPAC

    Read Bio
  • Professor Rikki Goddard-Fuller

    Professor Rikki Goddard-Fuller

    Director of Christie Education
    Christie Hospitals NHS Trust / University of Manchester, UK

    Read Bio
  • Professor Jen Williams

    Professor Jen Williams

    Faculty Dean, Medicine and Health, University of New England in Australia

    Read Bio