PUBLICATIONS & REPORTS In TIPS   on April 11, 2023 Investigation Into Factors That May Impact Examinee Performance Have you ever wondered if the specific set of factors you are assigned to on OSCE exam day has an impact on your performance? As with any exam that is in high demand and will be attempted…

PUBLICATIONS & REPORTS In TIPS   on November 30, 2022 Ontario 360: Improving Access to Internationally Educated Health Professionals Highlights Explore Resources Full Print Report Executive Summary Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco…

PUBLICATIONS & REPORTS In TIPS   on August 3, 2021 Securely Transitioning to Virtual Exams Key Takeaway Protocols and security functions for virtual, remotely proctored high-stakes exams can be replicated in a virtual setting in order to achieve the same principles and secure exam conditions as in person exams. Remote virtual exam delivery is an…

PUBLICATIONS & REPORTS In TIPS   on April 15, 2021 Standardized Versus Simulated Clients Key Takeaway A standardized client is used in exams and has been trained to replicate their performance for every examinee. Simulated clients are used in learning programs and have more flexibility to adapt their performance to suit each participant’s needs. Simulation…

PUBLICATIONS & REPORTS In TIPS   on May 5, 2020 Assessing Reliability and Validity Key Takeaway Through careful consideration of the strengths and limitations of the CTT and IRT models, test developers can implement valid, reliable and fair testing contexts that control for as much error as possible. The respective roles of Classical Test Theory…

PUBLICATIONS & REPORTS In TIPS   on November 5, 2019 Score Applicability and Retakes Key Takeaway While it may be considered ethical and fair to permit retakes for an examination, examinees should be made aware of research showing that retakes do not result in significant improvement for borderline examinees. Our Findings Evidence suggests that retake…

PUBLICATIONS & REPORTS In TIPS   on September 20, 2019 Building a Competency Assessment Key Takeaway Connecting education and assessment to a publicly accessible competency document will build public confidence by clarifying expectations for policy makers, regulators, educators, and examinees. Why do you need a competency-based assessment?   In our home province of Ontario The…

TIPS In TIPS   on April 6, 2019 DRIFT happens, sometimes: Examining time based rater variance in a high-stakes OSCE DRIFT happens, sometimes: Examining time based rater variance in a high-stakes OSCE Karen Coetzee & Dr. Sandra Monteiro BACKGROUND To what extent does DRIFT exist in 12 stations of the high-stakes IENCAP OSCE in which…

TIPS In TIPS   on April 13, 2018 Customizing the Standard to the Purpose of the Assessment Customizing the Standard to the Purpose of the Assessment The purpose of standard setting in health professions education is to facilitate decisions following the assessment of competence at admissions, during training or at certification. Read the Full Article…

TIPS In TIPS   on February 27, 2018 i-Assess: Evaluating the impact of electronic data capture for OSCE Tablet-based assessments offer benefits over scannable-paper assessments; however, there is little known about the impact to the variability of assessment scores. Read the Full Article Related in TIPS Investigation Into Factors That May Impact Examinee Performance on…