In August 2021, the Federal Training Committee (FTC) sought feedback from members regarding the current Selection process for the AOA 21 Training Program. Surveys were sent to all AOA fellows and trainees, and a Selection Review workshop was held to explore ways to improve the Selection process.
One concern that was raised related to a perception that some hospitals were consistently giving their AOA 21 Selection candidates ‘perfect’ scores in their referee reports. A data analysis was conducted by the AOA Selection Committee with the aim to find out:
- how many hospitals were consistently scoring their candidates the highest raw scores irrespective of their true performance
- whether any ‘perfect’ scoring has been consistent over the last three years (2019–2021)
Referee report data for the years 2019–2021 was collated from 160 hospitals that participated in providing referee reports for AOA Selection candidates. This included a review of individual scores and referenced the number of reports completed by each hospital each year.
There were a small number of hospitals (between 2.5–6 per cent), that gave ‘perfect’ scores in any one particular year. It was found that referee report scores do trend towards high scores being most common. On review of the data analysis, the FTC was pleased to note that there was no specific pattern across the past three years to suggest that particular hospitals were consistently awarding perfect scores.
Should you have any questions about this study, please don’t hesitate to email
selection@aoa.org.au
< Go back to the January 2022 eNewsletter