Email sent to PDs this AM:
Earlier this month, we notified candidates that the ABR would investigate the causes and effects of the problems that arose during the administration of the biology section of the computer-based qualifying examination on Thursday, July 8, 2010, at Pearson VUE testing centers. We know that neither the online calculator nor the case-flagging feature functioned properly during this portion of the exam.
As a result of our discussions with Pearson VUE, we have determined that they failed to install both of these features on the biology section of the exam and that quality assurance procedures also failed to detect this omission.
The ABRs psychometricians have carefully investigated the possible effects of these errors due to the manual calculations necessitated by the circumstances, including: 1) the amount of time provided for the biology section as an issue for candidates, and 2) the performance of candidates on the items for which a calculator ordinarily might have been used.
After a thorough analysis of item performance, exam results, and candidate surveys, the ABR has removed from scoring a number of poorly-performing items, and has determined that the rescored results are a valid and reliable assessment of knowledge of the principles of cancer and radiation biology. We have determined clearly that the items in question have not adversely impacted any candidates final performance, and the examination results this year are consistent with past performance. Each candidate with a score below the passing point has received a free hand score to further confirm the accuracy of the individual results.
We greatly appreciate your patience as we worked through the issues to ensure an appropriate and equitable outcome and we regret any distraction caused during the examination, or subsequent concerns. All candidates who took the biology exam have been notified by mail.
Sincerely,
Paul Wallner, DO
Associate Executive Director, Radiation Oncology
Beth Erickson, MD
Assistant Executive Director, Radiation Oncology Primary Examinations