I have only found one study asserting that OMT on standardized patients is a valid and reliable assessment.
Do you think the PE exam is necessary to protect the public?
OK, so I had the misfortune of actually reading that entire article and here are my notes/comments:
1) "Traditionally, medical students use OMT on volunteer patients or their peers and are assessed accordingly. This process, albeit of some value for formative feedback, generally lacks standardization and has limited fidelity. Potential differences in patient/subject conditions combined with variable, often subjective, assessment criteria render this strategy of limited use for summative assessments, especially where the stakes may be high. "
But isn't the point of OMT to diagnose somatic dysfunction first? How are standardized patients supposed to fake their own somatic dysfunction? Rule #1 of OMT: do not use OMT if there is no somatic dysfunction. The same SP with x complaint after having been treated with OMT from x number of examinees should no longer have the supposed somatic dysfunction by the end of the exam day.
2) "Likewise, for OMT, the candidates are not directly prompted to perform a particular maneuver. Instead, the standardized patients are trained to elicit some form of treatment through conversations about their medical histories. When prompted, candidates are required to select an appropriate treatment modality. For example, a standardized patient may say that, in the past, OMT was effective for treating his or her back pain."
See #4
3) "A total of 121 fourth-year medical students were tested at Western University of Health Sciences College of Osteopathic Medicine of the Pacific in Pomona, Calif. Within this sample, there were two students from Touro University College of Osteopathic Medicine in Vallejo, Calif."
I'm not a big research or statistics kind of person but I don't think taking your sample from two (if you can call two students from a school in the same state) schools is really what you would call a random or even diverse sample set.
4) "The specialties of the osteopathic physician examiners were as follows: family medicine (7), internal medicine (7, including 2 gastroenterologists, 1 women's health specialist, 1 geriatrician), pediatrics (1), and general surgery (1). Full-time osteopathic manipulative medicine faculty members were excluded from this particular study. The students were primarily recruited from the study site, and the osteopathic physician examiners were from the immediate region. Because osteopathic physician examiners were being used to rate OMT skills, we believed that the presence of recognized osteopathic manipulative medicine faculty members would cue the examinees that they were to be evaluated for OMT at those stations. The more natural cue that was incorporated was the prompt from the standardized patients within the clinical interaction. All osteopathic physician examiners were trained in the use of the assessment scales and were board-certified osteopathic physicians with at least 3 years of clinical practice experience."
Why not just get OMM faculty who are not from the immediate region? Or maybe use those "recognized" OMM faculty for all assessments? If they were present for all stations, that wouldn't serve as a cue. Also, not sure how the SP mentioning the effectiveness of OMT in previously treating his/her back pain is any more "natural" then having all OMM faculty present.
5) "This may have been due to examinee queuing (only OMT cases had an osteopathic physician observer in the room) or student preparation activities (eg, practicing maneuvers before the assessment)."
I think there was a typo...queuing should be cuing. Anyway, they made it obvious to do OMT right from the beginning! Either put a physician in all the rooms or not at all, not just in the OMT cases!
6) "Therefore, taking the osteopathic physician raters out of the room and substituting scoring done via monitors or videotape should be possible and will add to the verisimilitude of the assessment. This would eliminate the possibility of students being prompted to do OMT"
Well, duh.
7) "In addition, given the simulated nature of the encounter, it is often difficult to use palpatory diagnosis as the basis for initiating a treatment program involving manipulation. Here, it may be possible to use standardized patients with actual physical findings."
And how are you going to find these SPs with the actual physical findings?? Article doesn't say.
Also, I tried looking for any disclaimers noted in the article but couldn't find any.