The more educated someone is on what real illness looks like, the less valid the measures for detecting it.
True. In fact my PD told me that some lawyers have had their clients had so many SIRS done on them that they bought one on their own and learned how to beat the test. While he is not certain a specific lawyer that he could point out taught their client how to beat it, he is confident at least some of them have given his experience.
I had someone up for three counts of murder that I believe was malingering. I performed an M-FAST and he scored only a 6. In case you didn't know, that's the lowest possible score someone could score that suggests malingering. The higher the number, the more likely they are malingering. I was surprised because his clinical presentation was "flaming" for malingering based on Resnick's criteria of clinical identification. (BTW that criteria is not an end all be all. It should be supported with psychological testing). I did some investigation and found that he tried to use an NGRI defense in another state, was evaluated by a Court psychologist, and that doctor determined he was not eligible for that defense. That psychologist, I figure, did do an M-FAST but I could not get access to his report.
So I theorized that this guy might be savvy to psychological testing. A SIRS was done and that test very strongly pointed to malingering.
Someone who's taken the SIRS and got a hold of his test results could figure out how the test works.
Those tests also aren't full proof though they do add real objective data. While I mentioned that clinical observation is no better than a laymen, on occasion, it can pick up something that is just so blatantly and obviously malingering (such as the person even telling staff he's malingering) that it will hold in Court.
A doctor, however, saying a person is malingering or not only based on seeing them for a handful of hours and the person is not showing any strong signs either way is for all intents and purposes, a not very useful evaluation.
Ways to get useful information from clinical observation include the following: observing the patient around the clock (24 hours a day for several days. I call it "extended clinical observation") and recording if he doing tasks inconsistent with his diagnosis. E.g. the person claims to be psychotic only around staff. When he is with patients his behavior is stable. The person is doing tasks that require complex cognitive skill such as acquiring cigarettes that are contraband. The person is playing card or board games coherently.
The above examples go way beyond a simple 3-5 hour interview. The person has to be observed for several days by staff. Unfortunately that is not often what happens in many Court evaluations. In many of them the person is only interviewed for a few hours, then the report is produced.
If you understand the math behind the SIRS, if it points to someone as malingering, they are most likely malingering. The author of that test made it so that false positives would be very rare. If it's negative, that does not mean the person is not malingering. At the cost of a very low false positive rate, it has a higher likelihood of a false negative. The author made it this way because he did not want innocent people being fingered as malingering.
All of this information is important because you will occasionally get mixed results based from the tests. When this happens, then the next best thing to use is extended clinical observation.