Is the question categorical?
Because in the long long long time ago, a young psydr worked as a paraprofessional for an autism clinic. The psychologist asked me to retrieve the autistic kid from the waiting room. I asked her, “how will I know which one is autistic?”. She said, look for the one who looks autistic.”.
And she was right.
If the question is ordinal: then… like probably.. snd like … 50%?
That’s like asking if some random woman in a bar. walking up to me is interested.. like 50%.
This hits on so much of what I’ve been feeling about assessment lately.
I occasionally leave and rejoin the Testing Psychologist Facebook group. On one side, you’ve got the same ten people who reply to everything with absolute confidence and rigid opinions. On the other, it’s the “what’s a good test for dyslexia?” posts that make me rage-quit every time.
At my last clinic, I worked with another amazing psychologist, and we’d often joke that
a valid diagnosis of autism is made when I say the kid has autism highlighting the reality that diagnosis ultimately rests on the expertise of a trained clinician.
But that’s also a little terrifying, because we all know there’s huge variability in clinician quality and the general public really can’t tell the difference. I have a close friend (my first call whenever something is going on professionally, I need advice about), and she is constantly frustrated by a mutual acquaintance, someone who washed out of our graduate program but is now suddenly everywhere. Media interviews, “expert” panels, social media, etc.
This person is… an interesting case. I like them personally, they’re entertaining, but they’re not a serious clinician (not bad, but also not the best). Yet somehow, they’re getting all this credibility and attention for “expertise." It used to be baffling, and then it clicked for me:
They are proof that doing something is better than overanalyzing and planning nearly every time. They don’t overthink, they don’t wait until they have mastery, they just act and act confidently. And in a world where most people can't assess clinical competence, the person moving fast will always beat the person thinking deeply. As an aside, I find the fact that it bugs my friend so funny. This friend couldn't legally drink when we started our doc program. She has a thriving private practice. She's killing it and is the smartest person I know. So it's funny when something gets under her skin a little - especially when that person is a bit of a dunce.
I think what you’re saying touches on that old Supreme Court justice quote about the difference between pornography and art:
“You know it when you see it.” It’s the same with dyslexia. I just need to see how a kid spells and watch them read, and I can usually make a pretty accurate call. The testing is more about clarifying
how to help. I actually did my doctoral minor under one of the top dyslexia researchers in the world - their name is literally on tests that get used daily in most schools. And even they agreed with
you know it when you see it. The tests they publish are there to help reading specialists plan interventions and less knowledgeable clinicians avoid missing or bungling the diagnosis.
Autism, though, feels like it’s in danger of becoming a garbage diagnosis (if we’re not already there). Just like how the specific learning disability is now an elephant graveyard for all academic underachievement.
But let’s be real with autism: most of the time, you
know it when you see it. The testing can feel like going through the motions, but you do it because that’s what gets the kid access to services. You’re essentially testing in hopes of creating a document that both the underfunded state DD agency worker and the insurance pre-auth reviewer can understand and approve.
I also worry that the more we rely on tests, the more we start subordinating our own expertise to them. Tests are useful tools, but they’re not perfect - and they can be misused pretty easily. At the end of the day, it’s still about the clinician. How much in testing do we outsource the intangible meaning of what it means to be a good clinician? All to assuage or reduce anxiety by hiding behind data.