codetype4/9 said:
One of the things you will notice is the high dropout rate of subjects in EBT studies. Are the people that remain in the study representative of the whole spectrum of the problem?
Your comment raises a good point...
While I'm not debating the issues regarding client barriers to treatment (high drop out rate; low SES) that occur in the EBT studies, I think it is important to recognize that in sound dissemination research, you target clinicians in "the real world." Usually you would compare the efficacy of an EBT with TAU (treatment as usual). The clientele at these agencies is what it is- as a researcher you don't influence that. And in the "real world," client drop-out rate is high.
This is a bit different than your "prototypical" (well funded) treatment outcome study in a research setting. Say the research designs a treatment of 12 sessions or so. Partipants must complete every session during a set period of time. Often times, partipants are reimbursed for participating in the study. Is the drop out rate lower in these studies? Ofcourse. Does that mean these finding are more clinically relevant??? NO.
Think about all of the benefits of treatment outcomes in a research setting:
*grant money supporting the training, clinicians, and in some cases, even the
clients
*a staff dedicated to this particular research project and its outcome (PIs,
psychologists, RAs, what have you)
*generally a staff that is trained in the same modality (say CBT)
*exclusion criteria- this one is huge- if you are doing a study to treat
childhood anxiety disorders, well what you will find is that the kids who
present with primarily with ADHD/ODD are out. How representative is this???
Now think about how this contrasts to the "real world":
*overworked underpaid clinicians
*typically not enough agency funding to train clinicians in EBPs
*supervisors/taff from a variety of theoretical backgrounds
*client barriers to treatment (e.g., low SES, single parent families, etc...this
would be related to the high drop-out rate you see in "real world" studies)
*complex clinical cases that you just don't see in the neat little research
studies with their exclusion criteria
So, we, as researchers/clinicians must exercise caution when analysing the validity of the results of treatment outcome studies done in the confines of a research setting. Results in research simply does not equal results in the real world- and for good reasons.
This topic generates a lot of interest for me... and I think it's vital that young professionals (and more experienced professionals) are aware of these issues. If anyone wants any additional information (citations, resources for more info, whatever) PM me. I'd be happy to discuss in greater detail.