Evidence Based Medicine Insanity

This forum made possible through the generous support of SDN members, donors, and sponsors. Thank you.

pushinepi2

Bicarb chaser
15+ Year Member
20+ Year Member
Joined
Sep 15, 2001
Messages
262
Reaction score
2
Hey all. Let me first start with the necessary qualifiers:

1. I respect the wisdom of experience
2. Evidence based medicine has made major contributions towards redefining the current standard of care
3. Reviewing literature and quoting statistics does make you sound cool

That said, I think journal clubs have the potential to drive you insane. It is my non-randomized, entirely retrospective, and anectodal opinion that EBM correlates with schizophrenia. I'm fortunate to be at a program that values cutting edge research and places a high priority on interpretation of the literature. However, the sheer magnitude of information combined with several hundred different perspectives makes it difficult to achieve consensus on anything. As I've rapidly transitioned to actually making decisions (paramedic level decisions don't count because they're formuated on pre-existing protocol), I find frustration increasingly difficult to avoid. It seems that whatever the topic, there's data both supporting and contradicting the current and accepted standard of care.

To sidestep any BNP discussions for a moment, consider the risk-stratification of chest pain. There exists an imperative for ER docs to not only RULE out MIs but predict the occurence of adverse events within 30 days. Clearly, it makes little sense to discharge people if they're at risk of dropping dead in the next two weeks. Through troponins work well as markers of cardiac injury, they aren't good ischemic markers. Furthermore, newer research on cardiac catheterizations suggests that plaques can be both luminal and eccentric (involving the vessel wall). One study cited by our program director showed a "clean" coronary catheterization in someone with impressive main vessel disease as determined by intravascular ultrasound. Despite advances in biomarkers and chemistry, we still miss something like 2% of all MIs. Though a sizeable body of literature about cardiac injury exists, there is still much disagreement on the ideal, "rule out" protocol. Do we stress? Do we perform serial enzymes at Q3 or Q6 ? What about CT angio?

Consider that recent technology advances threaten to undermine our ability to interpret results! Our radiology dept recently took possession of 42 slice CT scanners. Now, everyone has radiological evidence of PE. What is clinically acceptable ? What millimeter of occlusion is considered clinically insignificant? These questions stem, I understand, from CTs obtained on YOUNG and generally HEALTHY trauma victims.

Just mention the word nesiritide to any emergency provider and cardiologist, and you'll get enough opinion to make your head spin. One article says, "Nesiritide is just as safe as nitroglycerin...." The same article, predictably, fails to mention that "safe" only refers to side effects experienced during treatment. Furthermore, there is no mention made of mortality data showing a statistically insignificant trend towards INCREASED mortality in patients recieving the aforementioned infusion. Glance at yet another masterful piece of work and read,"Nesiritide is safe and effective for use in the treatment of cardiogenic pulmonary edema." Then jump on over to MD consult and learn that the prestigious Eugene Braunward himself (of Harrison's Internal Medicine Fame) has just cautioned clinicians to limit BNP's therapeutic use to the very very ill. Just suffering from cardiogenic pulmonary edema only qualifies you as, 'moderately sick' I guess..

How do the more senior residents feel about this obsession with EBM? Since research is constantly in progress, how is it possible to keep up with recent advances ? How do you cope with the apparent contradictions in recommendations from respected expert panels? People are quick to rail against textbooks, but at least the information contained within them is usually more tried, tested, and consistent! I'm glad that our current generation of EPs will be well versed in literature review, but I find it increasingly difficult to formulate cogent therapeutic opinions in the midst of such variation. All too often, it seems that we current and future EPs are forced to make life changing decisions when faced with inadequate infromation, nonsensical histories, non compliant patients, and the threat of litigations. The trend towards EBM, in some cases, simply clouds the picture even further...

Not to mention that our specialty has something like the first or second highest payout rate of malpractice cases that are settled.

😡
 
lol. You have reminded me about the terrifying images Dr Mattu presents of pristine cardiac caths with HUGE eccentric plaques just begging to rupture and cause massive MI's on endovascular U/S. That presentation seriously scared me. "It's not if you will miss an MI dx but When will you miss an MI dx."
 
lol. as an intern, I feared, hated and loathed journal club. I scoffed at clinical research. I thought JC was exactly as you described. I mean, how dare people rip to pieces articles in the NEJM. Of course, as I am now preparing to apply for clinical research fellowship applications, and am now on 6 different large research projects, including one large on of my own, I have come to appreciate journal club and EBM. what is astounding is how LITTLE research that is WELL done is actually out there. That is why there is so much controversy. It doesn't meant htat all the research is useless, but that as you read the articles, you must be aware of the weaknesses, the faults, adn the pearls.

Very few people will argue with the validity of extremely solid research (eg ottowa ankle rules) however, constructing a study of this magnitude is phenomenally difficult and requires a very focused problem (vs SF syncope rules, which is a great study but deals with a much more complex issue than fx/no fx.).

EBM is great, but NO study should be taken simply because it is vaulted under EBM. And it is a great guidline, but still doesn't account for generalized gestalt.

Not to mention the legal ramifications of being versed in EBM.
 
Looks like there is a new aritcle in JAMA that relates to this discussion:

JAMA article story
 
sandg said:
Looks like there is a new aritcle in JAMA that relates to this discussion:

JAMA article story

Dude, that reference is freaking hilarious. Too bad the CNN website is not peer reviewed. LOL!!! Also, the latest NEJM has a, 'perspective' column on how Nesiritide, "isn't verified."

The irony never stops. During intern lecture today, we learned that..

"50% of patients with appendicitis don't have a white count.."
"50% of patients with appendicitis don't have a fever..."
"20% of patients with appendicitis don't have RLQ pain.."

These stats are so screwed up, they may have even referred to mesenteric ischemia. I was too busy trying to stop the CSF from pouring out of my ears to jot down the appropriate references. So, who the heck do you CT ? Answer: It depends on your clinical experience and gestalt. Thank god for the availability of the computed tomogram.

Another absolute favorite of mine is,

"The classic presentation of such and such illness only occurs less than 10% of the time..."

Or how about this one-liner to make opthalmologists irate:

"Just throw some tobrex into that eye. That facilitates healing of corneal mucosa..."

Roja made an excellent point about developing a frame of reference and appreciating the finer aspects of study design. Unfortunately, so much emphasis is placed on literature review that people are quick to adopt articles as, "the new cutting edge," or the future, "standard of care." It shouldn't be forgotten that medicine is PRACTICED by PEOPLE. Error, just like the common cold, is here to stay and will not intimidated by the latest salvo of references from JAMA.
 
How about an evidence-based study to prove the following:

'What we learn in residency is 50% correct. The problem is, we don't know which half...' 🙄
 
As quoted in our medical school lecture last year: "there is no evidence to date to prove that Evidence Based Medicine improves any quantitative measure (i.e. pt. outcomes) compared to anecdotal medical practices"
 
chuck deli said:
As quoted in our medical school lecture last year: "there is no evidence to date to prove that Evidence Based Medicine improves any quantitative measure (i.e. pt. outcomes) compared to anecdotal medical practices"

that quote is deliciously ironic
 
Don't forget that EBM can sometimes help to get RID of outdated practices as well.


For example, from a recent lecture on psuedo-axioms in medicine (ie great myths of treatment), our clinical research director did a lit search on some of this.

-treatment of strep throat to prevent Rheumatic Fever. NO EVIDENCE to support this.
-treatment of 'aspiration pneumonia' with aenarobic (aka clinda) coverage. NO EVIDENCE to support this. Not to mention several recent articles that have shown that there is actually no reason to do this.


So, EBM can also be used to counter (in the negative) many of the 'passed down oral' tradition type things. (especially those things that end up getting you a different awnser with EACH attending you work with.)

Journal club is an excercise to try and teach us (at least it should be) how to read literature quickly so that we don't swallow whole anything published into a journal. (think Cox-2 and HRT).

And it gets you chicks.
 
roja said:
And it gets you chicks.


I need you to elaborate on that. (gets out note book and pencil 🙄 )
 
roja said:
...EBM.. it gets you chicks.

I'm patiently waiting for you to cite some prospective, randomized, and controlled trials to support your interesting (and yet delicious) generalization!

Roja, your comments are well taken.. especially those about the often outmoded oral traditions. Like ghost stories by the campfire, many old attending assertions are little more than myths designed to keep the insatiable minds of medical students in a state of continual distraction. Its not that I have any objection to the pursuit of EBM; rather, I feel irony is one of its more CONSISTENT factors. I can remember an attending (IM) physician lecturing our medical team on an acute cardiac floor. Leveling his spectacles at the EKG before him, he commented about some foreboding ischemic changes: "Inverted T waves, especially in leads aVR, can yield important prognostic clues. An esteemed cardiologist friend of mine, published in some esoteric medical journal, confirmed the correlation between ischemia and inverted T waves in this particular lead..." My God, I thought... the hordes of patients with pathognomonic T waves in aVR that have been inappropriately dispositioned...

Here's another confusing moment in which the radiant light from EBM's torch was sorely missed... I was trying to get an HIV patient, who initially presented tachycardic, hypotensive, neutropenic, and febrile, admitted to the ICU. My request was summarily denied by the on call 'cross-cover' fellow. "If you can get your patient's blood pressure over 100 systolic, then I'll be quite comfortable with sending him to the acute medical floor.... push the fluids, follow his lytes, and I'll check back with you in three hours..." Roja, as an esteemed senior emergency medicine resident, I am sure you are aware of the confirmatory studies citing decreased mortality in patients who achieve this elusive goal??? My literature search on 'septicemia in the immunocompromised host with orthostatic hypotension and neutropenia' revealed that the risk of mortality drops 5,000 percent after their systolic clicks above 100.

I wholeheartedly agree that the EBM curriculum should train residents in the art of critical appraisal. Unfortunately, the practice of medicine is currently an uneasy marriage between science and art. EBM can be utilized as dogma, regurgitated as meaningless statistics, and then made into an effective device for the endless scrutiny of interns and medical students. I'm not trying to start any meaninful debate about the shift towards rigorous scientific examination. I simply enjoy the irony!

Off to prophylactially push lidocaine on MI patients and prescribe high dose HRT to post menopausal women for vaginal atrophy,

-PushinEBM
 
Well, sadly, I can only speak to the scant and rare fellow male residents we have in our residency but they seem to do quite well. And NYC is a tough market. It just all seem sso glam to be in the ER.

In regards to your obviously septic patient, the work on SIRS is quiet good (although by no means done). Key point being, these patients are often 5-6 liters down. And early aggressive hydration has been shown to decrease mortality. I have had our AC (ICU screener) try and tell me that they couldn't take the patient because they were unstable. I just laughed and said, well, thats why the patient is going to the ICU!!!!!!!!


I would guess that laziness is the culprit in that response, not EBM. when in doubt, ask them for the article.
 
pushinepi2 said:
Hey all. Let me first start with the necessary qualifiers:

1. I respect the wisdom of experience
2. Evidence based medicine has made major contributions towards redefining the current standard of care
3. Reviewing literature and quoting statistics does make you sound cool

That said, I think journal clubs have the potential to drive you insane. It is my non-randomized, entirely retrospective, and anectodal opinion that EBM correlates with schizophrenia. I'm fortunate to be at a program that values cutting edge research and places a high priority on interpretation of the literature. However, the sheer magnitude of information combined with several hundred different perspectives makes it difficult to achieve consensus on anything. As I've rapidly transitioned to actually making decisions (paramedic level decisions don't count because they're formuated on pre-existing protocol), I find frustration increasingly difficult to avoid. It seems that whatever the topic, there's data both supporting and contradicting the current and accepted standard of care.

To sidestep any BNP discussions for a moment, consider the risk-stratification of chest pain. There exists an imperative for ER docs to not only RULE out MIs but predict the occurence of adverse events within 30 days. Clearly, it makes little sense to discharge people if they're at risk of dropping dead in the next two weeks. Through troponins work well as markers of cardiac injury, they aren't good ischemic markers. Furthermore, newer research on cardiac catheterizations suggests that plaques can be both luminal and eccentric (involving the vessel wall). One study cited by our program director showed a "clean" coronary catheterization in someone with impressive main vessel disease as determined by intravascular ultrasound. Despite advances in biomarkers and chemistry, we still miss something like 2% of all MIs. Though a sizeable body of literature about cardiac injury exists, there is still much disagreement on the ideal, "rule out" protocol. Do we stress? Do we perform serial enzymes at Q3 or Q6 ? What about CT angio?

Consider that recent technology advances threaten to undermine our ability to interpret results! Our radiology dept recently took possession of 42 slice CT scanners. Now, everyone has radiological evidence of PE. What is clinically acceptable ? What millimeter of occlusion is considered clinically insignificant? These questions stem, I understand, from CTs obtained on YOUNG and generally HEALTHY trauma victims.

Just mention the word nesiritide to any emergency provider and cardiologist, and you'll get enough opinion to make your head spin. One article says, "Nesiritide is just as safe as nitroglycerin...." The same article, predictably, fails to mention that "safe" only refers to side effects experienced during treatment. Furthermore, there is no mention made of mortality data showing a statistically insignificant trend towards INCREASED mortality in patients recieving the aforementioned infusion. Glance at yet another masterful piece of work and read,"Nesiritide is safe and effective for use in the treatment of cardiogenic pulmonary edema." Then jump on over to MD consult and learn that the prestigious Eugene Braunward himself (of Harrison's Internal Medicine Fame) has just cautioned clinicians to limit BNP's therapeutic use to the very very ill. Just suffering from cardiogenic pulmonary edema only qualifies you as, 'moderately sick' I guess..

How do the more senior residents feel about this obsession with EBM? Since research is constantly in progress, how is it possible to keep up with recent advances ? How do you cope with the apparent contradictions in recommendations from respected expert panels? People are quick to rail against textbooks, but at least the information contained within them is usually more tried, tested, and consistent! I'm glad that our current generation of EPs will be well versed in literature review, but I find it increasingly difficult to formulate cogent therapeutic opinions in the midst of such variation. All too often, it seems that we current and future EPs are forced to make life changing decisions when faced with inadequate infromation, nonsensical histories, non compliant patients, and the threat of litigations. The trend towards EBM, in some cases, simply clouds the picture even further...

Not to mention that our specialty has something like the first or second highest payout rate of malpractice cases that are settled.

😡

Oh my god!! And to think I went into medicine for the girls, and then into EM for the real pretty ones! Oh my, Oh my, what have I done!!!????
 
Top