incorrect score reporting for step II CS

This forum made possible through the generous support of SDN members, donors, and sponsors. Thank you.

retroviridae

Senior Member
10+ Year Member
5+ Year Member
15+ Year Member
Joined
Feb 23, 2005
Messages
265
Reaction score
0
The USMLE website reported today that there was a problem with their software resulting in some people who passed CS being told they failed. This is posted elsewhere on this site. But the converse is that some who were told they passed actually failed. The USMLE website says few if any have been identified who would fall in that category, but I am now paranoid that I might be one of the few. I am sure there are a few poor souls. Why not me? I don't know if I barely passed the test, if I slammed it, or what. If they were to invalidate someone's pass, that means they would no longer be ECFMG certified, they would no longer have their residency spot, and as the test is I am sure booked from now until next fall, they would NOT be able to retake it in time for starting residency in June.

I seriously doubt I failed, but who knows?
This is so totally INEXCUSABLE on the part of the USMLE.

It makes me so f*ckin mad!!!!!!!!! 😡 😡 😡

And what do they say??? We are sorry and realize the gravity of the situation. No mesieurs/mesdames, you most certainly don't. Do we have any recourse? Nope. Nada.
 
one more rant and I will stop.

The waiting and worry over this stupid test never ends. I took the darn thing in September, but only got my results in the end of January. So the whole time I was interviewing I was stressing about whether or not I passed/could participate in the match. Now, results out. Matched. Just waiting for residency to start. And again, after finally being able to relax after so many years, AGAIN it starts.

😡 😡 😡

OK, I'm done.
 
Wow. This is truly an outrage. It's bad enough that the grading seems to be completely arbitrary, it's even worse that you have to wait for MONTHS to get the results, and add to this that the results may be INCORRECT when you get them...

It's a travesty.
 
retroviridae said:
The USMLE website says few if any have been identified who would fall in that category, but I am now paranoid that I might be one of the few. I am sure there are a few poor souls. Why not me?

Relax, dude. You have your passing score. The same laws of chance that explain why you don't routinely win the lottery (even the "Pick 3") will prevail.

-Skip
 
retroviridae said:
Don't knock the lottery ... that's my retirement plan! 😉

One of my good friends calls the lottery "a voluntary tax for stupid people." Personally, I think your medical career will work out much better for you. 😉

-Skip
 
This test is an absolute abomination. Even without such errors, the exam itself is based on a rather flimsy premise, and certainly does not merit the very hefty price. What's worse, the NBME has given virtually no feedback to those of us who failed and have made a point of refusing to review actual test materials as part of any score recheck. In other words, they have created an exam and a process that is totally opaque, arbitrary, and inscrutable to all but themselves. And, now that they admit to major scoring mistakes, my contempt for this dubious exercise has only increased.

I hope other students, schools, the AMA, AMSA, and the AAMC hold the NBME's feet to the fire. If the general consensus among fellow US med students is so entirely opposed to this exam (as I suspect it is), I don't see why we haven't been more successful in making the NBME more accountable. I, for one, would not be surprised if the test is scrapped altogether in the coming year or two.

Anyone else have thought to share?

Pardon the vitriol. But, at least I have the courage of my convictions.
 
😛
freefall said:
This test is an absolute abomination. Even without such errors, the exam itself is based on a rather flimsy premise, and certainly does not merit the very hefty price. What's worse, the NBME has given virtually no feedback to those of us who failed and have made a point of refusing to review actual test materials as part of any score recheck. In other words, they have created an exam and a process that is totally opaque, arbitrary, and inscrutable to all but themselves. And, now that they admit to major scoring mistakes, my contempt for this dubious exercise has only increased.

I hope other students, schools, the AMA, AMSA, and the AAMC hold the NBME's feet to the fire. If the general consensus among fellow US med students is so entirely opposed to this exam (as I suspect it is), I don't see why we haven't been more successful in making the NBME more accountable. I, for one, would not be surprised if the test is scrapped altogether in the coming year or two.

Anyone else have thought to share?

Pardon the vitriol. But, at least I have the courage of my convictions.

Well, it took from Flexner to Libby Zion for the Bell Commission's report to be enacted. Don't expect retraction of
 
Last edited:
El Duderino said:
Wow. This is truly an outrage. It's bad enough that the grading seems to be completely arbitrary, it's even worse that you have to wait for MONTHS to get the results, and add to this that the results may be INCORRECT when you get them...

It's a travesty.

Agreed.
 
I feel bad for those who were involuntarily withdrawn from the Match because of an incorrect failing score, which is what would've happened if you were an IMG applying this year. You could theoretically have set yourself back a year in your training all because of a scoring glitch, and through absolutely no fault of your own. What's the recourse for such folks? I'd love to know how the NBME is going to rectify that one.

-Skip
 
Skip Intro said:
I feel bad for those who were involuntarily withdrawn from the Match because of an incorrect failing score, which is what would've happened if you were an IMG applying this year. You could theoretically have set yourself back a year in your training all because of a scoring glitch, and through absolutely no fault of your own. What's the recourse for such folks? I'd love to know how the NBME is going to rectify that one.

-Skip

don't think this happened, because i don't think anybody that took it during these dates (after jan 10, right?) could have participated in the match anyhow....i know they allowed anyone who took it before dec 31 to participate, regardless of whether they recieved results by feb 23, but i don't think that the results would have been available, pass or fail, for those that fell into this later group...therefore, they would have been withdrawn from the match involuntarily regardless of the score.
 
I got a letter this morning from USMLE.
I had failed the Patient Note part.

A friend of mine got a phone call this morning saying there was an unfortunate accident and he HAD passed earlier. He had since repeated the CS.
They offered to reimburse his CS fee and travel expenses.
After he lost his residency and possibly a year. Plus he has visa issues.
Sorry we raped you, thank you for bending over, take a diaper wipe for consolation.

My score report went from COMPLETELY failing the Patient Note to being borderline fail. Now how am I supposed to know I am still a failure after the reassessment. Seems to me they would want to minimize the Fail to Pass corrections.

I called them and they said there have been 38 people who have gone from Fail to Pass. I think this was only at the Houston Center.
So I asked them if 38 people would go from Pass to Fail... she tried to bypass the question, but said they were trying to minimize those numbers and had not released those candidates statistics yet.

This exam is completely corrupt and in no way is it objective.
I hope someone sues the crap out of them.

EDIT: Only those reports reported between January 10th and March 3rd...
REPORTED... not TAKEN... so some of these people were completely affected Match-wise.
 
neilc said:
don't think this happened, because i don't think anybody that took it during these dates (after jan 10, right?) could have participated in the match anyhow....i know they allowed anyone who took it before dec 31 to participate, regardless of whether they recieved results by feb 23, but i don't think that the results would have been available, pass or fail, for those that fell into this later group...therefore, they would have been withdrawn from the match involuntarily regardless of the score.

It's actually phrased as people whose scores were reported during that period. So, using myself as an example, even though I took the exam in late Sept., my scores were only reported in late January. Many many IMGs in the match took the exam very early and had their scores held as they "accumulated enough scores to assure statistical validity" for the passing/failing mark! Hah! They should have spent more time looking at the software they use to create the scores. So yes, I am sure there are a poor unfortunate few who failed but did pass. They say there were only 33 people or so who actually passed but were reported as failed. So it doesn't seem like this was a major error in the system ... so assuming that 50% of test takers were IMGs (although significantly more of IMGs failed than US grads) maybe >16 of those were IMGs.

Again, inexcusable. After spending all that money to apply, interview, only to be yanked from the match by a computer glitch. Now they are delayed a year. And for programs that don't like you to have been out of school for more than a couple years, this is another year. Really, they just don't appreciate the problems this new exam has created.

I mean, several good programs wanted me to be ECFMG certified by their application deadlines. I said, I couldn't be because they were not releasing step II CS scores.
 
USMLE CS FAQ said:
Who was affected?

The problem potentially affects only those examinees who had a Step 2 CS score report dated January 12 through March 30, 2005. Within this group, the number of examinees whose overall outcome will change is small.

Simply brutal.
 
ok, the new FAQ posted on the USMLE website says that the problem was in matchig someone's patient note to the correct person. So it would seem that many people were affected, and the reason more scores aren't changing is that as most people pass this test, most score sheets, even if matched to the incorrect candidate would also have a passing grade. This actually makes me more worried than before because I thought the computer was just marking some sheets as lower than they should be. This means that the 38 who have had their scores changed from fail to pass will mean that 38 people who passed will most likely fail (although they have to factor in the SP's report along with the patient note). I wonder if they will notify everyone who passed that yes, you actually passed.
 
This is totally outrageous,I am scared as hell.As an IMG I have faced a lot anxiety over the whole residency affair and now that I have matched at my number 1 program and working towards the visa,this comes as a rude shock.Its clear that for the people whose status will change from pass to fail will be informed over a longer period of time.
Only time can tell,lets hope for the best!
 
serenity said:
This is totally outrageous,I am scared as hell.As an IMG I have faced a lot anxiety over the whole residency affair and now that I have matched at my number 1 program and working towards the visa,this comes as a rude shock.Its clear that for the people whose status will change from pass to fail will be informed over a longer period of time.
Only time can tell,lets hope for the best!

Do you really believe that there is a chance you failed? Seriously. I don't. I have my passing score. But, if in the miniscule chance that I was one of those unlucky SOBs who only thinks he passed, I will not rest until one of those idiots at the NBME gives me a detailed explanation as to why they're changing my score to "fail". I thought that test was so easy it was a joke - complete B.S. Collosal waste of time and, more importantly, money. I mean, it's bad enough they charge IMGs an additional $225 for that lousy test. For what? Now there's a chance that they're going to retroactively fail people? I think they just need to suck it up, let the people who got their passing scores (even wrongfully) keep them, and move on. Otherwise, they're going to end up in a lawsuit so huge that it will cripple the test... if they don't already after all of this.

-Skip
 
Top