These scores are steeply curved. Someone who gets a 280 might have gotten just 2 or 3 questions more correct than the person who got a 270. Can you tell me that those 2-3 questions mean very much in the broad scheme of things?
Can you share some data to support your claims?
🙂
AFAIK neither FSMB nor NBME has ever released any actual information as to how the tests are scored. I am not even sure if every question has got equal weightage.
I had read a lot about online v/s offline NBME score correlations. What I had gathered was that offline forms were useless as different questions got you different points depending upon the difficulty level (how many people could answer it). (Again, these are speculations)
I think rationally speaking, the curve should flatten out at the top (if you plot knowledge or correct answers on the X axis v/s scores on the Y axis). If the scoring were that steep and if it were uniform then are you suggesting that you get roughly 2 to 3 points for each correct answer? That would require like 87 to 130 correct answers to get a 260 score. I think that's highly improbable.
If you ask me, then there's a whole lot difference between a student scoring 240 (56th percentile) vs a student scoring 270 (95th percentile) on Step 2 CK (mean=237 SD=21). (Note the percentile for 270 may be even higher, morey like 95-98 percentile because Charting Outcomes and SDN analysis of scores suggest that the score distribution may actually be positively skewed)
If a student scoring 95th percentile does not get favorable treatment over one scoring 56th percentile, I think we have a problem with the system. The country where I come from, parents would disown you if you scored 56th percentile
😀
I would appreciate if some fellows, attendings and PDs could shed some light on this.
(With my above arguments, I do not intend to undermine the screening and interview process. I fully support that a candidate needs to have a well rounded profile. Also that it's absolutely essential for the candidate to be a normal person so that he/she will be able to work in a team environment.)
PS And for the rumor about discarding people for scoring 280 out of suspicion that they might be complete weirdos - we have a saying "Whatever gossip goes around, at least some of it must be true." Well if any of it is true, then I have to say I've never heard such a dumb argument before. Going by that argument, people never should have let Einstein study physics.