COMLEX 2015 Score discrepancy *Poll*
Started by pathologyDO
Thanks for the votes guys! So far it looks spread out all across the board
Keep it up guys, the more votes the more our data will better represent how we have been scoring this season!
Ok so we're getting a decent amount of voters but I'm having trouble keeping the thread high in the forum list. If you wanna see larger results please comment in the thread, otherwise I'm just gunna have to let it die. Thanks!
First before I say anything, I do realize the sample size collected so far is relatively small (32), and I don't know about the COMSAE's usual effectiveness for predicting COMLEX scores in past years, nor do I know if they even claim that it is a close predictor. I remember the NBME stated somewhere how close students generally perform on the USMLE in comparison to their exams.
That being said, I'm very confused by this data so far. Small sample size (32) yet you can see that 24 voters, or 75% scored +/- 50 points or more on their COMLEX phase 1 than their average COMSAE. This seems like a huge problem to me because the COMSAE is supposed to be to the COMLEX as the NBME is to the USMLE (right?), and what I mean by that is you should be scoring close to your COMSAE average on the COMLEX (I think).
This is my opinion, but if I were to think the COMSAE accurately predicted COMLEX scores, a majority of people would score somewhere near the +/-25 pts place rather than so far from their COMSAE averages as seen so far in this data. Does anyone know if the COMSAE actually states anywhere how close their practice tests are supposed to predict the COMLEX?
That being said, I'm very confused by this data so far. Small sample size (32) yet you can see that 24 voters, or 75% scored +/- 50 points or more on their COMLEX phase 1 than their average COMSAE. This seems like a huge problem to me because the COMSAE is supposed to be to the COMLEX as the NBME is to the USMLE (right?), and what I mean by that is you should be scoring close to your COMSAE average on the COMLEX (I think).
This is my opinion, but if I were to think the COMSAE accurately predicted COMLEX scores, a majority of people would score somewhere near the +/-25 pts place rather than so far from their COMSAE averages as seen so far in this data. Does anyone know if the COMSAE actually states anywhere how close their practice tests are supposed to predict the COMLEX?
You would think, but it's not. For the most part the NBMEs (or their averages) are pretty damn close, like +/- 5 points. I've never heard of the COMSAEs being accurate at all. There is just too much randomness in the COMLEX for that to happen.
OK I tried to look for trends in past years but wasn't very successful (didn't try that hard to look either). It amazes me that they can charge so much for a practice exam that gives you little idea of what the COMLEX will be like and with little predictive value. I'm not sure whether this is a COMLEX or a COMSAE problem. On one hand the COMLEX is so ridiculously lopsided to a few subjects that it would be hard for the COMSAE to make good exams to guide you with. On the other hand, this year the COMLEX had giant stems which was in stark contrast to what the COMSAE questions were like, so I don't think that the COMSAE stimulated real exam conditions even in that aspect.
I think a big confounding aspect is WHEN people took their COMSAEs. My A and B were nearly a hundred under my actual COMLEX, but they were almost 2 months out. My last one was a month out (C) and ended up within ten points. I think you'd have to account for when each test was taken to get a better representation.
Makes sense, but when people talk about their average NBMEs, that would also include exams taken months out and on that end we still see that average being near their USMLE. Now, if we did only consider newer exams I would venture to guess the data would show an even greater amount of students scoring well below their COMSAE average since we would only be considering the newer, higher scores and taking out the lower scores from further back in their study period.
But yeah I generally agree with what you're saying
Bump... Since we MIGHT get some scores back today.
