All he's saying is that GPA isn't a good indicator of academic prowess... His goal wasn't to trash on Rutgers/VCU/Minnesota/Pittsburgh.
Surprisingly (even to me), I didn't really have
any agenda going into this. I just saw the question, had some (admittedly non-comprehensive and biased, see above). Combined with the knowledge of how to mash on said data, I figured I could demonstrate something that basically
everyone already knew about (Some schools have a different approach to grading than others). This was already a well known "problem" in dental academia, which is why many schools provide ranks, a some schools don't. Factually, the numerous discussion on ranked vs. P/F schools on this board sort of obviate the need to discuss different grading systems between schools, as there isn't anyone out there who considers dental school GPA seriously in terms of residency application. Except maybe your mom. Gotta get those facebook like for your precious peanut's 4.0 in dentist college.
...(especially relative to the NBME)...I know. I know. Armorshell didn't actually say that "the NBME is a good predictor of academic prowess"...but excluding the issue with P/F schools (& the 3 year school) it's the best we've got.
I definitely didn't actually say that, because I (and pretty much I alone as far as I can tell) firmly believe the NBME is probably a
worse predictor of OMS residency success than GPA, or any of the other metrics we have available to look at. This is due to this particular tests inherent problems with face and criterion validity, its poor reliability, and its misuse for comparing students given its criterion-referenced construction. Also, the simple fact that the test was constructed to validate a certain level of understanding in a standardized curriculum only a tiny subset of the test takers in the dental student group are exposed to.
Don't misconstrue this as advice to ignore the importance of a good NBME score to your personal application, since just about every program director leans heavily on these scores...for now.
GPA was always designed to be a euphemism for rank. Unfortunately, we trust the "good" undergraduate universities to inflate their students' GPAs to compensate for their students' valedictorian-caliber talent (but at least we check to see if they're abusing that trust via the DAT).
The problem with GPA, rank, NBME, DAT and all of these measures is they rarely measure what the interpreter is actually looking for. PDs are all looking for different things in residents. Some are looking for intrinsic motivation, some for stability, some for academic or scholarly ability, some for clinical prowess, and so on and so forth. Rarely is a PD looking for "your ability to rail adderall, pump and dump a couple of study guides worth of biomedical data mostly unrelated to the field, then expertly take a multiple choice test." The problem is there are just too many factors involved to reliably test for the
actual traits you're looking for, and there it's extraordinarily rare to find any evidence, in any field, of such a test. This even includes
interviews.
Personally, I'd love to know how well rank indicates academic ability (or more specifically, how well does rank indicate NBME performance). Both Pacific and Meharry are in the deflated group. Is 50th percentile at Pacific equivalent to 50th percentile at Meharry? We know that their average pre-dental scores aren't equivalent on day 1.
In conclusion, thank god for the NBME. Next step: make all dental schools P/F.
From the same dataset (excluding all unranked schools for obvious purposes), the R=0.25 for rank to NBME. That value lies on the border between a weak and mild correlation, indicating
only that the majority of variation in NBME scores is not explained by rank (or
vice versa). Using the NBME as a "correction factor" for rank, would require you to assume that all the problems with the test which I mentioned above do not exist.
In effect: