A
AnatomyGrey12
Advertisement - Members don't see this ad
What is "soaping"?
The process where unmatched applicants try to find a residency position.
Use all the free resources available to you from SDN: articles, guides, expert advising, forums discussions, and school research.
What is "soaping"?
I agree that expanding this to the 9 most competitive residency would make it more accurate. But the DOPEN creator did indicate they were not including some of them because they were deemed to be lesser in total percentage. What is here in DOPEN does seem to speak to the fact that certain UGME medical programs would seem to expose students to these residency options and support their students to apply. Selecting a specialty is often the product of what they are able to see during their clinical years in med school. I can tell you that some of the newer med programs have risen to be consistently in the upper quartile nationally based on NBME 3-year data related to the categories of research, Step 1, Step 2, and altruistic activities. That means that some that were traditionally always in the upper quartile are no longer there for the UGME programs. Could this also be true for the residency specialty rankings? It is just a question; pure speculation on my part, and something that is not in my wheelhouse to speak deeply about. But things certainly are changing.Doesn’t even include the most competitive specialities like IR, urology, ophthalmology. Just laziness and makes it more useless.
I wouldnt trust a single bit of data from the spreadsheets my dudeThe IM spreadsheet at least always has a section on the average ROL placement of institutions for applicants who ranked them on the spreadsheet that year and then an ad hoc ranking. That might actually be more useful than doximity because it reflects the preferences of actual students instead of peer institutions
This is probably a silly question, but what are the t5 academic centers? Are they just the US News top 5? Or something else?These people are outliers, the vast majority of t5 med classes are aiming at big academic centers
I have done exactly this on a small scale for a few schools that some accepted students were deciding between (I.e., Case, Einstein, and Emory; little to no difference in students matching top 15 research-based IM programs over 4-5 year average).Interesting chart! More than 60% of people with a 250+ select a less competitive specialty however, so for trying to read a match list, you'd really have to look into where people were matching in big fields like IM
I've always been too lazy to do it, but someone could in theory put together a rank list assessment that looks at how many people land in the "top X" programs in their specialty. It will probably be the same group of big research centers that overperform the average, but would be interesting to quantify the advantage
Interesting, although I think your conclusions are too drastic.Adding to the data identifying match rate by generally perceived school rank, this paper just came out in the Laryngoscope:
Error - Cookies Turned Off
onlinelibrary.wiley.com
View attachment 333608
I find it very telling that for applicants applying to ENT, top 25 medical school rank was the only major objective factor that statistically increased odds of matching (if one took a research year). The analysis from OP indicates there are plenty of non top 25 schools that are associated with good DOPEN match rates, but that analysis combined with this one still point towards a institutional bias for traditionally competitive fields.
You are misinterpreting this analysis. Did you read the figure legend before you took the screenshot? lolAdding to the data identifying match rate by generally perceived school rank, this paper just came out in the Laryngoscope:
Error - Cookies Turned Off
onlinelibrary.wiley.com
View attachment 333608
I find it very telling that for applicants applying to ENT, top 25 medical school rank was the only major objective factor that statistically increased odds of matching (if one took a research year). The analysis from OP indicates there are plenty of non top 25 schools that are associated with good DOPEN match rates, but that analysis combined with this one still point towards a institutional bias for traditionally competitive fields.
This has probably already been mentioned in this thread but the concept of DOPEN matches as a reliable indicator is silly to begin with. An ortho match at a community program that barely hits the minimum ACGME case numbers is not nearly as impressive as a general surgery match at MGH or a peds match at CHOP.Also if you look on a more granular level at DOPEN matches at places like Stanford and Columbia, they tend to be at highly ranked programs within the specialty.
You are right, but it is even worse. I dug more into the paper. It actually boggles my mind that this was published, even with the goals they were aiming for.You are misinterpreting this analysis. Did you read the figure legend before you took the screenshot? lol
All this is saying is that for people who go to a T25 medical school, research year vs no research year correlates with matching. For any other sub-group, research years don't seem to matter. This is NOT saying that going to a T25 "increased odds of matching (if one took a research year)." Attending a T25 is constant between the two groups, the variable when calculating the odds ratio is research year or no research year. They would need to compare match rates for top 25 vs >25 to make the conclusion that you made, but they didn't do that in this paper. I mean...what they are studying is literally in the title of the paper..."Impact of Medical Student Research Fellowships on Otolaryngology Match Outcomes". This is only talking about research fellowships.
I would be happy to do a similar match list analysis on a larger scale, if there is interest in such a thing. I am not sure if it would help with the toxic “top” culture on the site, but it would at least make it more accurate (based on data, rather than hear-say).
It would probably put to bed the "match lists = tea leaves" sentiment I see frequently. It's hard for a premed to read a match list cold, but tell them "this school puts people into Top 10 programs in medicine/peds/surgery/etc 5x as often" and that's information they can actually use for decision making.I would be happy to do a similar match list analysis on a larger scale, if there is interest in such a thing. I am not sure if it would help with the toxic “top” culture on the site, but it would at least make it more accurate (based on data, rather than hear-say).
Again, why does having “higher than expected DOPEN” matter? You cannot account for personal preference when it comes down to it. Cool exercise, VERY limited utilityI added and updated some data. There is a pretty clear trend where most established private med schools have higher than expected DOPEN match rates. I wonder how things look if I separate them by public/private. I am still not finished with 2019 data and definitely am missing quite a few schools but my next update will probably not be soon. I will be revamping the spreadsheet so that will be updated next time.
Majority of AOA in my class went into IM, Radiology and PedsAgain, why does having “higher than expected DOPEN” matter? You cannot account for personal preference when it comes down to it. Cool exercise, VERY limited utility
Exactly. I know several top of the class rockstar types who went midwest rural FM. Maybe cuz I’m a lowly DO school grad (soon at least)Majority of AOA in my class went into IM, Radiology and Peds
Majority of AOA in my class went into IM, Radiology and Peds
Again, why does having “higher than expected DOPEN” matter? You cannot account for personal preference when it comes down to it. Cool exercise, VERY limited utility
I don't disagree with you. I more am putting that out there for people who just scroll through and get the wrong idea about things. Its rampant in the pre-med and preclinical community. Like I said, super cool idea I wish it was more generalizable and there was a way to account for people getting top choices and all that but that's under lock and key unfortunately. I feel like people getting top 3 choices sorted by specialty gives you a real good idea of how well people match from a school and accounts for their interests as wellTo some, it does not matter. Even for those who are going into these specialties, I think it is more like a history book and not the rule book. But I can make the analogy of becoming a med student from college. Majority of the top of my undergraduate did not go into medicine (engineering, business, tech, research, etc). It was personal preference as to why they didn't go into medicine. Still, I believe medicine to be competitive and knowing the number of premeds that eventually become med students would be nice to know information even if I would not solely use it for deciding my undergraduate.
Similar sentiments as @Chibucks15, and this is coming from someone who was DOPEN 100% in medical school and just matched. After going through the process I do think a better metric would be knowing how people do on their rank list, but even this will vary a lot by yearTo some, it does not matter. Even for those who are going into these specialties, I think it is more like a history book and not the rule book. But I can make the analogy of becoming a med student from college. Majority of the top of my undergraduate did not go into medicine (engineering, business, tech, research, etc). It was personal preference as to why they didn't go into medicine. Still, I believe medicine to be competitive and knowing the number of premeds that eventually become med students would be nice to know information even if I would not solely use it for deciding my undergraduate.
If you were choosing colleges, would you rather know the percent choosing medicine, or the percent getting into a top 10 program in their chosen field (JD, MD, PhD, MBA, etc)?To some, it does not matter. Even for those who are going into these specialties, I think it is more like a history book and not the rule book. But I can make the analogy of becoming a med student from college. Majority of the top of my undergraduate did not go into medicine (engineering, business, tech, research, etc). It was personal preference as to why they didn't go into medicine. Still, I believe medicine to be competitive and knowing the number of premeds that eventually become med students would be nice to know information even if I would not solely use it for deciding my undergraduate.
I personally chose based on the football team and college life but that's why I needed a gap year I guess 🤣If you were choosing colleges, would you rather know the percent choosing medicine, or the percent getting into a top 10 program in their chosen field (JD, MD, PhD, MBA, etc)?
I'd want to know the latter
If you were choosing colleges, would you rather know the percent choosing medicine, or the percent getting into a top 10 program in their chosen field (JD, MD, PhD, MBA, etc)?
I'd want to know the latter
Oops, looks like the class size was wrong. It should be 120 instead of 50. Thanks for having me double check that. The percentage is about 6% and not 14%. I will update that after the weekend.
I have done exactly this on a small scale for a few schools that some accepted students were deciding between (I.e., Case, Einstein, and Emory; little to no difference in students matching top 15 research-based IM programs over 4-5 year average).
Also, for those interested in a serious career in academic medicine, I usually point to the Doximity collaboration Paper published in “Academic Medicine” that analyzed the long-term career performances of 600,000+ graduates, and presented a T25 list based on career outcomes (rather than “student selectivity” scores, and other gameable nonsense):
![]()
What Makes a Top Research Medical School? A Call for a New... : Academic Medicine
ised the quality of medical education, the educational processes that produce the physicians who provide the best patient care and conduct the best biomedical research have not been identified. Comparative analyses are powerful tools to understand the differences between institutions, but they...journals.lww.com
I would be happy to do a similar match list analysis on a larger scale, if there is interest in such a thing. I am not sure if it would help with the toxic “top” culture on the site, but it would at least make it more accurate (based on data, rather than hear-say).
I assume you are talking about the Academic Medicine paper?This is interesting, and does seem like it would help account for school size vs total funding which is naturally tilted towards schools with more faculty members. However, the issue is that it's essentially a composite ranking of the school over the last 30+ years, whereas school quality and reputation change more quickly than that.
To play devil's advocate, it's an awful lot of coincidence that different metrics all favor the same couple dozen schools.I assume you are talking about the Academic Medicine paper?
Their main table shows the accumulated average over 60 years, but they also show the trend in school outcomes over ten-year increments (though only for a few schools; UCSF grads really suffer a decline, while other schools gradually rise up).
I would argue that reputation for institutions remains rather stable (or increases over time for the top; see explanation below), and taking graduate outcomes for 600,000+ students across time shows a more accurate representation of that reputation.
On the other hand, I agree - school quality does absolutely change on a short time-scale basis. Reputation doesn’t, mainly because of the “Matthew effects” - the notion that reputation is a positive feedback loop for those at the top; you need to reach a certain threshold to receive the benefits of the effect, but once you do, you have to do little to snowball the increase in your reputation. It self-propagates.
In either case, the main model people refer to today (US News) completely fails to capture med school quality (or changes to curriculum/student outcomes) at all, and their survey of “reputation” is abysmally inaccurate (over 70-80% of Program directors they send their surveys to throw their mail out, and they don’t care to correct for uneven distribution among specialty/region out of the small sample of PD’s that actually humor them.
It’s a statistician’s nightmare; a completely subjective parameter, collected in a horrifically deficient manner. The minimum threshold of confidence for such surveys, most agree, is 70%; go to 50%, and you have them clenching their teeth, and adding a Shakespearean amount of qualifiers to their result statements. Drop down to 20%, and they either laugh or cry - usually both, with vodka - when the public actually somehow “believes this crap”).
Anyways, my $0.02. While imperfect, I think that the paper presented the best measure, by far, of gauging med school’s overall quality in a way that would incentivize schools to produce better academic physicians rather than attract a 0.05 point difference in GPA and 2 point difference in MCAT of applicants to shoot up 20 rankings (I.e., see NYU). It would also tell applicants what school would likely offer them the best environment for them to succeed the most.
ok, maybe my $0.03
But here lies the “chicken and egg” problem. Top students - on average, but certainly not always - are attracted to top schools, which in turn benefit off of the top student’s success, which help propagate the school’s reputation. A la’ Matthews effects.To play devil's advocate, it's an awful lot of coincidence that different metrics all favor the same couple dozen schools.
If I want a med school with the most academically capable students - it's the "top 20" that hold higher MCAT/GPA intervals. Alternatively if you want the most impressive achievements - Rhodes & co winners, authors published in Nature level journals, professional level athletics, etc they're more common at top ranking schools.
If I want a med school with the most research funding, or research activity/awards, or easy funding for student projects, or with built in research time - it's the top 20 that boast these.
If I want a med school with, on average, the strongest affiliated residencies, it's top 20 university hospital systems.
If I want a med school with the most research funding, or research activity/awards, or easy funding for student projects, or with built in research time - it's the top 20 that boast these.
If I want a med school with, on average, the strongest affiliated residencies, it's top 20 university hospital systems.
If I care about my grandma being able to brag to strangers, the schools everyone recognizes are well ranked.
If I want the best financial package- full demonstrated need, or even merit packages- these are more available at the high endowment well ranked schools.
US news and doximity are flawed, but
I think your main gripe is that they call it a research ranking while adding in a lot of non-research factors (reputation, selectivity). Pretty much nobody is actually reading it to see where the funding goes.I would also like to add that this principle is ridiculously misguided, and bears no resemblance to reality. The “top 20” contrivance is constantly thrown around, with little to no effect on students or institution.
Do you know which schools made the cut of “top 20” for US News? Uchicago is one of them. Do you know which didn’t? Emory, Einstein, Minnesota, UC-Denver, UAB, and Case, among others. Would you then reasonably expect that Pritzker had way more research funding, PI’s, opportunities than this group - who were ranked lower in the research category? I certainly would.
I find it strange, then, that all of these schools (and others) had greater funding than Pritzker, including Emory, who had nearly twice the funding that Chicago did, and over 100 more PI’s than it (I hold no bias; not a student there).
Why would this be the case? Probably because the average MCAT is 1-2 points higher at UChicago than these other schools, and the 20% of distribution of medical school directors and PD’s that didn’t throw their survey out were those who were in the general region/speciality that favored Uchicago.
Pritzker is a wonderful school, by the way, and in no way am I trying to denigrate it. But are Emory, Colorado, etc. also wonderful schools with equal or greater opportunities and research strength? Absolutely! I just use them to show how deeply flawed this system is.
In my opinion, we really should have never given credibility to a magazine company to evaluate medical schools in the first place.
Not exactly (and also want to bring up that this is a larger response to viewpoints I’ve heard; not yours alone).I think your main gripe is that they call it a research ranking while adding in a lot of non-research factors (reputation, selectivity). Pretty much nobody is actually reading it to see where the funding goes.
Top 20 is a loose number. I bet if you look at the first 25 compared to 25-50, the average funding (per capita or total) is markedly higher. It's all a gradient, but "top 20" is a useful shorthand.Not exactly (and also want to bring up that this is a larger response to viewpoints I’ve heard; not yours alone).
I brought up the funding because you mentioned the research funding/opportunities available in the top 20. The truth is that they aren’t that different (and for some, lesser) than the ones that are left out of that group.
Regarding reputation - it’s subjective, so it’s messy. But if it’s used, it should be at least accurate. It’s far from that.
student selectivity as a metric, I feel, should be thrown out completely. It’s too gameable, and offers no description of the actual teaching provided by the school. What’s more, the difference in the scores across what they define as the top 50 schools are so small that schools easily experience a massive boost from just a small increase in their class’s stat averages (on one end, you see 3.8 and 516; on the other, 3.9 and 518. That’s an A rather than A- in a few more undergrad classes, and 1 extra point on two MCAT sections).
I have looked. The funding/PI follows the same trend for most programs over the past 15 years (Blue Ridge Institute for Medical Research), with some outliers, but the outliers are actually outside of the US News “T25” (Programs with slightly less faculty getting more funding, like Case. Several of these programs also are very successful in securing F30’s to their MSTP students).Top 20 is a loose number. I bet if you look at the first 25 compared to 25-50, the average funding (per capita or total) is markedly higher. It's all a gradient, but "top 20" is a useful shorthand.
Reputation may be subjective but it's been remarkably consistent across the years. Schools budge like 0.1/5 per year or don't change at all.
Student selectivity mattered to me. I'm sure it does to others too. If it's easy to game, where are the mid tier programs with 520 medians? High stats people with their choice of multiple programs tend to gravitate towards the same places, and being in a class full of remarkable minds is an appealing part of choosing one of those places.
Oh that sounds juicy, please share the examplesI have already found several examples of high-ranking schools producing match lists worse than those much lower rank by US news standards
The mid tiers are currently already doing their best to maximize their metrics. They can't get as high because too many of the high scorers prefer to usual suspects at the top of the rankingsI assume you are asking why there aren’t mid tier programs with 520 MCAT scores? It’s a circular question - if they do have a 520 (or close) score, they are way more likely to be higher in ranking. And if they are already higher in ranking, they are more likely to attract students (like yourself) that keep the average inflated, and thus your perception of them would be “top tier”, not “mid tier“ or whatever elitist bs people are saying these days.
Anecdotally, I had scored a 520+ on my MCAT when I applied. Did this make me smarter than my colleagues that scored 1 point lower in a couple of sections? It’s absolutely ridiculous to think so. You would find many gifted minds just as easily at a school with 516, just likely less people that had the extra $3000 from their parents lying around to pay for prep courses (granted, not what I did, but a very common strategy).
I feel like it would be self-defeating for my purpose. My point is to highlight that the rankings don’t really matter. If I can’t convince others here to believe that, I at least wanted people to more accurately identify schools that would help students more easily enter a career in academics. But now, I’m seeing that any discussion on it just becomes a petty contest to see “which is better”. if I identify schools that match better at “top” residencies, I inherently accept the same principle, but for the next step in the career path, and just highlight some other institutions to make them look better, while making others look bad (which is just the opposite of my goal...)Oh that sounds juicy, please share the examples
The mid tiers are currently already doing their best to maximize their metrics. They can't get as high because too many of the high scorers prefer to usual suspects at the top of the rankings
Idk what to tell you other than the people I've met at my med school were far and away the most impressive crowd I've ever been a part of. Maybe a rank 100 U of State is the exact same...maybe not.
I'm really skeptical of your claim, this feels pretty confirmatoryI feel like it would be self-defeating for my purpose (and the way you phrased “juicy” just skeeves me out).
Fair enough. Ranking doesn't matter unless you care what's being ranked. If someone cares about a weighted assessment of reputation, selectivity, and research funding it's a useful tool. If someone wants to find their best fit and doesn't care about those things, then it's not.My point is to highlight that the rankings don’t really matter. If I can’t convince others here to believe that, I at least wanted people to more accurately identify schools that would help students more easily enter a career in academics. But now, I’m seeing that any discussion on it just becomes a petty contest to see “which is better”. if I identify schools that match better at “top” residencies, I inherently accept the same principle, but for the next step in the career path, and just highlight some other institutions to make them look better, while making others look bad (which is just the opposite of my goal...)
Anyways, I don’t want to derail the thread further. The best school is the one you get in where you feel you’ll be happiest (and for 80% of us, that choice is quite simple)
Our mission is to provide students with free, unbiased information, resources, and advising for careers in the health professions. We believe every student deserves access to trustworthy guidance, regardless of background or ability to pay.