Step 1 score - 5/10
Rank of medical school - 8/10
Clinical grades/AOA - 5/10
Research experience - 1/10
Personality/interest in field/interview performance - 9/10
total = 28/50
----------
Candidate 2: MD/PhD from top 25 med school, average grades, average step 1, good personality
Step 1 score - 5/10
Rank of medical school - 8/10
Clinical grades/AOA - 5/10
Research experience - 10/10
Personality/interest in field/interview performance - 9/10
total = 37/50
----------
Candidate 3: MD from top 25 med school, 1 year research experience with a publication, great clinical grades and AOA, great step 1, good personality
Step 1 score - 9/10
Rank of medical school - 8/10
Clinical grades/AOA - 9/10
Research experience - 5/10
Personality/interest in field/interview performance - 9/10
total = 40/50
These program rank lists end up coming down to hundredths of a point. In a field like medicine, where big programs may take 50 people/year, maybe the program is big enough for all 3 candidates. Smaller fields... maybe not
As you say, this may be typical for medicine or surgery, where they have to weight hundreds or thousands of applicants. In smaller fields it doesn't work this way at all. This may be useful for deciding WHO to interview, but it really breaks down after that... I will use similar examples for a real-world perspective in my department... Basically, any one of these applicants may get in at the exclusion of the other two based on specific examples.
Dude 1- FMG with good scores, is quiet, but not homicidal.
Step 1 score - 9/10
Rank of medical school - 2/10
Clinical grades/AOA - 1/10
Research experience - 4/10
Personality/interest in field/interview performance - 9/10
total = 25/50
----------
Candidate 2: MD/PhD from top 25 med school, average grades, average step 1, good personality
Step 1 score - 5/10
Rank of medical school - 8/10
Clinical grades/AOA - 5/10
Research experience - 10/10
Personality/interest in field/interview performance - 9/10
total = 37/50
----------
Candidate 3: MD from top 25 med school, 1 year research experience with a publication, great clinical grades and AOA, great step 1, good personality
Step 1 score - 9/10
Rank of medical school - 8/10
Clinical grades/AOA - 9/10
Research experience - 5/10
Personality/interest in field/interview performance - 9/10
total = 40/50
Real world additions...
Dude 1- may not get an interview. But it turns out he did a 6-month long reasearch project with one of the attendings in the department, so he gets one anyway. He's also an IMG who's already completed his residency but wants the bling from the US. Great step scores (as usual for IMGs who get in), and gets a 2 from the school which means you may have actually heard of it. Clinical grades and LORs are useless because you can't read Farsi or whatever.
Why they get in- they can be the workhorse for the entering class. Sure they did research and are interested in it... but the department wants him to do the gruntwork. Probably won't even get a fellowship in the department unless they are desperate. But they can get this guy outside the match, and they know what they are getting- someone who's already completed residency.
Why they don't get in- the guy is creepy/can't speak english/antisocial too many other, more impressive candidates.
Candidate 2-
Why they get in- Will be sought after as a future faculty member. The chairman may personally recruit him to get him involved in science off the bat. If he's truly interested in research and is good, that is $$ for the department and its reputation. This is clearly a different track than applicants 1 & 3. May likely get the "rank to match" phone call.
Why they don't get in- doesn't give confidence to the program that they want to stay in academics, hints interest in private practice. Why take this guy when there are better drones out there, who like doing gruntwork? May waffle at the direct communications with chair or other department heads. May be kind of a douche, and turn people off.
Candidate 3- why they get in- future chief resident potential. Everything about his resume is stellar. Will be highly ranked for their poteintial in serfdom. May get the "rank to match" call, depending on how many other excellent applicant like this are out there. May get fellowship of choice if they are really that good.
Why they don't get in- is a douche.
Not to demistify residency or anything, but the department will not hire you because you are super awesome. They will hire you because they need scrubs to do the work. If you show you can do that well, you will get a spot. In all reality, for major academic departments, candidates 3 & 2 will get a spot 95% of the time, provided they are not douche bags. They will be on different career tracks however. If you are candidate #2 and don't know if you want to do academics or not, you've just poisoned the well from which your strengh flowed (that's as poetic as I get). Candidate #1 is basically interchangable with 2-300 other people.