- Joined
- Jul 21, 2002
- Messages
- 158
- Reaction score
- 0
Rumors, facts, ideas? Lets hear them. I have no idea what goes into ranking applicants post interview except a random number generator.
Poety said:I meant to ask for replies from someone who may actually have served on the recruiting committee or has been involved in the process to respond - I'm personally just interested in seeing how this whole thing really works behind the scenes. I think there are people on here that have actually participated in the match as a reviewer or served on the recruitment committee. Everything else is just speculation and/or common sense.
BKN said:As for the goofy numerical system, how else will you get agreement out of 100+ interviewees? In my place we make a provisional list from the numbers and then have a match party where each interviewer can make a pitch to move their favorites up and their concerns down.
BKN said:In my place we make a provisional list from the numbers and then have a match party where each interviewer can make a pitch to move their favorites up and their concerns down.
asdfaa said:I wonder, does the program director's "pitch" blow all other "pitches" out of the water? Let's say you have three interviews. Two interviewers like you a lot but the PD isn't so fond. Are you hosed?
Poety said:Ok, I'm confused about this number system. Do you mean the scores? Like you take all the applicants, invite for interview, then after interviews just take the grades/scores and the highest get ranked?
Is this whole process based on a numerical system worked out with grades and scores? YiKeS!
BKN said:No. I score the interviews, LORs, Dean's letters, MLEs, and transcripts. I standardize the interviewers so that those who meet with a tougher interviewer are not at a disadvantage. We also look at interrater reliability (Cronbach's alpha = .73 last year). We then weight the variables according to a secret formula, make a linear combination and standardize again. We then rank the applicants and that makes our provisional list. Then we talk.
I know it's clear now. Anyway, that's all I'm going to say about my shop. Aren't you glad you asked?
By the way, did I mention I've got a master's in research and stats?
ears said:.
May I ask why you are reluctant to share details of the process? Are you afraid of applicants "gaming" your system? Or is it something else?
BKN said:Well this is one I'm not going to enjoy. First, I described our process in some detail (perhaps more than I should) as an example. That doesn't mean others do it the same way.
Again, it's probably individual by program and by the PDs mood that day. Ultimately, the ACGME requires the the PD have total authority over the program. That's for your protection. It makes him accountable and it discourages the institution from using you for pure service. So yes the PD could do that.
Here's the part that's going to make you paranoid. At our place we assume every candidate is on their best behavior. Thus a significant interpersonal problem with any interviewer may be a red flag. Thus if a single interviewer wants to black ball, they can. We always discuss it. Probably happens less than once a year.
Any answer to this question has serious potential to mess with people's heads. If BKN says yes, then people will be questioning their ROL's, possibly not ranking in order of preference, thinking about where the programs are ranking them based on what the program thinks they are thinking. If BKN says no, we will doubt his answer.asdfaa said:When assigning ranks, do PD's take into account how likely they think the candidate is to choose their program.
orientedtoself said:Any answer to this question has serious potential to mess with people's heads. If BKN says yes, then people will be questioning their ROL's, possibly not ranking in order of preference, thinking about where the programs are ranking them based on what the program thinks they are thinking. If BKN says no, we will doubt his answer.
AngryTesticle said:Conversely, if you have not so strong stats but interview very well and people think that you are a great fit for the program and you're easy to work with, then you will be bumped up pretty far on the rank list.
BKN said:Oh goody! I think I'll say yes and no!
I have in fact heard it done both ways by other PDs. The thinking is:
1. Any PD wants his residents to be happy to be where they are.
2. Every PD has had the experience of not matching an applicant who was above the PDs bottom match and who had said that the program was his first choice. Most of us have had this experience many times.
I don't think there is any harm in telling a PD that you really want to match with him. It's likely that while being polite, he'll be a little cynical.You can't force the match; neither can he. The maximum happiness for everyone probably comes from both sides ranking honestly.
As for the big name grad going to a community program, I'd totally believe it.
I'm from a big name school and a bigger name residency. I'm at a smaller Univ hospital which I love and believe we are doing a better job than the big places. Of course that's just me and everybody knows I'm delusional.
My residency coordinator just went through. It was our third interview day and she wants it to be over.
deuist said:The American Association of Emergency Medicine prints a book entitled Rules of the Road that goes into detail about how residency programs rank applicants (for EM, at least). The top factors were:
1. EM rotation grade
2. Interview
3. Clinical grades
4. Other (e.g., prior training, leadership)
5. Recommendations
6. Grades overall
7. Elective work
8. Boards overall
9. USMLE Step II
10. Interest expressed (e.g., research within EM)
11. USMLE Step I
12. Awards
13. AOA
14. Medical school attended
15. extracurriculars
16. Basic science grades
17. Publications
18. Personal statement
Methyldopa said:Interesting list. I'm suprised to see personal statement so low!
.
misfit said:Many people will give you varying ideas on how applicants for residency are ranked, but here is the dirty truth:
It is NOT one factor, but a combination of factors such as...
1) Smile
2) The talent portion
And most importantly...
3) THE SWIMSUIT COMPETITION!
Re: Talent
Better to do a nice, well known ballad, say Danny Boy, or an up tempo pop song like YMCA?
As for the swimsuit competiton, it does make me feel cheap, but I do love the feel of silk in a psych. ward in the afternoon. BTW, Panda Bear I bet you totally rocked the swimsuit competition.
mlh25 said:In my experience (9 interviews in) just about anyone on a good day can BS an interview. I mean, interviews are only max 20 min (surg subspec). You'd have to be pretty dsyfunctional not to behave for 20 min. I think the interview is important but most interviewers seem to have a pre-conceived notion about the candidate from their application. If your application is good, it's really up to you to screw things up. Most people behave as if they want to like you. It's not like you walk into the room with a complete blank-slate after getting an interview.
Most doctors are not very skilled at job interviews and most medical students have had plentty of experiences BS'ing through standardized patients etc.. I think that the interview is really pretty useless unless you have big wholes in your application that need a lot of explanation (which by the way is not the way to put together an application, in case someone hasn't realized this yet.)
BKN said:My experience is about 900 resident applicants and 200,000 patient interviews. I'm with Prefontaine on this one. You may not be aware of how you're doing. You also don't seem to be aware that a clinician's first and most important job is interviews.
Certainly, I want to like every applicant. When I don't, I'm certainly not going to tell them.
Most of the posters on this forum seem excessively worried. You don't seem worried enough. Unless you're just covering it with bravado.
mlh25 said:Why exactly should I be worried? Maybe I would if I had something to hide but I really don't. So in effort to make this less personal... I understand that clinicians are trained at "interviewering" but assessing someone's professional qualifications for a job is not the same thing. Not even close. For example, do you even know or understand why certain questions are off limits /illegal? I can't even tell you how often I am asked these questions. As someone who in a different life had a different career, I can tell you that this would not stand in any other profession. Not that I mind answering these questions myself but it just goes to show that most clinicians/ academics have no idea what they are doing.
I'm curious why you are seeking to scare everyone on this forum. Isn't the point to find the candidate that "fits" the best with the program? If you're asking me personally, I think I've done pretty well in interviews just being myself, and so will most everyone else. I'm not exactly sure why you want candidates to be anything but themselves.
If you ask me, you're the one with too much bravado
One more thing...it amazes me as to how much I didn't know about my program when I came to interview here. I had to take a step back to think and realize that based on a one-day interview (or even a half-day interview), it is so very difficult to form solid and accurate impressions of a place as an applicant. Now, let's flip the looking glass in the other direction and look from the perspectives of those who are in the position of choosing one candidate over another. I can imagine that here too it can be hard to accurately evaluate an applicant. Frequently, the interviewer/evaluator forms some impressions but probably has to fall back on the documented paper application.trkd said:are you just as likely as the next to get ranked highly if you fit well and have a good personality? Or will you always have that less than impressive grade or board score or whatever holding you back?
I think it's fair game to ask residents during lunch questions like, "What other places were you looking at?" That is a pretty harmless question and is not considered poor form. I am very honest when I tell people why I chose my program and I don't trash talk other programs during lunch...that I do think is poor form because different programs have different strengths that cater to different kinds of people.chicamedica said:Is it bad form to ask residents at lunch about what they thought of other programs? I did so more to find out what fine points they liked in this program over the others they considered, but thinking back I can see how such questions might come across the wrong way.
How about asking faculty about how their program compares to another one I'm considering? Not too sure how that comes across. . .
trkd said:Hey BKN and prefontaine (or anyone else who is in the "know"), are MOST applicants on a level playing field when they get to the interview. What I mean is... once you get an interview, are you just as likely as the next to get ranked highly if you fit well and have a good personality? Or will you always have that less than impressive grade or board score or whatever holding you back? I have heard it is all even at the interview but I don't know whether it is backed by experience. And I know it varies from place to place, but just looking for your thoughts.
Thanks.
FOREAL said:Just to take a litte bit of a turn in the current thread, does anyone know if having your interview at the end of January (practically the end of interview season) has any affect on how residency programs rank you? Presumably, I would think programs/PDs generally wait until they have interviewed all applicants before generating their list. But is this what truly happens?
chicamedica said:Is it bad form to ask residents at lunch about what they thought of other programs? I did so more to find out what fine points they liked in this program over the others they considered, but thinking back I can see how such questions might come across the wrong way.
How about asking faculty about how their program compares to another one I'm considering? Not too sure how that comes across. . .
BKN said:I'm with AT on this. Gossiping with residents about their interview experiences might be OK. Don't do it with faculty.
In either case, don't run down another place yourself.
I wouldn't be surprised if the two institutions you speak of are MGH and the Brigham. I have heard too many stories like this (I'm at the Brigham). The "rivalry" between these two institutions can be kinda like some juvenile sibling rivalry/pissing contest. I agree it is extremely poor form.blue2000 said:To add to this, one of the few programs I didn't rank when I was interviewing was a (nationally known, highly regarded) program where the residents talked crap about another (nationally known, highly regarded) program. It's poor form, and makes you look less than classy. If I was chit-chatting with a candidate, and they talked crap about another program, it'd leave a sour taste in my mouth. I'd rather hear platitudes than negative stuff.
Yeah, that kinda is a loaded question. I know you've gone through this already and this is really for those who are interviewing now...a good way to answer the question is to highlight some of the things you liked at each program you visited. This is a great way to flip the conversation onto the interviewer's court as you can then ask if things are done similarly or differently at that particular institution.I always felt awkward when people asked me "where else did you like" but I think the residents are truly trying to make conversation, and it's not a loaded question for most people.
AngryTesticle said:I wouldn't be surprised if the two institutions you speak of are MGH and the Brigham. I have heard too many stories like this (I'm at the Brigham). The "rivalry" between these two institutions can be kinda like some juvenile sibling rivalry/pissing contest. I agree it is extremely poor form.
Yeah, that kinda is a loaded question. I know you've gone through this already and this is really for those who are interviewing now...a good way to answer the question is to highlight some of the things you liked at each program you visited. This is a great way to flip the conversation onto the interviewer's court as you can then ask if things are done similarly or differently at that particular institution.
Not necessarily. You're allowed to compliment certain aspects of other programs. But don't do it in an emotional manner. Don't be like, "Oh I loved how program X does this and that." No. Instead, be like, "I thought it was interesting that program Y focuses on this aspect of training and that program Z focused on that aspect of training." The goal is to come across as objective but not pejorative at the same time.chicamedica said:but then wouldn't the program think you'd rather go to the other program and as a result not rank you as high? That's kinda what i feel is the reason behind interviewers (and secretaries) asking me what other programs are my top choices. I've been responding truthfully so far, but i'm starting to think maybe I should be holding my tongue as far as these questions go (at least when I'm at my top programs). Or this an unwarranted concern?
AngryTesticle said:Not necessarily. You're allowed to compliment certain aspects of other programs. But don't do it in an emotional manner. Don't be like, "Oh I loved how program X does this and that." No. Instead, be like, "I thought it was interesting that program Y focuses on this aspect of training and that program Z focused on that aspect of training." The goal is to come across as objective but not pejorative at the same time.
Going through the interviews is like an art. Your goal is to convince every program that you like them so that they will rank you high. You kind of have to be a good bullsh*t artist especially at programs you know you're gonna rank low. Yeah, it kinda is manipulative but at this point, screw the programs. You gots to look out for your best interests even if it will be at the expense of the programs' interests.
My personal experience was kinda like this. I knew which 4 programs I was going to rank in the top 4, right from the get-go. I interviewed at these 4 programs back-to-back-to-back-to-back. At each, I was inevitably asked which other programs I was considering highly. Given my application, it was pretty obvious and so when I honestly mentioned these 4 programs, they weren't surprised. Of course, I qualified things by saying "Yeah, it's gonna be a hard decision and I don't know how I'm gonna rank places and blah blah blah (which was total BS cuz I knew exactly how I would rank them)." And that was good because that gave them the opportunity to make the case as to why they should be #1 on my list. The ball was in their court. The pressure was off my chest. So for me it was good to be honest at my top choices.
dodo2 said:BKN, AngryTesticle:
Recently interviewed at a souteast program. After the interview they said that they will rank me. I may be nitpicking here but does that mean I am assured to match there if I rank them at the top of my list?
They may have 5 seats and choose to rank 10 students. I may be ranked #8 and may still not match with them unless 3 higher ranked ones choose to go somewhere else?
In line with what BKN said, if the program tells you, "we will rank you", then the program likes you enough to put you on its rank list. However, it does not indicate whatsoever whether you will be ranked high or dead last. If the programs rank you very highly, the rhetoric usually changes. For instance, if the program is aggressive enough to let their top candidates know about their status, they may tell them something along the lines of, "we hope you choose to train here", "we hope to see you this summer", "you are a top contender for a position in our program", "we will rank you highly", etc. However, even given this rhetoric, it does not mean you are necessarily ranked to match. Think about, a program has 10 spots and they can feed their top 50 candidates the same rhetoric...no skin off their back. They may do this to try to bump their program up on your rank list. The Match is a game. Just like how you need to convince every program that you love their program so that they will think you want to go there and will be inclined to rank you a little higher.dodo2 said:BKN, AngryTesticle:
Recently interviewed at a souteast program. After the interview they said that they will rank me. I may be nitpicking here but does that mean I am assured to match there if I rank them at the top of my list?
They may have 5 seats and choose to rank 10 students. I may be ranked #8 and may still not match with them unless 3 higher ranked ones choose to go somewhere else?