It's a concept that is difficult for pre-meds to grasp sometimes (not you specifically just pre-meds in general), but residency is not a continuation of school. While academics and training play a large role, residency is a job. Just like any job there will be people who fit in better than others for certain jobs, with certain programs, or with certain people, etc. That's why these metrics are higher than something like Step scores. It doesn't matter if you score a 280 if the attendings and other residents don't feel like they can trust you, or they can't stand the idea of working with you. Remember in residency you basically spend 80+ hours a week with the same people for years, and fit is huge in that scenario.
.