Your match results are based on a combination of factors: your grades, your board scores, your class rank, your school rep, your letters of recommendation, your research projects, your interviews, etc... etc...
If you do well in all those aspects, then even if your school rep isn't the greatest, it shouldn't hurt you too much.
Conversely, I've never heard of a student with poor grades, poor board scores, etc... who matched somewhere because of the prestige and reputation of their medical school.
Like the last poster said, you need to pick a place that you feel comfortable with (and that you can afford!). School rep is just one of the many factors that residency programs look at and in the end, it is one of the smallest factors they consider.