i really think that the main reason to go to a high-ranked school is if you are interested in research. isn't that mostly what the rankings are based on anyway? if you are wise enough to not care about school rankings, then i wouldn't worry about research much if you don't like it. research is hard enough, it's even harder if your heart isn't in it, which makes it not that valuable of an experience at the end of the day. i think if you have really strong clinical experience (volunteering and shadowing) that will go a long way at more primary-care oriented schools. i wish i had more volunteering, instead i have research but i'm not applying to many research-heavy schools because i don't really like it.
do what you like and do it well and i think it all works out.