I think for many students it is location, the weather especially. Rochester is is no way a 'college town' so a lot of people looking for the type of things that brings to a city are disappointed.
However, Minneapolis is not very far nor is U of Wisconsin LaCrosse. Rochester is the fastest growing city in Minnesota (although it's still small at around 100,000 people) so things are changing.
If you just could not stand cold weather for even an instant, it might not be the best place for you. But we get plenty of students from Florida and Arizona that seem to handle it just fine. On a last note, there are many opportunities to do rotations away from Rochester. One student in my class is completing 90% of their 4th year in Arizona.
If you are asking about academic weaknesses I think that is difficult to say since most people have only attended a single medical school so it is tough to compare. There is always room for improvement, but apart from a class or two that are poorly taught, I can't imagine a better education elsewhere.