Unless you want a diverse resume or want to upgrade program names during residency for academic sake, it really doesn't make a difference.
The advantages of staying in one place are many. No move, familiar people and surroundings, and familiar hospital system (computers, charting, records, etc.)
In the end I wouldn't change just for the sake of change unless you just want to go somewhere else.