The real question is whether you'd feel comfortable being outnumbered (quantitatively) 20:1 in the student body and town? Pikevegas is like any small rural town, to my observation, and they tend to distrust anyone who is not from there. That said, they like medical students and treat them pretty well.
I'd spend some time there outside of the one interview day and see what you think. The other thing to remember is that you'll probably only spend your first 2 years in pikeville and then will be on the road (potentially) for your rotations, so perhaps you could rotate in places with even more diversity.
I don't want to discourage you, but would want you to try to figure out what is important to you. I believe pikeville is tolerant, but you might not have as many people from a similar background to socialize with. I believe that the PCSOM student body if very diverse, on the other hand, and you'd probably learn a lot.
Your mileage may vary...