Think about what you want to do when you finish residency and where you'd like to live. Then look for programs that will allow you to achieve those goals. The end justifies the means, so to speak.
For example, I want to end up in the Desert Southwest and work in an area with many outdoor extreme activities/sports, so I looked for a program with some exposure to wilderness medicine. Also, I wanted an unopposed program (I feel it will make me a better physician) so I could get maximum exposure to trauma and critical care. I'm a DO student, and I wanted a DO or combined program because I plan to use at least some OMT in my practice. I hate big cities, so I avoided applying there. I have a family and absolutely will not compromise my kids' education and safety, so I looked for communities with good schools and relatively low crime. We also love the natural world and I looked for a place with lots of opportunities to be outdoors. As a bonus, I looked at programs in states with no income taxes and I did pay attention to programs' retirement plan contributions!
My classmate, on the other hand, wants to do lots of OB in a rural setting. He looked for places with a big emphasis on that, specifically with surgical and lots of high-risk OB/peds rotations. He also wanted a good salary, a place safe for his kids, etc.
Another classmate wanted to be near family, so that was a primary goal for him in looking at programs.
All in all, my advice would be to get a game plan for what kind of FM doc you want to be (and where you want to live) and look for programs that will help you to be that doc in that place.
Fortunately for us, FM is a field that is begging for applicants, so most of us get one of our top choices.