As a family doc a year or two into practice - I think it depends what you want to do with your career. If you want to do anything beyond bread and butter outpatient primary care (prenatal care/deliveries, inpatient coverage, more advanced office based procedures, more complex peds patients or newborn care, certain niche interests like addiction medicine, HIV treatment, transgender care, etc.), think twice. Are there alumni of either program who are doing those things? If the answer is yes at program A but no at program B - might be worth a few years away from home to get the training you need to spend the rest of your life doing the job you want. Some places these days just do not prepare you for the "extra" stuff as ACGME requirements for family medicine residency training have been watered down over the years. If you just want to do plain old regular office FM - any decent program in the US is probably adequate.
One other factor to consider (and perhaps you already have) - beware of some programs affiliated with religious hospital systems if you are wanting to do IUDs, nexplanon, birth control, etc.
As for the above comments re: connections/finding a job: connections are really not that important for family medicine jobs (except perhaps in high demand areas - which I do not have experience with, but have not heard anything about this being an issue from friends in larger cities). Most places are THRILLED to hire an FM doc who is excited to be there regardless of where you trained. Personally - I exclusively applied to jobs a few hours away from where I trained with no particular "in"/connection at the health systems/clinics where I interviewed, and I had zero issues getting interviews. Recruiters were excited that I had family connections in the areas where I interviewed, eg I applied to a few places near where I have extended family and spend a lot of time visiting - it sounds like you would benefit from that in the area of program B anyway if that's where you want to work long term. But I also got recruited very hard at places where I had no particular connection whatsoever and just applied because it seemed to be a good fit for me.
