I've been all over the country in various parts of my life so am familiar with different areas. I think one thing to think about is, "what am I going to do with my career?" If you really want to do pain, your route may be different than if you want to do general VA, or if you want to do academic TBI.
If you are destined to do a fellowship, your best bet would be to set yourself up for a fellowship in the Bay Area, in my opinion. In order to do that, you have two options. You could try to do the Bay Area residency and show your stuff to the people who run the fellowships there. Alternatively, you could try to go to a big name program elsewhere and set yourself apart there. There are arguments for each, and I think either are fine, just knowing that you have to earn that fellowship no matter where you're from. It's generally slightly easier to get the fellowship from your home institution, but not a lot.
If you're not destined to do a fellowship, then to me it would make sense to stay west and find a good PM&R residency there (UC Davis, Stanford are both great and are in/near the Bay Area) while you network. However, if they aren't a good fit for you, it's probably not worth it.
If you're unsure of your future, which most are, I would say to head west early. I have found that knowing people outweighs your credentials in most things in this world, and the more you know, the better off you'll be. There are just no certainties, however. When I encountered this problem originally, I decided to go with the residency that fit me best (that happened to be far away), worked hard, and then found a fellowship where I'd like to live long-term. It worked out well for me, but others haven't been so lucky.
To summarize my ramblings, don't go to a residency program that you don't like (for whatever reason) just because of the location, but I would err on the side of being close to where you want to end up. Experience a lot of places and choose the place that will suit you best, then work hard and demonstrate to everyone that you'll be a good physiatrist.