I would highly doubt it would have any negative impact on nearby states, but like I do think it might raise an eyebrow if you are in med school on the east coast, do all your aways in California and apply to Texas. I can say with certainty that this idea came up when I was applying for MD/PhD programs, including interviewers asking me why they should believe I would be willing to move to X after spending my whole life up to that point in the northeast.
The programs can only see what is on your transcript. If your transcript does not indicate it is an away or where it is, then they actually will have no idea.