As the spouse of a current intern, I'm somewhat worried about that myself. Med school wasn't bad, but this year is bad. I'm hoping for more family time next year and thereafter. There's no doubt about it: it's a bummer to go to social events by yourself ("my husband's on call"), to spend nights alone or with a sleep-deprived shadow-of-a-person, and not to have the together time that you are used to having.
Note: I'm not saying that I have it worse than my spouse, so please, residents, don't jump all over me. I'm just saying it would be nicer to have some more time with him.
So yes, it's a legitimate concern.