It might have just been that particular day that the rest of your interviewee pool was from HYPSM. I've hosted a number of applicants this season and every one (except one) was from a state school or a small private institution.
As for Boston, it's definitely on the less crowded side for cities. Having just gotten back from NYC over Thanksgiving break, I'm still feeling the relief and joy of being back here. As for affordable living, I'm a five-minute walk away from TMEC and paying less than what people pay in Vandy each month - it's possible, you just have to look! Lots of other couples are living off campus for affordable prices as well.
I'm sorry to hear it's not your cup of tea, but just wanted to provide an alternative view for those who might have your concerns but do find the students unique, the curriculum interesting, and Boston appealing!
Leaving with this:
The City of Boston