My impression is that generally if you're a normal person without obvious red flags, after you do an away rotation at Yale, you get a courtesy interview. You will likely spend some time with the program director during your away so she can look for red flags herself.
Yale is a good program. There is no stand-alone ophtho building, but when we combine the Yale New Haven hospital, Yale Eye Center, VA hospital, and the Cornell Scott Hill Health, you got everything you need (socioeconomic variety, pathology, practice settings, independence vs hand-holding). All buildings are within 2 miles of each other, so you can get to places without a car. There are not that many US ophtho programs with such geographic clustering. There was one Yale resident who went to all locations by hospital bus or on a bike. New Haven is a college town so there is some quaintness to it, but NYC is 2 hrs south by train, and Boston is about the same distance to the north. Near New haven, there is great apple picking and camping spots. Great speakers at the Yale law school and college. And amazing Yale libraries!
Some residents have spouses/sig other in Boston or NYC and get by okay. Yale is the only program in Connecticut, so plenty of trauma, but residents generally not overworked. You see everything in the 3 years there. You'll feel confident going into comprehensive after residency, but you will also have good standing when applying for any fellowship.
Wherever you match, if you can do internship at the same hospital, I highly recommend you do that. That way, you only move once after med school, get to know the hospital system, make friends, and not miss a beat when you start ophtho PGY-2 year. Yale medicine is really really great.