If you are "young and single", then IMO there is nowhere else you should do your residency other than in NYC. There are many good programs: NYU, Columbia, Cornell, Mt Sinai, etc. You work hard in residency and also work odd hours. Doing residency in NYC is the only place where if you get off work at 22:00, you can shower and have friends willing to meet for dinner at 23:00, then have a full night out until 04:00 or later if you want. You do not have to plan things. It is the only 24/7/365 city in the United States. No other city comes close. Museums, shows, restaurants, underground music, and art scenes galore. NYC has it all. That said, if you have kids and a family, it can be prohibitively expensive to live a normal life there. Private schools are extremely expensive, 99.99% of residents will not be able to afford a house there, and you are living hand-to-mouth. If you are at that stage where investing in your kid's 529 plan is your top priority, then avoid NYC.
As to the training itself. Is it frustrating to get an ED consult where the patient speaks some obscure rural Chinese dialect that not even your phone interpreter who is fluent in Fuzhou, Cantonese, and Mandarin does not speak, so you have no way to communicate with this patient with severe progressive myelopathy? Yes. Is is frustrating to have an ED attending try and force admit a homeless person with a radial nerve palsy to your service because he can't use his wheel chair now? Yes. Would some 24 hour shifts come with 20+ consults, 8 of which are admitted to your service? Yes.
That said, in most Neuro programs you are still out the door by 16:00 or 17:00 daily, and live an awesome life. I can also attest that going through training in NYC prepares you for everything you will ever see clinically. I remember meeting applicants from major midwest academic programs during fellowship interviews, and they would see 2-4 patients in a clinic day. Carrying 4 patients on an inpatient Neuro service was a "heavy load". I have also witnessed residents in midwest programs get very overwhelmed by the type of patient load that would be a breeze for any resident training on the east coast. Lastly, I can tell you that as an attending, physicians that trained on the east coast in big cities (and physicians that trained in the stroke belt that end up doing Vascular) stand out for all these reasons. They always seem to be the ones that can get the work done.