Depends what you want.
It's obviously true that any time surgery happens, anesthesia needs to happen too. If surgery happens at night or on a weekend, one of us has to be there. Newborns are also very inconsiderate when it comes to others' schedules, so OB can be a burden.
But I'd rather spend three nights in the hospital than one day in a clinic talking to outpatients who'll come back to see me in three months after ignoring my recommendations and gaining 10 pounds in the interim.
There are low/no call jobs out there, jobs with no OB coverage. If you hate working in darkness that much, take one of those jobs and earn a little less money. You'll still make a nice living. Nobody is forced to take a job with 24h Saturday shifts at a busy L1 trauma center.
The good anesthesia lifestyle is mainly a product of relatively high wages per hour worked, quantity of time off, and complete freedom when you're off. I've never been called 5 days after one of the patients I cut open presented to the ER with a wound infection, because I don't cut people open. If you need to be the "leader" of the surgical team be a surgeon. If you want to test your endurance on 15-minute clinic appointment treadmill and see 30+ patients a day in a blur of smiling customer service, do primary care. If you just want to work, enjoy instant satisfaction and immediate results from the work you do, get paid well, and then GTFO to live a life outside the hospital, anesthesia can be a great lifestyle specialty.