Residency is brutal for surgical fields across the board, especially for junior surgical residents. No question about that.
Life AFTER residency, however, is a different story. In general, surgical subspecialists can have a reasonable lifestyle after residency. Some examples...
Neurosurgery: I know this sounds crazy, but neurosurgeons can have a pretty good lifestyle after residency if they choose wisely. Neurosurgeons that avoid level 1 trauma centers and focus on spine can have a practice that almost exclusively consists of elective cases. Spine emergencies are relatively rare (spinal cord compression, etc.) so ER call for spine surgeons isn't bad at all. Cranial call, on the other hand, can be an absolute nightmare with subarachnoid bleeds, subdurals, tumors...I know many neurosurgeons in private practice around the country (Washington State, NYC, Los Angeles, Georgia, Michigan) that work roughly 40-55 hours per week with easy call (i.e., being called in from home maybe once per year). Their income ranges from $500,000 to $1,200,000 annually. All of these people have practices that are exclusively (or heavily) spine. One guy in particular just joined Kaiser in California, where he is employed as a spine surgeon. He makes $500,000 annually for 40 hours of work per wek. That's roughly TWICE what an anesthesiologist at Kaiser makes when he/she starts working there, despite the fact that both will work the same number of hours weekly. Neurosurgery has a reputation for being absolutely horrible when it comes to lifestyle, but the reality is that MANY neurosurgeons in private practice have very reasonable schedules. Residency, on the other hand...
Otolaryngology: The average otolaryngologist works ~50 hours per week and pulls over $400K annually. The beauty of this field is that you can tailor your practice to what suits you. If you don't want the headache (and crappy hours) of dealing with head and neck cancer patients, you can focus on bread and butter ENT (tubes, tonsils, etc.) and work 4 1/2 days per week, leaving the OR around 3 PM on your operative days. Facial plastics, otology, laryngology, and sinus subspecialists have FANTASTIC schedules. No emergencies to speak of, good pay, and great job security. The other cool thing about ENT is that older docs can scale back on their operative time as they get closer to retirement and just do clinic stuff, which is very predictable (9-4 every day). I'm sure you've heard the saying "ENT stands for early nights and tennis." This field definitely lends itself to a reasonable lifestyle after residency.
Ophthalmology: Probably the cushest of all surgical subspecialties. These guys--once they have an established practice--can work 4 1/2 days a week with no nights, no weekends, and no ER call. And they can pull in over $400K annually, in many cases over $500K. Not bad for a specialty that has a high impact on patients' quality of life (hard to argue with the overall value of restoring clear vision), low acuity, and low stress.
Plastic surgery: Brutal residency but life after residency can be really sweet. I won't go into the details here, because I'm sure you're well aware of the perks of plastic surgery. These guys have it pretty good after residency.
Other surgical subspecialties with reasonable lifestyles:
Urology
Surgical oncology
Endocrine surgery
Orthopaedics (more variable but there are definitely many orthopaedic surgeons with good hours and crazy high pay)
The truth of the matter is that surgical sub specialists often enjoy higher prestige, higher pay, better hours, more job opportunities, and higher job security than anesthesiologists.
Nothing trumps derm, though.