i would say YES it's definitely possible since my dad does it. he's a cardiologist, one of the most busy and on-call specialties, and he certainly has time for a family life. i think the trick is also being in a group as opposed to working by yourself. there are 6 other cardiologists in his group, so he is only on-call 1 out of every 6 weekends. sometimes a group member will ask you to cover him one weekend, but then this gives you leverage for your own time off and to be covered by him when it's time for your vacation.
my dad generally works 8am to 7 pm Mon-Friday, 1 of every 6 weekends and is married, has 3 kids (2 of us just graduated college and the other one is starting HS soon), and heavily active in our "church." we've always taken real badass family vacations, too, including going to the hotspots of the US and plenty of international traveling. when he wants time for international travel, he takes 2-3 weeks off. you plan ahead and schedule your time-off.
and yes, he makes a lot of money haha. seems like a pretty good life to me! i know there are specialties that run till 5 pm only, but i personally found those ones more boring. like radiology, anesthesiology, etc...you don't get too much patient contact. you get plenty of it in cardiology, tho! also, I want to go into a super cool specialty involving an integral part of the body, i.e. the lungs, heart, brain, surgery, etc. i think i'd get bored as a radiologist looking at xrays all day or like a dentist. idk, i know they get good hours and pay but i think i'd get bored working with teeth all the time. teeth aren't that vital...what's the worst thing that could happen? you lose your teeth? you can live and eat without your teeth. my grandfather has been doing it for 20+ years, and he's happy! lol