Residency is about getting skills, not about easy/chill hours. You've got a ton to learn in a short time, especially in family medicine.
That said, we bust ass in Southern California, but lots of our residents have beach time, surf time, scuba time, hiking / mountain climbing time, etc. You get days off at whatever program you attend.