Of course, this question assumes a physician could easily transition to a comparable career outside of medicine, something many medical students seem to believe.
So, assuming those alleged six-figure consulting jobs everyone assumes they could get would get quickly saturated, and factoring in how much time has passed since I held a non-medical job (and the quality of that job, and of my non-medical CV), I'd take a 75%+ pay cut, or even go back to my resident salary (at my current hours, which are relatively low) to stay in medicine, as that would still be, by far, the best job I could get. Regardless of what other people say on this thread, realistically we'd all do the same.
To more directly answer your question, later in life I'd consider a relatively low-paying, very chill VA job or something.