I'd argue it's not only possible, but almost certainly a smarter financial decision too. You'd almost certainly make more in PP building up that nest egg for 5-10 years. Then go back and do a fellowship, which is not hard to get into, to hop back into academia. Chances are you won't be welcomed into name brand places like MGH or Columbia unless you were doing significant research in PP, but where I'm at I think they'd consider anyone for a position if they had the experience for it.