Assuming you continue doing CME and maintain your license and board certification, you shouldn't fall that far behind in 3 years. Most potential employers will be wary of hiring somebody who's been out of practice for any significant length of time, however. I'm not saying you won't be able to get a job, but it'll be harder, especially in a saturated market like NY.