I did it, and it has been the best decision of my life (financially-speaking). It was manageable since most of my cases were (and continue to be) breast, prostate, and lung which you are exposed to amply in residency. When I had questionable cases, I consulted old attendings, chartrounds.com, SDN, etc. I never took chances with anything. This is not to say I was perfect, but I definitely strictly adhered to the books when I first started, and that kept me out of trouble.
The billing side was a learning process, but I was aggressive about sitting down with my biller from the get-go and learning all I could. For me, the biggest downside has been the lack of coverage. Sans oral boards, I haven't had a vacation in 2 years.
I work very hard, and my job doesn't stop when I leave work. I sometimes carry over 40 patients myself, and I still have to find time to wine and dine my referring docs. But I'm young, and the big money is worth it to me. I'm sure I'll burn out eventually, but for now I'm happy.