Many community hospitals hire. You may want to work in one as you become older and more experienced. You may tire of academia. Community generally has better pay, hours, and no teaching or research. You may find your future spouse, home, etc is near a community hospital, etc...
You would be surprised how many positions in academia want AP/CP, even if the work is AP only. You may also be biased against when competing against AP/CPers who are applying for the same position. Many ppl are doing 2 fellowships anyway. You will have to face annoying questions (ie, everyone in every interview will ask you why you did AP only). Unless you know someone and are on an AP/derm or AP/GI fellowship track, I say don't do it and spend the next year like everyone else.