You can and likely will have to pelvic exams, breast exams and pap smears if you do a medicine residency, because your resident clinic patients will need them. I never did colposcopies nor was trained in those at my residency.
We do no obstetrics in internal medicine.
If you want to do OB stuff, need to do OB/Gyn or family practice residency.
There are a few "women's health" IM fellowships. I don't think these are officially accredited and I'm not sure if they are 1 or 2 yearrs long. I guess you learn health maintenance and prevention such as how to treat osteoporosis, manage menstrual problems, plus maybe do research as a fellow, etc. I personally don't see the point. I think it would be better to do family practice or OB/Gyn if you want to do that stuff, but I'm not that well informed about the women's health IM fellowships.