Aside from some women who have religious/cultural objections to having a man in the room during a medical exam, most people will not have an issue with you doing your job.
If I were to interview you, I might ask if the experience led you toward, or away from wanting a career as an OB-GYN and why. No judgment as to why you would have taken the scribe job in the first place, that isn't even a question I could see entertaining.