My physics professor in undergrad was a great guy, but he was so into astronomy and such that we didn't even GET to the optics part, even though it was in the course description. Needless to say, I was not pleased. I am not a "physics person" anyway, so I was really worried about what optics would be like when I got to optometry school.
Anyway, despite my not being a "physics person," and completely lacking any optics experience prior, I thought optics was okay. Yes, there were some difficult exams, etc. But I didn't feel like I was behind or anything. It might have been good to have a head-start memorizing formulas and such, but the classes were totally and completely possible. I took Part I of boards earlier this month, and I actually felt most comfortable with optics.