Whether you should drop the course depends on a lot of factors, but considering the MCAT alone, it shouldn't be a problem. Most physics courses go into more detail (or are generally more mathematically difficult) than the average MCAT. If you use your time properly, studying the rest of the physics material on your own might help you more than the class would.
The highest-yield physics topics on the current MCAT tend to be fluids, electricity/circuits/electric fields, optics, sound, and basic motion/work/energy (where it's more important to understand units than almost anything else). You've covered most of these already, and the rest can be learned on your own. Just don't rush through tough topics like optics - it's important to really understand why everything happens! And of course, don't neglect reviewing topics you learned in Physics 1. I can't tell you how many students focus all their energy on the "hard" physics topics only to find that they've forgotten how to do simple projectile motion calculations.
Good luck!