ok, I have to say this. I'm in ohio state, so I can only speak for my school. Calc based physics is not only calculus based. What I mean is that, the difference between the calc based and the non clac based is not only calc, but most importantly, its extremely harder. It goes into a lot more depth. I took physics 1 calc based, since I was a biochem major, and then took physics 2 non calc based, which turned out to be an easy A even though your talking about a total different course.
Who takes physics with calc? Biochem majors so they have the prereqs for physical biochemistry, and chem majors, for physical chemistry (pchem), I've also heard of other unergraduate majors not offered at my school, like bioengineering, or something like that.
Is physical chemistry worth it? Its all about quantum chemistry (schrodinger), thermochemistry, etc, basically the kind of chemistry you DON'T want to get into unless your goal is a chem major or the like. Personally, I think if you want to go to med school, stay away from two things, calc based physics, and most of all physical chemistry. I cannot tell you what to take, but i do wish you the best of luck.