I agree with milkman, it depends how you learn. Regular physics will be easier in the sense that you won't have to integrate or derive things, but at the same time you won't necessarily get the background that ties things together. For me, I thought knowing how the equations can be derived from each other or where things came from made it easier to understand than when they just give you an equation to memorize and you have no idea where it came from.
If you're really afraid of math or can be content with just memorizing equations, then take the regular, non-physics based class.
If you like to know where they got the equations or think a better background would be helpful, I'd go with the calculus based class.
I find that the calculus based classes are sometimes better for giving you tips and ways to feel out an answer without going through a bunch of steps and lots of math. In comparing with friends who took the other physics, it seemed like they missed a lot of the discussion on why and how and focused more on what equation...to me, that makes physics much more difficult.