If math isn't your thing and the schools you plan to apply to don't require it, I suppose there is no reason to take Calculus. Most schools require a full year of math I believe, so wont you run out of algebra before that? My only concern would be whether you are prematurely foreclosing yourself from applying to schools that require Calc. There are also certain physics and statistics classes some people take before med school (the latter tends to be helpful in certain forms of research) for which calculus may be required or helpful, but you can probably avoid these as well.
