Your math, biology, chem, and physics grades are all put together by AMCAS, the med school application service, to create the BCMP GPA. All other grades are put into a separate calculation. Both numbers need to be good.
Clearly, you're not a math person, but fortunately there are many med schools that allow you to take statistics instead of calc to fulfill prerequisites. Try to focus better and improve your time management. You can dig yourself out of your current GPA hole, since you're a freshman, but another year of similiar performance, and may find yourself needing to apply later (as only 6 semesters of grades are calculated if you apply at the usual time after junior year) to get your GPA into a competitive range (recall that a 3.6 is average for med school admissions). If you really want to be a doctor, straight As should be your goal.