Hey OP,
I decided to pursue medicine when I had ~2.40 gpa after two years of college. I've had a 3.9+ for about two years now (all upper-level science classes, and a couple retakes), scored a balanced 505 on my MCAT (not ridiculous, but respectable) and was invited to interview at 11 medical schools so far this cycle (DO). When I first switched to pre-med, there were students I had in my introductory chemistry classes that looked down on me for being dumb instead of trying to help me through my struggle. Funny story, I ended up tutoring two of them in Immunology a couple years later!
The only person who can stop you from doing what you want to do is you.
I was told by a professor my first year of pre-med to pursue physical education instead of medicine, and told by my academic adviser to quit pre-med while I was making my transition. Did it hurt? Yep. Was it demoralizing? You bet! I felt like a degenerate. But now they respect me in the way they should have from the start (as a potential/future medical student and a serious pre-med student.)
My point is, you will run into people who will tell you you can't do it the entire time you are fighting for what you want, but if you truly want to be a doctor and have the willpower to bear-down and study your a** off, you can make it (whether you desire a DO or an MD.)
That being said, the issues being raised in previous comments are very real... do you think you are committed/driven enough to build a solid story of reinvention (A's from now on, solid MCAT, clinical/shadowing experience, maybe some research, etc.) that you will one day convince medical schools to admit you?