Shadowing doesn't give you any "hands on" experience. At least it shouldn't. It should let you see, over the course of several sessions, what the average day in the life of a doctor is. In fact, no experience working in a clinical setting is going to give you the "hands on" experience of what it's like to be a doctor, with the possible (not so hands-on) exception of scribing, where you complete the physician's chart. Nonetheless, reflect on those clinical experiences that have exposed you to the role of physicians and decide if there's anything else you'd rather do.
Medicine isn't fun 100% of the time. No job is. There are more boring jobs though, in my opinion.
I struggled for a long time over whether to apply to medical school. I shadowed, scribed, volunteered in different healthcare settings, and talked to as many doctors as I could. I made pro and con lists. I went back and forth for years.
In the end, my biggest piece of advice is this: know yourself. If you know yourself, inform yourself about the profession, think hard, and finally decide that medicine is a good fit, you'll have done all you can do to make an informed choice.
EDIT: It sounds like you're at Cornell. If so, I have friends who are there, and they've told me that pre-meds can expect exceedingly little leniency for lower grades when applying... So you may get a small break, but not much... and I wouldn't bank on the school's name to save you. Of course, I defer to adcom members' thoughts on this.