Are you at a school that will have the classes that you need to graduate offered in the summer? Even at large schools the advanced science classes are not the common summer school offering.
Getting good grades is key. Graduating early won't hurt your med school chances; trying to rush it and dropping your GPA would. Make sure you are guaranteeing yourself A's before you decide to pile such a loaded schedule on yourself.
Also ask yourself, why are you in such a hurry to graduate? Will finishing early give you a gap year, and if so, what are you going to do in between undergrad and med school?
My question is: Assuming I do well GPA-wise with this schedule, will med schools look down upon it because they see it as a way to "rush out of undergrad?"
Graduating early, especially for financial considerations, is not going to work against you, so long as your grades are excellent and you can continue to engage in appropriate experiences. Be sure that by leaving campus you won't lose access to activities that help benefit your application during your gap year.