Unfortunately, it seems like ADCOMs agree with you. To medical schools your GPA is basically your GPA, whether you majored in ChemE or Communications. Thes problems with this philosophy are:
1) People do change majors. Premeds are forced to seek out classes and degrees with the highest GPAs rather than actually challenging themselves. This makes the concept of premedicine as a necessary prerequisite to medical school even more asanine than it needs to be.
2) It biases the system against people who chose medicine late in their undergraduate career. You can't game a game if you don't even know you're playing. Isn't the entire point of premedicine (vs. starting medical school straight out of HS, like in most other countries) that people need some time to figure out what they want to do?
3) It's yet another factor that biases the system towards the rich. It's easy to say 'change your major' if you have no undergraduate debt to pay back or if you have 100% confidence that you are ultimately going to medical school. However a lot of people need to pick a major that leads to some kind of a real income stream in case they don't end up a doctor (which most applicants won't). The problem is that majors that pay tend to have low GPAs. That leaves poorer applicans choosing between risking their chance at medical school and rolling the dice with their finances.
Be grateful this is the way your school handles it, it sounds like they at least built some mild grade inflation into the system. My school only had about 1/4th of students make it through because they required a 2.0. They only graduated a few people with above a 3.0. The kind of GPAs that are considered standard for medical school (>3.6) would make you the absolute top student in the class.