Is early education a back up career path for you? If so, go for it. If not, maybe major in something similar that will not take extra time - biopsychology comes to mind.
I majored in Communications and Rhetoric Studies with double minors in French and Psychology, plus I did all of my premed requirements. I finished in four years, but I did take one summer of classes (two classes total), plus I didn't have any elective that didn't count towards one of those studies (either my major or one of my minors), so I may have missed out on that aspect of college.
The premed requirements really aren't too many - most schools will require some sciences to graduate, so you can just take some of your prereqs for those instead of, say, Biology for non-majors.