My personal experience probably won't help you too much... I was considering working in human medicine for a while but once I started getting experience I realized that while I liked the medicine aspect, I was not a fan of people-hospitals or working there.
Having spent four years working in the human medical field, I can tell you that human medicine has a ridiculous amount of red tape. Human medicine is a bureaucracy and there are a lot of nurses, techs, staff (dietary, transport, housekeeping, admitting, med. ethics, rehab, laundry, central supply, sterile supply, maintenance, lab, pharmacy, security, phlebotomy etc etc) filtering in and out and affecting your patient. There are a million little wheels in the giant machine and it can be hard to keep track of everything. Many times I spent half an hour on the phone trying to find where a patient was (I was an EKG tech), so it can be a little alarming. Compare that to an average practice with say two vets, two techs, and a receptionist. Add in insurance, malpractice, and HIPAA issues, along with the mountains of required paperwork, and I'd say you have a pretty good reason to choose vet medicine.
On the other hand, you probably should think about salary, and that you will probably make more as a human doctor. I don't think a person should choose either profession just for the money, but since you have a genuine passion for both it's a good thing to consider.