May I ask which school is asking for a letter directly from the premed committee? Just because I am similarly skipping the committee letter (and probably won't apply to that school).
For other schools, I would imagine that something like "I realized that I wanted to pursue medicine later in college, at which point I was no longer eligible for the school's pre-medicine track" would suffice.