Wear it if you think that is what defines you and what you bring to the table.
Otherwise, the only thing anyone at the interview is going to see is your uniform. Yeah, you stand out, but you want them to see the whole picture.
Uniforms have their place, but at most civilian programs, I would think that your application would be able to sufficiently highlight your military experience.
I obviously wore mine to USUHS as it was mandated since I was on active duty at the time. The other five schools that I interviewed at this year I honestly didn't even consider wearing it (accepted at 3 of them so far, waiting to hear back from the other 2).
One guy did wear his uniform at an interview I was at...forgot his headgear and had a button ripped off his uniform in transit...now that is dorky.
If you were in the military, you probably have more than enough qualities and experiences that make you shine above an equally qualified (yet less experienced) applicant. With or without the uniform.
Best of luck to everyone.